WO2022135005A1 - 一种基于通话的屏幕共享方法、装置、设备及存储介质 - Google Patents

一种基于通话的屏幕共享方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2022135005A1
WO2022135005A1 PCT/CN2021/132808 CN2021132808W WO2022135005A1 WO 2022135005 A1 WO2022135005 A1 WO 2022135005A1 CN 2021132808 W CN2021132808 W CN 2021132808W WO 2022135005 A1 WO2022135005 A1 WO 2022135005A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
sharing
data
call
display
Prior art date
Application number
PCT/CN2021/132808
Other languages
English (en)
French (fr)
Inventor
孙鹏
Original Assignee
百果园技术(新加坡)有限公司
孙鹏
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百果园技术(新加坡)有限公司, 孙鹏 filed Critical 百果园技术(新加坡)有限公司
Publication of WO2022135005A1 publication Critical patent/WO2022135005A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation

Definitions

  • the embodiments of the present application relate to the field of communication technologies, and in particular, to a method, apparatus, device, and storage medium for screen sharing based on a call.
  • screen sharing is often used for document display, operation demonstration, etc. in online meetings.
  • the image data collected by the camera is collected on the client, and sent to the server through the call video transmission channel, and then sent by the server to other clients in the same call room for display.
  • Embodiments of the present application provide a call-based screen sharing method, apparatus, device, and storage medium, so as to realize screen sharing during a call and optimize user experience.
  • an embodiment of the present application provides a call-based screen sharing method, applied to a server, including:
  • the display images corresponding to the screen sharing data include a plurality of display images corresponding to the screen acquisition data
  • an embodiment of the present application provides a call-based screen sharing method, which is applied to a sharing initiator, including:
  • the screen image is collected by a video collection tool to obtain screen collection data
  • the screen capture data is uploaded to the server based on the call video transmission channel, and the server integrates the screen sharing data sent by the sharing initiator to obtain screen sharing data, and sends the screen sharing data to the sharing receiver based on the call video transmission channel.
  • the screen sharing data is sent for the sharing receiver to display the screen sharing data, and the display images corresponding to the screen sharing data include a plurality of display images corresponding to the screen acquisition data.
  • an embodiment of the present application provides a call-based screen sharing method, which is applied to a sharing receiver, including:
  • the acquisition data is integrated to obtain, the display screen corresponding to the screen sharing data includes a plurality of display screens corresponding to the screen acquisition data, and the screen acquisition data is transmitted between the sharing initiator and the server based on the call video transmission channel .
  • an embodiment of the present application provides a call-based screen sharing device applied to a server, including a screen projection response module, a data integration module, and a data push module, wherein:
  • the screen projection response module is configured to, in response to a screen projection request sent by a plurality of shared initiators, respectively receive screen capture data uploaded by a plurality of the shared initiators based on the video transmission channel of the call, and the screen capture data is generated by the The sharing initiator collects the screen image through the video capture tool;
  • the data integration module is configured to integrate a plurality of the screen acquisition data to obtain screen sharing data, and the display images corresponding to the screen sharing data include a plurality of display images corresponding to the screen acquisition data;
  • the data push module is configured to determine the shared receiver corresponding to the screen projection request, and send the screen sharing data to the shared receiver based on the call video transmission channel, so that the shared receiver can monitor the screen Share data for display.
  • an embodiment of the present application provides a call-based screen sharing device, which is applied to a sharing initiator and includes a screen projection request module, a screen acquisition module, and a data upload module, wherein:
  • the screen projection request module is used to enter the screen acquisition interface in response to the screen projection selection operation, and send a screen projection request to the server;
  • the screen acquisition module is configured to acquire screen acquisition data by acquiring screen images through a video acquisition tool in response to the screen projection response information returned by the server;
  • the data uploading module is used for uploading the screen capture data to the server based on the call video transmission channel, and the server integrates the screen sharing data sent by the sharing initiator to obtain the screen sharing data, and the screen sharing data is obtained based on the call video transmission channel.
  • the transmission channel sends the screen sharing data to the sharing receiving end, so that the sharing receiving end can display the screen sharing data, and the display screen corresponding to the screen sharing data includes a plurality of corresponding screen acquisition data. display screen.
  • an embodiment of the present application provides a call-based screen sharing device, which is applied to a sharing receiver, and includes a screen projection response module and a screen projection display module, wherein:
  • the screen projection response module is used to enter the screen sharing interface in response to the screen projection notification of the server;
  • the screen projection display module is configured to receive the screen sharing data sent by the server based on the call video transmission channel, and display the screen sharing data in the screen sharing interface, and the screen sharing data is shared by the server to many
  • the screen capture data uploaded by the sharing initiator is integrated to obtain, the display screen corresponding to the screen sharing data includes a plurality of display screens corresponding to the screen capture data, and the communication between the sharing initiator and the server is The screen capture data is transmitted based on the call video transmission channel.
  • an embodiment of the present application provides a call-based screen sharing device, including: a memory and one or more processors;
  • the memory for storing one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors implement the call-based Screen sharing method.
  • embodiments of the present application provide a storage medium containing computer-executable instructions, the computer-executable instructions, when executed by a computer processor, are used to perform aspects such as the first aspect, the second aspect, and the third aspect The call-based screen sharing method of any one.
  • a video collection tool is used to collect screen images of each sharing initiator and generate screen capture data.
  • the server receives the screen capture data uploaded by each share initiator based on the video transmission channel of the call. Integrate these screen acquisition data to obtain screen sharing data corresponding to the screen images of multiple sharing initiators, and send the screen sharing data to the sharing receiving terminal based on the call video transmission channel, so that the sharing receiving terminal can display the screen sharing data.
  • Multiple shared initiators share the screen of the shared receiver.
  • the shared receiver can view the screen of the shared initiator in real time, reducing the need for the shared initiator to share the screen by taking screenshots, and effectively optimizing the user experience.
  • FIG. 1 is a flowchart of a call-based screen sharing method applied to a server provided by an embodiment of the present application
  • FIG. 2 is a flowchart of a call-based screen sharing method applied to a sharing initiator provided by an embodiment of the present application
  • FIG. 3 is a schematic diagram of a call room interface displayed by a sharing initiator according to an embodiment of the present application
  • FIG. 4 is a screen capture interface displayed by a sharing initiator provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a chat list displayed by a sharing initiator according to an embodiment of the present application.
  • FIG. 6 is a flowchart of a call-based screen sharing method applied to a sharing receiver provided by an embodiment of the present application
  • FIG. 7 is a schematic diagram of a screen sharing interface displayed by a sharing initiator according to an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a chat list displayed by a shared receiving end provided by an embodiment of the application.
  • FIG. 9 is a flowchart of a call-based screen sharing device applied to a server provided by an embodiment of the present application.
  • FIG. 10 is a flowchart of a call-based screen sharing device applied to a sharing initiator provided by an embodiment of the present application
  • FIG. 11 is a flowchart of a call-based screen sharing device applied to a sharing receiver provided by an embodiment of the present application
  • FIG. 12 is a schematic structural diagram of a call-based screen sharing device provided by an embodiment of the present application.
  • FIG. 1 shows a flowchart of a call-based screen sharing method applied to a server provided by an embodiment of the present application.
  • the call-based screen sharing method provided by the embodiment of the present application may be performed by a call-based screen sharing device.
  • the call-based screen sharing apparatus may be implemented by means of hardware and/or software, and is integrated in a call-based screen sharing device (for example, the server provided by the embodiment of the present application).
  • the call-based screen sharing apparatus executing the call-based screen sharing method as an example for description.
  • the call-based screen sharing method includes:
  • S101 In response to screen projection requests sent by multiple sharing initiators, receive screen capture data uploaded by a plurality of sharing initiators respectively based on the video transmission channel of the call, and the screen capture data are obtained by the sharing initiators through a video capture tool Capture the screen image.
  • the shared initiator and shared receiver provided in this embodiment transmit video data and/or voice data between the server and the server based on the call video transmission channel, and there may be multiple shared initiators and shared receivers, that is, multiple shared initiators A voice and video call is made between the terminal and multiple shared receivers.
  • the call video channel provided in this embodiment is established based on the TCP or UDP transmission protocol, specifically an international call video channel, and a corresponding DNS service is deployed in a corresponding operator.
  • the sharing initiating end and the sharing receiving end provided in this embodiment can be respectively understood as a client that provides a shared screen image and a client that receives and displays the shared screen image. It can be understood that the sharing initiator and the sharing receiving terminal can be converted to each other. For example, after the sharing initiator ends the screen sharing, it can be converted to the sharing receiving terminal to display the screen sharing data, and the sharing receiving terminal can display the screen sharing data through the sent screen. Request screen sharing as a sharing initiator.
  • the multiple sharing initiators when multiple sharing initiators need to share screen images, the multiple sharing initiators send screen projection requests to the server.
  • each sharing initiator collects the screen images through the video capture tool, obtains the video stream recorded with the screen images as the screen capture data, and uploads it to the server through the call video transmission channel.
  • the video capture tool may be a screen capture tool provided by the sharing initiator's own system (for example, the VideoCapture tool provided by the Android system).
  • the server After receiving the screen projection request sent by each sharing initiator, the server responds to the screen projection request sent by each sharing initiator, and respectively receives the screen capture data uploaded by each sharing initiator based on the video transmission channel of the call.
  • S102 Integrate a plurality of the screen acquisition data to obtain screen sharing data, and the display images corresponding to the screen sharing data include a plurality of display images corresponding to the screen acquisition data.
  • the screen sharing data sent by each sharing initiator is decoded, the corresponding display images of each sharing initiator are obtained, and these display images are integrated into one display image. , and encode the integrated display image to obtain screen sharing data, and the corresponding display image after decoding the screen sharing data includes a plurality of display images corresponding to the screen acquisition data.
  • integrating a plurality of the screen collection data to obtain the screen sharing data specifically includes: synchronizing the plurality of the screen sharing data according to the timestamps corresponding to the plurality of the screen collection data; A plurality of the screen sharing data after synchronization processing are integrated to obtain screen sharing data.
  • the screen sharing data sent by each sharing initiator is decoded to obtain the corresponding display image of each sharing initiator and the timestamp of each frame of the displayed image.
  • the display images corresponding to different sharing initiators are synchronized based on the time stamp, the synchronized display images are integrated into one display image, and the integrated display images are encoded to obtain screen sharing data.
  • the corresponding display image after decoding the screen sharing data includes the display images corresponding to the multiple screen acquisition data, and the display images corresponding to the multiple screen acquisition data are kept synchronized in time.
  • S103 Determine the sharing receiver corresponding to the screen projection request, and send the screen sharing data to the sharing receiver based on the call video transmission channel, so that the sharing receiver can display the screen sharing data.
  • these shared receivers are the shared receivers corresponding to the screen projection request, and send screen sharing to these shared receivers based on the call video transmission channel. data.
  • the sharing receiving terminal decodes the screen sharing data and plays the screen sharing data in the voice and video call interface, so as to simultaneously display the corresponding screen images of each sharing initiator in the sharing receiving terminal.
  • the screen images of each sharing initiator are collected by the video capture tool and screen capture data is generated, and in response to the screen projection request sent by each sharing initiator, the server receives the screen capture data uploaded by each sharing initiator based on the video transmission channel of the call, and responds to the screen capture data uploaded by each sharing initiator.
  • These screen acquisition data are integrated to obtain screen sharing data corresponding to the screen images of multiple sharing initiators, and the screen sharing data is sent to the sharing receiving terminal based on the video transmission channel of the call, so that the sharing receiving terminal can display the screen sharing data and display multiple screen sharing data. Share the screen image sharing between the sharing initiator and the sharing receiving terminal.
  • the sharing receiving terminal can view the screen of the sharing initiator in real time, reducing the need for the sharing initiator to share the screen by taking screenshots, and effectively optimizing the user experience.
  • switch the video source data of the call video transmission channel to the screen capture data which can realize the mode of viewing by multiple shared initiators and multiple shared receivers at the same time, and meet the user's needs for screen sharing during the call process.
  • the call-based video transmission channel can realize low latency of data transmission, higher network transmission speed, and better user experience.
  • the synchronization of the corresponding screen images of different sharing initiators can be realized, the computational requirements of the sharing receivers are reduced, and the communication between the sharing receivers and the sharing receivers can be effectively reduced.
  • Data transmission volume reducing the traffic consumption of the shared receiver.
  • FIG. 2 shows a flowchart of a call-based screen sharing method applied to a sharing initiator provided by an embodiment of the present application.
  • the call-based screen sharing method provided by the embodiment of the present application may be performed by a call-based screen sharing device.
  • the call-based screen sharing apparatus may be implemented by means of hardware and/or software, and be integrated in a call-based screen sharing device (for example, the sharing initiator provided by the embodiment of the present application).
  • the call-based screen sharing apparatus executing the call-based screen sharing method as an example for description.
  • the call-based screen sharing method includes:
  • S201 Entering a screen capture interface in response to a screen projection selection operation, and sending a screen projection request to the server.
  • the sharing initiator provided by the embodiment of the present application may be a device such as a smartphone, a tablet computer, etc. that can communicate with the server through a video transmission channel of a call, and the sharing initiator's own system provides a screen capture tool (for example, the VideoCapture tool provided by the Android system) as a The video collection tool provided by the embodiment of the present application.
  • a screen capture tool for example, the VideoCapture tool provided by the Android system
  • both the sharing initiator and the sharing receiving end establish a call video transmission channel based on the audio, voice and video call SDK (software development kit), so as to perform data transmission with the server based on the call video transmission channel.
  • SDK software development kit
  • the shared initiating end and the shared receiving end when the shared initiating end and the shared receiving end establish a voice and video call connection, the shared initiating end and the shared receiving end enter a common video chat room, and display a call room interface on the shared initiating end, and the call room interface displays User information (for example, user avatars) corresponding to each sharing initiating terminal and sharing receiving terminal in the current call room.
  • User information for example, user avatars
  • the sharing initiator provides a screen-casting selection button.
  • the user can trigger the screen-casting selection button on the sharing initiator.
  • the sharing initiator detects that the screen-casting selection button is triggered, it determines that the screen-casting selection operation occurs. , and switch to the display screen capture interface in response to the screen projection selection operation.
  • the screen capture interface displays the shared receiver in the current room and the screen projection text prompt (for example, "sharing screen" is displayed in the screen capture interface), prompting the user
  • the sharing initiator has entered screen sharing mode.
  • the sharing initiator After determining that the screen-casting selection operation occurs, the sharing initiator sends a screen-casting request to the server, and waits for a response from the server.
  • FIG. 3 is a schematic diagram of a talking room interface displayed by a sharing initiator according to an embodiment of the present application
  • FIG. 4 is a screen capture interface displayed by a sharing initiator according to an embodiment of the present application.
  • the user avatars (A1 in Figure 3) corresponding to each sharing initiating terminal and the sharing receiving terminal are displayed in the call room interface, and a screen selection button (B in Figure 3) is provided in the call room interface. .
  • the screen displayed on the sharing initiator is switched from the call room interface to the screen capture interface.
  • the user avatars corresponding to each sharing initiator and sharing receiver are displayed on the screen capture interface.
  • “sharing the screen” is displayed in the screen capture interface as a screen-casting text prompt.
  • a room minimization button (C in FIG. 4 ) and an exit sharing button (D in FIG. 4 ) are displayed in the screen capture interface. Click the Exit Sharing button to exit the screen sharing process and return to the call room interface.
  • the sharing initiator determines whether there is an operator's voice and video call network, and if so, continues to perform the step of displaying the screen capture interface, otherwise prompts through toast (toast prompt) to remind you of no network and exit the screen sharing process. Further, when performing the step of displaying the screen capture interface, if the screen capture interface fails to be displayed, a toast prompt is used to remind the screen projection interface to enter the failure and exit the screen sharing process.
  • the server after receiving the screen projection request sent by the sharing initiator, the server returns screen projection response information to the sharing initiator, so as to notify the sharing initiator to collect and upload screen capture data.
  • the sharing initiator collects the screen image and obtains the screen capture data by calling the video capture tool provided by its own system.
  • the collection range for collecting the screen image is the full screen range by default, and the collection range may also be determined by selection or designation.
  • the screen capture data is obtained by capturing the screen image with a video capture tool, including steps S2021-S2022:
  • S2021 Determine the capture range of the screen image based on the sharing range selection operation.
  • the sharing initiator after entering the screen capture interface, provides a sharing range selection button, and after the sharing range selection button is triggered, provides a frame selection icon whose size, shape, and position can be adjusted, and check the adjustment of the frame selection icon. (ie, check the sharing range selection operation), after determining the adjustment of the frame selection icon (ie, check the sharing range selection operation), the screen range framed by the frame selection icon is the acquisition range of the screen image.
  • S2022 Using a video collection tool, collect screen images based on the collection range to obtain screen collection data.
  • the screen image corresponding to the acquisition range is acquired by calling the video acquisition tool provided by the own system to obtain the screen acquisition data.
  • the sharing initiator can also be operated to cause the sharing initiator to display the screen content desired to be shared for the video capture tool to capture, Specifically include:
  • a sharing prompt button that can be dragged to adjust the position is added to the sharing initiator.
  • FIG. 5 is a schematic diagram of a chat list displayed by a sharing initiator provided by an embodiment of the present application.
  • the sharing initiator displays The screen is switched from the screen capture interface to the chat list display interface, and at the same time, a display sharing prompt button (E in Figure 5) is added in the form of a floating window in the sharing initiator to remind the user that the user is currently in the screen sharing mode.
  • you can operate the sharing initiator to make the sharing initiator display the screen content you want to share for example, open a PPT document, Word document, etc.
  • the sharing initiator detects in real time whether the sharing prompt button is triggered, and after detecting that the sharing prompt button is triggered, determines to send a selection operation for the sharing prompt button, closes the sharing prompt button, returns to the voice and video call room, and displays the Call room interface.
  • S203 Upload the screen capture data to the server based on the call video transmission channel, the server integrates the screen sharing data sent by the sharing initiator to obtain screen sharing data, and send the screen sharing data to the share based on the call video transmission channel
  • the receiving end sends the screen sharing data for the sharing receiving end to display the screen sharing data, and the display image corresponding to the screen sharing data includes a plurality of display images corresponding to the screen acquisition data.
  • the collected screen capture data is simultaneously uploaded to the server in real time based on the video transmission channel of the call.
  • the server receives the screen capture data uploaded from each sharing initiator based on the call video transmission channel. Further, the server integrates the screen sharing data sent by each sharing initiator to obtain the screen sharing data, and transmits the screen sharing data to each sharing receiving terminal that conducts a voice and video call with the corresponding sharing initiator based on the call video transmission channel.
  • each sharing receiver After receiving the screen sharing data, each sharing receiver decodes and plays the screen sharing data in real time. At this time, the display screen on the sharing receiver includes the display screen corresponding to the collected data of each screen.
  • the screen images of each sharing initiator are collected by the video capture tool and screen capture data is generated, and in response to the screen projection request sent by each sharing initiator, the server receives the screen capture data uploaded by each sharing initiator based on the video transmission channel of the call, and responds to the screen capture data uploaded by each sharing initiator.
  • These screen acquisition data are integrated to obtain screen sharing data corresponding to the screen images of multiple sharing initiators, and the screen sharing data is sent to the sharing receiving terminal based on the video transmission channel of the call, so that the sharing receiving terminal can display the screen sharing data and display multiple screen sharing data.
  • the sharing initiator shares the screen image of the sharing receiving terminal, and the sharing receiving terminal can view the screen image of the sharing initiator in real time, which reduces the need for the sharing initiator to share the screen image by way of screenshots, and effectively optimizes the user experience.
  • the acquisition range of the screen image can be determined according to the user's sharing range needs, so as to meet the user's needs for different sharing ranges and further optimize the user experience.
  • FIG. 6 shows a flowchart of a call-based screen sharing method applied to a sharing receiver provided by an embodiment of the present application.
  • the call-based screen sharing method provided by the embodiment of the present application may be performed by a call-based screen sharing device.
  • the call-based screen sharing apparatus may be implemented by means of hardware and/or software, and be integrated in a call-based screen sharing device (for example, the sharing receiver provided in the embodiment of the present application).
  • the call-based screen sharing method includes:
  • S301 Enter a screen sharing interface in response to a screen projection notification from the server.
  • the shared receiving end provided by the embodiment of the present application may be a device such as a smart phone, a tablet computer, etc., which can communicate with a server through a video transmission channel of a call. Further, video data and/or voice data are transmitted between the shared initiator and the shared receiver and the server based on the call video transmission channel provided in this embodiment, so as to realize the shared voice and video between the initiator and the shared receiver and the server. call.
  • the shared receiving end and the shared initiating end when the shared receiving end and the shared initiating end establish a voice and video call connection, the shared receiving end and the shared initiating end enter a common video chat room, and display a call room interface on the shared receiving end, and the call room interface displays User information corresponding to each sharing initiating end and sharing receiving end in the current call room (refer to FIG. 3 ).
  • the server pushes a screencasting notification to the shared receivers that conduct voice and video calls with these sharing initiators.
  • the server receives the screen capture data uploaded by these shared initiators based on the video transmission channel of the call, integrates these screen capture data to obtain screen sharing data, and sends the shared data to the shared data. Receiver sends.
  • the sharing receiver exits the call room interface and switches to display the screen sharing interface, displays the user avatars corresponding to each sharing initiator and the sharing receiving terminal in the screen sharing interface, and displays the corresponding user avatars on the screen sharing interface at the same time.
  • the playback window reserved for playback of screen sharing data.
  • S302 Receive the screen sharing data sent by the server based on the call video transmission channel, and display the screen sharing data in the screen sharing interface, where the screen sharing data is uploaded by the server to multiple sharing initiators
  • the screen acquisition data is integrated to obtain, the display screen corresponding to the screen sharing data includes a plurality of display screens corresponding to the screen acquisition data, and the screen is transmitted between the sharing initiator and the server based on the call video transmission channel. Data collection.
  • the screen sharing data sent by the server is received based on the call video transmission channel, and the screen sharing data is decoded in real time and played on the play window used for playing the screen sharing data in the screen sharing interface.
  • the screen sharing data provided in the embodiments of the present application is obtained by integrating the screen acquisition data uploaded by multiple sharing initiators by the server, and the display screen corresponding to the screen sharing data includes a plurality of display screens corresponding to the screen acquisition data, and the sharing initiator
  • the screen capture data is transmitted between the terminal and the server based on the video transmission channel of the call.
  • a room exit button is set in the call room interface, and whether the room exit button displayed in the call room interface is triggered is detected in real time, after the room exit button is triggered, it is determined that a room exit operation occurs, and the room exits in response to Operation to exit the call room interface.
  • a screen sharing window that can be dragged to adjust the position is added to the sharing receiver, and the screen sharing data received from the server is played and displayed in the screen sharing window in real time.
  • FIG. 7 is a schematic diagram of a screen sharing interface displayed by a sharing initiator provided by an embodiment of the present application.
  • a sharing initiator provided by an embodiment of the present application.
  • FIG. 7 after successfully entering the screen sharing interface and receiving the screen sharing data sent by the server, synchronous analysis is performed in the screen sharing interface. And play the screen sharing data (F in FIG. 7 ), and at the same time, the user avatars corresponding to each sharing initiating end and the sharing receiving end are displayed in the screen sharing interface (A3 in FIG. 7 ). And the room exit button (G in Figure 7) is displayed in the screen sharing interface.
  • FIG. 8 is a schematic diagram of a chat list displayed by a shared receiver provided by an embodiment of the application.
  • the display screen of the shared receiver is displayed by The screen sharing interface is switched to the display interface of the chat list, and at the same time, a screen sharing window (H in Figure 8) is added to the sharing receiver, and the screen sharing data received from the server is displayed in real time in the screen sharing window.
  • the sharing receiver detects in real time whether the screen sharing window is clicked, and after detecting that the screen sharing window is clicked, determines to send a selection operation for the screen sharing window, closes the screen sharing window, returns to the voice and video call room, and displays the Screen sharing interface.
  • the screen images of each sharing initiator are collected by the video capture tool and screen capture data is generated, and in response to the screen projection request sent by each sharing initiator, the server receives the screen capture data uploaded by each sharing initiator based on the video transmission channel of the call, and responds to the screen capture data uploaded by each sharing initiator.
  • These screen acquisition data are integrated to obtain screen sharing data corresponding to the screen images of multiple sharing initiators, and the screen sharing data is sent to the sharing receiving terminal based on the video transmission channel of the call, so that the sharing receiving terminal can display the screen sharing data and display multiple screen sharing data.
  • the sharing initiator shares the screen image of the sharing receiving terminal, and the sharing receiving terminal can view the screen image of the sharing initiator in real time, which reduces the need for the sharing initiator to share the screen image by way of screenshots, and effectively optimizes the user experience.
  • FIG. 9 is a flowchart of a call-based screen sharing apparatus applied to a server provided by an embodiment of the present application.
  • the call-based screen sharing device includes a screen projection response module 41 , a data integration module 42 and a data push module 43 .
  • the screen projection response module 41 is configured to, in response to screen projection requests sent by multiple shared initiators, receive screen capture data uploaded by multiple shared initiators based on the video transmission channel of the call, respectively, and the screen capture data
  • the screen image is collected by the sharing initiator through a video collection tool;
  • the data integration module 42 is used to integrate a plurality of the screen collection data to obtain screen sharing data, and the display image corresponding to the screen sharing data Contains a plurality of display images corresponding to the screen capture data;
  • the data push module 43 is used to determine the shared receiver corresponding to the screen projection request, and send the shared receiver based on the call video transmission channel to the shared receiver. Screen sharing data for the sharing receiver to display the screen sharing data.
  • the screen images of each sharing initiator are collected by the video capture tool and screen capture data is generated, and in response to the screen projection request sent by each sharing initiator, the server receives the screen capture data uploaded by each sharing initiator based on the video transmission channel of the call, and responds to the screen capture data uploaded by each sharing initiator.
  • These screen acquisition data are integrated to obtain screen sharing data corresponding to the screen images of multiple sharing initiators, and the screen sharing data is sent to the sharing receiving terminal based on the video transmission channel of the call, so that the sharing receiving terminal can display the screen sharing data and display multiple screen sharing data.
  • the sharing initiator shares the screen image of the sharing receiving terminal, and the sharing receiving terminal can view the screen image of the sharing initiator in real time, which reduces the need for the sharing initiator to share the screen image by way of screenshots, and effectively optimizes the user experience.
  • FIG. 10 is a flowchart of a call-based screen sharing apparatus applied to a sharing initiator according to an embodiment of the present application.
  • the call-based screen sharing device includes a screen projection request module 51 , a screen capture module 52 and a data upload module 53 .
  • the screen projection request module 51 is used to enter the screen capture interface in response to the screen projection selection operation, and send a screen projection request to the server; the screen capture module 52 is used to respond to the screen projection response returned by the server.
  • the data uploading module 53 is used to upload the screen capture data to the server based on the video transmission channel of the call, and the server initiates the sharing of the data.
  • the screen sharing data sent by the terminal is integrated to obtain the screen sharing data, and the screen sharing data is sent to the sharing receiving terminal based on the video transmission channel of the call, so that the sharing receiving terminal can display the screen sharing data.
  • the display image corresponding to the screen sharing data includes a plurality of display images corresponding to the screen acquisition data.
  • the screen images of each sharing initiator are collected by the video capture tool and screen capture data is generated, and in response to the screen projection request sent by each sharing initiator, the server receives the screen capture data uploaded by each sharing initiator based on the video transmission channel of the call, and responds to the screen capture data uploaded by each sharing initiator.
  • These screen acquisition data are integrated to obtain screen sharing data corresponding to the screen images of multiple sharing initiators, and the screen sharing data is sent to the sharing receiving terminal based on the video transmission channel of the call, so that the sharing receiving terminal can display the screen sharing data and display multiple screen sharing data.
  • the sharing initiator shares the screen image of the sharing receiving terminal.
  • the sharing receiving terminal can view the screen image of the sharing initiator in real time, which reduces the need for the sharing initiator to share the screen image by means of screenshots, and effectively optimizes the user experience.
  • FIG. 11 is a flowchart of a call-based screen sharing apparatus applied to a sharing receiver according to an embodiment of the present application.
  • the call-based screen sharing device includes a screen projection response module 61 and a screen projection display module 62 .
  • the screen projection response module 61 is used to enter the screen sharing interface in response to a screen projection notification from the server; the screen projection display module 62 is used to receive the screen sharing data sent by the server based on the call video transmission channel, and The screen sharing data is displayed in the screen sharing interface, and the screen sharing data is obtained by integrating the screen acquisition data uploaded by a plurality of the sharing initiators by the server, and the display screen corresponding to the screen sharing data includes There are a plurality of display images corresponding to the screen capture data, and the screen capture data is transmitted between the sharing initiating end and the server based on the video transmission channel of the call.
  • the screen images of each sharing initiator are collected by the video capture tool and screen capture data is generated, and in response to the screen projection request sent by each sharing initiator, the server receives the screen capture data uploaded by each sharing initiator based on the video transmission channel of the call, and responds to the screen capture data uploaded by each sharing initiator.
  • These screen acquisition data are integrated to obtain screen sharing data corresponding to the screen images of multiple sharing initiators, and the screen sharing data is sent to the sharing receiving terminal based on the video transmission channel of the call, so that the sharing receiving terminal can display the screen sharing data and display multiple screen sharing data.
  • the sharing initiator shares the screen image of the sharing receiving terminal, and the sharing receiving terminal can view the screen image of the sharing initiator in real time, which reduces the need for the sharing initiator to share the screen image by way of screenshots, and effectively optimizes the user experience.
  • FIG. 12 is a schematic structural diagram of a call-based screen sharing device provided by an embodiment of the present application.
  • the call-based screen sharing device includes: an input device 73, an output device 74, a memory 72, and one or more processors 71; the memory 72 is used to store one or more programs; when the one One or more programs are executed by the one or more processors 71, so that the one or more processors 71 implement the call-based screen sharing method provided by the above-mentioned embodiments.
  • the input device 73 , the output device 74 , the memory 72 and the processor 71 may be connected through a bus or in other ways, and the connection through a bus is taken as an example in FIG. 12 .
  • the memory 72 can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the call-based screen sharing method described in any embodiment of the present application (for example, based on the The screen-casting response module 41 , the data integration module 42 and the data push module 43 or the screen-casting request module 51 , the screen acquisition module 52 and the data uploading module 53 or the screen-casting response module 61 and the screen-casting display module 62 in the screen sharing device of the call ).
  • the input device 73 may be used to receive input numerical or character information, and to generate key signal input related to user settings and function control of the device.
  • the output device 74 may include a display device such as a display screen.
  • the processor 71 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 72, that is, to implement the above-mentioned call-based screen sharing method.
  • the call-based screen sharing apparatus, device, and computer provided above can be used to execute the call-based screen sharing method provided by any of the above embodiments, and have corresponding functions and beneficial effects.
  • Embodiments of the present application further provide a storage medium that is applied to a server and includes computer-executable instructions, where the computer-executable instructions, when executed by a computer processor, are used to execute the call-based screen sharing method provided by the foregoing embodiments,
  • the call-based screen sharing method includes: in response to a screen projection request sent by a plurality of sharing initiating terminals, respectively receiving screen capture data uploaded by a plurality of the sharing initiating terminals based on a video transmission channel of a call, wherein the screen capture data is obtained by the
  • the sharing initiating end collects the screen image through a video collection tool; the screen sharing data is obtained by integrating a plurality of the screen collection data, and the display image corresponding to the screen sharing data includes a plurality of displays corresponding to the screen collection data.
  • screen determine the sharing receiver corresponding to the screen projection request, and send the screen sharing data to the sharing receiver based on the call video transmission channel, so that the sharing receiver can display the screen sharing data.
  • Embodiments of the present application further provide a storage medium containing computer-executable instructions applied to a sharing initiator, where the computer-executable instructions are used to execute the call-based screen sharing method provided by the above embodiments when executed by a computer processor
  • the call-based screen sharing method includes: entering a screen capture interface in response to a screen-casting selection operation, and sending a screen-casting request to the server; in response to the screen-casting response information returned by the server, collecting the screen image through a video collection tool Obtain the screen capture data; upload the screen capture data to the server based on the call video transmission channel, the server integrates the screen share data sent by the sharing initiator to obtain the screen share data, and sends the screen share data based on the call video transmission channel to the server.
  • the sharing receiving end sends the screen sharing data for the sharing receiving end to display the screen sharing data, and the display image corresponding to the screen sharing data includes a plurality of display images corresponding to the screen acquisition data .
  • Embodiments of the present application further provide a storage medium containing computer-executable instructions applied to a sharing receiver, where the computer-executable instructions are used to execute the call-based screen sharing method provided by the above embodiments when executed by a computer processor
  • the call-based screen sharing method includes: entering a screen sharing interface in response to a screen projection notification from a server; receiving screen sharing data sent by the server based on a call video transmission channel, and displaying the screen sharing interface in the screen sharing interface
  • the screen sharing data is obtained by integrating a plurality of screen acquisition data uploaded by the sharing initiator, and the display screen corresponding to the screen sharing data includes a plurality of display screens corresponding to the screen acquisition data.
  • the screen capture data is transmitted between the sharing initiator and the server based on the call video transmission channel.
  • storage medium any of various types of memory devices or storage devices.
  • storage medium is intended to include: installation media, such as CD-ROMs, floppy disks, or tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. ; non-volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc.
  • the storage medium may also include other types of memory or combinations thereof.
  • the storage medium may be located in the first computer system in which the program is executed, or may be located in a second, different computer system connected to the first computer system through a network such as the Internet.
  • the second computer system may provide program instructions to the first computer for execution.
  • storage medium may include two or more storage media that may reside in different locations (eg, in different computer systems connected by a network).
  • the storage medium may store program instructions (eg, embodied as a computer program) executable by one or more processors.
  • a storage medium containing computer-executable instructions provided by an embodiment of the present application, the computer-executable instructions of which are not limited to the above-mentioned call-based screen sharing method, and can also execute the call-based screen sharing method provided by any embodiment of the present application.
  • Related operations in the screen sharing method of a call are not limited to the above-mentioned call-based screen sharing method, and can also execute the call-based screen sharing method provided by any embodiment of the present application.
  • the call-based screen sharing device, device, and storage medium provided in the above-mentioned embodiments can perform the call-based screen sharing method provided by any embodiment of the present application.
  • the call-based screen sharing method provided by any embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请实施例公开了一种基于通话的屏幕共享方法、装置、设备及存储介质。本申请实施例提供的技术方案通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情况，有效优化用户体验。

Description

一种基于通话的屏幕共享方法、装置、设备及存储介质
本申请要求在2020年12月23日提交中国专利局、申请号为202011535310.5的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及通信技术领域，尤其涉及一种基于通话的屏幕共享方法、装置、设备及存储介质。
背景技术
屏幕共享作为一种信息共享手段，在线上会议中经常被用于文档展示、操作演示等。在多人语音视频通话过程中，在客户端上采集的是摄像头的采集的图像数据，并通过通话视频传输通道发送到服务器，再由服务器发送到同一通话房间的其他客户端中进行显示。
但是，在用户需要向其他客户端展示自身客户端上显示的内容时，一般是通过截图工具进行截图，再通过其他通讯工具发送给其他客户端，用户体验较差。
发明内容
本申请实施例提供一种基于通话的屏幕共享方法、装置、设备及存储介质，以实现通话过程的屏幕共享，优化用户体验。
在第一方面，本申请实施例提供了一种基于通话的屏幕共享方法，应用于服务器，包括：
响应于多个共享发起端发出的投屏请求，基于通话视频传输通道分别接收多个所述共享发起端上传的屏幕采集数据，所述屏幕采集数据由所述共享发起端通过视频采集工具对屏幕画面进行采集得到；
对多个所述屏幕采集数据进行整合得到屏幕共享数据，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面；
确定所述投屏请求对应的共享接收端，并基于通话视频传输通道向所述共 享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示。
在第二方面，本申请实施例提供了一种基于通话的屏幕共享方法，应用于共享发起端，包括：
响应于投屏选择操作进入屏幕采集界面，并向服务器发出投屏请求；
响应于所述服务器返回的投屏响应信息，通过视频采集工具对屏幕画面进行采集得到屏幕采集数据；
基于通话视频传输通道向所述服务器上传所述屏幕采集数据，由所述服务器对所述共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，以及基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
在第三方面，本申请实施例提供了一种基于通话的屏幕共享方法，应用于共享接收端，包括：
响应于服务器的投屏通知进入屏幕共享界面；
基于通话视频传输通道接收所述服务器发送的屏幕共享数据，并在所述屏幕共享界面中显示所述屏幕共享数据，所述屏幕共享数据由所述服务器对多个所述共享发起端上传的屏幕采集数据进行整合得到，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面，并且所述共享发起端与所述服务器之间基于通话视频传输通道传输屏幕采集数据。
在第四方面，本申请实施例提供了一种基于通话的屏幕共享装置，应用于服务器，包括投屏响应模块、数据整合模块和数据推送模块，其中：
所述投屏响应模块，用于响应于多个共享发起端发出的投屏请求，基于通话视频传输通道分别接收多个所述共享发起端上传的屏幕采集数据，所述屏幕采集数据由所述共享发起端通过视频采集工具对屏幕画面进行采集得到；
所述数据整合模块，用于对多个所述屏幕采集数据进行整合得到屏幕共享数据，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面；
所述数据推送模块，用于确定所述投屏请求对应的共享接收端，并基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示。
在第五方面，本申请实施例提供了一种基于通话的屏幕共享装置，应用于共享发起端，包括投屏请求模块、屏幕采集模块和数据上传模块，其中：
所述投屏请求模块，用于响应于投屏选择操作进入屏幕采集界面，并向服务器发出投屏请求；
所述屏幕采集模块，用于响应于所述服务器返回的投屏响应信息，通过视频采集工具对屏幕画面进行采集得到屏幕采集数据；
所述数据上传模块，用于基于通话视频传输通道向所述服务器上传所述屏幕采集数据，由所述服务器对所述共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，以及基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
在第六方面，本申请实施例提供了一种基于通话的屏幕共享装置，应用于共享接收端，包括投屏响应模块和投屏显示模块，其中：
所述投屏响应模块，用于响应于服务器的投屏通知进入屏幕共享界面；
所述投屏显示模块，用于基于通话视频传输通道接收所述服务器发送的屏幕共享数据，并在所述屏幕共享界面中显示所述屏幕共享数据，所述屏幕共享数据由所述服务器对多个所述共享发起端上传的屏幕采集数据进行整合得到，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面，并且所述共享发起端与所述服务器之间基于通话视频传输通道传输屏幕采集数据。
在第七方面，本申请实施例提供了一种基于通话的屏幕共享设备，包括：存储器以及一个或多个处理器；
所述存储器，用于存储一个或多个程序；
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如第一方面、第二方面和第三方面任一项所述的基于通话的屏幕共享方法。
在第八方面，本申请实施例提供了一种包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如第一方面、第二方面和第三方面任一项所述的基于通话的屏幕共享方法。
本申请实施例通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传 输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情况，有效优化用户体验。
附图说明
图1是本申请实施例提供的应用于服务器的一种基于通话的屏幕共享方法的流程图；
图2是本申请实施例提供的一种应用于共享发起端的基于通话的屏幕共享方法的流程图；
图3是本申请实施例提供的一种共享发起端显示的通话房间界面示意图；
图4是本申请实施例提供的一种共享发起端显示的屏幕采集界面；
图5是本申请实施例提供的一种共享发起端显示的聊天列表示意图；
图6是本申请实施例提供的一种应用于共享接收端的基于通话的屏幕共享方法的流程图；
图7是本申请实施例提供的一种共享发起端显示的屏幕共享界面示意图；
图8是申请实施例提供的一种共享接收端显示的聊天列表示意图；
图9是本申请实施例提供的应用于服务器的一种基于通话的屏幕共享装置的流程图；
图10是本申请实施例提供的应用于共享发起端的一种基于通话的屏幕共享装置的流程图；
图11是本申请实施例提供的应用于共享接收端的一种基于通话的屏幕共享装置的流程图；
图12是本申请实施例提供的一种基于通话的屏幕共享设备的结构示意图。
具体实施方式
为了使本申请的目的、技术方案和优点更加清楚，下面结合附图对本申请具体实施例作进一步的详细描述。可以理解的是，此处所描述的具体实施例仅仅用于解释本申请，而非对本申请的限定。另外还需要说明的是，为了便于描 述，附图中仅示出了与本申请相关的部分而非全部内容。在更加详细地讨论示例性实施例之前应当提到的是，一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各项操作(或步骤)描述成顺序的处理，但是其中的许多操作可以被并行地、并发地或者同时实施。此外，各项操作的顺序可以被重新安排。当其操作完成时所述处理可以被终止，但是还可以具有未包括在附图中的附加步骤。所述处理可以对应于方法、函数、规程、子例程、子程序等等。
图1给出了本申请实施例提供的应用于服务器的一种基于通话的屏幕共享方法的流程图，本申请实施例提供的基于通话的屏幕共享方法可以由基于通话的屏幕共享装置来执行，该基于通话的屏幕共享装置可以通过硬件和/或软件的方式实现，并集成在基于通话的屏幕共享设备(例如本申请实施例提供的服务器)中。
下述以基于通话的屏幕共享装置执行基于通话的屏幕共享方法为例进行描述。参考图1，该基于通话的屏幕共享方法包括：
S101：响应于多个共享发起端发出的投屏请求，基于通话视频传输通道分别接收多个所述共享发起端上传的屏幕采集数据，所述屏幕采集数据由所述共享发起端通过视频采集工具对屏幕画面进行采集得到。
本实施例提供的共享发起端和共享接收端与服务器之间基于通话视频传输通道进行视频数据和/或语音数据的传输，并且共享发起端和共享接收端可以是多个，即多个共享发起端和多个共享接收端之间进行语音视频通话。本实施例提供的通话视频通道基于TCP或UDP传输协议建立，具体为国际通话视频通道，并在对应的运营商部署相应的DNS服务。
本实施例提供的共享发起端和共享接收端可分别理解为提供共享屏幕画面的客户端和对共享屏幕画面进行接收并显示的客户端。可以理解的是，共享发起端和共享接收端可相互转换，例如共享发起端在结束屏幕画面共享后，可转换为共享接收端进行屏幕共享数据的显示，而共享接收端可通过发出的投屏请求作为共享发起端进行屏幕画面共享。
示例性的，在多个共享发起端需要进行屏幕画面的共享时，多个共享发起端向服务器发出投屏请求。同时，各个共享发起端分别通过视频采集工具对屏幕画面进行采集，得到记录有屏幕画面的视频流作为屏幕采集数据，并通过通 话视频传输通道向服务器上传。其中，视频采集工具可以是共享发起端自身系统提供的屏幕抓取工具(例如Android系统提供的VideoCapture工具)。
进一步的，服务器在接收到各个共享发起端发出的投屏请求后，分别响应各共享发起端发出的投屏请求，基于通话视频传输通道分别接收各个共享发起端上传的屏幕采集数据。
S102：对多个所述屏幕采集数据进行整合得到屏幕共享数据，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
示例性的，在接收到各个共享发起端上传的屏幕共享数据后，对各个共享发起端发出的屏幕共享数据进行解码，得到各个共享发起端对应显示画面，并将这些显示画面整合到一个显示画面中，并对整合后的显示画面进行编码，得到屏幕共享数据，并且对该屏幕共享数据解码后对应的显示画面包含有多个屏幕采集数据对应的显示画面。
在一个可能的实施例中，对多个所述屏幕采集数据进行整合得到屏幕共享数据具体包括：根据多个所述屏幕采集数据对应的时间戳对多个所述屏幕共享数据进行同步处理；对同步处理后的多个所述屏幕共享数据进行整合得到屏幕共享数据。
具体的，在接收到各个共享发起端上传的屏幕共享数据后，对各个共享发起端发出的屏幕共享数据进行解码，得到各个共享发起端对应显示画面以及每一帧显示画面的时间戳。
进一步的，基于时间戳对不同共享发起端对应的显示画面进行同步，并将同步后的显示画面整合到一个显示画面中，并对整合后的显示画面进行编码，得到屏幕共享数据。此时，对屏幕共享数据解码后对应的显示画面包含有多个屏幕采集数据对应的显示画面，并且多个屏幕采集数据对应的显示画面在时间上保持同步。
S103：确定所述投屏请求对应的共享接收端，并基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示。
示例性的，确定正在与这些共享发起端进行语音视频通话的共享接收端，这些共享接收端即为投屏请求所对应的共享接收端，并基于通话视频传输通道向这些共享接收端发送屏幕共享数据。
进一步的，共享接收端在接收到屏幕共享数据后，对屏幕共享数据进行解 码并在语音视频通话界面中播放屏幕共享数据，以共享接收端中同时显示各个共享发起端对应的屏幕画面。
上述，通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情况，有效优化用户体验，当用户需要共享屏幕数据时，将通话视频传输通道的视频源数据切换为屏幕采集数据，可以实现同时多个共享发起端和多个共享接收端任意查看的模式，满足用户通话过程对屏幕共享的需求。并且基于通话的通话视频传输通道可实现数据传输的低时延，网络传输速度更高，用户体验更好。同时，通过在服务器中对多个屏幕采集数据进行整合得到屏幕共享数据，即可实现不同共享发起端对应屏幕画面的同步，减少共享接收端的计算量要求，还有效减少与共享接收端之间的数据传输量，减少共享接收端的流量耗费。
图2给出了本申请实施例提供的一种应用于共享发起端的基于通话的屏幕共享方法的流程图，本申请实施例提供的基于通话的屏幕共享方法可以由基于通话的屏幕共享装置来执行，该基于通话的屏幕共享装置可以通过硬件和/或软件的方式实现，并集成在基于通话的屏幕共享设备(例如本申请实施例提供的共享发起端)中。
下述以基于通话的屏幕共享装置执行基于通话的屏幕共享方法为例进行描述。参考图2，该基于通话的屏幕共享方法包括：
S201：响应于投屏选择操作进入屏幕采集界面，并向服务器发出投屏请求。
本申请实施例提供的共享发起端可以是智能手机、平板电脑等可通过通话视频传输通道与服务器进行的设备，并且共享发起端自身系统提供屏幕抓取工具(例如Android系统提供的VideoCapture工具)作为本申请实施例提供的视频采集工具。
进一步的，共享发起端和共享接收端与服务器之间基于通话视频传输通道进行视频数据和/或语音数据的传输，实现共享发起端和共享接收端与服务器之 间的语音视频通话。具体的，共享发起端和共享接收端均基于音语音视频通话SDK(软件开发工具包)建立通话视频传输通道，以基于该通话视频传输通道与服务器进行数据传输。
具体的，在共享发起端与共享接收端建立语音视频通话连接时，共享发起端和共享接收端进入共同的视频聊天房间，并在共享发起端上显示通话房间界面，并且通话房间界面中显示有当前通话房间中的各个共享发起端和共享接收端对应的用户信息(例如用户头像)。
同时，共享发起端提供投屏选择按钮，在需要共享屏幕画面时，用户可触发共享发起端上的投屏选择按钮，共享发起端检测到投屏选择按钮被触发后，确定发生投屏选择操作，并响应该投屏选择操作切换至显示屏幕采集界面，在屏幕采集界面中显示当前房间中的共享接收端以及投屏文字提示(例如在屏幕采集界面中显示“正在分享屏幕”)，提示用户共享发起端已进入屏幕共享模式。
进一步的，在确定发生投屏选择操作后，共享发起端向服务器发去投屏请求，并等待服务器的回应。
图3是本申请实施例提供的一种共享发起端显示的通话房间界面示意图，图4是本申请实施例提供的一种共享发起端显示的屏幕采集界面。如图3所示，在通话房间界面中显示各个共享发起端和共享接收端对应的用户头像(图3中的A1)，并且在通话房间界面中提供投屏选择按钮(图3中的B)。
在用户触发投屏选择按钮后，该共享发起端显示的画面由通话房间界面切换至屏幕采集界面，如图4所示，在屏幕采集界面中显示各个共享发起端和共享接收端对应的用户头像(图4中的A2)，同时在屏幕采集界面中显示“正在分享屏幕”作为投屏文字提示。并且在屏幕采集界面中显示房间最小化按钮(图4中的C)和退出共享按钮(图4中的D)。点击退出共享按钮可退出屏幕共享流程并返回通话房间界面。
在一个可能的实施例中，共享发起端在检测到投屏选择操作后，判断是否存在运营商的语音视频通话网络，若存在，则继续执行对屏幕采集界面的显示步骤，否则通过吐司提示(toast提示)的方式进行无网络提醒并退出屏幕共享流程。进一步的，在进行对屏幕采集界面的显示步骤时，若屏幕采集界面显示失败，则通过吐司提示的方式进行投屏界面进入失败提醒并退出屏幕共享流程。
S202：响应于所述服务器返回的投屏响应信息，通过视频采集工具对屏幕 画面进行采集得到屏幕采集数据。
示例性的，服务器在接收并通过共享发起端发出的投屏请求后，向该共享发起端返回投屏响应信息，以通知共享发起端进行屏幕采集数据的采集和上传。
进一步的，共享发起端在接收到服务器返回的投屏响应信息后，通过调用自身系统提供的视频采集工具对屏幕画面进行采集并得到屏幕采集数据。其中，对屏幕画面进行采集的采集范围默认是全屏幕范围，还可以是通过选择或指定的方式确定采集范围。
在一个实施例中，对于通过选择或指定的方式确定采集范围，所述通过视频采集工具对屏幕画面进行采集得到屏幕采集数据，包括步骤S2021-S2022：
S2021：基于共享范围选择操作确定对屏幕画面的采集范围。
示例性的，在进入屏幕采集界面后，共享发起端提供共享范围选择按钮，在共享范围选择按钮被触发后，提供一个可调整大小、形状、位置的框选图标，检查对框选图标的调整(即检查共享范围选择操作)，在确定对框选图标的调整(即检查共享范围选择操作)后，框选图标所框中的屏幕范围，该屏幕范围即为对屏幕画面的采集范围。
S2022：通过视频采集工具，基于所述采集范围对屏幕画面进行采集得到屏幕采集数据。
在确定对屏幕画面的采集范围后，通过调用自身系统提供的视频采集工具对采集范围对应的屏幕画面进行采集，以得到屏幕采集数据。
在一个可能的实施例中，在通过视频采集工具对屏幕画面进行采集得到屏幕采集数据之后，还可通过操作共享发起端使共享发起端显示希望共享的画面内容，以供视频采集工具进行采集，具体包括：
S2023：响应于房间最小化操作，退出屏幕采集界面并显示共享提示按钮。
具体的，实时检测在屏幕采集界面中显示的房间最小化按钮是否被触发，在屏幕采集界面中显示的房间最小化按钮被触发后，确定发生房间最小化操作，并响应于该房间最小化操作，退出屏幕采集界面。
进一步的，在退出屏幕采集界面后，在共享发起端中添加显示一个可拖动调整位置的共享提示按钮。
图5是本申请实施例提供的一种共享发起端显示的聊天列表示意图，如图5所示，在点击图4中提供的房间最小化按钮(图4中的C)后，共享发起端的显示画面由屏幕采集界面切换到聊天列表的显示界面中，同时在共享发起端中以 悬浮窗的形式添加显示共享提示按钮(图5中的E)，提示用户当前处于屏幕共享模式。在退出屏幕采集界面后，可通过操作共享发起端使共享发起端显示希望共享的画面内容(例如打开PPT文档、Word文档等)，以供在后台运行的视频采集工具进行屏幕画面的采集。
S2024：响应于对所述共享提示按钮的选择操作，关闭所述共享提示按钮并返回通话房间界面。
具体的，共享发起端实时检测共享提示按钮是否被触发，并在检测到共享提示按钮被触发后，确定发送对共享提示按钮的选择操作，并关闭该共享提示按钮并返回语音视频通话房间并显示通话房间界面。
通过房间最小化操作退出屏幕采集界面，可操作共享发起端显示希望进行屏幕共享的内容，并可通过共享提示按钮快速返回通话房间界面，方便用户返回语音视频通话房间的操作，优化用户体验。
S203：基于通话视频传输通道向所述服务器上传所述屏幕采集数据，由所述服务器对所述共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，以及基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
具体的，在通过视频采集工具对屏幕画面进行采集得到屏幕采集数据的同时，同步基于通话视频传输通道向服务器实时上传采集到的屏幕采集数据。
同时，服务器基于通话视频传输通道接收来自各个共享发起端上传的屏幕采集数据。进一步的，服务器对各个共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，并基于通话视频传输通道向与对应共享发起端进行语音视频通话的各个共享接收端进行发送。
各共享接收端在接收到屏幕共享数据后，实时对屏幕共享数据进行解码并播放，此时共享接收端上的显示画面包含有各个屏幕采集数据对应的显示画面。
上述，通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共 享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情况，有效优化用户体验。同时，可根据用户的共享范围需要确定对屏幕画面的采集范围，满足用户对不同共享范围的需要，进一步优化用户体验。
图6给出了本申请实施例提供的一种应用于共享接收端的基于通话的屏幕共享方法的流程图，本申请实施例提供的基于通话的屏幕共享方法可以由基于通话的屏幕共享装置来执行，该基于通话的屏幕共享装置可以通过硬件和/或软件的方式实现，并集成在基于通话的屏幕共享设备(例如本申请实施例提供的共享接收端)中。
下述以基于通话的屏幕共享装置执行基于通话的屏幕共享方法为例进行描述。参考图6，该基于通话的屏幕共享方法包括：
S301：响应于服务器的投屏通知进入屏幕共享界面。
本申请实施例提供的共享接收端可以是智能手机、平板电脑等可通过通话视频传输通道与服务器进行的设备。进一步的，本实施例提供的共享发起端和共享接收端与服务器之间基于通话视频传输通道进行视频数据和/或语音数据的传输，实现共享发起端和共享接收端与服务器之间的语音视频通话。
具体的，在共享接收端与共享发起端建立语音视频通话连接时，共享接收端和共享发起端进入共同的视频聊天房间，并在共享接收端上显示通话房间界面，并且通话房间界面中显示有当前通话房间中的各个共享发起端和共享接收端对应的用户信息(可参考图3)。
进一步的，服务器在接收到多个共享发起端发出的投屏请求后，向与这些共享发起端进行语音视频通话的共享接收端推送投屏通知。同时，服务器在接收到多个共享发起端发出的投屏请求后，基于通话视频传输通道分别接收这些共享发起端上传的屏幕采集数据，对这些屏幕采集数据进行整合得到屏幕共享数据，并向共享接收端发送。
进一步的，共享接收端在接收到投屏通知后，退出通话房间界面并切换为显示屏幕共享界面，在屏幕共享界面中显示各个共享发起端和共享接收端对应的用户头像，同时在屏幕共享界面中保留用于播放屏幕共享数据的播放窗口。
S302：基于通话视频传输通道接收所述服务器发送的屏幕共享数据，并在所述屏幕共享界面中显示所述屏幕共享数据，所述屏幕共享数据由所述服务器对多个所述共享发起端上传的屏幕采集数据进行整合得到，所述屏幕共享数据 对应的显示画面包含有多个所述屏幕采集数据对应的显示画面，并且所述共享发起端与所述服务器之间基于通话视频传输通道传输屏幕采集数据。
具体的，在成功进入屏幕共享界面后，基于通话视频传输通道接收服务器发送的屏幕共享数据，实时对屏幕共享数据进行解码并在屏幕共享界面中用于播放屏幕共享数据的播放窗口上进行播放。
其中，本申请实施例提供的屏幕共享数据由服务器对多个共享发起端上传的屏幕采集数据进行整合得到，屏幕共享数据对应的显示画面包含有多个屏幕采集数据对应的显示画面，并且共享发起端与服务器之间基于通话视频传输通道传输屏幕采集数据。
在一个可能的实施例中，在通话房间界面显示屏幕共享界面之后，还包括步骤S303-S304：
S303：响应于房间退出操作，退出通话房间界面并显示屏幕共享窗口，并在所述屏幕共享窗口中显示所述屏幕共享数据。
具体的，在通话房间界面中设置一个房间退出按钮，实时检测在通话房间界面中显示的房间退出按钮是否被触发，在房间退出按钮被触发后，确定发生房间退出操作，并响应于该房间退出操作退出通话房间界面。
进一步的，在退出通话房间界面后，在共享接收端中添加显示一个可拖动调整位置的屏幕共享窗口，并在该屏幕共享窗口中实时播放显示从服务器接收的屏幕共享数据。
图7是本申请实施例提供的一种共享发起端显示的屏幕共享界面示意图，如图7所述，在成功进入屏幕共享界面并接收服务器发送的屏幕共享数据后，在屏幕共享界面中同步解析并播放屏幕共享数据(图7中的中F)，同时，在屏幕共享界面中提供中显示各个共享发起端和共享接收端对应的用户头像(图7中的A3)。并且在屏幕共享界面中显示房间退出按钮(图7中的G)。
图8是申请实施例提供的一种共享接收端显示的聊天列表示意图，如图8所示，在点击图4中提供的房间退出按钮(图7中的G)后，共享接收端的显示画面由屏幕共享界面切换到聊天列表的显示界面中，同时在共享接收端中添加显示屏幕共享窗口(图8中的H)，在屏幕共享窗口中实时播放显示从服务器接收的屏幕共享数据。
S304：响应于对所述屏幕共享窗口的选择操作，关闭所述屏幕共享窗口并返回通话房间界面
具体的，共享接收端实时检测屏幕共享窗口是否被点击，并在检测到屏幕共享窗口被点击后，确定发送对屏幕共享窗口的选择操作，并关闭该屏幕共享窗口并返回语音视频通话房间并显示屏幕共享界面。
上述，通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情况，有效优化用户体验。同时，可通过房间退出操作实现快速退出屏幕共享界面，并可通过共享提示按钮快速返回通话房间界面，方便用户操作。
图9是本申请实施例提供的应用于服务器的一种基于通话的屏幕共享装置的流程图。如图9所示，该基于通话的屏幕共享装置包括投屏响应模块41、数据整合模块42和数据推送模块43。
其中，所述投屏响应模块41，用于响应于多个共享发起端发出的投屏请求，基于通话视频传输通道分别接收多个所述共享发起端上传的屏幕采集数据，所述屏幕采集数据由所述共享发起端通过视频采集工具对屏幕画面进行采集得到；所述数据整合模块42，用于对多个所述屏幕采集数据进行整合得到屏幕共享数据，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面；所述数据推送模块43，用于确定所述投屏请求对应的共享接收端，并基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示。
上述，通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情 况，有效优化用户体验。
图10是本申请实施例提供的应用于共享发起端的一种基于通话的屏幕共享装置的流程图。如图10所示，该基于通话的屏幕共享装置包括投屏请求模块51、屏幕采集模块52和数据上传模块53。
其中，所述投屏请求模块51，用于响应于投屏选择操作进入屏幕采集界面，并向服务器发出投屏请求；所述屏幕采集模块52，用于响应于所述服务器返回的投屏响应信息，通过视频采集工具对屏幕画面进行采集得到屏幕采集数据；所述数据上传模块53，用于基于通话视频传输通道向所述服务器上传所述屏幕采集数据，由所述服务器对所述共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，以及基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
上述，通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情况，有效优化用户体验。
图11是本申请实施例提供的应用于共享接收端的一种基于通话的屏幕共享装置的流程图。如图11所示，该基于通话的屏幕共享装置包括投屏响应模块61和投屏显示模块62。
其中，所述投屏响应模块61，用于响应于服务器的投屏通知进入屏幕共享界面；所述投屏显示模块62，用于基于通话视频传输通道接收所述服务器发送的屏幕共享数据，并在所述屏幕共享界面中显示所述屏幕共享数据，所述屏幕共享数据由所述服务器对多个所述共享发起端上传的屏幕采集数据进行整合得到，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面，并且所述共享发起端与所述服务器之间基于通话视频传输通道传输屏 幕采集数据。
上述，通过视频采集工具采集各个共享发起端的屏幕画面并生成屏幕采集数据，响应于各个共享发起端发出的投屏请求，服务器基于通话视频传输通道接收各个共享发起端上传的屏幕采集数据，并对这些屏幕采集数据进行整合得到对应多个共享发起端的屏幕画面的屏幕共享数据，并基于通话视频传输通道向共享接收端发送屏幕共享数据，以使共享接收端对屏幕共享数据进行显示，显现多个共享发起端对共享接收端的屏幕画面共享，共享接收端可实时查看共享发起端的屏幕画面，减少需要共享发起端通过截图的方式分享屏幕画面的情况，有效优化用户体验。
本申请实施例还提供了一种基于通话的屏幕共享设备，该基于通话的屏幕共享设备可集成本申请实施例提供的基于通话的屏幕共享装置。图12是本申请实施例提供的一种基于通话的屏幕共享设备的结构示意图。参考图12，该基于通话的屏幕共享设备包括：输入装置73、输出装置74、存储器72以及一个或多个处理器71；所述存储器72，用于存储一个或多个程序；当所述一个或多个程序被所述一个或多个处理器71执行，使得所述一个或多个处理器71实现如上述实施例提供的基于通话的屏幕共享方法。其中输入装置73、输出装置74、存储器72和处理器71可以通过总线或者其他方式连接，图12中以通过总线连接为例。
存储器72作为一种计算设备可读存储介质，可用于存储软件程序、计算机可执行程序以及模块，如本申请任意实施例所述的基于通话的屏幕共享方法对应的程序指令/模块(例如，基于通话的屏幕共享装置中的投屏响应模块41、数据整合模块42和数据推送模块43或投屏请求模块51、屏幕采集模块52和数据上传模块53或投屏响应模块61和投屏显示模块62)。输入装置73可用于接收输入的数字或字符信息，以及产生与设备的用户设置以及功能控制有关的键信号输入。输出装置74可包括显示屏等显示设备。
处理器71通过运行存储在存储器72中的软件程序、指令以及模块，从而执行设备的各种功能应用以及数据处理，即实现上述的基于通话的屏幕共享方法。
上述提供的基于通话的屏幕共享装置、设备和计算机可用于执行上述任意实施例提供的基于通话的屏幕共享方法，具备相应的功能和有益效果。
本申请实施例还提供一种应用于服务器的包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如上述实施例提供的基于通话的屏幕共享方法，该基于通话的屏幕共享方法包括：响应于多个共享发起端发出的投屏请求，基于通话视频传输通道分别接收多个所述共享发起端上传的屏幕采集数据，所述屏幕采集数据由所述共享发起端通过视频采集工具对屏幕画面进行采集得到；对多个所述屏幕采集数据进行整合得到屏幕共享数据，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面；确定所述投屏请求对应的共享接收端，并基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示。
本申请实施例还提供一种应用于共享发起端的包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如上述实施例提供的基于通话的屏幕共享方法，该基于通话的屏幕共享方法包括：响应于投屏选择操作进入屏幕采集界面，并向服务器发出投屏请求；响应于所述服务器返回的投屏响应信息，通过视频采集工具对屏幕画面进行采集得到屏幕采集数据；基于通话视频传输通道向所述服务器上传所述屏幕采集数据，由所述服务器对所述共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，以及基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
本申请实施例还提供一种应用于共享接收端的包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如上述实施例提供的基于通话的屏幕共享方法，该基于通话的屏幕共享方法包括：响应于服务器的投屏通知进入屏幕共享界面；基于通话视频传输通道接收所述服务器发送的屏幕共享数据，并在所述屏幕共享界面中显示所述屏幕共享数据，所述屏幕共享数据由所述服务器对多个所述共享发起端上传的屏幕采集数据进行整合得到，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面，并且所述共享发起端与所述服务器之间基于通话视频传输通道传输屏幕采集数据。
存储介质——任何的各种类型的存储器设备或存储设备。术语“存储介质” 旨在包括：安装介质，例如CD-ROM、软盘或磁带装置；计算机系统存储器或随机存取存储器，诸如DRAM、DDR RAM、SRAM、EDO RAM，兰巴斯(Rambus)RAM等；非易失性存储器，诸如闪存、磁介质(例如硬盘或光存储)；寄存器或其它相似类型的存储器元件等。存储介质可以还包括其它类型的存储器或其组合。另外，存储介质可以位于程序在其中被执行的第一计算机系统中，或者可以位于不同的第二计算机系统中，第二计算机系统通过网络(诸如因特网)连接到第一计算机系统。第二计算机系统可以提供程序指令给第一计算机用于执行。术语“存储介质”可以包括可以驻留在不同位置中(例如在通过网络连接的不同计算机系统中)的两个或更多存储介质。存储介质可以存储可由一个或多个处理器执行的程序指令(例如具体实现为计算机程序)。
当然，本申请实施例所提供的一种包含计算机可执行指令的存储介质，其计算机可执行指令不限于如上所述的基于通话的屏幕共享方法，还可以执行本申请任意实施例所提供的基于通话的屏幕共享方法中的相关操作。
上述实施例中提供的基于通话的屏幕共享装置、设备及存储介质可执行本申请任意实施例所提供的基于通话的屏幕共享方法，未在上述实施例中详尽描述的技术细节，可参见本申请任意实施例所提供的基于通话的屏幕共享方法。
上述仅为本申请的较佳实施例及所运用的技术原理。本申请不限于这里所述的特定实施例，对本领域技术人员来说能够进行的各种明显变化、重新调整及替代均不会脱离本申请的保护范围。因此，虽然通过以上实施例对本申请进行了较为详细的说明，但是本申请不仅仅限于以上实施例，在不脱离本申请构思的情况下，还可以包括更多其他等效实施例，而本申请的范围由权利要求的范围决定。

Claims (12)

  1. 一种基于通话的屏幕共享方法，应用于服务器，其特征在于，包括：
    响应于多个共享发起端发出的投屏请求，基于通话视频传输通道分别接收多个所述共享发起端上传的屏幕采集数据，所述屏幕采集数据由所述共享发起端通过视频采集工具对屏幕画面进行采集得到；
    对多个所述屏幕采集数据进行整合得到屏幕共享数据，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面；
    确定所述投屏请求对应的共享接收端，并基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示。
  2. 根据权利要求1所述的基于通话的屏幕共享方法，其特征在于，所述对多个所述屏幕采集数据进行整合得到屏幕共享数据，包括：
    根据多个所述屏幕采集数据对应的时间戳对多个所述屏幕共享数据进行同步处理；
    对同步处理后的多个所述屏幕共享数据进行整合得到屏幕共享数据。
  3. 一种基于通话的屏幕共享方法，应用于共享发起端，其特征在于，包括：
    响应于投屏选择操作进入屏幕采集界面，并向服务器发出投屏请求；
    响应于所述服务器返回的投屏响应信息，通过视频采集工具对屏幕画面进行采集得到屏幕采集数据；
    基于通话视频传输通道向所述服务器上传所述屏幕采集数据，由所述服务器对所述共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，以及基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
  4. 根据权利要求3所述的基于通话的屏幕共享方法，其特征在于，所述通过视频采集工具对屏幕画面进行采集得到屏幕采集数据，包括：
    基于共享范围选择操作确定对屏幕画面的采集范围；
    通过视频采集工具，基于所述采集范围对屏幕画面进行采集得到屏幕采集数据。
  5. 根据权利要求3所述的基于通话的屏幕共享方法，其特征在于，所述通过视频采集工具对屏幕画面进行采集得到屏幕采集数据之后，还包括：
    响应于房间最小化操作，退出屏幕采集界面并显示共享提示按钮；
    响应于对所述共享提示按钮的选择操作，关闭所述共享提示按钮并返回通话房间界面。
  6. 一种基于通话的屏幕共享方法，应用于共享接收端，其特征在于，包括：
    响应于服务器的投屏通知进入屏幕共享界面；
    基于通话视频传输通道接收所述服务器发送的屏幕共享数据，并在所述屏幕共享界面中显示所述屏幕共享数据，所述屏幕共享数据由所述服务器对多个所述共享发起端上传的屏幕采集数据进行整合得到，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面，并且所述共享发起端与所述服务器之间基于通话视频传输通道传输屏幕采集数据。
  7. 根据权利要求6所述的基于通话的屏幕共享方法，其特征在于，所述在通话房间界面显示屏幕共享界面之后，还包括：
    响应于房间退出操作，退出通话房间界面并显示屏幕共享窗口，并在所述屏幕共享窗口中显示所述屏幕共享数据；
    响应于对所述屏幕共享窗口的选择操作，关闭所述屏幕共享窗口并返回通话房间界面。
  8. 一种基于通话的屏幕共享装置，应用于服务器，其特征在于，包括投屏响应模块、数据整合模块和数据推送模块，其中：
    所述投屏响应模块，用于响应于多个共享发起端发出的投屏请求，基于通话视频传输通道分别接收多个所述共享发起端上传的屏幕采集数据，所述屏幕采集数据由所述共享发起端通过视频采集工具对屏幕画面进行采集得到；
    所述数据整合模块，用于对多个所述屏幕采集数据进行整合得到屏幕共享数据，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面；
    所述数据推送模块，用于确定所述投屏请求对应的共享接收端，并基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示。
  9. 一种基于通话的屏幕共享装置，应用于共享发起端，其特征在于，包括投屏请求模块、屏幕采集模块和数据上传模块，其中：
    所述投屏请求模块，用于响应于投屏选择操作进入屏幕采集界面，并向服务器发出投屏请求；
    所述屏幕采集模块，用于响应于所述服务器返回的投屏响应信息，通过视 频采集工具对屏幕画面进行采集得到屏幕采集数据；
    所述数据上传模块，用于基于通话视频传输通道向所述服务器上传所述屏幕采集数据，由所述服务器对所述共享发起端发出的屏幕共享数据进行整合得到屏幕共享数据，以及基于通话视频传输通道向所述共享接收端发送所述屏幕共享数据，以供所述共享接收端对所述屏幕共享数据进行显示，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面。
  10. 一种基于通话的屏幕共享装置，应用于共享接收端，其特征在于，包括投屏响应模块和投屏显示模块，其中：
    所述投屏响应模块，用于响应于服务器的投屏通知进入屏幕共享界面；
    所述投屏显示模块，用于基于通话视频传输通道接收所述服务器发送的屏幕共享数据，并在所述屏幕共享界面中显示所述屏幕共享数据，所述屏幕共享数据由所述服务器对多个所述共享发起端上传的屏幕采集数据进行整合得到，所述屏幕共享数据对应的显示画面包含有多个所述屏幕采集数据对应的显示画面，并且所述共享发起端与所述服务器之间基于通话视频传输通道传输屏幕采集数据。
  11. 一种基于通话的屏幕共享设备，其特征在于，包括：存储器以及一个或多个处理器；
    所述存储器，用于存储一个或多个程序；
    当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-7任一所述的基于通话的屏幕共享方法。
  12. 一种包含计算机可执行指令的存储介质，其特征在于，所述计算机可执行指令在由计算机处理器执行时用于执行如权利要求1-7任一所述的基于通话的屏幕共享方法。
PCT/CN2021/132808 2020-12-23 2021-11-24 一种基于通话的屏幕共享方法、装置、设备及存储介质 WO2022135005A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011535310.5A CN112702557A (zh) 2020-12-23 2020-12-23 一种基于通话的屏幕共享方法、装置、设备及存储介质
CN202011535310.5 2020-12-23

Publications (1)

Publication Number Publication Date
WO2022135005A1 true WO2022135005A1 (zh) 2022-06-30

Family

ID=75510959

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/132808 WO2022135005A1 (zh) 2020-12-23 2021-11-24 一种基于通话的屏幕共享方法、装置、设备及存储介质

Country Status (2)

Country Link
CN (1) CN112702557A (zh)
WO (1) WO2022135005A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125352A (zh) * 2020-08-29 2022-03-01 华为技术有限公司 屏幕共享方法、电子设备及系统
CN112702557A (zh) * 2020-12-23 2021-04-23 百果园技术(新加坡)有限公司 一种基于通话的屏幕共享方法、装置、设备及存储介质
CN115484430A (zh) * 2021-05-31 2022-12-16 华为技术有限公司 共享屏幕的方法、相关电子设备及系统
CN118098224A (zh) * 2022-11-25 2024-05-28 华为技术有限公司 屏幕共享控制方法、装置、设备、介质以及程序产品
CN116347145B (zh) * 2023-03-27 2023-10-31 广州南翼信息科技有限公司 多设备屏幕共享方法、投屏装置、显示装置及共享系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法
JP2016212752A (ja) * 2015-04-29 2016-12-15 株式会社オプティム 画面共有サーバ、画面共有方法及び画面共有プログラム
CN111880695A (zh) * 2020-08-03 2020-11-03 腾讯科技（深圳）有限公司 一种屏幕共享方法、装置、设备及存储介质
CN112099750A (zh) * 2020-09-24 2020-12-18 Oppo广东移动通信有限公司 一种屏幕共享方法、终端、计算机存储介质以及系统
CN112702557A (zh) * 2020-12-23 2021-04-23 百果园技术(新加坡)有限公司 一种基于通话的屏幕共享方法、装置、设备及存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8473851B2 (en) * 2008-02-27 2013-06-25 Cisco Technology, Inc. Multi-party virtual desktop
JP5197351B2 (ja) * 2008-12-26 2013-05-15 三菱電機株式会社 情報処理装置及び情報処理方法及びプログラム
CN102883134B (zh) * 2012-11-01 2015-04-22 成都飞视美视频技术有限公司 用于视频会议系统的屏幕共享及控制方法
CN104284234B (zh) * 2014-10-17 2017-12-12 惠州Tcl移动通信有限公司 多个终端间共享同步图像的方法及系统
CN109542378A (zh) * 2018-11-19 2019-03-29 上海闻泰信息技术有限公司 屏幕共享方法、装置、电子设备及可读存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法
JP2016212752A (ja) * 2015-04-29 2016-12-15 株式会社オプティム 画面共有サーバ、画面共有方法及び画面共有プログラム
CN111880695A (zh) * 2020-08-03 2020-11-03 腾讯科技（深圳）有限公司 一种屏幕共享方法、装置、设备及存储介质
CN112099750A (zh) * 2020-09-24 2020-12-18 Oppo广东移动通信有限公司 一种屏幕共享方法、终端、计算机存储介质以及系统
CN112702557A (zh) * 2020-12-23 2021-04-23 百果园技术(新加坡)有限公司 一种基于通话的屏幕共享方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN112702557A (zh) 2021-04-23

Similar Documents

Publication Publication Date Title
WO2022135005A1 (zh) 一种基于通话的屏幕共享方法、装置、设备及存储介质
CN106488335B (zh) 直播控制方法及装置
US8701020B1 (en) Text chat overlay for video chat
US9473741B2 (en) Teleconference system and teleconference terminal
WO2016124101A1 (zh) 一种信息展示方法、装置及系统
JP6626440B2 (ja) マルチメディアファイルを再生するための方法及び装置
WO2017219347A1 (zh) 直播显示方法、装置及系统
WO2017181551A1 (zh) 视频处理方法及装置
WO2017036039A1 (zh) 远程协助方法和客户端
RU2609147C2 (ru) Способ и устройство для передачи изображений
JP2006506927A (ja) テレビ会議及びマルチメディア・プレンゼンテーションのためのシステム、方法およびコンピュータプログラム製品
WO2021147480A1 (zh) 直播辅助方法及电子设备
CN109586929B (zh) 会议内容的传输方法及装置、电子设备、存储介质
JP6385429B2 (ja) ストリーム・メディア・データを再生する方法および装置
WO2018076358A1 (zh) 多媒体信息播放方法及系统、标准化服务器、直播终端
US20220159336A1 (en) Method and system for displaying screen
CN111901695B (zh) 视频内容截取方法、装置和设备及计算机存储介质
CN113225592B (zh) 基于Wi-Fi P2P的投屏方法和装置
US11444992B2 (en) Method and apparatus for communication processing
JP2017501598A5 (zh)
CN111880865A (zh) 多媒体数据推送方法、装置、电子设备及存储介质
JP2018515979A (ja) 通信処理方法及び電子装置
CN113893524A (zh) 云应用处理系统、方法、装置及设备
US9832422B2 (en) Selective recording of high quality media in a videoconference
WO2019096307A1 (zh) 视频播放方法、装置、计算设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21909004

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21909004

Country of ref document: EP

Kind code of ref document: A1