CN111290722A - Screen sharing method, device and system, electronic equipment and storage medium - Google Patents

Screen sharing method, device and system, electronic equipment and storage medium Download PDF

Info

Publication number
CN111290722A
CN111290722A CN202010067501.7A CN202010067501A CN111290722A CN 111290722 A CN111290722 A CN 111290722A CN 202010067501 A CN202010067501 A CN 202010067501A CN 111290722 A CN111290722 A CN 111290722A
Authority
CN
China
Prior art keywords
terminal
display data
data
communication connection
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010067501.7A
Other languages
Chinese (zh)
Inventor
苏浩
季东悦
郝虹阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dami Future Technology Co ltd
Original Assignee
Beijing Dami Future Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dami Future Technology Co ltd filed Critical Beijing Dami Future Technology Co ltd
Priority to CN202010067501.7A priority Critical patent/CN111290722A/en
Publication of CN111290722A publication Critical patent/CN111290722A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/82Protecting input, output or interconnection devices
    • G06F21/84Protecting input, output or interconnection devices output devices, e.g. displays or monitors
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone

Abstract

A screen sharing method, device, system, electronic device and storage medium are disclosed. The method comprises the steps of responding to a connection request of a first terminal or a second terminal through a server, establishing a first communication connection with the first terminal, establishing a second communication connection with the second terminal, obtaining second display data of the second terminal through the second communication connection, determining first display data according to the second display data, and sending the first display data to the first terminal through the first communication connection for display. Therefore, the display data of the second terminal can be transmitted to the first terminal in real time for display, so that users of the first terminal and the second terminal can browse the display data synchronously, and the communication between the users is facilitated.

Description

Screen sharing method, device and system, electronic equipment and storage medium
Technical Field
The invention relates to the technical field of internet, in particular to a screen sharing method, device and system, electronic equipment and a storage medium.
Background
Online education is a learning behavior based on network, and students and teachers develop teaching activities through the network, so that the students can learn at any time and any place by means of network courseware.
In some scenarios, a platform operator (e.g., a lesson advisor or teacher) needs to communicate with a user (e.g., a student or parent), such as: in teaching explanation, post-school summary or course selling links, etc., the existing mode usually adopts telephone communication or instant messaging (such as WeChat, QQ) and other modes. However, the communication in the above manner cannot transmit the content or the explanation data of the explanation to the user in real time, and cannot realize data synchronization between the two parties, so that the user is inconvenient to communicate.
Disclosure of Invention
In view of this, an object of the embodiments of the present invention is to provide a screen sharing method, an apparatus, a system, an electronic device, and a storage medium, which can transmit screen data of a second terminal to a first terminal for displaying in real time, so that users of the first terminal and the second terminal can browse the screen data synchronously, thereby facilitating user communication.
In a first aspect, an embodiment of the present invention provides a screen sharing method, where the method includes:
receiving a connection request from at least one first terminal or at least one second terminal, wherein the connection request comprises identification information of the first terminal and/or the second terminal;
establishing a first communication connection with the first terminal according to the connection request, and establishing a second communication connection with the second terminal;
acquiring second display data of the second terminal through the second communication connection, wherein the second display data are real-time display data of at least one part of a display device of the second terminal;
obtaining first display data according to the second display data; and
and sending the first display data to the first terminal through the first communication connection.
Preferably, obtaining the first display data according to the second display data includes:
identifying sensitive data in the second display data;
performing protection processing on the sensitive data; and
obtaining the first display data based on the second display data after protection processing;
wherein the protection process is to cause all or part of the sensitive data to be displayed or invisible in an obscured state.
Preferably, identifying sensitive data in the second display data comprises:
identifying sensitive data in the second display data based on a first mapping relation and/or a second mapping relation, wherein the first mapping relation is a mapping relation between page address information in the second display data and a sensitive label, and the second mapping relation is a mapping relation between identification information corresponding to each display area in the second display data and the sensitive label; and/or
And identifying the sensitive data in the second display data based on a selection instruction, wherein the selection instruction is an input instruction of the second terminal acquired through the second communication connection.
Preferably, the second display data includes display interface data and/or input operation data.
Preferably, the method further comprises:
receiving second video data from the second terminal through the second communication connection, wherein the second video data is video data recorded by a camera device of the second terminal; and
and sending the second video data to the first terminal through the first communication connection.
Preferably, the method further comprises:
receiving first video data from the first terminal through the first communication connection, wherein the first video data is video data recorded by a camera device of the first terminal; and
and sending the first video data to the second terminal through the second communication connection.
In a second aspect, an embodiment of the present invention provides a screen sharing apparatus, where the apparatus includes:
a receiving unit, configured to receive a connection request from at least one first terminal or at least one second terminal, where the connection request includes identification information of the first terminal and/or the second terminal;
the communication unit is used for establishing a first communication connection with the first terminal according to the connection request and establishing a second communication connection with the second terminal;
a data obtaining unit, configured to obtain second display data of the second terminal through the second communication connection, where the second display data is real-time display data of at least a part of a display device of the second terminal;
the data processing unit is used for obtaining first display data according to the second display data; and
a sending unit, configured to send the first display data to the first terminal through the first communication connection.
In a third aspect, an embodiment of the present invention provides a screen sharing system, where the system includes at least one first terminal, at least one server, and at least one second terminal;
the first terminal or the second terminal is used for sending a connection request to the server;
the server is used for establishing a first communication connection with the first terminal according to the connection request and establishing a second communication connection with the second terminal;
the second terminal responds to the establishment of a second communication connection with the server and sends second display data to the server through the second communication connection, wherein the second display data are real-time display data of at least one part of a display device of the second terminal;
the server is used for obtaining first display data according to the screen data and sending the first display data to the first terminal through the first communication connection.
In a fourth aspect, an embodiment of the present invention provides an electronic device, including a memory and a processor, the memory being configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method according to the first aspect.
In a fifth aspect, embodiments of the present invention provide a computer-readable storage medium on which computer program instructions are stored, which when executed by a processor implement the method according to the first aspect.
According to the technical scheme of the embodiment of the invention, the server responds to the connection request of the first terminal or the second terminal to establish the first communication connection with the first terminal and the second communication connection with the second terminal, the second display data of the second terminal is obtained through the second communication connection, the first display data is determined according to the second display data, and the first display data is sent to the first terminal through the first communication connection for display. Therefore, the display data of the second terminal can be transmitted to the first terminal in real time for display, so that users of the first terminal and the second terminal can browse the display data synchronously, and the communication between the users is facilitated.
Drawings
The above and other objects, features and advantages of the present invention will become more apparent from the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:
FIG. 1 is a diagram of a screen sharing system according to an embodiment of the present invention;
FIG. 2 is a flowchart of a screen sharing method according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating second display data of a second terminal according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating first display data of a first terminal according to an embodiment of the present invention;
FIG. 5 is a flow diagram of input operation data processing according to an embodiment of the present invention;
FIG. 6 is a flow chart of a video call of an embodiment of the present invention;
fig. 7 is a flowchart of a screen sharing method of a server according to an embodiment of the present invention;
FIG. 8 is a flow chart of determining first display data according to an embodiment of the present invention;
FIG. 9 is a diagram illustrating a screen sharing apparatus according to an embodiment of the present invention;
fig. 10 is a schematic diagram of an electronic device of an embodiment of the invention.
Detailed Description
The present invention will be described below based on examples, but the present invention is not limited to only these examples. In the following detailed description of the present invention, certain specific details are set forth. It will be apparent to one skilled in the art that the present invention may be practiced without these specific details. Well-known methods, procedures, components and circuits have not been described in detail so as not to obscure the present invention.
Further, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.
Meanwhile, it should be understood that, in the following description, a "circuit" refers to a conductive loop constituted by at least one element or sub-circuit through electrical or electromagnetic connection. When an element or circuit is referred to as being "connected to" another element or element/circuit is referred to as being "connected between" two nodes, it may be directly coupled or connected to the other element or intervening elements may be present, and the connection between the elements may be physical, logical, or a combination thereof. In contrast, when an element is referred to as being "directly coupled" or "directly connected" to another element, it is intended that there are no intervening elements present.
Unless the context clearly requires otherwise, throughout the description, the words "comprise", "comprising", and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is, what is meant is "including, but not limited to".
In the description of the present invention, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified.
Fig. 1 is a flowchart of a screen sharing system according to an embodiment of the present invention. As shown in fig. 1, the screen sharing system according to the embodiment of the present invention includes at least one first terminal 1, at least one second terminal 2, and at least one server 3. The first terminal 1 or the second terminal 2 is configured to send a connection request to the server 3. The server 3 is configured to establish a first communication connection with the first terminal 1 according to the connection request, and establish a second communication connection with the second terminal 2. The second terminal 2, in response to establishing a second communication connection with the server 3, sends second display data to the server 3 via the second communication connection, the second display data being real-time display data of at least a part of a display device of the second terminal 2. The server 3 is configured to derive first display data from the second display data, and to send the first display data to the first terminal 1 via the first communication connection.
In this embodiment, the at least one first terminal 1 is a terminal that receives display data. Preferably, the first terminal 1 is a terminal used by students or parents. It should be understood that, in the embodiment, the screen sharing system is described by taking two first terminals as an example, but the number of the first terminals 1 is not limited in the embodiment, and the number of the first terminals may be one or multiple.
In this embodiment, the second terminal 2 is a terminal sharing display data. Preferably, the second terminal 2 is a terminal used by a platform operator, for example, a terminal used by a lesson counselor, a salesperson or a lecture teacher. It should be understood that, in the embodiment, the screen sharing system is described by taking an example that the screen sharing system includes one second terminal, but the number of the second terminals is not limited in the embodiment, and the second terminal may be one or multiple.
In this embodiment, the first terminal 1 and the second terminal 2 may be a mobile phone, a tablet computer, a notebook computer, a desktop computer, or other electronic devices with wireless communication functions. The first terminal 1 and the second terminal 2 comprise at least a processor capable of running image data and a display device capable of displaying image data. In this embodiment, the second terminal has a function of sharing display data with other terminals, and the first terminal has at least a display function.
In this embodiment, an example in which one second terminal shares display data with a plurality of first terminals is taken as an example for description, it should be understood that the scheme provided in this embodiment is also applicable to a scenario in which a plurality of second terminals share display data with a plurality of first terminals at the same time, or a scenario in which a plurality of second terminals share display data with one first terminal, or a scenario in which a plurality of second terminals share display data with a plurality of first terminals, and the like.
In this embodiment, the server 3 is configured to transmit data for the first terminal 1 and the second terminal 2. Specifically, the first terminal 1 and the second terminal 2 may be connected to the server 3 via a network.
Further, the server 3 may be implemented by an independent server or a server cluster composed of a plurality of servers. In an optional implementation manner, the server 3 includes a front-end server and a back-end server, where the back-end server is configured to obtain second display data of the second terminal 2, and the front-end server is configured to send the first display data to the first terminal 1, so that the first display data is displayed on the first terminal. Preferably, the front-end server and the back-end server establish a connection through a websocket, which is a full duplex communication Protocol based on TCP (transmission control Protocol).
Further, the screen sharing method according to the embodiment of the present invention can refer to fig. 2, and includes the following steps:
step S201, the first terminal sends a connection request to the server.
In this embodiment, the first terminal 1 sends a connection request to the server 3 to request a connection to be established with the second terminal. Wherein the connection request comprises identification information of the second terminal 2.
In an alternative implementation, the first terminal 1 may send the connection request by scanning a two-dimensional code of the second terminal 2. Specifically, when the user of the second terminal 2 needs to share the second display data to the first terminal 1, the user of the second terminal 2 inputs an operation command for obtaining the two-dimensional code to obtain the two-dimensional code of the second terminal 2, and optionally, the user may click a predetermined function area on the screen to obtain the two-dimensional code. After obtaining the two-dimensional code, the user of the second terminal 2 may send the two-dimensional code to the user of the first terminal 1 through an instant messaging application (e.g., WeChat, QQ, etc.). The user scans the two-dimensional code of the second terminal 2 through the first terminal 1 to send a connection request to the server 3. Optionally, the first terminal 1 scans the two-dimensional code to obtain a scanning result, and directly sends the connection request to the server, or the first terminal 1 scans the two-dimensional code to obtain the scanning result, and requests the user whether to send the connection request, and sends the connection request to the server 3 after receiving the confirmation information of the user.
In another optional implementation manner, the first terminal 1 may input identification information of the second terminal 2 through an operation interface to send the connection request to the server 3, where the identification information of the second terminal 2 may be a user account, a user name, or the like.
It should be understood that the present embodiment may also be that the second terminal 2 sends a connection request to the server 3. Wherein the connection request comprises identification information of at least one first terminal 1.
Step S202, the server establishes communication connection.
In this embodiment, after receiving a connection request of a first terminal 1, a server 3 parses the connection request to obtain identification information of a second terminal 2, establishes a first communication connection with the first terminal 1 according to the identification information, and establishes a second communication connection with the second terminal 2.
Step S203, the server sends a connection establishment notification.
In this embodiment, after establishing the communication connection with the first terminal 1 and the second terminal 2, the server 3 sends a notification of successful establishment of the communication connection to the second terminal 2.
Optionally, after establishing the communication connection with the first terminal 1 and the second terminal 2, the server 3 sends a notification of successful establishment of the communication connection to the first terminal 1.
Step S204, the second terminal 2 sends the second display data.
In this embodiment, after receiving the notification message of successful establishment of communication connection from the server, the second terminal 2 obtains the second display data of the display device in real time, and sends the second display data to the server 3. The second display data is real-time display data of at least one part of a display device of the second terminal.
Further, the second display data includes display interface data, and the display interface data is screen data of a display device of the second terminal.
In an alternative implementation, the second display data sent by the second terminal 2 to the server may be all real-time display data of the display device of the second terminal 2.
In another alternative implementation, the second display data sent by the second terminal 2 to the server may be real-time display data of a portion of the display device of the second terminal 2. Specifically, the real-time display data of the portion of the display device of the second terminal 2 may be a region designated by the user or a predetermined region. When the area is designated by the user, the user can select an area to be transmitted by a frame selection or the like. In the case of a preset area, the area to be transmitted can be selected by setting a domain name of display data or a designated application program in advance.
And S205, the server obtains first display data according to the second display data.
In this embodiment, after receiving the second display data of the second terminal 2, the server 3 pre-processes the second display data to obtain the first display data.
In this embodiment, the server 3 detects sensitive data in the second display data of the second terminal 2, performs protection processing on the sensitive data, and determines the second display data after the protection processing as the first display data. Wherein the protection process is to cause all or part of the sensitive data to be displayed or invisible in an obscured state.
Further, the protection process may be any one or more processes of removing, replacing, blocking, hiding, blurring, mosaic and the like on the sensitive data.
In an optional implementation manner, the server 3 may identify the sensitive data in the second display data of the second terminal based on a first mapping relationship and/or a second mapping relationship, where the first mapping relationship is a mapping relationship between page address information and a sensitive tag in the second display data, and the second mapping relationship is a mapping relationship between identification information corresponding to each display area in the second display data and a sensitive tag. For example, the server 3 may identify sensitive data in the second display data of the second terminal based on the first mapping relationship, and may preset a sensitive tag of each page address information, where the page address information may be a domain name or an IP (Internet Protocol) address. And after receiving the second display data, the server 3 acquires page address information of the second display data, and identifies whether the second display data is sensitive data according to the mapping relation between the page address information and the sensitive label. And responding to the fact that a certain page is sensitive data, and performing protection processing on all or part of data of the page. Therefore, sensitive data can be effectively protected and leakage can be prevented. For another example, the server 3 may identify sensitive data in the second display data of the second terminal based on the second mapping relationship, where one page often includes different functional areas, the page may be divided into multiple display areas according to the different functional areas, and a sensitive tag corresponding to the identification information of each display area in the page is preset. After receiving the second display data, the server 3 obtains the identification information of each display area of the second display data, and detects whether the display area is sensitive data according to the mapping relationship between the identification information and the sensitive label. And responding to that a certain display area is sensitive data, and performing protection processing on all or part of the data of the display area. Therefore, sensitive data can be effectively protected and leakage can be prevented. For another example, the server 3 may further identify sensitive data in the second display data of the second terminal based on the first mapping relationship and the second mapping relationship, and the server 3 may first identify whether the received second display data is a sensitive page through the first mapping relationship, and determine that the second display data does not include the sensitive data in response to that the second display data is not a sensitive page. And in response to that the second display data is a sensitive page, detecting whether each display area in the second display data is sensitive data or not through the second mapping relation, and in response to that a certain display area is sensitive data, performing protection processing on all or part of the data of the display area. Therefore, sensitive data can be effectively protected and leakage can be prevented.
In another alternative implementation, the present embodiment may also specify the sensitive data by the user. Correspondingly, the method of the embodiment of the invention further comprises the following steps:
step S204', the second terminal sends a selection instruction.
In this embodiment, the server 3 may identify the sensitive data in the second display data based on a selection instruction, where the selection instruction is an input instruction of the second terminal acquired through the second communication connection
In this embodiment, the user of the second terminal 2 may select the sensitive data in the second display data by a frame selection or the like to generate a selection instruction, and send the selection instruction to the server 3. And the server 3 carries out protection processing on the corresponding display area according to the selection instruction. Therefore, sensitive data can be effectively protected in a mode designated by a user, and leakage is prevented.
Thus, the server may determine the first display data by pre-processing the second display data.
Step S206, the server sends the first display data.
In this embodiment, the server 3 sends the first display data to the first terminal 1 after obtaining the first display data.
Step S207, the first terminal displays the first display data.
In this embodiment, after receiving the first display data sent by the server 3, the first terminal 1 displays the first display data through the display device.
Specifically, reference may be made to fig. 3 and 4 for the first terminal 1 and the second terminal 2 to share display data. Fig. 3 is a schematic diagram of second display data of the second terminal according to the embodiment of the present invention, and fig. 4 is a schematic diagram of first display data of the first terminal according to the embodiment of the present invention. In the present embodiment, the first terminal 1 is a mobile phone, and the second terminal 2 is a computer, for example, it should be understood that both the first terminal 1 and the second terminal 2 can be implemented by a mobile phone, a tablet computer, a notebook computer, a desktop computer, or other electronic devices with wireless communication functions. As shown in fig. 3, the second display data of the second terminal 2 may be divided into a plurality of regions including a region a1, a region a2, and a region a3, and a control k1, a control k2, and a control k 3. In this embodiment, taking the data in the area a2 as an example for explanation, the first display data received by the first terminal is as shown in fig. 4, and includes an area b1, an area b2, an area b3, a control k1, a control k2, and a control k 3. Since the data of the area a2 is sensitive data, the server 3 performs a protection process on the data in the area a2 so that the data is not visible at the first terminal.
The embodiment of the invention responds to the connection request of the first terminal or the second terminal through the server to establish the first communication connection with the first terminal and establish the second communication connection with the second terminal, obtains the second display data of the second terminal through the second communication connection, determines the first display data according to the second display data, and sends the first display data to the first terminal through the first communication connection for display. Therefore, the display data of the second terminal can be transmitted to the first terminal in real time for display, so that users of the first terminal and the second terminal can browse the display data synchronously, and the communication between the users is facilitated.
Further, the second display data further includes input operation data, which is a mark left by the user of the second terminal 2 when operating the screen. For example, when the user of the second terminal 2 performs operations such as dragging, drawing, and clicking, input operation data is formed on the screen. As shown in fig. 5, the method includes the following steps:
step S501, the second terminal obtains input operation data.
In this embodiment, when the user of the second terminal 2 operates the screen, for example, drag, draw, click, and the like, the second terminal 2 acquires input operation data.
And step S502, the second terminal sends input operation data to the server.
In this embodiment, the second terminal 2 sends input operation data to the server 3 through the second communication connection, the input operation data being used for characterizing an operation input by a user at the second terminal.
Step S503, the server sends the input operation data to the first terminal through the first communication connection, so that the first terminal synchronously displays the operation of the second terminal when displaying the interface data.
And step S504, the first terminal displays the input operation data.
Therefore, the input operation data can be displayed on the first terminal, so that the user of the first terminal can more intuitively see the operation of the user of the second terminal.
Optionally, in order to further facilitate user communication, the method according to the embodiment of the present invention may further provide a video call function for the user, specifically as shown in fig. 6, including the following steps:
step S601, the second terminal acquires the second video data.
In the present embodiment, the second terminal 2 acquires the second video data by the camera.
And step S602, the second terminal sends the second video data.
In this embodiment, after the second video data is recorded by the camera device of the second terminal 2, the second video data is sent to the server through the second communication connection.
Step S603, the server transmits the video data.
In this embodiment, the server 3 transmits the second video data to the first terminal 1 via a first communication connection.
And step S604, displaying by the first terminal.
In this embodiment, after receiving the second video data sent by the server, the first terminal 1 displays the second video data in a predetermined area of the screen.
Alternatively, the user of the first terminal may change the display area and size of the second video data by dragging or the like.
Thereby, the user of the first terminal can acquire the video data of the second terminal.
Optionally, in order to further facilitate user communication, the method according to the embodiment of the present invention further includes:
step S605, the first terminal acquires video data.
In the present embodiment, the first terminal 1 acquires the first video data by the image pickup device.
Step S606, the first terminal sends the first video data.
In this embodiment, after the second video data is recorded by the camera device of the first terminal 1, the first video data is sent to the server through the first communication connection.
Step S607, the server transmits the first video data.
In this embodiment, the server 3 transmits the first video data to the second terminal 2 via a second communication connection.
And step S608, displaying by the second terminal.
In this embodiment, after receiving the first video data sent by the server, the second terminal 2 displays the first video data in a predetermined area of the screen.
Alternatively, the user of the second terminal may change the display area and size of the first video data by dragging or the like.
Thus, the video call between the first terminal and the second terminal can be realized through the steps S601 to S608.
Fig. 7 is a flowchart of a screen sharing method of a server according to an embodiment of the present invention. As shown in fig. 5, the method of the embodiment of the present invention includes the following steps:
step S710, receiving a connection request from at least one first terminal or at least one second terminal.
In this embodiment, the server receives a connection request from at least one first terminal or at least one second terminal, where the connection request includes identification information of the first terminal and/or the second terminal.
Further, the connection request sent by the first terminal is taken as an example for explanation, and the connection request includes the identification information of the second terminal. In an alternative implementation, the first terminal 1 may send the connection request by scanning a two-dimensional code of the second terminal 2. Specifically, when the user of the second terminal 2 needs to share the second display data to the first terminal 1, the user of the second terminal 2 inputs an operation command for obtaining the two-dimensional code to obtain the two-dimensional code of the second terminal 2, and optionally, the user may click a predetermined function area on the screen to obtain the two-dimensional code. After obtaining the two-dimensional code, the user of the second terminal 2 may send the two-dimensional code to the user of the first terminal 1 through an instant messaging application (e.g., WeChat, QQ, etc.). The user scans the two-dimensional code of the second terminal 2 through the first terminal 1 to send a connection request to the server 3. Optionally, the first terminal 1 scans the two-dimensional code to obtain a scanning result, and directly sends the connection request to the server, or the first terminal 1 scans the two-dimensional code to obtain the scanning result, and requests the user whether to send the connection request, and sends the connection request to the server 3 after receiving the confirmation information of the user. In another optional implementation manner, the first terminal 1 may input identification information of the second terminal 2 through an operation interface to send the connection request to the server 3, where the identification information of the second terminal 2 may be a user account, a user name, or the like.
Step S720, establishing a first communication connection with the first terminal according to the connection request, and establishing a second communication connection with the second terminal.
And step 730, acquiring second display data of the second terminal through the second communication connection.
In this embodiment, the second display data is real-time display data of at least a part of a display device of the second terminal. And after receiving the notification information of successful communication connection establishment of the server, the second terminal 2 acquires second display data of the display device in real time and sends the second display data to the server 3. The second display data is real-time display data of at least one part of a display device of the second terminal.
Further, the second display data includes display interface data, and the display interface data is screen data of a display device of the second terminal.
In an alternative implementation, the second display data sent by the second terminal 2 to the server may be all real-time display data of the display device of the second terminal 2.
In another alternative implementation, the second display data sent by the second terminal 2 to the server may be real-time display data of a portion of the display device of the second terminal 2. Specifically, the real-time display data of the portion of the display device of the second terminal 2 may be a region designated by the user or a predetermined region. When the area is designated by the user, the user can select an area to be transmitted by a frame selection or the like. In the case of a preset area, the area to be transmitted may be selected by setting a domain name of the second display data to be presented or a designated application program in advance.
Further, the second display data further includes input operation data, which is a mark left by the user of the second terminal 2 when operating the screen. For example, when the user of the second terminal 2 performs operations such as dragging, drawing, and clicking, input operation data is formed on the screen. The second terminal obtains input operation data, the input operation data are sent to the server 3 through the second communication connection, and the server sends the input operation data to the first terminal through the first communication connection, so that the first terminal synchronously displays the operation of the second terminal when displaying interface data. Therefore, the input operation data can be displayed on the first terminal, so that the user of the first terminal can more intuitively see the operation of the user of the second terminal.
And step S740, obtaining first display data according to the second display data.
Specifically, the server obtains the first display data according to the second display data as shown in fig. 8, and includes the following steps:
and S741, identifying sensitive data in the second display data.
And step S742, performing protection processing on the sensitive data.
Step S743, obtaining the first display data based on the second display data after the protection processing.
In this embodiment, the server 3 detects sensitive data in the second display data of the second terminal 2, performs protection processing on the sensitive data, and determines the second display data after the protection processing as the first display data. Wherein the protection process is to cause all or part of the sensitive data to be displayed or invisible in an obscured state. .
Further, the protection process may be any one or more processes of removing, replacing, blocking, hiding, blurring, mosaic and the like on the sensitive data.
In an optional implementation manner, the server 3 may identify the sensitive data in the second display data of the second terminal based on a first mapping relationship and/or a second mapping relationship, where the first mapping relationship is a mapping relationship between page address information and a sensitive tag in the second display data, and the second mapping relationship is a mapping relationship between identification information corresponding to each display area in the second display data and a sensitive tag. For example, the server 3 may identify sensitive data in the second display data of the second terminal based on the first mapping relationship, and may preset a sensitive tag of each page address information, where the page address information may be a domain name or an IP (Internet Protocol) address. And after receiving the second display data, the server 3 acquires page address information of the second display data, and identifies whether the second display data is sensitive data according to the mapping relation between the page address information and the sensitive label. And responding to the fact that a certain page is sensitive data, and performing protection processing on all or part of data of the page. Therefore, sensitive data can be effectively protected and leakage can be prevented. For another example, the server 3 may identify sensitive data in the second display data of the second terminal based on the second mapping relationship, where one page often includes different functional areas, the page may be divided into multiple display areas according to the different functional areas, and a sensitive tag corresponding to the identification information of each display area in the page is preset. After receiving the second display data, the server 3 obtains the identification information of each display area of the second display data, and detects whether the display area is sensitive data according to the mapping relationship between the identification information and the sensitive label. And responding to that a certain display area is sensitive data, and performing protection processing on all or part of the data of the display area. Therefore, sensitive data can be effectively protected and leakage can be prevented. For another example, the server 3 may further identify sensitive data in the second display data of the second terminal based on the first mapping relationship and the second mapping relationship, and the server 3 may first identify whether the received second display data is a sensitive page through the first mapping relationship, and determine that the second display data does not include the sensitive data in response to that the second display data is not a sensitive page. And in response to that the second display data is a sensitive page, detecting whether each display area in the second display data is sensitive data or not through the second mapping relation, and in response to that a certain display area is sensitive data, performing protection processing on all or part of the data of the display area. Therefore, sensitive data can be effectively protected and leakage can be prevented.
Step S750, sending the first display data to the first terminal through the first communication connection.
In this embodiment, after obtaining the first display data, the server sends the first display data to the first terminal. Therefore, the first terminal can acquire the screen data of the second terminal, and screen sharing is achieved.
Optionally, in order to further facilitate user communication, the method according to the embodiment of the present invention further includes:
and step S760, receiving second video data from the second terminal through the second communication connection, where the second video data is video data recorded by a camera of the second terminal.
Step S770, sending the second video data to the first terminal through the first communication connection.
Step S780, receiving first video data from the first terminal through the first communication connection, where the first video data is video data recorded by a camera of the first terminal.
And step S790, sending the first video data to the second terminal through the second communication connection.
It should be understood that the above steps S760 to S770 and steps S780 to S790 do not limit the execution order. Therefore, the video call between the first terminal and the user of the second terminal can be realized.
The embodiment of the invention responds to the connection request of the first terminal or the second terminal through the server to establish the first communication connection with the first terminal and establish the second communication connection with the second terminal, obtains the second display data of the second terminal through the second communication connection, determines the first display data according to the second display data, and sends the first display data to the first terminal through the first communication connection for display. Therefore, the display data of the second terminal can be transmitted to the first terminal in real time for display, so that users of the first terminal and the second terminal can browse the display data synchronously, and the communication between the users is facilitated.
Fig. 9 is a schematic diagram of a screen sharing device according to an embodiment of the invention. As shown in fig. 9, the screen sharing apparatus according to the embodiment of the present invention includes a receiving unit 91, a communication unit 92, a data obtaining unit 93, a data processing unit 94, and a sending unit 95. The receiving unit 91 is configured to receive a connection request from at least one first terminal or at least one second terminal, where the connection request includes identification information of the first terminal and/or the second terminal. The communication unit 92 is configured to establish a first communication connection with the first terminal according to the connection request, and establish a second communication connection with the second terminal. The data obtaining unit 93 is configured to obtain second display data of the second terminal through the second communication connection, where the second display data is real-time display data of at least a part of a display device of the second terminal. The data processing unit 94 is configured to obtain first display data according to the second display data. The sending unit 95 is configured to send the first display data to the first terminal through the first communication connection.
Preferably, the data processing unit includes:
and the data identification module is used for identifying the sensitive data in the second display data.
The data protection module is used for protecting the sensitive data; and
and the data generation module is used for obtaining the first display data based on the second display data after protection processing.
Wherein the protection process is to cause all or part of the sensitive data to be displayed or invisible in an obscured state.
Preferably, the data identification module is configured to identify the sensitive data in the second display data based on a first mapping relationship and/or a second mapping relationship, where the first mapping relationship is a mapping relationship between page address information in the second display data and the sensitive tag, and the second mapping relationship is a mapping relationship between identification information corresponding to each display area in the second display data and the sensitive tag; and/or identifying the sensitive data in the second display data based on a selection instruction, wherein the selection instruction is an input instruction of the second terminal acquired through the second communication connection.
Preferably, the second display data includes display interface data and/or input operation data.
Preferably, the screen sharing apparatus further includes:
the second video receiving unit is used for receiving second video data from the second terminal through the second communication connection, wherein the second video data are video data recorded by a camera device of the second terminal; and
a second video sending unit, configured to send the second video data to the first terminal through the first communication connection.
Preferably, the screen sharing apparatus further includes:
the first video receiving unit is used for receiving first video data from the first terminal through the first communication connection, wherein the first video data is video data recorded by a camera device of the first terminal; and
and the first video sending unit is used for sending the first video data to the second terminal through the second communication connection.
The embodiment of the invention responds to the connection request of the first terminal or the second terminal through the server to establish the first communication connection with the first terminal and establish the second communication connection with the second terminal, obtains the second display data of the second terminal through the second communication connection, determines the first display data according to the second display data, and sends the first display data to the first terminal through the first communication connection for display. Therefore, the display data of the second terminal can be transmitted to the first terminal in real time for display, so that users of the first terminal and the second terminal can browse the display data synchronously, and the communication between the users is facilitated.
Fig. 10 is a schematic diagram of an electronic device of an embodiment of the invention. The electronic device shown in fig. 10 is a general-purpose data processing apparatus comprising a general-purpose computer hardware structure including at least a processor 101 and a memory 102. The processor 101 and the memory 102 are connected by a bus 103. The memory 102 is adapted to store instructions or programs executable by the processor 101. Processor 101 may be a stand-alone microprocessor or a collection of one or more microprocessors. Thus, the processor 101 implements the processing of data and the control of other devices by executing instructions stored by the memory 102 to perform the method flows of embodiments of the present invention as described above. The bus 103 connects the above-described components together, and also connects the above-described components to a display controller 104 and a display device and an input/output (I/O) device 105. Input/output (I/O) devices 105 may be a mouse, keyboard, modem, network interface, touch input device, motion sensing input device, printer, and other devices known in the art. Typically, the input/output devices 105 are coupled to the system through input/output (I/O) controllers 106.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus (device) or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations of methods, apparatus (devices) and computer program products according to embodiments of the application. It will be understood that each flow in the flow diagrams can be implemented by computer program instructions.
These computer program instructions may be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows.
These computer program instructions may also be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A screen sharing method, the method comprising:
receiving a connection request from at least one first terminal or at least one second terminal, wherein the connection request comprises identification information of the first terminal and/or the second terminal;
establishing a first communication connection with the first terminal according to the connection request, and establishing a second communication connection with the second terminal;
acquiring second display data of the second terminal through the second communication connection, wherein the second display data are real-time display data of at least one part of a display device of the second terminal;
obtaining first display data according to the second display data; and
and sending the first display data to the first terminal through the first communication connection.
2. The method of claim 1, wherein deriving first display data from the second display data comprises:
identifying sensitive data in the second display data;
performing protection processing on the sensitive data; and
obtaining the first display data based on the second display data after protection processing;
wherein the protection process is to cause all or part of the sensitive data to be displayed or invisible in an obscured state.
3. The method of claim 2, wherein identifying sensitive data in the second display data comprises:
identifying sensitive data in the second display data based on a first mapping relation and/or a second mapping relation, wherein the first mapping relation is a mapping relation between page address information in the second display data and a sensitive label, and the second mapping relation is a mapping relation between identification information corresponding to each display area in the second display data and the sensitive label; and/or
And identifying the sensitive data in the second display data based on a selection instruction, wherein the selection instruction is an input instruction of the second terminal acquired through the second communication connection.
4. The method of claim 1, wherein the second display data comprises display interface data and/or input operation data.
5. The method of claim 1, further comprising:
receiving second video data from the second terminal through the second communication connection, wherein the second video data is video data recorded by a camera device of the second terminal; and
and sending the second video data to the first terminal through the first communication connection.
6. The method of claim 1, further comprising:
receiving first video data from the first terminal through the first communication connection, wherein the first video data is video data recorded by a camera device of the first terminal; and
and sending the first video data to the second terminal through the second communication connection.
7. A screen sharing apparatus, the apparatus comprising:
a receiving unit, configured to receive a connection request from at least one first terminal or at least one second terminal, where the connection request includes identification information of the first terminal and/or the second terminal;
the communication unit is used for establishing a first communication connection with the first terminal according to the connection request and establishing a second communication connection with the second terminal;
a data obtaining unit, configured to obtain second display data of the second terminal through the second communication connection, where the second display data is real-time display data of at least a part of a display device of the second terminal;
the data processing unit is used for obtaining first display data according to the second display data; and
a sending unit, configured to send the first display data to the first terminal through the first communication connection.
8. A screen sharing system is characterized by comprising at least one first terminal, at least one server and at least one second terminal;
the first terminal or the second terminal is used for sending a connection request to the server;
the server is used for establishing a first communication connection with the first terminal according to the connection request and establishing a second communication connection with the second terminal;
the second terminal responds to the establishment of a second communication connection with the server and sends second display data to the server through the second communication connection, wherein the second display data are real-time display data of at least one part of a display device of the second terminal;
and the server is used for obtaining first display data according to the second display data and sending the first display data to the first terminal through the first communication connection.
9. An electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method of any of claims 1-6.
10. A computer-readable storage medium on which computer program instructions are stored, which, when executed by a processor, implement the method of any one of claims 1-6.
CN202010067501.7A 2020-01-20 2020-01-20 Screen sharing method, device and system, electronic equipment and storage medium Pending CN111290722A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010067501.7A CN111290722A (en) 2020-01-20 2020-01-20 Screen sharing method, device and system, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010067501.7A CN111290722A (en) 2020-01-20 2020-01-20 Screen sharing method, device and system, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN111290722A true CN111290722A (en) 2020-06-16

Family

ID=71023455

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010067501.7A Pending CN111290722A (en) 2020-01-20 2020-01-20 Screen sharing method, device and system, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111290722A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113190206A (en) * 2021-07-02 2021-07-30 南京云联数科科技有限公司 Method for displaying medicine information on same screen, computing equipment and computer storage medium
CN113297513A (en) * 2021-07-28 2021-08-24 北京健康之家科技有限公司 Sensitive information coding method and device based on cloud mobile phone and storage medium
CN113890945A (en) * 2021-08-31 2022-01-04 江苏微皓智能科技有限公司 Data sharing method, device and equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470786A (en) * 2007-12-28 2009-07-01 北京帮助在线信息技术有限公司 Apparatus and method used for transparent window intimacy protection of on-line help
CN101539714A (en) * 2009-04-17 2009-09-23 清华大学深圳研究生院 Interactive projector equipment
US20100231548A1 (en) * 2009-03-10 2010-09-16 William Henry Mangione-Smith Touch-sensitive display device and method
CN105204748A (en) * 2014-06-27 2015-12-30 阿里巴巴集团控股有限公司 Terminal interaction method and device
CN106656471A (en) * 2016-12-22 2017-05-10 武汉信安珞珈科技有限公司 Method and system for protecting user sensitive information
CN107580105A (en) * 2017-07-26 2018-01-12 努比亚技术有限公司 A kind of screen sharing method, terminal and computer-readable recording medium
US20180300511A1 (en) * 2016-07-21 2018-10-18 Pax Computer Technology (Shenzhen) Co., Ltd. Touch screen security protection structure and display device
CN108933965A (en) * 2017-05-26 2018-12-04 腾讯科技(深圳)有限公司 screen content sharing method, device and storage medium
CN110378145A (en) * 2019-06-10 2019-10-25 华为技术有限公司 A kind of method and electronic equipment of sharing contents

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470786A (en) * 2007-12-28 2009-07-01 北京帮助在线信息技术有限公司 Apparatus and method used for transparent window intimacy protection of on-line help
US20100231548A1 (en) * 2009-03-10 2010-09-16 William Henry Mangione-Smith Touch-sensitive display device and method
CN101539714A (en) * 2009-04-17 2009-09-23 清华大学深圳研究生院 Interactive projector equipment
CN105204748A (en) * 2014-06-27 2015-12-30 阿里巴巴集团控股有限公司 Terminal interaction method and device
US20180300511A1 (en) * 2016-07-21 2018-10-18 Pax Computer Technology (Shenzhen) Co., Ltd. Touch screen security protection structure and display device
CN106656471A (en) * 2016-12-22 2017-05-10 武汉信安珞珈科技有限公司 Method and system for protecting user sensitive information
CN108933965A (en) * 2017-05-26 2018-12-04 腾讯科技(深圳)有限公司 screen content sharing method, device and storage medium
CN107580105A (en) * 2017-07-26 2018-01-12 努比亚技术有限公司 A kind of screen sharing method, terminal and computer-readable recording medium
CN110378145A (en) * 2019-06-10 2019-10-25 华为技术有限公司 A kind of method and electronic equipment of sharing contents

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ICDL基金会 著: "《ICDL 教育信息技术应用》", vol. 1, 北京希望电子出版社, pages: 206 - 207 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113190206A (en) * 2021-07-02 2021-07-30 南京云联数科科技有限公司 Method for displaying medicine information on same screen, computing equipment and computer storage medium
CN113297513A (en) * 2021-07-28 2021-08-24 北京健康之家科技有限公司 Sensitive information coding method and device based on cloud mobile phone and storage medium
CN113890945A (en) * 2021-08-31 2022-01-04 江苏微皓智能科技有限公司 Data sharing method, device and equipment

Similar Documents

Publication Publication Date Title
JP6094550B2 (en) Information processing apparatus and program
US10013408B2 (en) Information processing apparatus, information processing method, and computer readable medium
CN111290722A (en) Screen sharing method, device and system, electronic equipment and storage medium
CN102681870B (en) Automatically action is performed when logging in
KR20150043344A (en) Integrating co-browsing with other forms of information sharing
CN111338721A (en) Online interaction method, system, electronic device and storage medium
US11061641B2 (en) Screen sharing system, and information processing apparatus
JP2021530070A (en) Methods for sharing personal information, devices, terminal equipment and storage media
WO2022156606A1 (en) Information processing method and apparatus, and electronic device
WO2021023085A1 (en) Watermark adding method and apparatus, watermark recognition method and apparatus, and electronic device
CN112215924A (en) Picture comment processing method and device, electronic equipment and storage medium
EP3156895A1 (en) Image processing apparatus and image processing system
JP6286836B2 (en) Projection system, projection apparatus, projection method, and projection program
US10580188B2 (en) Method of creating animated image based on key input, and user terminal for performing the method
US20190266220A1 (en) Information processing apparatus and non-transitory computer readable medium
CN111290721A (en) Online interaction control method, system, electronic device and storage medium
JP5632733B2 (en) Display device, screen image transfer method, and program
CN105204748A (en) Terminal interaction method and device
JP6291989B2 (en) Content display device and control program for content display device
JP6485522B2 (en) Management server, information processing terminal, control method, and program
US8793342B2 (en) Interpreting web application content
WO2021018229A1 (en) Image processing method and apparatus, and electronic device
US11556663B2 (en) Information processing apparatus and non-transitory computer readable medium storing information processing program
WO2018159224A1 (en) Operation assistance device, operation assistance method, and computer-readable recording medium
EP2573665A1 (en) User interface feature generation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination