CN107707972B - Data processing method, device and system for screen sharing and electronic equipment - Google Patents
Data processing method, device and system for screen sharing and electronic equipment Download PDFInfo
- Publication number
- CN107707972B CN107707972B CN201710891590.5A CN201710891590A CN107707972B CN 107707972 B CN107707972 B CN 107707972B CN 201710891590 A CN201710891590 A CN 201710891590A CN 107707972 B CN107707972 B CN 107707972B
- Authority
- CN
- China
- Prior art keywords
- transmission
- sharing
- request
- picture data
- shared picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 239000000725 suspension Substances 0.000 claims abstract description 127
- 230000005540 biological transmission Effects 0.000 claims abstract description 102
- 230000004044 response Effects 0.000 claims abstract description 16
- 238000012544 monitoring process Methods 0.000 claims abstract description 11
- 238000012545 processing Methods 0.000 claims description 38
- 238000000034 method Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 9
- 230000001960 triggered effect Effects 0.000 claims description 8
- 230000000977 initiatory effect Effects 0.000 claims 1
- 238000010926 purge Methods 0.000 claims 1
- 238000004891 communication Methods 0.000 description 29
- 238000010586 diagram Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 239000000835 fiber Substances 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4333—Processing operations in response to a pause request
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application discloses a data processing method, a device and a system for screen sharing and electronic equipment. One embodiment of a data processing method for screen sharing includes: in response to monitoring the sharing suspension request, determining the type of the sharing suspension request; and if the termination request is a playing termination request, sending a transmission termination request of the shared picture data to the opposite terminal equipment, wherein the transmission termination request comprises an indication parameter indicating that the equipment connection is maintained. The embodiment realizes that the playing of the shared picture can be suspended under the condition that the electronic equipment is not actively disconnected, and the opposite terminal equipment is instructed to stop transmitting the shared picture data under the condition that the equipment connection with the electronic equipment is kept. Therefore, when the electronic device restarts to share the screen of the opposite device, the electronic device can directly receive the shared picture data sent by the opposite device, thereby realizing screen sharing quickly and efficiently.
Description
Technical Field
The present application relates generally to the field of computer communication technologies, and in particular, to the field of computer file transmission, and in particular, to a data processing method, apparatus, system, and electronic device for screen sharing.
Background
With the development of mobile communication technology, more and more mobile communication terminals support wireless Direct (Wi-Fi Direct) and wireless video Display (WFD) functions.
Wireless direct refers to allowing devices in a wireless network to connect to each other without going through a router. The wireless video display is a technology for realizing the mutual connection of terminal equipment (including mobile terminal equipment) and realizing the real-time sharing of screen contents based on a wireless direct connection technology.
The screen sharing system in the wireless video display protocol architecture can comprise two types of devices: a sending terminal device (Source terminal) and a receiving terminal device (Sink terminal). The sending end equipment is used for obtaining multimedia data such as audio and video and the like, and sending the multimedia data to the receiving end equipment for displaying after encoding. Common sending end equipment includes a mobile phone, a tablet computer, a notebook computer and the like. The receiving end equipment is used for receiving multimedia data such as audio and video and the like sent by the sending end equipment, decoding the multimedia data and playing the decoded multimedia data.
Therefore, the wireless video display technology can be used for displaying any content such as a user interface, read characters, games, pictures, webpages, videos and the like displayed on the screen of the sending terminal equipment on the screen of the receiving terminal equipment in real time, and screen sharing is realized.
After the screen sharing connection is established between the receiving end device and the sending end device for realizing screen sharing, the receiving end device displays complete information on a screen of the sending end device, and when the receiving end device is temporarily closed and quits a display interface, the connection between the receiving end device and the sending end device needs to be disconnected. The connection needs to be re-established when the information on the screen of the sending end device needs to be displayed again on the receiving end device. Therefore, the speed and the efficiency for realizing screen sharing by the receiving end equipment and the sending end equipment are both lower.
Disclosure of Invention
The present application aims to provide a data processing method, device, system and electronic device for screen sharing, so as to solve the technical problems mentioned in the above background section.
In a first aspect, the present application provides a data processing method for screen sharing, the method comprising: in response to listening to a sharing abort request, determining a type of the sharing abort request; if the sharing suspension request is a playing suspension request, sending a transmission suspension request for suspending transmission of the shared picture data to the opposite terminal equipment, wherein the transmission suspension request comprises an indication parameter for indicating to keep equipment connection
In some embodiments, after sending a transmission suspension request for suspending transmission of shared screen data to the peer device, the method further includes: and sending a transmission starting request for starting transmission of the shared picture data to the opposite terminal equipment.
In some embodiments, the above method further comprises: and if the sharing suspension request is a display suspension request, continuing to receive the shared picture data sent by the opposite terminal equipment, and storing the shared picture data into a preset buffer area.
In some embodiments, after saving the shared picture data to a preset buffer, the method further comprises: and clearing the shared picture data which is stored in the preset buffer area and is not displayed.
In some embodiments, the continuing to receive the shared picture data sent by the peer device includes: and continuously receiving the shared picture data sent by the opposite terminal equipment through the wireless connection established based on the wireless fidelity direct connection protocol.
In some embodiments, the above method further comprises: and responding to the monitoring of the sharing termination request, and sending a transmission termination request for terminating the transmission of the shared picture data to the opposite terminal equipment, wherein the transmission termination request comprises an indication parameter for disconnecting the equipment connection.
In a second aspect, the present application provides a data processing apparatus for screen sharing, the apparatus comprising: the determining unit is configured to respond to the monitoring of the sharing suspension request and determine the type of the sharing suspension request; and the processing unit is configured to send a transmission suspension request for suspending transmission of the shared picture data to the opposite terminal device if the sharing suspension request is a play suspension request, wherein the transmission suspension request comprises an indication parameter indicating that the connection of the device is maintained.
In some embodiments, the apparatus further includes a transmission starting unit configured to send, to the peer device, a transmission start request to start transmission of the shared screen data after the processing unit sends, to the peer device, the transmission stop request to stop transmission of the shared screen data.
In some embodiments, the processing unit is further configured to: and if the sharing suspension request is a display suspension request, continuing to receive the shared picture data sent by the opposite terminal equipment and storing the shared picture data into a preset buffer area.
In some embodiments, the apparatus further includes a clearing unit configured to clear the shared picture data that is saved in the preset buffer and is not displayed after the processing unit saves the shared picture data in the preset buffer.
In some embodiments, the processing unit is further configured to: and continuously receiving the shared picture data sent by the opposite terminal equipment through the wireless connection established based on the wireless fidelity direct connection protocol.
In some embodiments, the apparatus further includes a termination unit, where the termination unit is configured to send, to the peer device, a transmission termination request for terminating transmission of the shared screen data in response to monitoring of the sharing termination request, and the transmission termination request includes an indication parameter for disconnecting the device connection.
In a third aspect, the present application provides a data processing system for screen sharing, including an opposite end device and at least one receiving end device, where the at least one receiving end device determines a type of a sharing suspension request in response to receiving the sharing suspension request, and sends a transmission suspension request for suspending transmission of shared picture data to the opposite end device when the type of the sharing suspension request is a play suspension request, where the transmission suspension request includes identity information of the receiving end device and an indication parameter indicating that connection of a device is maintained; and the opposite terminal equipment responds to the received transmission suspension request of the receiving terminal equipment, suspends the sending of the shared picture data to the receiving terminal equipment corresponding to the identity information, and simultaneously keeps the connection with the equipment of the receiving terminal equipment corresponding to the identity information.
In some embodiments, the peer device receives a transmission start request for starting transmission of shared picture data sent by at least one receiving device, where the transmission start request includes identity information of the receiving device; and the opposite terminal equipment sends the shared picture data to the receiving terminal equipment corresponding to the identity information.
In a fourth aspect, the present application provides an electronic device, comprising: one or more processors; a memory for storing one or more programs, which when executed by the one or more processors, cause the one or more processors to execute the data processing method for screen sharing of the first aspect.
In a fifth aspect, the present application provides a computer-readable storage medium on which is stored a computer program that, when executed by a processor, implements the data processing method for screen sharing of the first aspect described above.
According to the data processing method, the device and the system for screen sharing and the electronic equipment, the type of a sharing suspension request is determined in response to the fact that the sharing suspension request is monitored; and if the sharing suspension request is a playing suspension request, sending a transmission suspension request of the shared picture data to the opposite terminal equipment, wherein the transmission suspension request comprises an indication parameter indicating that the equipment connection is maintained. The method and the device realize that the playing of the shared picture can be suspended under the condition that the electronic equipment is not actively disconnected, and the opposite terminal equipment is instructed to stop transmitting the shared picture data under the premise of keeping the equipment connection with the electronic equipment. Therefore, when the electronic device restarts to share the screen of the opposite device, the electronic device can directly receive the shared picture data sent by the opposite device, thereby realizing screen sharing quickly and efficiently.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 shows a schematic flow chart diagram of one embodiment of a data processing method for screen sharing according to the present application;
FIG. 2 shows a schematic flow chart diagram of another embodiment of a data processing method for screen sharing according to the present application;
FIG. 3 shows the data processing in the pre-defined buffer;
FIG. 4 is a schematic diagram illustrating a data processing method for screen sharing according to an embodiment of the present application;
FIG. 5 is a diagram showing an exemplary structure of a data processing apparatus for screen sharing according to an embodiment of the present application;
fig. 6 illustrates an exemplary system architecture to which an embodiment of a data processing method for screen sharing or a data processing apparatus for screen sharing of the present application is applied;
FIG. 7 is a block diagram of a computer system suitable for use in implementing the electronic device of an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
Referring to FIG. 1, a flow 100 of one embodiment of a data processing method for screen sharing according to the present application is shown. The data processing method for screen sharing comprises the following steps:
In this embodiment, the electronic device on which the data processing method for screen sharing is executed may establish a communication connection with the peer device in advance in a wired manner or a wireless manner. The communication connection between the electronic device and the peer device may be a point-to-point connection that does not require routing. In some optional implementations, the communication connection between the electronic device and the terminal device may be a wireless direct connection established based on a wireless fidelity protocol, point to point, without routing.
In this embodiment, the electronic device may be a receiving end device shared by screens; the peer device may be a sending end device shared by screens.
The electronic device can receive the shared picture data sent by the opposite terminal device through the communication connection, so that the picture displayed on the screen of the opposite terminal device can be displayed on the screen of the electronic device. In this embodiment, the display screen of the peer device may be a screen presented by the current peer device, including but not limited to text, a game interface, a picture, a web page, a video, and so on.
The electronic device can receive the shared picture data sent by the opposite terminal device in real time through the wireless connection pre-established with the opposite terminal device to share and display the picture displayed by the screen of the opposite terminal device. In this embodiment, the data transmission between the electronic device and the peer device may be data transmission implemented based on a Socket (Socket) technology. Socket technology is a widely used communication technology and will not be described in detail here. In an implementation, a data receiving thread may be created in the electronic device to receive the shared screen data sent by the peer device through the communication connection.
In some optional implementation manners of this embodiment, the electronic device may also monitor an external event while sharing the display picture of the screen of the peer device. Specifically, the electronic device may listen to an external event and determine the type of the external request according to the external event. For example, in some application scenarios, the external event may include a click operation on a close button of the display window, and in these application scenarios, the electronic device may determine, according to the click operation event and the touch position, that the external request corresponding to the external event is a request for closing the current display window.
In this embodiment, the sharing suspension request may be a playing suspension request. The play suspension request may be a request to the electronic device triggered by an external event. The playing suspension request may include an instruction for requesting the electronic device to temporarily stop playing the current screen data and release a thread of the electronic device playing the screen data. In the electronic device, a sharing suspension event list corresponding to the playback suspension request may be set in advance. A plurality of externally triggered events may be included in the sharing abort event list. The sharing suspension event may be, for example, a suspension event triggered by an operation of a user clicking a pause button displayed on the screen of the electronic device when the screen of the peer device is shared with the electronic device.
When the electronic device determines that the sharing suspension request is a playing suspension request, the electronic device may send a transmission suspension request to the peer device. The transmission suspension request is used for requesting the opposite terminal device to stop transmitting the shared picture data. Meanwhile, the electronic device can release a data receiving thread for receiving the shared picture data of the opposite terminal device.
In addition, the transmission suspension request may further include an indication parameter indicating whether to indicate that the device connection is maintained. Thus, whether the opposite device keeps the device connection with the electronic device can be required through the indication parameter. In this embodiment, the transmission suspension request may include an indication parameter for indicating to maintain the device connection, so as to request the peer device to maintain the device connection of the electronic device.
In some optional implementation manners of this embodiment, after sending the transmission suspension request of the shared screen data to the peer device, the electronic device may further send a transmission start request of the shared screen data to the peer device in response to a restart operation of the user on screen sharing of the peer device. And the electronic device can create a new data receiving thread to receive the current shared picture data sent by the opposite device. The restart operation of the user for screen sharing of the peer device may be, for example, a selection operation of the peer device by the user in a device list that can implement screen sharing with the electronic device according to the identity information of the peer device or the user information corresponding to the peer device. The device list may display identity information of each device that can be screen-shared with the electronic device or user information of each device that can be screen-shared with the electronic device. The request for starting transmission of the shared screen data may include an instruction parameter instructing the peer device to transmit the shared screen data to the electronic device.
In the processing method for screen sharing provided in this embodiment, after monitoring the sharing suspension request, if it is determined that the sharing suspension request is the play suspension request, the electronic device sends a transmission suspension request for suspending transmission of shared screen data to the peer device, where the transmission suspension request includes an indication parameter indicating that the device connection is maintained. The method and the device realize that the playing of the shared picture can be suspended under the condition that the electronic equipment is not actively disconnected, and the opposite terminal equipment is instructed to stop transmitting the shared picture data under the premise of keeping the equipment connection with the electronic equipment. Therefore, when the electronic device restarts to share the screen of the opposite device, the electronic device can directly receive the shared picture data sent by the opposite device, thereby realizing screen sharing quickly and efficiently.
Continuing to refer to FIG. 2, a flow 200 of another embodiment of a data processing method for screen sharing according to the present application is shown. The data processing method for screen sharing comprises the following steps:
In this embodiment, the sharing suspension request may be a display suspension request. The display suspension request may be a request to the electronic device, triggered by an external event. The display suspension request may include an instruction requesting the electronic device to temporarily stop displaying the shared screen data on its screen, while maintaining a thread in the electronic device that receives the screen data transmitted by the peer device. In the electronic device, a sharing suspension event list corresponding to the display suspension request may be preset. A plurality of externally triggered sharing abort events may be included in the sharing abort event list. The sharing suspension event corresponding to the display suspension request may be, for example, an external incoming call event when the screen of the peer device is shared by the electronic devices; and the event corresponding to the screen switching operation when the user shares the picture data of the opposite terminal equipment, and the like.
The electronic device may determine the type of the sharing suspension request according to the monitored external event.
Step 202 may be the same as step 102 in the embodiment shown in fig. 1, and is not described herein again.
And when the electronic equipment judges that the sharing suspension request is a display suspension request, a data receiving thread in the electronic equipment continuously receives the sharing picture data sent by the opposite terminal equipment through the pre-established communication connection. Alternatively, the communication connection may be a wireless direct connection established based on a wireless fidelity protocol, point-to-point without routing. The electronic equipment stores the received shared picture data of the screen of the opposite terminal equipment in a preset buffer area without displaying the shared picture data.
In some optional implementations of this embodiment, a release thread may be created in the electronic device, and the shared screen data that is stored in the preset buffer and is not displayed by the electronic device is cleared by the release thread until the suspension event is ended. After the termination event is ended, the electronic device may continue to display the shared picture data of the current screen of the peer device on the screen of the electronic device.
Referring to fig. 3, a data processing method 300 in a predetermined buffer is shown. As shown in fig. 3, the preset buffer 301 is disposed in the electronic device. The opposite terminal device can send the shared picture data a to be displayed on the screen to the electronic device in a wired connection mode or a wireless connection mode. After the electronic device receives the shared screen data a, the electronic device monitors the display suspension request before displaying the shared screen data. The electronic device may save the shared screen data a in the preset buffer 301. And meanwhile, the opposite terminal equipment still continues to send the shared picture data B and the shared picture data C to the electronic equipment. After receiving the shared picture data B and the shared picture data C, the electronic device still stores the shared picture data B and the shared picture data C in the preset buffer 301. If other events processed by the electronic device after the display suspension request are completed when the opposite device displays the frame B, the electronic device may extract the shared frame data B from the preset buffer and display the shared frame data B on the screen. In addition, the electronic device may use the release thread to clear the shared screen data a stored in the preset buffer 301 and not displayed by the electronic device.
In some optional implementation manners of this embodiment, the electronic device may receive, through a wireless connection established based on a wifi direct connection protocol, shared picture data sent by an opposite-end device.
In an embodiment, when the electronic device shares the picture data of the screen of the peer device, and receives a display suspension request, the electronic device may continue to receive the shared picture data sent by the peer device. And the electronic equipment stores the shared picture data in a preset buffer area without displaying. And when other events processed by the electronic equipment are completed after the sharing suspension request, the electronic equipment continuously plays the sharing picture data of the screen of the opposite terminal equipment received in real time. In this way, when receiving the display suspension request, the opposite-end device does not stop transmitting the shared screen data to the electronic device, but the electronic device locally sets a buffer area for processing the shared screen data transmitted by the opposite-end device. Therefore, when the electronic equipment restarts sharing the shared picture data of the screen of the opposite terminal equipment, the shared picture data of the opposite terminal equipment received in real time can be displayed through the communication connection established before. The communication connection between the electronic equipment and the opposite terminal equipment does not need to be reestablished, the electronic equipment does not need to reestablish a data receiving thread, and an instruction for starting transmission of the shared picture data does not need to be sent to the opposite terminal equipment. Therefore, the screen sharing between the electronic equipment and the opposite terminal equipment can be realized more quickly and efficiently.
In some optional implementations of this embodiment, the external event may be a sharing termination event. The termination event may be, for example, a sharing termination event triggered by an operation of clicking a termination screen to share a corresponding button by a user. The electronic device may determine the sharing termination request according to the sharing termination event, and send a transmission termination request for terminating transmission of the shared screen data to the peer device. The transmission termination request includes an indication parameter for disconnecting the device.
Continuing to refer to fig. 4, a schematic diagram 400 of a data processing method for screen sharing provided by an embodiment of the present application is shown.
As shown in fig. 4, after a communication connection between the peer device 401 and the electronic device 402 is performed once, a control layer and a data layer of the communication connection can be created. Specifically, a control layer and a data layer are created in both the peer device 401 and the electronic device 402. The control layer and the data layer may each be implemented by a block including a plurality of instructions.
When the electronic device 402 establishes a communication connection with the peer device 401, the communication connection may be established between a control layer disposed in the electronic device 402 and a control layer disposed in the peer device 401. The control layer in the electronic device 402 may send an instruction to maintain the communication connection or disconnect the communication connection to the control layer of the peer device 401. Furthermore, the electronic device 402 may also send an instruction to the peer device through the control layer to stop transmitting the shared screen data through the data layer and to start transmitting the shared screen data through the data layer. When the electronic device 402 monitors the play suspension request, the electronic device 402 may carry an indication parameter indicating that the communication connection is maintained when sending an instruction to the peer device 401 to stop transmitting the picture data through the data layer. Thus, the peer device 401 stops transmitting the shared screen data to the electronic device 402; while the control layer of the peer device 401 maintains a communication connection with the control layer of the electronic device 402. When the electronic device 402 monitors the request for terminating the sharing, the electronic device 402 may carry an instruction parameter indicating to disconnect the communication connection when sending an instruction to stop transmitting the picture data through the data layer to the peer device 401. In this way, the peer device 401 stops transmitting the shared screen data to the data layer of the electronic device 402 through the data layer; meanwhile, the control layer of the peer device 401 disconnects the communication connection with the control layer of the electronic device 402.
Further, a preset buffer may be provided in the electronic device 402 described above. When the electronic device 402 monitors the display stop request, the currently received shared screen data is saved in the preset buffer. After the display stop request is finished, the electronic device 402 may extract the shared screen data being displayed by the peer device 401 from the preset buffer. In addition, the electronic device 402 can also compensate the shared screen data stored in the preset buffer area before the currently displayed shared screen data.
With further reference to fig. 5, an exemplary block diagram of a data processing apparatus for screen sharing according to an embodiment of the present application is shown.
As shown in fig. 5, a data processing apparatus 500 for screen sharing includes: a determining unit 501, configured to determine, in response to monitoring the sharing suspension request, a type of the sharing suspension request; the processing unit 502 is configured to send a transmission suspension request for suspending transmission of shared screen data to the peer device if the sharing suspension request is a play suspension request, where the transmission suspension request includes an indication parameter indicating that device connection is maintained.
In this embodiment, the specific processes of the determining unit 501 and the processing unit 502 of the data processing apparatus 500 for screen sharing and the technical effects thereof can refer to the related descriptions of step 101 and step 102 in the corresponding embodiment of fig. 1, which are not repeated herein.
In some optional implementations of the present embodiment, the data processing apparatus 500 for screen sharing further includes a transmission starting unit (not shown in the figure). The transmission starting unit is configured to send a transmission starting request for starting transmission of the shared picture data to the opposite-end device after the processing unit sends a transmission stopping request for stopping transmission of the shared picture data to the opposite-end device.
In some optional implementations of this embodiment, the processing unit 502 is further configured to: and if the sharing suspension request is a display suspension request, continuing to receive the shared picture data sent by the opposite terminal equipment and storing the shared picture data into a preset buffer area.
In some optional implementations of the present embodiment, the data processing apparatus for screen sharing further includes a clearing unit (not shown in the figure). The clearing unit is configured to clear the shared picture data which is stored in the preset buffer area and is not displayed after the processing unit stores the shared picture data in the preset buffer area.
In some optional implementations of this embodiment, the processing unit 502 is further configured to: and continuously receiving the shared picture data sent by the opposite terminal equipment through the wireless connection established based on the wireless fidelity direct connection protocol.
In some optional implementations of the present embodiment, the data processing apparatus for screen sharing further includes a termination unit (not shown in the figure). The termination unit is configured to send a transmission termination request for terminating transmission of the shared picture data to the peer device in response to monitoring the sharing termination request, where the transmission termination request includes an indication parameter for disconnecting the device connection.
With continued reference to fig. 6, an exemplary system architecture 600 to which embodiments of the data processing method for screen sharing or the data processing apparatus for screen sharing of the present application may be applied is shown.
As shown in fig. 6, the system architecture 600 may include receiving end devices 601, 602, 603, a wireless network 604 and a peer device 605. Each receiving end device may be an electronic device as mentioned in the embodiments shown in fig. 1 and fig. 2. The data processing method for screen sharing provided by the embodiment of the present application is generally executed by the receiving end devices 601, 602, 603. The data processing means for screen sharing shown in fig. 5 may be included in the sink devices 601, 602, 603.
The receiving end devices 601, 602, and 603 interact with the peer device 605 via the network 604 to receive the shared screen data and the like displayed on the screen sent by the peer device 605. The receiving end devices 601, 602, 603 and the peer device 605 may be mounted with wireless communication modules and the like.
The sink devices 601, 602, 603 may be various electronic devices having a display screen and supporting information input, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like. Peer device 605 may be an electronic device with a display screen and supporting information entry, including but not limited to a smart television, a smart phone, a tablet computer, a laptop portable computer, a desktop computer, and so on.
In this embodiment, the at least one receiving end device 601, 602, 603 determines the type of the sharing suspension request in response to receiving the sharing suspension request. If the type of the sharing suspension request is the play suspension request, the receiving end device sends a transmission suspension request for suspending transmission of the shared picture data to the peer device 605. Wherein the transmission suspension request includes identity information of the receiving end device and an indication parameter indicating to maintain the device connection. In response to receiving the transmission suspension request from the receiving end devices 601, 602, and 603, the peer device 605 suspends sending the shared screen data to the receiving end device corresponding to the identity information according to the identity information, and meanwhile, the peer device 605 maintains a connection with the device of the receiving end device corresponding to the identity information.
In some optional implementations of this embodiment, after stopping sending the shared screen data to at least one of the receiving end devices 601, 602, 603, the peer device 605 may receive, through the network 604, a transmission start request for starting the transmitted shared screen data sent by the receiving end devices 601, 602, 603, where the transmission start request includes the identity information of the receiving end devices 601, 602, 603. The peer device 605 transmits the shared screen data to the receiving end devices 601, 602, and 603 corresponding to the identity information according to the identity information.
It should be understood that the number of receiving end devices 601, 602, 603, networks 604 in fig. 6 is merely illustrative. There may be any number of receiving end devices, networks, as desired for implementation.
Referring now to FIG. 7, shown is a block diagram of a computer system 700 suitable for use in implementing the electronic device of an embodiment of the present application. The server shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 7, the computer system 700 includes a Central Processing Unit (CPU)701, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data necessary for the operation of the system 700 are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
The following components are connected to the I/O interface 705: an input portion 706 including a keyboard, a mouse, and the like; an output section 707 including such components as a Liquid Crystal Display (LCD) and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. A drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read out therefrom is mounted into the storage section 708 as necessary.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711. The computer program, when executed by a Central Processing Unit (CPU)701, performs the above-described functions defined in the method of the present application. It should be noted that the computer readable medium of the present application can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, server, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, server, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, server, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Some of the units or modules described in the embodiments of the present application may be implemented by software or hardware. Some of the units or modules described may also be provided in the processor, and may be described as: a processor includes a determination unit and a processing unit. Where the names of these units or modules do not in some cases constitute a limitation on the units or modules themselves, for example, the determining unit may also be described as a "unit that determines the type of a sharing abort request in response to listening for a sharing abort request".
As another aspect, the present application also provides a computer-readable medium, which may be contained in the apparatus described in the above embodiments; or may be present separately and not assembled into the device. The computer readable medium carries one or more programs which, when executed by the apparatus, cause the apparatus to: in response to monitoring the sharing suspension request, determining the type of the sharing suspension request; and if the sharing suspension request is a playing suspension request, sending a transmission suspension request of the shared picture data to the opposite terminal equipment, wherein the transmission suspension request comprises an indication parameter indicating that the equipment connection is maintained.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention herein disclosed is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the inventive concept. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (14)
1. A data processing method for screen sharing, the method comprising:
in response to listening to a sharing abort request, determining a type of the sharing abort request;
if the sharing suspension request is a playing suspension request, sending a transmission suspension request for suspending transmission of the shared picture data to opposite-end equipment, wherein the transmission suspension request comprises an indication parameter for indicating to keep equipment connection;
and if the sharing suspension request is a display suspension request triggered by a sharing suspension event in a preset sharing suspension event list, continuously receiving the shared picture data sent by the opposite terminal equipment, and storing the shared picture data in a preset buffer area to keep equipment connection.
2. The method according to claim 1, wherein after sending a transmission suspension request for suspending transmission of shared picture data to the peer device, the method further comprises:
and sending a transmission starting request for starting transmission of the shared picture data to the opposite terminal equipment.
3. The method of claim 1, wherein after saving the shared picture data to a preset buffer, the method further comprises:
and clearing the shared picture data which is stored in the preset buffer area and is not displayed.
4. The method according to any one of claims 1 to 3, wherein the continuing to receive the shared picture data sent by the peer device comprises:
and continuously receiving the shared picture data sent by the opposite terminal equipment through the wireless connection established based on the wireless fidelity direct connection protocol.
5. The method of claim 1, further comprising:
and responding to the monitoring of the sharing termination request, and sending a transmission termination request for terminating the transmission of the shared picture data to the opposite terminal equipment, wherein the transmission termination request comprises an indication parameter for disconnecting the equipment connection.
6. A data processing apparatus for screen sharing, the apparatus comprising:
the device comprises a determining unit and a processing unit, wherein the determining unit is used for responding to the monitoring of the sharing suspension request and determining the type of the sharing suspension request;
a processing unit, configured to send a transmission suspension request for suspending transmission of shared picture data to an opposite terminal device if the sharing suspension request is a play suspension request, where the transmission suspension request includes an indication parameter indicating that device connection is maintained; and if the sharing suspension request is a display suspension request triggered by a sharing suspension event in a preset sharing suspension event list, continuously receiving the shared picture data sent by the opposite terminal equipment, and storing the shared picture data into a preset buffer area to keep equipment connection.
7. The apparatus of claim 6, further comprising a transmission initiation unit,
the transmission starting unit is configured to send a transmission starting request for starting transmission of the shared picture data to the opposite terminal device after the processing unit sends a transmission stopping request for stopping transmission of the shared picture data to the opposite terminal device.
8. The apparatus of claim 6, further comprising a purge unit,
the clearing unit is configured to clear the shared picture data which is stored in the preset buffer area and is not displayed after the processing unit stores the shared picture data in the preset buffer area.
9. The apparatus according to one of claims 6 to 8, wherein the processing unit is further configured to:
and continuously receiving the shared picture data sent by the opposite terminal equipment through the wireless connection established based on the wireless fidelity direct connection protocol.
10. The apparatus according to claim 6, characterized in that the apparatus further comprises a termination unit,
the termination unit is configured to send a transmission termination request for terminating transmission of the shared picture data to the peer device in response to monitoring of the sharing termination request, where the transmission termination request includes an indication parameter for disconnecting the device connection.
11. A data processing system for screen sharing, comprising a peer device and at least one sink device for screen sharing, wherein the sink device comprises the data processing apparatus for screen sharing according to any one of claims 6 to 10;
at least one receiving end device responds to a received sharing suspension request, determines the type of the sharing suspension request, and sends a transmission suspension request for suspending transmission of shared picture data to the opposite end device when the type of the sharing suspension request is a playing suspension request, wherein the transmission suspension request comprises identity information of the receiving end device and an indication parameter indicating that device connection is maintained;
and the opposite terminal equipment responds to the received transmission suspension request of the receiving terminal equipment, suspends the sending of the shared picture data to the receiving terminal equipment corresponding to the identity information, and simultaneously keeps the equipment connection with the receiving terminal equipment corresponding to the identity information.
12. The system according to claim 11, wherein the peer device receives a transmission start request for starting transmission of shared picture data sent by at least one of the sink devices, and the transmission start request includes identity information of the sink device;
and the opposite terminal equipment sends the shared picture data to the receiving terminal equipment corresponding to the identity information.
13. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method recited in any of claims 1-5.
14. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710891590.5A CN107707972B (en) | 2017-09-27 | 2017-09-27 | Data processing method, device and system for screen sharing and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710891590.5A CN107707972B (en) | 2017-09-27 | 2017-09-27 | Data processing method, device and system for screen sharing and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107707972A CN107707972A (en) | 2018-02-16 |
| CN107707972B true CN107707972B (en) | 2020-12-25 |
Family
ID=61174452
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710891590.5A Active CN107707972B (en) | 2017-09-27 | 2017-09-27 | Data processing method, device and system for screen sharing and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107707972B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108664229B (en) * | 2018-04-02 | 2020-10-02 | 广州视源电子科技股份有限公司 | Screen transmission method and device, electronic equipment and computer readable storage medium |
| CN110909382B (en) * | 2019-11-14 | 2022-11-04 | 北京字节跳动网络技术有限公司 | Data security control method and device, electronic equipment and computer readable medium |
| CN110989950A (en) * | 2019-11-15 | 2020-04-10 | 维沃移动通信有限公司 | Sharing control method and electronic equipment |
| CN111415636B (en) * | 2020-03-31 | 2022-03-11 | 惠州华阳通用电子有限公司 | Picture sharing system and implementation method thereof |
| CN111581319B (en) * | 2020-05-09 | 2023-06-09 | 四川易利数字城市科技有限公司 | GIS application multi-screen interaction method based on WebSocket technology |
| CN117880577A (en) * | 2021-06-22 | 2024-04-12 | 荣耀终端有限公司 | Screen mirroring method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103155692A (en) * | 2010-08-13 | 2013-06-12 | Lg电子株式会社 | Mobile/portable terminal, device for displaying and method for controlling same |
| CN104184834A (en) * | 2014-09-11 | 2014-12-03 | 东莞宇龙通信科技有限公司 | File transmission method and device and terminal |
| KR20150025584A (en) * | 2013-08-29 | 2015-03-11 | 삼성전자주식회사 | Method for screen sharing and an electronic device |
| CN105791965A (en) * | 2014-12-24 | 2016-07-20 | 中国移动通信集团公司 | Device connection processing method and system for use in screen sharing and relevant device |
| CN106658103A (en) * | 2016-11-15 | 2017-05-10 | 乐视控股（北京）有限公司 | Method for sharing video stream data, source equipment and electronic equipment |
| WO2017142373A1 (en) * | 2016-02-17 | 2017-08-24 | Samsung Electronics Co., Ltd. | Method of controlling the sharing of videos and electronic device adapted thereto |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101272199A (en) * | 2008-05-14 | 2008-09-24 | 中兴通讯股份有限公司 | Broadcasting program speed-changing broadcast processing method and terminal |
| CN104184944B (en) * | 2014-08-15 | 2016-03-16 | 小米科技有限责任公司 | Obtain method and the device of multimedia data stream |
-
2017
- 2017-09-27 CN CN201710891590.5A patent/CN107707972B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103155692A (en) * | 2010-08-13 | 2013-06-12 | Lg电子株式会社 | Mobile/portable terminal, device for displaying and method for controlling same |
| KR20150025584A (en) * | 2013-08-29 | 2015-03-11 | 삼성전자주식회사 | Method for screen sharing and an electronic device |
| CN104184834A (en) * | 2014-09-11 | 2014-12-03 | 东莞宇龙通信科技有限公司 | File transmission method and device and terminal |
| CN105791965A (en) * | 2014-12-24 | 2016-07-20 | 中国移动通信集团公司 | Device connection processing method and system for use in screen sharing and relevant device |
| WO2017142373A1 (en) * | 2016-02-17 | 2017-08-24 | Samsung Electronics Co., Ltd. | Method of controlling the sharing of videos and electronic device adapted thereto |
| CN106658103A (en) * | 2016-11-15 | 2017-05-10 | 乐视控股（北京）有限公司 | Method for sharing video stream data, source equipment and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107707972A (en) | 2018-02-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107707972B (en) | Data processing method, device and system for screen sharing and electronic equipment | |
| CN108965907B (en) | Method, device and system for playing video | |
| CN110166791B (en) | Connection establishing method, device, equipment and storage medium | |
| JP2023527576A (en) | INTERACTION METHOD, APPARATUS AND ELECTRONICS | |
| US20150117513A1 (en) | Bandwidth reduction system and method | |
| CN109819268B (en) | Live broadcast room play control method, device, medium and equipment in video live broadcast | |
| WO2021073205A1 (en) | Video processing method and apparatus, storage medium, and electronic device | |
| CN112019914B (en) | Screen projection method and device, electronic equipment and computer readable medium | |
| CN115396521A (en) | Method, device and system for switching communication protocol | |
| CN112312222A (en) | Video sending method and device and electronic equipment | |
| WO2018107628A1 (en) | Display method and device | |
| JP7480344B2 (en) | Information display method, device and electronic device | |
| EP4113985A1 (en) | Multimedia conference data processing method and apparatus, and electronic device | |
| CN111711784B (en) | Conference control method and device, readable medium and electronic equipment | |
| KR20150028588A (en) | Electronic device and method for providing streaming service | |
| CN108337556B (en) | Method and device for playing audio-video file | |
| CN113521728A (en) | Cloud application implementation method and device, electronic equipment and storage medium | |
| CN113542856B (en) | Method, device, equipment and computer readable medium for reverse playing of online video | |
| CN112261651B (en) | Terminal control method, device, terminal and storage medium | |
| CN113301424A (en) | Play control method, device, storage medium and program product | |
| US11190842B2 (en) | USB-based media device upgrading system | |
| CN111225242A (en) | Video playing disaster tolerance method and device and computer storage medium | |
| CN113596328B (en) | Camera calling method and device and electronic equipment | |
| CN111444457B (en) | Data release method and device, storage medium and electronic equipment | |
| US10389830B2 (en) | Device delegation of push notification distribution |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |