CN112416278A - Screen sharing method and device, electronic equipment and storage medium - Google Patents

Screen sharing method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN112416278A
CN112416278A CN202011249013.4A CN202011249013A CN112416278A CN 112416278 A CN112416278 A CN 112416278A CN 202011249013 A CN202011249013 A CN 202011249013A CN 112416278 A CN112416278 A CN 112416278A
Authority
CN
China
Prior art keywords
frame data
key frame
serial number
terminal
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011249013.4A
Other languages
Chinese (zh)
Other versions
CN112416278B (en
Inventor
李中秋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing 58 Information Technology Co Ltd
Original Assignee
Beijing 58 Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing 58 Information Technology Co Ltd filed Critical Beijing 58 Information Technology Co Ltd
Priority to CN202011249013.4A priority Critical patent/CN112416278B/en
Publication of CN112416278A publication Critical patent/CN112416278A/en
Application granted granted Critical
Publication of CN112416278B publication Critical patent/CN112416278B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Abstract

The invention provides a screen sharing method and device, electronic equipment and a storage medium. The method comprises the following steps: receiving frame data uploaded by any terminal for screen sharing and a serial number identifier of the frame data; determining key frame data from the frame data according to the serial number identification of each frame data received currently, and sending the key frame data to each terminal for screen sharing so as to control the screen of each terminal to render the key frame data synchronously; the method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data. Therefore, the beneficial effects that each terminal is ensured to acquire unified latest key frame data, and screen synchronization of each terminal is realized are achieved.

Description

Screen sharing method and device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a screen sharing method and apparatus, an electronic device, and a storage medium.
Background
With the continuous development of science and technology and the continuous change of people's demands, the screen sharing technology is applied to facilitate that different users can share information with each other while browsing the same interface through different terminals, and the screen sharing is a method for keeping the state synchronization in the screen in real time among different terminals.
In the related art, for a plurality of terminals performing screen sharing, operations of the terminals are mutually transmitted to other terminals, a unified central control is not provided, and judgment of screen state priority completely depends on local judgment of the terminals.
However, if the screen states of multiple terminals depend on the local priority of each terminal for judgment, and the local time sequences of each terminal may be different, so that the priorities judged by each terminal are different, and further, the screen states of multiple terminals are different, and screen synchronization is not completely realized.
Disclosure of Invention
The embodiment of the invention provides a screen sharing method and device, electronic equipment and a storage medium, and aims to solve the problems that the prior screen sharing process easily causes different priorities judged by all terminals, further causes different screen states of a plurality of terminals, and does not completely realize screen synchronization.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a screen sharing method, including:
receiving frame data uploaded by any terminal for screen sharing and a serial number identifier of the frame data;
determining key frame data from the frame data according to the serial number identification of each frame data received currently, and sending the key frame data to each terminal for screen sharing so as to control the screen of each terminal to render the key frame data synchronously;
the method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data.
Optionally, the step of determining key frame data from the frame data according to the sequence number identifier of each currently received frame data includes:
acquiring current initial key frame data according to the sequence number identification of each currently received frame data and the sequence number identification of the key frame data issued last time;
responding to the fact that the initial key frame data and the latest key frame data are from different terminals, obtaining a time stamp of the initial key frame data, and detecting whether a time difference between the time stamp of the initial key frame data and the time stamp of the latest key frame data exceeds a preset locking duration;
responding to the fact that the time difference between the time stamp of the initial key frame data and the time stamp of the key frame data which is issued last time exceeds the locking duration, and taking the initial key frame data as the current key frame data and issuing the current key frame data;
and responding to the fact that the initial key frame data and the key frame data which is issued last time are from the same terminal, and taking the initial key frame data as the current key frame data and issuing the current key frame data.
Optionally, the sequence number identifier of the frame data uploaded by each terminal is based on the sequence number identifier of the key frame data currently displayed by the terminal, and the sequence number identifiers sequentially increase according to the uploading sequence of the frame data, and the change amplitudes of the sequence number identifiers at each time are the same.
Optionally, the step of obtaining the current initial key frame data according to the sequence number identifier of each currently received frame data and the sequence number identifier of the key frame data that is delivered last time includes:
acquiring first frame data with the largest serial number identification from the frame data according to the serial number identification of each currently received frame data;
judging whether the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time;
and in response to the fact that the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time, taking the first frame data as the current initial key frame data.
Optionally, in each adjusting operation process, the frame data uploaded by the terminal includes starting frame data when the adjusting operation starts, ending frame data when the adjusting operation ends, and at least one intermediate frame data between the starting frame data and the ending frame data, and a time interval between two consecutive intermediate frame data is a specified time length.
In a second aspect, an embodiment of the present invention provides a screen sharing method, including:
in the screen sharing process, in response to receiving an adjustment operation aiming at display content in a screen, acquiring frame data in the adjustment operation period, and determining a serial number identifier of the frame data according to a serial number identifier of currently displayed key frame data;
uploading the frame data and the serial number identification of the frame data to the sharing control server, receiving key frame data returned by the sharing control server, and rendering the key frame data in the screen;
and determining the key frame data from the frame data by the shared control server according to the serial number identification of each currently received frame data.
In a third aspect, an embodiment of the present invention provides a screen sharing apparatus, including:
the frame data acquisition module is used for receiving frame data uploaded by any terminal for screen sharing and a serial number identifier of the frame data;
the key frame data issuing module is used for determining key frame data from the frame data according to the serial number identification of each frame data currently received, and issuing the key frame data to each terminal for screen sharing so as to control the screen of each terminal to synchronously render the key frame data;
the method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data.
Optionally, the key frame data issuing module includes:
the initial key frame data acquisition sub-module is used for acquiring current initial key frame data according to the serial number identification of each currently received frame data and the serial number identification of the key frame data which is issued for the latest time;
the locking duration detection submodule is used for responding to the fact that the initial key frame data and the latest key frame data are from different terminals, acquiring the time stamp of the initial key frame data, and detecting whether the time difference between the time stamp of the initial key frame data and the time stamp of the latest key frame data exceeds preset locking duration or not;
the first key frame data confirmation submodule is used for responding that the time difference between the time stamp of the initial key frame data and the time stamp of the key frame data which is issued last time exceeds the locking duration, and the initial key frame data is taken as the current key frame data and issued;
and the second key frame data confirmation submodule is used for responding that the initial key frame data and the key frame data which is issued last time come from the same terminal, taking the initial key frame data as the current key frame data and issuing the current key frame data.
Optionally, the sequence number identifier of the frame data uploaded by each terminal is based on the sequence number identifier of the key frame data currently displayed by the terminal, and the sequence number identifiers sequentially increase according to the uploading sequence of the frame data, and the change amplitudes of the sequence number identifiers at each time are the same.
Optionally, the initial key frame data obtaining sub-module is specifically configured to:
acquiring first frame data with the largest serial number identification from the frame data according to the serial number identification of each currently received frame data;
judging whether the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time;
and in response to the fact that the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time, taking the first frame data as the current initial key frame data.
Optionally, in each adjusting operation process, the frame data uploaded by the terminal includes starting frame data when the adjusting operation starts, ending frame data when the adjusting operation ends, and at least one intermediate frame data between the starting frame data and the ending frame data, and a time interval between two consecutive intermediate frame data is a specified time length.
In a fourth aspect, an embodiment of the present invention provides a screen sharing apparatus, including:
the system comprises a serial number identifier setting module, a data processing module and a data processing module, wherein the serial number identifier setting module is used for responding to received adjustment operation aiming at display content in a screen in the screen sharing process, acquiring frame data in the adjustment operation period, and determining the serial number identifier of the frame data according to the serial number identifier of currently displayed key frame data;
the frame data uploading module is used for uploading the frame data and the serial number identification of the frame data to the sharing control server;
the key frame data display module is used for receiving the key frame data returned by the sharing control server and rendering the key frame data in the screen;
and determining the key frame data from the frame data by the shared control server according to the serial number identification of each currently received frame data.
In a fifth aspect, an embodiment of the present invention additionally provides an electronic device, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the screen sharing method according to the first and second aspects.
In a sixth aspect, the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program, when executed by a processor, implements the steps of the screen sharing method according to the first aspect and the second aspect.
In the embodiment of the invention, the sharing control server is introduced and used for judging and storing the key frame data representing the current latest screen state operation and the serial number identification of the key frame data, and forwarding the latest key frame data and the serial number identification to all terminals shared by the screen, so that central control management is uniformly carried out, the terminals are ensured to acquire the uniform latest key frame data, and screen synchronization of the terminals is realized.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without inventive labor.
FIG. 1 is a flow chart of the steps of a screen sharing method in an embodiment of the present invention;
FIG. 2 is a flow chart of the steps of another screen sharing method in an embodiment of the present invention;
FIG. 3 is a flow chart of the steps of another screen sharing method in an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a screen sharing apparatus according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of another screen sharing apparatus according to an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of another screen sharing apparatus according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a hardware structure of an electronic device in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flowchart illustrating steps of a screen sharing method according to an embodiment of the present invention is shown.
Step 110, receiving frame data uploaded by any terminal for screen sharing and a serial number identifier of the frame data;
step 120, determining key frame data from the frame data according to the serial number identifier of each currently received frame data, and sending the key frame data to each terminal for screen sharing, so as to control the screen of each terminal to synchronously render the key frame data;
the method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data.
In the invention, in order to be suitable for a priority judging mechanism of multi-terminal operation in a screen sharing state, a sharing control server is introduced and used for judging and storing the current latest screen state operation (namely key frame data) and the serial number identification of the key frame data, and the latest operation state, namely the key frame data and the serial number identification can be forwarded to all terminals shared by screens.
Specifically, for each terminal performing screen sharing, in order to ensure that when any terminal user adjusts the screen state, the display content of each terminal sharing the screen can be completely synchronized with other terminals sharing the screen, each terminal can be controlled to upload frame data in the screen adjustment process to the sharing control server in real time, and since there may be users of multiple terminals simultaneously adjusting the display content in the screen or users of the same terminal continuously adjusting the display content in the screen within a period of time, the sharing server can quickly and accurately judge the latest generated key frame data in each frame data received by the sharing server, and when the terminal uploads the frame data, the terminal can also generate a sequence number identifier representing the generation sequence of the frame data and upload the sequence number identifier and the frame data to the sharing control server at the same time.
For the sharing control server, after receiving the frame data uploaded by any terminal performing screen sharing and the serial number identifier of the frame data, the sharing control server may determine key frame data from the frame data according to the currently received serial number identifier of each frame data, and synchronously issue the key frame data to each terminal performing screen sharing, so as to control the screen of each terminal to synchronously render the key frame data. Specifically, in order to ensure that the display states of the terminals are synchronous and not jammed, the shared control server may determine and issue the current key frame data based on the currently received frame data and the serial number identifier thereof after receiving the frame data.
For example, if the shared control server currently receives frame data uploaded by multiple terminals and the serial number identifier of each frame data at the same time, the key frame data that can represent the latest operation state of the screen can be determined according to the serial number identifier of each frame data, and the key frame data is synchronously sent to each terminal.
The method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data.
For the same terminal, in a continuous adjustment operation process, the display content in the screen may continuously change, so that in order to synchronize the screen state in the adjustment operation process of the display content in the screen of any terminal in the screen sharing process to other terminals in real time, it may be set that in each adjustment operation process, the terminal uploads the frame data displayed in the screen to the sharing control server with a preset time period as a period. The preset duration can be set by user according to requirements, and the embodiment of the invention is not limited. For example, the preset time period may be set to 800ms (milliseconds) or the like.
In addition, the generation policy of the serial number identifier may also be set by user according to requirements, and the embodiment of the present invention is not limited. For example, in a screen sharing process, an initial value of a serial number identifier may be set to be 0, for each terminal of the screen sharing, if an adjustment operation for the content shown in the screen is received, uploading frame data may be triggered, and each time frame data is uploaded, the frame data may be confirmed according to the serial number identifier of the key frame data currently shown by the terminal and the uploading sequence of the frame data. For example, assuming that the serial number identifier of the key frame data currently displayed by the terminal is 0 as an initial value, the serial number identifiers may be sequentially increased by 1, when the terminal uploads the frame data, the serial number identifier of the frame data uploaded for the first time may be 1 as the initial value, and if the serial number identifier of the key frame data currently displayed by the terminal is 2, when the terminal uploads the frame data, the serial number identifier of the frame data currently uploaded may be 3, and so on. At this time, for the sharing control server, it may determine, according to the sequence number identifier of each currently received frame data, that the frame data with the largest sequence number identifier is the key frame data from the frame data, and send the key frame data to each terminal performing screen sharing.
It should be noted that the frame data uploaded by the terminal each time may be frame data corresponding to a display picture uploaded to a terminal screen, and specific content of the frame data may be different in different application scenarios, which is not limited in the embodiment of the present invention.
For example, in a VR (Virtual Reality) room-viewing scene, in order to satisfy synchronization of viewing rooms by multiple people, a picture displayed in a screen of a terminal shared by the screens is a VR scene picture of a house, at this time, when the terminal receives a user operation, uploaded frame data may include VR space orientation data, space coordinate data, roaming point data, mark data, and the like of a current picture, and after receiving key frame data issued by a sharing control server, the terminal may be drawn according to the key frame data by a 3D renderer and displayed in the screen, so that screen picture synchronization is realized; for a 3D game scene, when a terminal receives user operation, the uploaded frame data at each time can include a 3D game animation frame of a current picture; for an animation or video sharing scene, the frame data uploaded by the terminal each time can include an animation frame or a video frame of a current picture; and so on.
Referring to fig. 2, in the embodiment of the present invention, the step 120 may further include:
step 121, obtaining current initial key frame data according to the sequence number identifier of each currently received frame data and the sequence number identifier of the key frame data which is issued for the latest time;
step 122, in response to that the initial key frame data and the latest key frame data are from different terminals, obtaining a time stamp of the initial key frame data, and detecting whether a time difference between the time stamp of the initial key frame data and the time stamp of the latest key frame data exceeds a preset locking duration;
step 123, in response to the time difference between the time stamp of the initial key frame data and the time stamp of the key frame data which is issued last time exceeding the locking duration, taking the initial key frame data as the current key frame data and issuing the current key frame data;
and step 124, responding to that the initial key frame data and the key frame data which is issued last time are from the same terminal, and taking the initial key frame data as the current key frame data and issuing the current key frame data.
In practical application, if a plurality of terminals performing screen sharing continuously receive adjustment operations of a user for display contents in a screen of the terminals within a period of time, each corresponding terminal also uploads frame data to the sharing control server, and if the sharing control server determines and issues key frame data based on the frame data after receiving the frame data each time, the display contents in the screen of each terminal are easily refreshed frequently, and the display contents are easily disordered when the terminals adjust the display contents at the same time, so that the visual effect of the user is affected.
Therefore, in the embodiment of the present invention, in order to avoid the above problem, a locking duration of issuing key frame data may be further set, for the sharing control server, the current initial key frame data may be obtained according to the sequence number identifier of each currently received frame data and the sequence number identifier of the key frame data issued last time, and if the initial key frame data and the key frame data issued last time by the sharing control server originate from different terminals, the timestamp of the initial key frame data may be obtained, and whether the time difference between the timestamp of the initial key frame data and the timestamp of the key frame data issued last time exceeds a preset locking duration may be detected, if the time difference between the timestamp of the initial key frame data and the timestamp of the key frame data issued last time exceeds the locking duration, the initial key frame data can be used as the current key frame data and sent down to each terminal shared by the screen. And if the time difference between the time stamp of the initial key frame data and the time stamp of the key frame data which is transmitted last time does not exceed the locking duration, the initial key frame data can be discarded, whether the initial key frame data is valid key frame data or not is not considered, the initial key frame data cannot be forwarded, and in addition, the current adjustment operation of the terminal which uploads the initial key frame data can be prompted to have conflict.
If the initial key frame data and the latest key frame data are from the same terminal, the continuous operation of the same terminal for the display content in the screen can be considered, and the initial key frame data can be directly used as the current key frame data and issued.
In addition, in the embodiment of the present invention, after each frame data uploaded by the terminal is received and the current key frame data is determined and before the key frame data is issued, it may be determined whether a time difference between a time stamp of the key frame data and a time stamp of the key frame data issued last time exceeds a preset locking duration, and if the time difference between the time stamp of the key frame data and the time stamp of the key frame data issued last time exceeds the locking duration, the key frame data may be taken as the current latest key frame data and issued. If the time difference between the time stamp of the key frame data and the time stamp of the key frame data which is issued last time does not exceed the locking duration, the key frame data can be discarded and not forwarded, and in addition, the conflict of the current adjustment operation of the terminal which uploads the corresponding key frame data can be prompted.
In addition, in the embodiment of the present invention, in order to facilitate the shared control server to accurately determine and issue the key frame data, the shared control server may store the latest issued key frame data and the serial number identifier of the key frame data.
And when the current initial key frame data is obtained according to the serial number identifier of each currently received frame data and the serial number identifier of the key frame data which is issued for the latest time, the current initial key frame data can be determined based on the corresponding relation between the serial number identifiers and the key frame data.
For example, if the frame data with the largest sequence number identifier is set as the current key frame data, it may be detected whether frame data with a larger sequence number identifier than the key frame data issued last time exists in each currently received frame data, and if so, the frame data with a larger sequence number identifier than the key frame data issued last time and the largest sequence number identifier is used as the current initial key frame data; if the frame data with the minimum serial number identification is set as the current key frame data, whether frame data smaller than the serial number identification of the key frame data issued last time exists in each currently received frame data or not can be detected, and if so, the frame data smaller than the serial number identification of the key frame data issued last time and with the minimum serial number identification is used as the current initial key frame data; and so on.
Optionally, in the embodiment of the present invention, the sequence number identifier of the frame data uploaded by each terminal is based on the sequence number identifier of the key frame data currently displayed by the terminal, and the sequence number identifiers sequentially increase according to the uploading sequence of the frame data, and the change amplitudes of the sequence number identifiers are the same each time.
The change range of the serial number identifier at each time can be set by user according to requirements, and the embodiment of the invention is not limited. For example, assuming that the initial value of the serial number flag is 0, the change amplitude of the serial number flag at each time may be set to a specified value, such as 1, and so on.
For example, for any terminal, assuming that the sequence number identifier of the currently displayed key frame data is N, when the terminal receives an adjustment operation of a user for the display content in the screen of the terminal, uploading frame data to the shared control server may be triggered, and when uploading frame data in the adjustment operation process, the sequence number identifier of the uploaded frame data may be set to be sequentially increased according to the uploading sequence of the frame data based on the sequence number identifier of the currently displayed key frame data of the terminal.
For example, assuming that the change range of the sequence number identifier is 1 each time, in one adjustment operation process, periodically uploading frame data to the shared control server, the sequence number identifier of each frame data may be sequentially increased by 1, that is, sequentially increased by N +1, N +2, and the like, according to the uploading sequence of each frame data, and if the key frame data displayed by the terminal changes, for example, the key frame data displayed in the terminal is changed to another key frame data, and the sequence number identifier of the changed key frame data is N +2, when uploading frame data in the adjustment operation process, the sequence number identifiers of the adjusted key frame data currently displayed by the terminal may be sequentially increased, according to the uploading sequence of each frame data thereafter, the sequence number identifiers thereof may be sequentially increased, for example, sequentially increased by N +3, N +4, and the like.
For example, in screen sharing, the interaction mode between the terminal and the sharing control server may be set as follows:
when a terminal operates alone, the serial number identification of the uploaded frame data is added with 1 based on the serial number identification of the currently displayed key frame data, and after receiving the frame data, the server can forward the frame data to other terminals as the key frame data, so that screen synchronization is realized;
when a terminal continuously operates, the serial number identification of each uploaded frame data is sequentially added with 1 based on the serial number identification of the currently displayed key frame data, the key frame data can be forwarded by the same server, and the latest forwarded key frame data and the serial number identification of the key frame data are saved.
When a plurality of terminals operate simultaneously, each terminal sequentially adds 1 to the serial number identifier of the uploaded frame data based on the serial number identifier of the currently displayed key frame data of each terminal and sends the serial number identifier to the server, and the server compares each received frame data with the latest issued key frame data stored by the shared control server. If the serial number identifier of the frame data is smaller than the serial number identifier of the latest key frame data, the server may discard the frame data, forward the frame data to the latest key frame data of other terminals, and prompt a conflict for the source terminal of the discarded frame data. If the serial number identifier of the frame data is greater than or equal to the serial number identifier of the latest key frame data, whether the time distance between the frame data and the timestamp of the latest key frame data exceeds the locking duration or not can be further judged, and if the time distance exceeds the locking duration, the frame data can cover the current latest key frame data of the sharing control server and can be forwarded at the same time. When a new terminal joins the screen sharing, the sharing control server can forward the stored latest key frame data to the newly joined terminal, so as to realize the initialization of screen state synchronization.
Optionally, in an embodiment of the present invention, the step 121 may further include:
step 1211, obtaining, according to the sequence number identifier of each currently received frame data, a first frame data with the largest sequence number identifier from the frame data;
step 1212, determining whether the sequence number identifier of the first frame data is greater than the sequence number identifier of the latest key frame data;
step 1213, in response to that the serial number identifier of the first frame data is greater than the serial number identifier of the latest issued key frame data, taking the first frame data as the current initial key frame data.
As described above, if the serial number identifiers of the frame data are based on the serial number identifiers of the key frame data currently displayed by the terminal and sequentially increase according to the uploading order of the frame data, it can be assumed that the frame data with larger serial number identifiers can represent the latest state of the screen, therefore, in the embodiment of the present invention, in order to determine the initial key frame data, the first frame data with the largest serial number identifier can be obtained from the frame data according to the currently received serial number identifiers of each frame data, and further, whether the serial number identifier of the first frame data is larger than the serial number identifier of the key frame data issued last time is judged, if the serial number identifier of the first frame data is larger than the serial number identifier of the key frame data issued last time, the first frame data can be used as the current initial key frame data, and if the serial number identifier of the first frame data is not larger than the serial, the current key frame data can be determined to be the latest key frame data to be issued, and the key frame data does not need to be issued again.
Optionally, in an embodiment of the present invention, in each adjusting operation process, the frame data uploaded by the terminal includes starting frame data when the adjusting operation starts, ending frame data when the adjusting operation ends, and at least one intermediate frame data between the starting frame data and the ending frame data, and a time interval between two consecutive intermediate frame data is a specified time length.
In practical applications, a user may be continuous when adjusting the display content in the terminal screen, for example, a dragging operation and the like generally last for a period of time, and in the continuous adjustment operation process, the display content in the screen may change continuously, so that in order to enable each terminal to achieve synchronization of the display content in time in the adjustment operation process, it is necessary to upload frame data generated in the adjustment operation process to the shared control server in time in one adjustment operation process. The frame data uploaded by the terminal includes frame data at the beginning of the adjustment operation, i.e., start frame data, and frame data at the end of the adjustment operation, i.e., end frame data, and at least one frame data among the start frame data and the end frame data, i.e., intermediate frame data. For example, each terminal may be configured to upload a middle frame data after uploading the start frame data during a tuning operation, and upload an end frame data after the tuning operation.
In addition, a plurality of intermediate frame data may be uploaded, for example, the current intermediate frame data is uploaded once again at a specified time interval after the intermediate frame data is uploaded for the first time until the upload end frame data is completed when the adjustment operation is completed. The time length of the specified duration can be set by self according to requirements, and the embodiment of the invention is not limited. For example, the specified time period may be set to 800ms or the like.
Referring to FIG. 3, a flow chart of steps of another screen sharing method in an embodiment of the invention is shown.
Step 210, in the screen sharing process, in response to receiving an adjustment operation for the display content in the screen, acquiring frame data during the adjustment operation, and determining a serial number identifier of the frame data according to a serial number identifier of currently displayed key frame data;
step 220, uploading the frame data and the serial number identifier of the frame data to the shared control server;
step 230, receiving the key frame data returned by the sharing control server, and rendering the key frame data in the screen; and determining the key frame data from the frame data by the shared control server according to the serial number identification of each currently received frame data.
The execution main body in the embodiment of the present invention is any terminal that performs screen sharing, and the execution main body in each step in the above embodiment is a sharing control server, but the interaction process between the two may refer to the above contents, which is not described again.
In the embodiment of the invention, the sharing control server is introduced and used for judging and storing the key frame data representing the current latest screen state operation and the serial number identification of the key frame data, and forwarding the latest key frame data and the serial number identification to all terminals shared by the screen, so that central control management is uniformly carried out, the terminals are ensured to acquire the uniform latest key frame data, and screen synchronization of the terminals is realized.
Referring to fig. 4, a schematic structural diagram of a screen sharing device in the embodiment of the present invention is shown.
The screen sharing device of the embodiment of the invention comprises: a frame data acquisition module 310 and a key frame data issuing module 320.
The functions of the modules and the interaction relationship between the modules are described in detail below.
The frame data acquisition module 310 is configured to receive frame data uploaded by any terminal performing screen sharing and a serial number identifier of the frame data;
a key frame data issuing module 320, configured to determine key frame data from the frame data according to the sequence number identifier of each currently received frame data, and issue the key frame data to each terminal performing screen sharing, so as to control a screen of each terminal to render the key frame data synchronously;
the method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data.
Referring to fig. 5, in the embodiment of the present invention, the key frame data issuing module 320 may further include:
an initial key frame data obtaining sub-module 321, configured to obtain current initial key frame data according to the sequence number identifier of each currently received frame data and the sequence number identifier of the key frame data that is issued last time;
a locking duration detection sub-module 322, configured to obtain a timestamp of the initial key frame data in response to that the initial key frame data and the latest key frame data are from different terminals, and detect whether a time difference between the timestamp of the initial key frame data and the timestamp of the latest key frame data exceeds a preset locking duration;
the first key frame data confirmation submodule 323 is configured to respond that a time difference between the time stamp of the initial key frame data and the time stamp of the key frame data that is delivered last time exceeds the locking duration, and to take the initial key frame data as current key frame data and deliver the current key frame data;
the second key frame data confirmation sub-module 324 is configured to respond that the initial key frame data and the key frame data that is delivered last time originate from the same terminal, and to deliver the initial key frame data as the current key frame data.
Optionally, in the embodiment of the present invention, the sequence number identifier of the frame data uploaded by each terminal is based on the sequence number identifier of the key frame data currently displayed by the terminal, and the sequence number identifiers sequentially increase according to the uploading sequence of the frame data, and the change amplitudes of the sequence number identifiers are the same each time.
Optionally, in this embodiment of the present invention, the initial key frame data obtaining sub-module 321 may be specifically configured to:
acquiring first frame data with the largest serial number identification from the frame data according to the serial number identification of each currently received frame data;
judging whether the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time;
and in response to the fact that the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time, taking the first frame data as the current initial key frame data.
Optionally, in an embodiment of the present invention, in each adjusting operation process, the frame data uploaded by the terminal includes starting frame data when the adjusting operation starts, ending frame data when the adjusting operation ends, and at least one intermediate frame data between the starting frame data and the ending frame data, and a time interval between two consecutive intermediate frame data is a specified time length.
The screen sharing device provided by the embodiment of the present invention can implement each process implemented in the method embodiments of fig. 1 to fig. 2, and is not described herein again to avoid repetition.
Referring to fig. 6, a schematic structural diagram of another screen sharing device in the embodiment of the present invention is shown.
The screen sharing device of the embodiment of the invention comprises: a serial number identifier setting module 410, a frame data uploading module 420 and a key frame data presentation module 430.
The functions of the modules and the interaction relationship between the modules are described in detail below.
A sequence number identifier setting module 410, configured to, in a screen sharing process, in response to receiving an adjustment operation for display content in a screen, obtain frame data during the adjustment operation, and determine a sequence number identifier of the frame data according to a sequence number identifier of currently displayed key frame data;
a frame data uploading module 420, configured to upload the frame data and the serial number identifier of the frame data to the shared control server;
a key frame data display module 430, configured to receive key frame data returned by the shared control server, and render the key frame data in the screen;
and determining the key frame data from the frame data by the shared control server according to the serial number identification of each currently received frame data.
The screen sharing device provided by the embodiment of the present invention can implement each process implemented in the method embodiment of fig. 3, and is not described herein again to avoid repetition.
Preferably, an embodiment of the present invention further provides an electronic device, including: the processor, the memory, and the computer program stored in the memory and capable of running on the processor, when executed by the processor, implement the processes of the screen sharing method embodiment, and can achieve the same technical effects, and in order to avoid repetition, details are not repeated here. Moreover, the electronic device may be the above-mentioned sharing control server when implementing the screen sharing method implemented in the above-mentioned method embodiment of fig. 1 to 2, and the electronic device may be the above-mentioned terminal when implementing the screen sharing method implemented in the above-mentioned method embodiment of fig. 3.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of the screen sharing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
Fig. 7 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention.
The electronic device 500 includes, but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 511. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 7 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 501 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 510; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 502, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output as sound. Also, the audio output unit 503 may also provide audio output related to a specific function performed by the electronic apparatus 500 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.
The input unit 504 is used to receive an audio or video signal. The input Unit 504 may include a Graphics Processing Unit (GPU) 5041 and a microphone 5042, and the Graphics processor 5041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 506. The image frames processed by the graphic processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502. The microphone 5042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 501 in case of the phone call mode.
The electronic device 500 also includes at least one sensor 505, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 5061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 5061 and/or a backlight when the electronic device 500 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 505 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 506 is used to display information input by the user or information provided to the user. The Display unit 506 may include a Display panel 5061, and the Display panel 5061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 507 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. Touch panel 5071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 5071 using a finger, stylus, or any suitable object or attachment). The touch panel 5071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 510, and receives and executes commands sent by the processor 510. In addition, the touch panel 5071 may be implemented in various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 5071, the user input unit 507 may include other input devices 5072. In particular, other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 5071 may be overlaid on the display panel 5061, and when the touch panel 5071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 510 to determine the type of the touch event, and then the processor 510 provides a corresponding visual output on the display panel 5061 according to the type of the touch event. Although in fig. 7, the touch panel 5071 and the display panel 5061 are two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 5071 and the display panel 5061 may be integrated to implement the input and output functions of the electronic device, and is not limited herein.
The interface unit 508 is an interface for connecting an external device to the electronic apparatus 500. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 508 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic apparatus 500 or may be used to transmit data between the electronic apparatus 500 and external devices.
The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 510 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 509 and calling data stored in the memory 509, thereby performing overall monitoring of the electronic device. Processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 510.
The electronic device 500 may further include a power supply 511 (e.g., a battery) for supplying power to various components, and preferably, the power supply 511 may be logically connected to the processor 510 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system.
In addition, the electronic device 500 includes some functional modules that are not shown, and are not described in detail herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (14)

1. A screen sharing method, comprising:
receiving frame data uploaded by any terminal for screen sharing and a serial number identifier of the frame data;
determining key frame data from the frame data according to the serial number identification of each frame data received currently, and sending the key frame data to each terminal for screen sharing so as to control the screen of each terminal to render the key frame data synchronously;
the method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data.
2. The method according to claim 1, wherein the step of determining key frame data from the frame data according to the sequence number identifier of each currently received frame data comprises:
acquiring current initial key frame data according to the sequence number identification of each currently received frame data and the sequence number identification of the key frame data issued last time;
responding to the fact that the initial key frame data and the latest key frame data are from different terminals, obtaining a time stamp of the initial key frame data, and detecting whether a time difference between the time stamp of the initial key frame data and the time stamp of the latest key frame data exceeds a preset locking duration;
responding to the fact that the time difference between the time stamp of the initial key frame data and the time stamp of the key frame data which is issued last time exceeds the locking duration, and taking the initial key frame data as the current key frame data and issuing the current key frame data;
and responding to the fact that the initial key frame data and the key frame data which is issued last time are from the same terminal, and taking the initial key frame data as the current key frame data and issuing the current key frame data.
3. The method according to any one of claims 1-2, wherein the serial number identifier of the frame data uploaded by each terminal is based on the serial number identifier of the key frame data currently displayed by the terminal, the serial number identifiers sequentially increase according to the uploading sequence of the frame data, and the change amplitude of each serial number identifier is the same.
4. The method according to claim 3, wherein the step of obtaining the current initial key frame data according to the sequence number identifier of each currently received frame data and the sequence number identifier of the key frame data that is delivered last time comprises:
acquiring first frame data with the largest serial number identification from the frame data according to the serial number identification of each currently received frame data;
judging whether the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time;
and in response to the fact that the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time, taking the first frame data as the current initial key frame data.
5. The method according to claim 1, wherein during each adjustment operation, the frame data uploaded by the terminal comprises start frame data at the beginning of the adjustment operation, end frame data at the end of the adjustment operation, and at least one intermediate frame data between the start frame data and the end frame data, and the time interval between two consecutive intermediate frame data is a specified time length.
6. A screen sharing method, comprising:
in the screen sharing process, in response to receiving an adjustment operation aiming at display content in a screen, acquiring frame data in the adjustment operation period, and determining a serial number identifier of the frame data according to a serial number identifier of currently displayed key frame data;
uploading the frame data and the serial number identification of the frame data to the shared control server;
receiving key frame data returned by the sharing control server, and rendering the key frame data in the screen;
and determining the key frame data from the frame data by the shared control server according to the serial number identification of each currently received frame data.
7. A screen sharing apparatus, comprising:
the frame data acquisition module is used for receiving frame data uploaded by any terminal for screen sharing and a serial number identifier of the frame data;
the key frame data issuing module is used for determining key frame data from the frame data according to the serial number identification of each frame data currently received, and issuing the key frame data to each terminal for screen sharing so as to control the screen of each terminal to synchronously render the key frame data;
the method comprises the steps that frame data are uploaded under the condition that the terminal receives adjustment operation aiming at display content in a screen, and the serial number identification of the frame data is obtained according to the serial number identification of key frame data currently displayed by the terminal and the uploading sequence of the frame data.
8. The apparatus of claim 7, wherein the key frame data issuing module comprises:
the initial key frame data acquisition sub-module is used for acquiring current initial key frame data according to the serial number identification of each currently received frame data and the serial number identification of the key frame data which is issued for the latest time;
the locking duration detection submodule is used for responding to the fact that the initial key frame data and the latest key frame data are from different terminals, acquiring the time stamp of the initial key frame data, and detecting whether the time difference between the time stamp of the initial key frame data and the time stamp of the latest key frame data exceeds preset locking duration or not;
the first key frame data confirmation submodule is used for responding that the time difference between the time stamp of the initial key frame data and the time stamp of the key frame data which is issued last time exceeds the locking duration, and the initial key frame data is taken as the current key frame data and issued;
and the second key frame data confirmation submodule is used for responding that the initial key frame data and the key frame data which is issued last time come from the same terminal, taking the initial key frame data as the current key frame data and issuing the current key frame data.
9. The device according to any one of claims 7 to 8, wherein the serial number identifier of the frame data uploaded by each terminal is based on the serial number identifier of the key frame data currently displayed by the terminal, the serial number identifiers sequentially increase according to the uploading sequence of the frame data, and the change amplitude of each serial number identifier is the same.
10. The apparatus according to claim 9, wherein the initial key frame data obtaining sub-module is specifically configured to:
acquiring first frame data with the largest serial number identification from the frame data according to the serial number identification of each currently received frame data;
judging whether the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time;
and in response to the fact that the serial number identification of the first frame data is larger than the serial number identification of the key frame data which is issued at the latest time, taking the first frame data as the current initial key frame data.
11. The apparatus according to claim 7, wherein during each adjustment operation, the frame data uploaded by the terminal includes start frame data at the beginning of the adjustment operation, end frame data at the end of the adjustment operation, and at least one intermediate frame data between the start frame data and the end frame data, and a time interval between two consecutive intermediate frame data is a specified time length.
12. A screen sharing apparatus, comprising:
the system comprises a serial number identifier setting module, a data processing module and a data processing module, wherein the serial number identifier setting module is used for responding to received adjustment operation aiming at display content in a screen in the screen sharing process, acquiring frame data in the adjustment operation period, and determining the serial number identifier of the frame data according to the serial number identifier of currently displayed key frame data;
the frame data uploading module is used for uploading the frame data and the serial number identification of the frame data to the sharing control server;
the key frame data display module is used for receiving the key frame data returned by the sharing control server and rendering the key frame data in the screen;
and determining the key frame data from the frame data by the shared control server according to the serial number identification of each currently received frame data.
13. An electronic device, comprising: memory, processor and computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, carries out the steps of the screen sharing method according to any one of claims 1 to 6.
14. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the screen sharing method according to any one of claims 1 to 6.
CN202011249013.4A 2020-11-10 2020-11-10 Screen sharing method and device, electronic equipment and storage medium Active CN112416278B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011249013.4A CN112416278B (en) 2020-11-10 2020-11-10 Screen sharing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011249013.4A CN112416278B (en) 2020-11-10 2020-11-10 Screen sharing method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112416278A true CN112416278A (en) 2021-02-26
CN112416278B CN112416278B (en) 2021-12-03

Family

ID=74781782

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011249013.4A Active CN112416278B (en) 2020-11-10 2020-11-10 Screen sharing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112416278B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113448527A (en) * 2021-06-28 2021-09-28 华科融资租赁有限公司 Data synchronization method and device, computer equipment and storage medium
CN114567802A (en) * 2021-12-29 2022-05-31 沈阳中科创达软件有限公司 Data display method and device

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1658149A (en) * 2004-01-15 2005-08-24 微软公司 System and process for controlling a shared display given inputs from multiple users using multiple input modalities
CN101201824A (en) * 2006-12-15 2008-06-18 深圳市锐明视讯技术有限公司 Method for processing signal of video stream
CN104378675A (en) * 2014-12-08 2015-02-25 厦门雅迅网络股份有限公司 Multichannel audio-video synchronized playing processing method
CN105306871A (en) * 2014-07-25 2016-02-03 富士施乐株式会社 INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING SYSTEM, AND information processing method
CN107070671A (en) * 2017-04-08 2017-08-18 广东公信智能会议股份有限公司 The processing method of share desktop in conference system
KR20180108967A (en) * 2017-03-24 2018-10-05 전자부품연구원 Multi-vision screen image rendering system, device and method
CN108694009A (en) * 2017-04-05 2018-10-23 博彦科技股份有限公司 terminal control method and device
CN108694029A (en) * 2017-04-05 2018-10-23 博彦科技股份有限公司 Terminal screen display processing method, device and storage medium
CN109375867A (en) * 2019-01-16 2019-02-22 南昌黑鲨科技有限公司 A kind of touch operation method and device
US10264297B1 (en) * 2017-09-13 2019-04-16 Perfect Sense, Inc. Time-based content synchronization
US20190304133A1 (en) * 2018-03-30 2019-10-03 Electronics And Telecommunications Research Institute Method and apparatus for performing image feature matching using labeled keyframes in slam-based camera tracking
CN111078171A (en) * 2019-11-30 2020-04-28 北京城市网邻信息技术有限公司 Method, terminal device, device and readable storage medium for synchronous display
CN111131817A (en) * 2019-12-31 2020-05-08 科大讯飞股份有限公司 Screen sharing method, device, storage medium and screen sharing system
CN111182303A (en) * 2019-10-08 2020-05-19 腾讯科技(深圳)有限公司 Encoding method and device for shared screen, computer readable medium and electronic equipment
CN111596876A (en) * 2020-04-28 2020-08-28 维沃移动通信有限公司 Information display method and device, electronic equipment and storage medium

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1658149A (en) * 2004-01-15 2005-08-24 微软公司 System and process for controlling a shared display given inputs from multiple users using multiple input modalities
CN101201824A (en) * 2006-12-15 2008-06-18 深圳市锐明视讯技术有限公司 Method for processing signal of video stream
CN105306871A (en) * 2014-07-25 2016-02-03 富士施乐株式会社 INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING SYSTEM, AND information processing method
CN104378675A (en) * 2014-12-08 2015-02-25 厦门雅迅网络股份有限公司 Multichannel audio-video synchronized playing processing method
KR20180108967A (en) * 2017-03-24 2018-10-05 전자부품연구원 Multi-vision screen image rendering system, device and method
CN108694009A (en) * 2017-04-05 2018-10-23 博彦科技股份有限公司 terminal control method and device
CN108694029A (en) * 2017-04-05 2018-10-23 博彦科技股份有限公司 Terminal screen display processing method, device and storage medium
CN107070671A (en) * 2017-04-08 2017-08-18 广东公信智能会议股份有限公司 The processing method of share desktop in conference system
US10264297B1 (en) * 2017-09-13 2019-04-16 Perfect Sense, Inc. Time-based content synchronization
US20190304133A1 (en) * 2018-03-30 2019-10-03 Electronics And Telecommunications Research Institute Method and apparatus for performing image feature matching using labeled keyframes in slam-based camera tracking
CN109375867A (en) * 2019-01-16 2019-02-22 南昌黑鲨科技有限公司 A kind of touch operation method and device
CN111182303A (en) * 2019-10-08 2020-05-19 腾讯科技(深圳)有限公司 Encoding method and device for shared screen, computer readable medium and electronic equipment
CN111078171A (en) * 2019-11-30 2020-04-28 北京城市网邻信息技术有限公司 Method, terminal device, device and readable storage medium for synchronous display
CN111131817A (en) * 2019-12-31 2020-05-08 科大讯飞股份有限公司 Screen sharing method, device, storage medium and screen sharing system
CN111596876A (en) * 2020-04-28 2020-08-28 维沃移动通信有限公司 Information display method and device, electronic equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
罗良耀: "视频会议系统中屏幕共享的设计与实现", 《中国优秀硕士学位论文全文数据库》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113448527A (en) * 2021-06-28 2021-09-28 华科融资租赁有限公司 Data synchronization method and device, computer equipment and storage medium
CN113448527B (en) * 2021-06-28 2023-05-26 华科融资租赁有限公司 Data synchronization method, device, computer equipment and storage medium
CN114567802A (en) * 2021-12-29 2022-05-31 沈阳中科创达软件有限公司 Data display method and device
CN114567802B (en) * 2021-12-29 2024-02-09 沈阳中科创达软件有限公司 Data display method and device

Also Published As

Publication number Publication date
CN112416278B (en) 2021-12-03

Similar Documents

Publication Publication Date Title
CN107977144B (en) Screen capture processing method and mobile terminal
CN108182019B (en) Suspension control display processing method and mobile terminal
CN109992231B (en) Screen projection method and terminal
CN108279948B (en) Application program starting method and mobile terminal
CN110209313B (en) Icon moving method and terminal equipment
CN108900695B (en) Display processing method, terminal equipment and computer readable storage medium
CN108628515B (en) Multimedia content operation method and mobile terminal
CN111031108B (en) Synchronization method and electronic equipment
CN107734170B (en) Notification message processing method, mobile terminal and wearable device
CN109710349B (en) Screen capturing method and mobile terminal
CN109407920B (en) Status icon display method, status icon processing method and related equipment
CN109343788B (en) Operation control method of mobile terminal and mobile terminal
CN108762877B (en) Control method of mobile terminal interface and mobile terminal
CN109327672B (en) Video call method and terminal
CN107707760B (en) Push notification processing method and mobile terminal
CN109656636B (en) Application starting method and device
CN110990172A (en) Application sharing method, first electronic device and computer-readable storage medium
CN110933494A (en) Picture sharing method and electronic equipment
CN112416278B (en) Screen sharing method and device, electronic equipment and storage medium
CN108196781B (en) Interface display method and mobile terminal
CN108270853B (en) Message processing method and mobile terminal
CN111417929A (en) Interface display method and control terminal
CN109101151B (en) Information display processing method and terminal equipment
CN109002245B (en) Application interface operation method and mobile terminal
CN111061404A (en) Control method and first electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant