CN112988315A - Method, system and readable storage medium for personalized viewing of shared desktop - Google Patents
Method, system and readable storage medium for personalized viewing of shared desktop Download PDFInfo
- Publication number
- CN112988315A CN112988315A CN202110543058.0A CN202110543058A CN112988315A CN 112988315 A CN112988315 A CN 112988315A CN 202110543058 A CN202110543058 A CN 202110543058A CN 112988315 A CN112988315 A CN 112988315A
- Authority
- CN
- China
- Prior art keywords
- window
- client
- desktop
- interest
- interest window
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method, a system and a readable storage medium for personalized viewing of a shared desktop, wherein the method comprises the following steps: receiving desktop content and application program window coordinates shared by a speaker client, wherein the desktop content comprises an application program window; selecting an application program window corresponding to a certain coordinate position as an interest window, and returning the coordinates of the interest window to the client of the speaker so that the client of the speaker can obtain the content data of the interest window according to the coordinates of the interest window; receiving the interest window content data sent by the client of the speaker, and storing the interest window content data at the local side; when receiving desktop change content sent by a speaker client, displaying an interest window on the top layer of the desktop of the client based on the interest window content data stored by the client, and displaying the received desktop change content on the next layer of the layer where the interest window is located. The invention can realize the effect that the participants watch the shared desktop individually.
Description
Technical Field
The present invention relates to the field of desktop sharing technologies, and in particular, to a method, a system, and a readable storage medium for personalized viewing of a shared desktop.
Background
At present, with the development of computer technology, network technology and communication technology, the application of netmeeting is more and more extensive, such as remote monitoring, remote teaching, remote medical diagnosis and the like. By using the conference system, people far away from thousands of miles can hold various conferences together or discuss academic problems with technicians far away. The system greatly facilitates real and intuitive communication among the cooperative members by transmitting the video and audio information of the writing members; at present, a network conference system can provide a desktop sharing function, that is, a client of a desktop sharer can acquire information of a client interface in real time, and then send the information of the client interface to clients of other participants through a server.
In the existing network conference, the participant watches the shared desktop, namely watches videos or pictures, the participant outputs contents to the desktop of the participant unilaterally by a speaker, and the participants watch the videos or the pictures uniformly in the watching process, so that the characteristic of individuation is lacked. For example, in a conference, when one of the document contents is a content that is of particular interest to a participant, but the speaker may hide or be blocked by other documents or applications in view of the conference sharing process at the next moment, so that the participant cannot view the content of interest of the participant, and the user experience at the participant side is poor.
Disclosure of Invention
In view of the foregoing problems, it is an object of the present invention to provide a method, system and readable storage medium for personalized viewing of a shared desktop, which can achieve the effect of personalized viewing of the shared desktop by participants.
The invention provides a method for individually watching a shared desktop in a first aspect, which comprises the following steps:
receiving desktop content and application program window coordinates shared by a speaker client, wherein the desktop content comprises an application program window;
selecting an application program window corresponding to a certain coordinate position as an interest window, and returning the coordinates of the interest window to the client of the speaker so that the client of the speaker can obtain the content data of the interest window according to the coordinates of the interest window;
receiving the interest window content data sent by the client of the speaker, and storing the interest window content data at the local side;
when receiving desktop change content sent by a speaker client, displaying an interest window on the top layer of the desktop of the client based on the interest window content data stored by the client, and displaying the received desktop change content on the next layer of the layer where the interest window is located.
In the scheme, the method for returning the interest window coordinate to the client of the speaker so that the client of the speaker obtains the content data of the interest window according to the interest window coordinate specifically comprises the following steps:
returning the coordinates of the interest window to the conference server;
receiving the interest window coordinates by the conference server, identifying corresponding participant client identification information, packaging the participant client identification information and the interest window coordinates together into a network message, and sending the network message to the speaker client;
extracting participant client identification information and an interest window coordinate from a network message by a speaker client, calculating a window handle of the interest window coordinate in a speaker client running system, and correlating the window handle with the participant client identification information and recording the window handle into a memory of the running system;
and calling the window handle by the speaker client to acquire the content data of the interest window.
In this scheme, after the interest window is displayed on the top layer of the desktop of the local side based on the content data of the interest window stored by the local side, the method further includes:
rendering the interest window, wherein the rendering mode is as follows:
rendering the boundary line of the interest window through a preset color; or
Rendering the boundary line of the interest window through a preset line type; or
Rendering the boundary line of the interest window through a preset dynamic track; or
And carrying out highlight rendering on the area of the interest window.
In this scheme, after the interest window is displayed on the top layer of the desktop of the local side based on the content data of the interest window stored by the local side, the method further includes:
receiving an instruction to hide the interest window;
removing the interest window from the layer top layer of the desktop at the side end, forming a hidden icon in a corresponding area of the desktop at the side end for subsequent restoration, and simultaneously displaying the desktop change content on the layer top layer of the desktop at the side end; or
Receiving an instruction for closing the interest window;
deleting the content data of the interest window stored at the side end, removing the interest window from the layer top layer of the desktop at the side end, and simultaneously displaying the desktop change content on the layer top layer of the desktop at the side end.
In the scheme, after receiving the desktop content shared by the client of the main speaker and the application program window coordinates, the method comprises the following steps:
returning confirmation information of successfully receiving the shared desktop content and the application program coordinate to the speaker client;
after receiving the confirmation message, the speaker client triggers a timer at the local side to start timing;
when the client of the speaker receives the coordinates of the interest window, ending the timing action of the timer and calculating the continuous sharing duration of the desktop content according to the timing starting time and the timing ending time;
judging whether the continuous sharing duration exceeds a preset threshold value or not by the client of the speaker, and if so, acquiring the content data of the interest window according to the coordinates of the interest window; if not, feeding back notification information of failure generation of the interest window to the participant client, and terminating the subsequent process.
In this scheme, after receiving the desktop content and the application window coordinates shared by the client from the presenter, the method further includes:
selecting a plurality of application program windows corresponding to the coordinate positions as interest windows, and respectively returning the coordinates of the interest windows to the client of the speaker;
receiving interest window content data based on a plurality of interest window coordinates sent by the client of the speaker, labeling the interest window content data, and storing the interest window content data at the client;
forming an adaptive number of layers on the desktop of the side end based on the number of the content data of the interest window, wherein the number of the layers is equal to the number of the content data of the interest window plus 1;
when receiving desktop change contents sent by a client of a speaker, displaying the received desktop change contents on the bottommost layer of a desktop layer of a local side, and simultaneously arranging corresponding interest windows downwards from the topmost layer of the desktop layer of the local side in sequence according to the label size of the content data of the interest windows;
and receiving a layer adjustment instruction for a certain interest window, and adjusting the interest window to a specified layer based on the layer adjustment instruction.
The second aspect of the present invention further provides a system for personalized viewing of a shared desktop, including a memory and a processor, where the memory includes a method program for personalized viewing of the shared desktop, and when executed by the processor, the method program for sensing a sharing result and a sharing status implements the following steps:
receiving desktop content and application program window coordinates shared by a speaker client, wherein the desktop content comprises an application program window;
selecting an application program window corresponding to a certain coordinate position as an interest window, and returning the coordinates of the interest window to the client of the speaker so that the client of the speaker can obtain the content data of the interest window according to the coordinates of the interest window;
receiving the interest window content data sent by the client of the speaker, and storing the interest window content data at the local side;
when receiving desktop change content sent by a speaker client, displaying an interest window on the top layer of the desktop of the client based on the interest window content data stored by the client, and displaying the received desktop change content on the next layer of the layer where the interest window is located.
In the scheme, the method for returning the interest window coordinate to the client of the speaker so that the client of the speaker obtains the content data of the interest window according to the interest window coordinate specifically comprises the following steps:
returning the coordinates of the interest window to the conference server;
receiving the interest window coordinates by the conference server, identifying corresponding participant client identification information, packaging the participant client identification information and the interest window coordinates together into a network message, and sending the network message to the speaker client;
extracting participant client identification information and an interest window coordinate from a network message by a speaker client, calculating a window handle of the interest window coordinate in a speaker client running system, and correlating the window handle with the participant client identification information and recording the window handle into a memory of the running system;
and calling the window handle by the speaker client to acquire the content data of the interest window.
In this scheme, when executed by the processor, the method for sensing the sharing result and the state further includes:
returning confirmation information of successfully receiving the shared desktop content and the application program coordinate to the speaker client;
after receiving the confirmation message, the speaker client triggers a timer at the local side to start timing;
when the client of the speaker receives the coordinates of the interest window, ending the timing action of the timer and calculating the continuous sharing duration of the desktop content according to the timing starting time and the timing ending time;
judging whether the continuous sharing duration exceeds a preset threshold value or not by the client of the speaker, and if so, acquiring the content data of the interest window according to the coordinates of the interest window; if not, feeding back notification information of failure generation of the interest window to the participant client, and terminating the subsequent process.
The third aspect of the present invention also provides a computer-readable storage medium, where the computer-readable storage medium includes a program of a method for personalized viewing of a shared desktop, and when the program of the method for personalized viewing of a shared desktop is executed by a processor, the steps of the method for personalized viewing of a shared desktop are implemented.
According to the method, the system and the readable storage medium for personalized viewing of the shared desktop, disclosed by the invention, the participant can set the application program window on the shared desktop of the speaker as the interest window, the content of the window area set as the interest window can be always displayed at the topmost layer position of the participant side, even if the window at the speaker side is blocked or minimized by other windows, the position of the interest window at the participant side at the topmost layer can not be influenced, and thus the effect of personalized viewing of the shared desktop at the participant side is realized.
Drawings
FIG. 1 is a flow diagram illustrating a method for personalized viewing of a shared desktop in accordance with the present invention;
FIG. 2 illustrates a flow diagram of a method for personalizing viewing of a shared desktop in accordance with an embodiment of the present invention;
FIG. 3 illustrates a desktop view of a participant-side uninteresting window in accordance with one embodiment of the present invention;
FIG. 4 is a diagram illustrating a desktop with a participant-side set-up interest window according to an embodiment of the present invention;
FIG. 5 shows a schematic of a desktop on the speaker side of an embodiment of the present invention;
FIG. 6 illustrates a desktop view of a participant-side window of interest in accordance with an embodiment of the present invention;
FIG. 7 is a block diagram of a system for personalized viewing of a shared desktop in accordance with the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
FIG. 1 is a flow chart illustrating a method for personalized viewing of a shared desktop according to the present invention.
As shown in fig. 1, a first aspect of the present invention provides a method for personalized viewing of a shared desktop, comprising the following steps:
s102, receiving desktop content and application program window coordinates shared by a client of a speaker, wherein the desktop content comprises an application program window;
s104, selecting an application program window corresponding to a certain coordinate position as an interest window, and returning the coordinates of the interest window to the client of the speaker so that the client of the speaker can obtain the content data of the interest window according to the coordinates of the interest window;
s106, receiving the interest window content data sent by the client of the speaker, and storing the interest window content data at the local side;
s108, when receiving the desktop change content sent by the client of the speaker, displaying the interest window on the top layer of the desktop of the client based on the interest window content data stored by the client, and displaying the received desktop change content on the next layer of the layer where the interest window is located.
It should be noted that before the above steps are performed, a network conference system needs to be set up, where the network conference system may include a speaker client, a conference server, and at least one participant client, the speaker client is held by a speaker, the participant clients are held by corresponding participants, and the speaker client and the participant clients may be downloaded from a platform by the speaker and the participants respectively and installed on the communication device. Preferably, the communication device may be a mobile phone, a PC, an IPAD, a smart watch, etc., but is not limited thereto. The speaker client and the at least one participant client are in network communication with the conference server respectively. Firstly, a main speaker client end shares a desktop, and sends shared desktop content and application program window coordinates to a conference server, the conference server receives the shared desktop content and the application program window coordinates and then respectively sends the shared desktop content and the application program window coordinates to a participant client end, the participant client end receives the shared desktop content and the application program window coordinates and displays the desktop content, then a participant clicks an interested coordinate position on the desktop, an application program window corresponding to the coordinate position is used as an interest window, then the interest window coordinates are returned to the conference server, the conference server receives the interest window coordinates and identifies corresponding participant client end identification information (such as ID), then the participant client end identification information and the interest window coordinates are returned to the main speaker client end together, after the main speaker client end receives the interest window coordinates, corresponding application window content data is identified and treated as interest window content data. It can be understood that the desktop display of the participant client is a picture, and content data of an application program window cannot be acquired from the picture, and the picture displayed by the participant client is shared by the master client, and the slave client can acquire content data of a corresponding application program window, so that coordinates can be marked on the picture displayed by the participant client, and then the application program window corresponding to the coordinates can be found on the shared desktop of the master client according to the coordinates, and further the corresponding content data of the application program window (i.e. the content data of the fun window) can be extracted. And after the speaker client side obtains the content data of the interest window, the content data of the interest window is sent to the conference server, and is forwarded to the corresponding participant client side by the conference server, and the participant client side stores the content data.
It is to be appreciated that the interest window is a concept on the participant side, and the participant can set the application window on the presenter sharing desktop as the interest window. The content of the window area set as the interest window is always displayed at the topmost image layer position of the participant side, and even if the window at the speaker side is blocked or minimized by other windows, the position of the interest window at the participant side at the topmost image layer is not influenced.
According to the embodiment of the invention, the interest window coordinate is returned to the speaker client, so that the speaker client can obtain the interest window content data according to the interest window coordinate, and the method specifically comprises the following steps:
returning the coordinates of the interest window to the conference server;
receiving the interest window coordinates by the conference server, identifying corresponding participant client identification information, packaging the participant client identification information and the interest window coordinates together into a network message, and sending the network message to the speaker client;
extracting participant client identification information and an interest window coordinate from a network message by a speaker client, calculating a window handle of the interest window coordinate in a speaker client running system, and correlating the window handle with the participant client identification information and recording the window handle into a memory of the running system;
and calling the window handle by the speaker client to acquire the content data of the interest window.
It should be noted that the running system of the speaker client may be a Windows operating system or a Linux operating system, but is not limited thereto.
It should be noted that, associating the window handle with the identification information of the participant client and recording the window handle into the memory of the operating system can enable the speaker to know which participants are interested in what application window. Furthermore, the content concerned by the participants can be conveniently known by the speaker, the content concerned by the participants can be the content which is not clearly taught by the speaker, and if a plurality of participants are respectively marked as interest windows based on the same application program window, the speaker can subsequently supplement and explain the content data of the application program window.
According to the embodiment of the present invention, after associating the window handle with the identification information of the participant client and recording the window handle in the memory of the operating system, the method further includes:
monitoring the associated information recorded in the memory in real time by the running system of the participant client;
judging whether the quantity of the associated information corresponding to the same window handle exceeds a preset threshold value or not;
if yes, extracting the corresponding application program window based on the same window handle, and enabling the application program window to prompt the speaker through the acousto-optic signal.
It should be noted that, when the presenter shares the latest application window, if a participant exceeding a preset threshold appears as an interest window, the boundary line of the application window may be highlighted or flickered on the shared desktop of the presenter client to remind the presenter to explain content data of the application window in detail in the following. Preferably, the preset threshold may be 5 or 10, but is not limited thereto.
According to the embodiment of the present invention, after the interest window is displayed on the top layer of the desktop of the local side based on the content data of the interest window stored in the local side, the method further includes:
rendering the interest window, wherein the rendering mode comprises the following steps:
rendering the boundary line of the interest window through a preset color;
rendering the boundary line of the interest window through a preset line type;
rendering the boundary line of the interest window through a preset dynamic track;
and carrying out highlight rendering on the area of the interest window.
It should be noted that, in order to enable the participant to quickly identify the interest window, the interest window may be rendered. The rendering modes provided by this implementation may be various, for example: the boundary line of the interest window can be rendered through a preset color, and the preset color can be green, red and other colors which are easy to identify; the boundary line of the interest window can be rendered through a preset line type, wherein the preset line type can be a bold line, a wavy line, a dotted line and the like; the boundary line of the interest window can also be rendered through a preset dynamic track, and the preset dynamic track can be that a moving image rotates clockwise or anticlockwise along the boundary line of the interest window; meanwhile, the area of the interest window can be highlighted and rendered, so that the brightness of the interest window is enhanced and is obviously higher than other areas of the desktop, and therefore the participant can conveniently identify the area.
According to the embodiment of the present invention, after the interest window is displayed on the top layer of the desktop of the local side based on the content data of the interest window stored in the local side, the method further includes:
receiving an instruction to hide the interest window;
removing the interest window from the layer top layer of the desktop at the side end, forming a hidden icon in a corresponding area of the desktop at the side end for subsequent restoration, and simultaneously displaying the desktop change content on the layer top layer of the desktop at the side end; or
Receiving an instruction for closing the interest window;
deleting the content data of the interest window stored at the side end, removing the interest window from the layer top layer of the desktop at the side end, and simultaneously displaying the desktop change content on the layer top layer of the desktop at the side end.
It should be noted that, the embodiment may implement hiding or closing the interest window. For example, when a participant temporarily loses heat of the interest window, the mouse arrow may be positioned in the interest window, and the menu bar may be displayed by clicking the right mouse button, and the hiding of the interest window may be achieved by clicking a hidden option in the menu bar. The hidden interest window content data are still stored at the local side, so that the hidden interest window content data can be conveniently restored by clicking the hidden icon. When the participant loses the heat of the interest window permanently, the arrow of the mouse can be positioned in the interest window, the menu bar is displayed by clicking the right button of the mouse, and the interest window is closed by clicking the closing option in the menu bar. The closed interest window content data is deleted from the local side, so that sufficient storage space is made for more interest window content data in the later period.
According to an embodiment of the invention, after receiving the desktop content and the application window coordinates from the presenter client, the method comprises:
returning confirmation information of successfully receiving the shared desktop content and the application program coordinate to the speaker client;
after receiving the confirmation message, the speaker client triggers a timer at the local side to start timing;
when the client of the speaker receives the coordinates of the interest window, ending the timing action of the timer and calculating the continuous sharing duration of the desktop content according to the timing starting time and the timing ending time;
judging whether the continuous sharing duration exceeds a preset threshold value or not by the client of the speaker, and if so, acquiring the content data of the interest window according to the coordinates of the interest window; if not, feeding back notification information of failure generation of the interest window to the participant client, and terminating the subsequent process.
It should be noted that when the speaker selects the shared desktop content, the content that does not need to be shared may be shared out in a short time, and this part of content may relate to the privacy of the speaker, but the speaker often finds and switches the shared desktop content in time, so that the participants cannot clearly view the private content due to insufficient time. However, if during this short sharing time, a participant successfully sets the speaker's private content as the window of interest, the participant has sufficient time to fully understand the speaker's private content. In order to protect the privacy content of the speaker, the embodiment sets time limit, that is, only if the complete content of the window is shared to the participant and exceeds the window with the preset threshold time, the complete content of the window can be set as the interest window, and whether the initiative right of the interest window can be set to be mastered by the participant or not is set, so that the disclosure of the privacy content can be effectively avoided, and the healthy, safe and stable development of the network conference is maintained. Preferably, the value of the preset threshold ranges from 1s to 5s, but is not limited thereto.
According to an embodiment of the invention, after receiving the desktop content and the application window coordinates from the presenter client, the method further comprises:
selecting a plurality of application program windows corresponding to the coordinate positions as interest windows, and respectively returning the coordinates of the interest windows to the client of the speaker;
receiving interest window content data based on a plurality of interest window coordinates sent by the client of the speaker, labeling the interest window content data, and storing the interest window content data at the client;
forming an adaptive number of layers on the desktop of the side end based on the number of the content data of the interest window, wherein the number of the layers is equal to the number of the content data of the interest window plus 1;
when receiving desktop change contents sent by a client of a speaker, displaying the received desktop change contents on the bottommost layer of a desktop layer of a local side, and simultaneously arranging corresponding interest windows downwards from the topmost layer of the desktop layer of the local side in sequence according to the label size of the content data of the interest windows;
and receiving a layer adjustment instruction for a certain interest window, and adjusting the interest window to a specified layer based on the layer adjustment instruction.
It should be noted that the client of the participant in this embodiment may support multiple interest windows, that is, the participant may select multiple interest window coordinates from the desktop of the local side and send the multiple interest window coordinates to the client of the speaker, and then the speaker obtains corresponding interest window content data based on the interest window coordinates, and sends the corresponding interest window content data to the client of the participant, and after labeling, the content data is stored locally; by labeling the labels, the multiple interest windows can be conveniently managed subsequently. It can be understood that the participant client should construct a layer architecture based on the number of the interest window content data, for example, if the number of the interest window content data is 2, the layer architecture includes 3 layers of layers, two interest windows occupy the upper two layers of the layer architecture respectively, and currently shared desktop content occupies the lowest layer of the layer architecture.
It should be noted that, when multiple interest windows are displayed together, which may cause individual interest windows to be blocked, this embodiment may support adjustment of the interest window layer, for example, a participant needs to view the interest window of the layer 2, and the interest window is blocked by the interest window of the top layer, at this time, a menu field may be displayed by a right mouse button, and adjustment of a specified interest window may be implemented by a layer shift option of the menu field. Furthermore, the layer architecture model may also be a specified field layer architecture model at the participant client, where the layer architecture model displays icons of layers at all levels, and the icons of corresponding layers are dragged by a mouse to shift in the layer architecture model, so as to realize layer adjustment of a certain interest window.
According to the embodiment of the invention, after receiving the desktop change content sent by the client of the speaker, the method further comprises the following steps:
selecting an application program window corresponding to a certain coordinate position as an interest window from the desktop to change the content, and returning the interest window coordinate to the speaker client so that the speaker client can obtain the content data of the interest window according to the interest window coordinate;
receiving interest window content data sent by the client of the speaker, labeling labels according to the label rule of the client, and storing the labels at the client;
and reforming a layer with an adaptive number on the desktop of the side end based on the number of the content data of the current interest window of the side end, and sequentially arranging the corresponding interest windows downwards from the topmost layer of the desktop of the side end according to the label size of the content data of the interest windows.
It should be noted that, the value of the received tag is smaller first, and the value of the received tag is larger later, and through such setting, the recently set interest window can be presented at the topmost layer of the graph layer architecture to cater to the current interest point of the participant.
In practical application, it is possible that a participant is accessed in the middle of a web conference, before the participant accesses the web conference, a speaker already shares a lot of desktop contents, and the part of desktop contents are likely to be hidden or covered by the speaker, how to make the participant accessed later efficiently extract an application program window interested in the participant from the desktop contents shared by the speaker before, and the following description is respectively made through three embodiments.
Example one
The method further comprises the following steps:
the conference server respectively stores all the application program window content data shared by the client of the speaker;
when a participant client accesses a conference server in the middle of a conference, and provides feature information such as occupation, post and conference appeal of the participant for the conference server;
the conference server respectively compares the feature information with all application program window content data shared by locally stored speaker clients one by one, and respectively calculates to obtain a plurality of similarity degrees;
the conference server sends the application program window content data with the highest similarity or higher than a preset threshold value as interest window content data to the participant client and stores the interest window content data;
and the participant client displays the interest window based on the interest window content data.
It should be noted that, because there are many application windows shared by the speaker, in the first embodiment, an application window matched with the speaker can be selected as an interest window according to the occupation, the post and the meeting appeal of the subsequently accessed participant, so that the subsequently accessed participant can efficiently extract the desktop core content shared by the speaker (for the subsequently accessed participant). It is understood that there may be more than one or none of the application window content data above the preset threshold; the content data of the application program windows can be fed back to the participant client, and the interest windows are displayed through multiple layers; if not, no window of interest may be exposed.
Example two
The method further comprises the following steps:
the internal memory of the operating system of the speaker client stores the interest window handles set by other participant clients;
respectively judging the interest degree of each interest window handle at the client of other participants;
extracting interest window handles with the highest interest heat or the top n interest window handles;
acquiring interest window content data based on the extracted interest window handle, sending the interest window content data to the participant client, and storing the interest window content data;
and the participant client displays the interest window based on the interest window content data.
It should be noted that the interest degree is how many participants are set in the same interest window, and the interest degree is higher when the number of participants set in the same interest window is larger. By referring to the interest windows set by other participants, the embodiment can quickly extract the desktop core content shared by the speaker before (for the participant who accesses later).
EXAMPLE III
The method further comprises the following steps:
the internal memory of the operating system of the speaker client stores the interest window handles set by other participant clients;
when a participant client accesses a conference server in the middle of a conference, providing department information of the participants for the conference server;
the conference server feeds back the department information of the participant to the speaker client;
the speaker client screens out the participants with consistent department information from other participants based on the department information, and forms a group of the participants in the department;
screening out an interest window handle corresponding to the group of the participating persons in the department from the memory by the client of the speaker;
respectively judging the interest degree of each interest window handle in the participatory group of the department;
extracting interest window handles with the highest interest heat or the top n interest window handles;
acquiring interest window content data based on the extracted interest window handle, sending the interest window content data to the participant client, and storing the interest window content data;
and the participant client displays the interest window based on the interest window content data.
It should be noted that the third embodiment is further optimized on the basis of the second embodiment, and since the interests of the participants in the same department are generally the same or similar, the third embodiment only extracts from the interest windows set in the same department, thereby providing a more suitable interest window for the subsequently accessed participants.
FIG. 2 is a flow diagram illustrating a method for personalizing viewing of a shared desktop, in accordance with an embodiment of the present invention.
The speaker desktop in fig. 2 is a desktop of a speaker client, the server is a conference server, and a participant is a participant client.
Firstly, a speaker desktop shares a desktop, and sends desktop contents and window application program (namely application program window) coordinates to send a server;
the server sends the desktop content and the window application program coordinate to a certain participant;
the participants select a certain area coordinate as an interest window and return the interest window to the server;
the server forwards the interest window to a speaker desktop, the speaker desktop calculates a window handle of the interest window in the system (an operating system, such as a Windows system), and records the id of the participant and the window handle in a memory in an associated manner;
the method comprises the steps that a speaker desktop acquires content data of an interest window and sends the content data to a server;
the server forwards the content data of the interest window to a certain participant;
some participant saves the content data of the interest window;
when the desktop content of the speaker interface changes, sending the new desktop content and the window application program coordinate to the server;
the server forwards the new desktop content and the window application program coordinate to a certain participant;
the interest window is always displayed at the topmost position of the desktop of the participant, and subsequent participants can render desktop sharing and interest windows.
To further illustrate the technical solution of the present invention, a specific implementation scenario is illustrated below.
First, the presenter shares the desktop, on which a document "Streaming systems. pdf" is opened, and fig. 3 is the desktop sharing content seen by the participant side.
This document is of particular interest to the participant, where the participant can interactively set the document as an "interest window", fig. 4, where the participant side is setting an "interest window".
Pdf documents are occluded by another document opened on the speaker side. Fig. 5 is a desktop display of the presenter side.
Because the participant sets "Streaming systems. pdf" as the interest window, the area where the interest window "Streaming systems. pdf" is located is displayed on the topmost layer according to the characteristics of the interest window; the area of interest window may have some effect, such as a circle of green lines around the perimeter of the interest window. Fig. 6 is a display effect of the participant side.
FIG. 7 is a block diagram of a system for personalized viewing of a shared desktop in accordance with the present invention.
As shown in fig. 7, the second aspect of the present invention further provides a system 7 for personalized viewing of a shared desktop, including a memory 71 and a processor 72, where the memory 71 includes a method program for personalized viewing of a shared desktop, and when executed by the processor 72, the method program for sensing a sharing result and a sharing status implements the following steps:
receiving desktop content and application program window coordinates shared by a speaker client, wherein the desktop content comprises an application program window;
selecting an application program window corresponding to a certain coordinate position as an interest window, and returning the coordinates of the interest window to the client of the speaker so that the client of the speaker can obtain the content data of the interest window according to the coordinates of the interest window;
receiving the interest window content data sent by the client of the speaker, and storing the interest window content data at the local side;
when receiving desktop change content sent by a speaker client, displaying an interest window on the top layer of the desktop of the client based on the interest window content data stored by the client, and displaying the received desktop change content on the next layer of the layer where the interest window is located.
According to the embodiment of the invention, the interest window coordinate is returned to the speaker client, so that the speaker client can obtain the interest window content data according to the interest window coordinate, and the method specifically comprises the following steps:
returning the coordinates of the interest window to the conference server;
receiving the interest window coordinates by the conference server, identifying corresponding participant client identification information, packaging the participant client identification information and the interest window coordinates together into a network message, and sending the network message to the speaker client;
extracting participant client identification information and an interest window coordinate from a network message by a speaker client, calculating a window handle of the interest window coordinate in a speaker client running system, and correlating the window handle with the participant client identification information and recording the window handle into a memory of the running system;
and calling the window handle by the speaker client to acquire the content data of the interest window.
According to an embodiment of the present invention, when executed by the processor, the method for sensing the shared result and status further includes:
returning confirmation information of successfully receiving the shared desktop content and the application program coordinate to the speaker client;
after receiving the confirmation message, the speaker client triggers a timer at the local side to start timing;
when the client of the speaker receives the coordinates of the interest window, ending the timing action of the timer and calculating the continuous sharing duration of the desktop content according to the timing starting time and the timing ending time;
judging whether the continuous sharing duration exceeds a preset threshold value or not by the client of the speaker, and if so, acquiring the content data of the interest window according to the coordinates of the interest window; if not, feeding back notification information of failure generation of the interest window to the participant client, and terminating the subsequent process.
The third aspect of the present invention also provides a computer-readable storage medium, where the computer-readable storage medium includes a program of a method for personalized viewing of a shared desktop, and when the program of the method for personalized viewing of a shared desktop is executed by a processor, the steps of the method for personalized viewing of a shared desktop are implemented.
According to the method, the system and the readable storage medium for personalized viewing of the shared desktop, disclosed by the invention, the participant can set the application program window on the shared desktop of the speaker as the interest window, the content of the window area set as the interest window can be always displayed at the topmost layer position of the participant side, even if the window at the speaker side is blocked or minimized by other windows, the position of the interest window at the participant side at the topmost layer can not be influenced, and thus the effect of personalized viewing of the shared desktop at the participant side is realized.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
Claims (10)
1. A method for personalizing viewing of a shared desktop, comprising the steps of:
receiving desktop content and application program window coordinates shared by a speaker client, wherein the desktop content comprises an application program window;
selecting an application program window corresponding to a certain coordinate position as an interest window, and returning the coordinates of the interest window to the client of the speaker so that the client of the speaker can obtain the content data of the interest window according to the coordinates of the interest window;
receiving the interest window content data sent by the client of the speaker, and storing the interest window content data at the local side;
when receiving desktop change content sent by a speaker client, displaying an interest window on the top layer of the desktop of the client based on the interest window content data stored by the client, and displaying the received desktop change content on the next layer of the layer where the interest window is located.
2. The method of claim 1, wherein the step of returning the interest window coordinates to the speaker client so that the speaker client obtains the interest window content data according to the interest window coordinates comprises:
returning the coordinates of the interest window to the conference server;
receiving the interest window coordinates by the conference server, identifying corresponding participant client identification information, packaging the participant client identification information and the interest window coordinates together into a network message, and sending the network message to the speaker client;
extracting participant client identification information and an interest window coordinate from a network message by a speaker client, calculating a window handle of the interest window coordinate in a speaker client running system, and correlating the window handle with the participant client identification information and recording the window handle into a memory of the running system;
and calling the window handle by the speaker client to acquire the content data of the interest window.
3. The method of claim 1, wherein after displaying the interest window on a top layer of a layer of the desktop of the local side based on the content data of the interest window stored on the local side, the method further comprises:
rendering the interest window, wherein the rendering mode is as follows:
rendering the boundary line of the interest window through a preset color; or
Rendering the boundary line of the interest window through a preset line type; or
Rendering the boundary line of the interest window through a preset dynamic track; or
And carrying out highlight rendering on the area of the interest window.
4. The method of claim 1, wherein after displaying the interest window on a top layer of a layer of the desktop of the local side based on the content data of the interest window stored on the local side, the method further comprises:
receiving an instruction to hide the interest window;
removing the interest window from the layer top layer of the desktop at the side end, forming a hidden icon in a corresponding area of the desktop at the side end for subsequent restoration, and simultaneously displaying the desktop change content on the layer top layer of the desktop at the side end; or
Receiving an instruction for closing the interest window;
deleting the content data of the interest window stored at the side end, removing the interest window from the layer top layer of the desktop at the side end, and simultaneously displaying the desktop change content on the layer top layer of the desktop at the side end.
5. The method of claim 1, wherein after receiving the desktop content and application window coordinates from the presenter client, the method comprises:
returning confirmation information of successfully receiving the shared desktop content and the application program coordinate to the speaker client;
after receiving the confirmation message, the speaker client triggers a timer at the local side to start timing;
when the client of the speaker receives the coordinates of the interest window, ending the timing action of the timer and calculating the continuous sharing duration of the desktop content according to the timing starting time and the timing ending time;
judging whether the continuous sharing duration exceeds a preset threshold value or not by the client of the speaker, and if so, acquiring the content data of the interest window according to the coordinates of the interest window; if not, feeding back notification information of failure generation of the interest window to the participant client, and terminating the subsequent process.
6. The method of claim 1, wherein after receiving the desktop content and application window coordinates from the presenter client, the method further comprises:
selecting a plurality of application program windows corresponding to the coordinate positions as interest windows, and respectively returning the coordinates of the interest windows to the client of the speaker;
receiving interest window content data based on a plurality of interest window coordinates sent by the client of the speaker, labeling the interest window content data, and storing the interest window content data at the client;
forming an adaptive number of layers on the desktop of the side end based on the number of the content data of the interest window, wherein the number of the layers is equal to the number of the content data of the interest window plus 1;
when receiving desktop change contents sent by a client of a speaker, displaying the received desktop change contents on the bottommost layer of a desktop layer of a local side, and simultaneously arranging corresponding interest windows downwards from the topmost layer of the desktop layer of the local side in sequence according to the label size of the content data of the interest windows;
and receiving a layer adjustment instruction for a certain interest window, and adjusting the interest window to a specified layer based on the layer adjustment instruction.
7. A system for personalized viewing of a shared desktop, comprising a memory and a processor, wherein the memory comprises a method program for personalized viewing of a shared desktop, and the method program for personalized viewing of a shared desktop, when executed by the processor, implements the following steps:
receiving desktop content and application program window coordinates shared by a speaker client, wherein the desktop content comprises an application program window;
selecting an application program window corresponding to a certain coordinate position as an interest window, and returning the coordinates of the interest window to the client of the speaker so that the client of the speaker can obtain the content data of the interest window according to the coordinates of the interest window;
receiving the interest window content data sent by the client of the speaker, and storing the interest window content data at the local side;
when receiving desktop change content sent by a speaker client, displaying an interest window on the top layer of the desktop of the client based on the interest window content data stored by the client, and displaying the received desktop change content on the next layer of the layer where the interest window is located.
8. The system of claim 7, wherein the step of returning the interest window coordinates to the speaker client to enable the speaker client to obtain the interest window content data according to the interest window coordinates comprises:
returning the coordinates of the interest window to the conference server;
receiving the interest window coordinates by the conference server, identifying corresponding participant client identification information, packaging the participant client identification information and the interest window coordinates together into a network message, and sending the network message to the speaker client;
extracting participant client identification information and an interest window coordinate from a network message by a speaker client, calculating a window handle of the interest window coordinate in a speaker client running system, and correlating the window handle with the participant client identification information and recording the window handle into a memory of the running system;
and calling the window handle by the speaker client to acquire the content data of the interest window.
9. The system for personalized viewing of a shared desktop according to claim 7, wherein the method program for personalized viewing of a shared desktop when executed by the processor further implements the following steps:
returning confirmation information of successfully receiving the shared desktop content and the application program coordinate to the speaker client;
after receiving the confirmation message, the speaker client triggers a timer at the local side to start timing;
when the client of the speaker receives the coordinates of the interest window, ending the timing action of the timer and calculating the continuous sharing duration of the desktop content according to the timing starting time and the timing ending time;
judging whether the continuous sharing duration exceeds a preset threshold value or not by the client of the speaker, and if so, acquiring the content data of the interest window according to the coordinates of the interest window; if not, feeding back notification information of failure generation of the interest window to the participant client, and terminating the subsequent process.
10. A computer-readable storage medium, wherein the computer-readable storage medium includes a program of a method for personalized viewing of a shared desktop, and when the program of the method for personalized viewing of a shared desktop is executed by a processor, the steps of the method for personalized viewing of a shared desktop as claimed in any one of claims 1 to 6 are implemented.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110543058.0A CN112988315B (en) | 2021-05-19 | 2021-05-19 | Method, system and readable storage medium for personalized viewing of shared desktop |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110543058.0A CN112988315B (en) | 2021-05-19 | 2021-05-19 | Method, system and readable storage medium for personalized viewing of shared desktop |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112988315A true CN112988315A (en) | 2021-06-18 |
| CN112988315B CN112988315B (en) | 2021-08-27 |
Family
ID=76336802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110543058.0A Active CN112988315B (en) | 2021-05-19 | 2021-05-19 | Method, system and readable storage medium for personalized viewing of shared desktop |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112988315B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113253967A (en) * | 2021-07-12 | 2021-08-13 | 全时云商务服务股份有限公司 | Reminding method and system for network conference shared application program and readable storage medium |
| CN115396404A (en) * | 2022-08-08 | 2022-11-25 | 深圳乐播科技有限公司 | Synchronous screen projection method and related device for speaker explanation position in cloud conference scene |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107113397A (en) * | 2014-12-05 | 2017-08-29 | 英特尔Ip公司 | Interactive video meeting |
| CN111338590A (en) * | 2020-02-19 | 2020-06-26 | 北京翼鸥教育科技有限公司 | Screen sharing initiating and responding method and interaction system |
| CN111756672A (en) * | 2019-03-26 | 2020-10-09 | 阿里巴巴集团控股有限公司 | Conference content saving and acquiring method, conference system, conference equipment and storage medium |
| CN112463098A (en) * | 2020-12-25 | 2021-03-09 | 创想空间信息技术(苏州)有限公司 | Method and system for freezing specific application program update |
| CN112463283A (en) * | 2020-12-25 | 2021-03-09 | 创想空间信息技术(苏州)有限公司 | Method and system for reviewing historical content of application program and electronic equipment |
| CN112565666A (en) * | 2020-12-25 | 2021-03-26 | 创想空间信息技术(苏州)有限公司 | Method and system for quickly viewing desktop shared historical content |
| CN112565667A (en) * | 2020-12-25 | 2021-03-26 | 创想空间信息技术(苏州)有限公司 | Method and system for reviewing historical content of application program |
| CN112579244A (en) * | 2021-02-25 | 2021-03-30 | 全时云商务服务股份有限公司 | Method and system for capturing regional picture in remote desktop at mobile terminal |
| CN112612570A (en) * | 2021-03-08 | 2021-04-06 | 全时云商务服务股份有限公司 | Method and system for viewing shielded area of application program |
-
2021
- 2021-05-19 CN CN202110543058.0A patent/CN112988315B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107113397A (en) * | 2014-12-05 | 2017-08-29 | 英特尔Ip公司 | Interactive video meeting |
| CN111756672A (en) * | 2019-03-26 | 2020-10-09 | 阿里巴巴集团控股有限公司 | Conference content saving and acquiring method, conference system, conference equipment and storage medium |
| CN111338590A (en) * | 2020-02-19 | 2020-06-26 | 北京翼鸥教育科技有限公司 | Screen sharing initiating and responding method and interaction system |
| CN112463098A (en) * | 2020-12-25 | 2021-03-09 | 创想空间信息技术(苏州)有限公司 | Method and system for freezing specific application program update |
| CN112463283A (en) * | 2020-12-25 | 2021-03-09 | 创想空间信息技术(苏州)有限公司 | Method and system for reviewing historical content of application program and electronic equipment |
| CN112565666A (en) * | 2020-12-25 | 2021-03-26 | 创想空间信息技术(苏州)有限公司 | Method and system for quickly viewing desktop shared historical content |
| CN112565667A (en) * | 2020-12-25 | 2021-03-26 | 创想空间信息技术(苏州)有限公司 | Method and system for reviewing historical content of application program |
| CN112579244A (en) * | 2021-02-25 | 2021-03-30 | 全时云商务服务股份有限公司 | Method and system for capturing regional picture in remote desktop at mobile terminal |
| CN112612570A (en) * | 2021-03-08 | 2021-04-06 | 全时云商务服务股份有限公司 | Method and system for viewing shielded area of application program |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113253967A (en) * | 2021-07-12 | 2021-08-13 | 全时云商务服务股份有限公司 | Reminding method and system for network conference shared application program and readable storage medium |
| CN113253967B (en) * | 2021-07-12 | 2021-10-29 | 全时云商务服务股份有限公司 | Reminding method and system for network conference shared application program and readable storage medium |
| CN115396404A (en) * | 2022-08-08 | 2022-11-25 | 深圳乐播科技有限公司 | Synchronous screen projection method and related device for speaker explanation position in cloud conference scene |
| CN115396404B (en) * | 2022-08-08 | 2023-09-05 | 深圳乐播科技有限公司 | Synchronous screen throwing method and related device for explanation positions of main speakers in cloud conference scene |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112988315B (en) | 2021-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9686497B1 (en) | Video annotation and dynamic video call display for multi-camera devices | |
| CN110570698B (en) | Online teaching control method and device, storage medium and terminal | |
| US11171893B2 (en) | Methods and systems for providing virtual collaboration via network | |
| CN104836981B (en) | The collaboration method and conference terminal of intelligent meeting | |
| AU2013346503B2 (en) | Multi-user interactive virtual environment including broadcast content and enhanced social layer content | |
| CN109691054A (en) | Animation user identifier | |
| EP2685715B1 (en) | Method and device for managing video resources in video conference | |
| CN111541936A (en) | Video and image processing method and device, electronic equipment and storage medium | |
| CN112988315B (en) | Method, system and readable storage medium for personalized viewing of shared desktop | |
| US20140188997A1 (en) | Creating and Sharing Inline Media Commentary Within a Network | |
| US9471902B2 (en) | Proxy for asynchronous meeting participation | |
| CN108683954A (en) | Pop-up animation producing method and device, pop-up animation, network direct broadcasting server | |
| CN104822077B (en) | The operation method and client of client | |
| CN111314730A (en) | Virtual resource searching method, device, equipment and storage medium for live video | |
| CN108769724A (en) | Method and apparatus, the network direct broadcasting system of pop-up are pushed in network direct broadcasting | |
| US20220084292A1 (en) | Extended reality markers for enhancing social engagement | |
| CN113573090A (en) | Content display method, device and system in game live broadcast and storage medium | |
| US9740378B2 (en) | Collaboration content sharing | |
| CN107409230A (en) | social interaction system based on video | |
| CN114430494B (en) | Interface display method, device, equipment and storage medium | |
| CN114139491A (en) | Data processing method, device and storage medium | |
| CN113938696A (en) | Live broadcast interaction method and system based on user-defined virtual gift and computer equipment | |
| CN109819341A (en) | Video broadcasting method, calculates equipment and storage medium at device | |
| CN109688347A (en) | Multi-screen interaction method, device and electronic equipment | |
| CN115277660A (en) | Control method for synchronous reading of documents between APP and small programs during remote double recording |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |