CN112988025A - Cross-device sharing method, system and readable storage medium - Google Patents
Cross-device sharing method, system and readable storage medium Download PDFInfo
- Publication number
- CN112988025A CN112988025A CN202110559743.2A CN202110559743A CN112988025A CN 112988025 A CN112988025 A CN 112988025A CN 202110559743 A CN202110559743 A CN 202110559743A CN 112988025 A CN112988025 A CN 112988025A
- Authority
- CN
- China
- Prior art keywords
- client
- speaker
- equipment
- speaker client
- desktop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
The invention discloses a cross-device sharing method, a cross-device sharing system and a readable storage medium, wherein the method comprises the following steps: receiving a login request sent by a speaker through a speaker client installed in a plurality of devices; after the verification is passed, respectively establishing network long connection with the speaker clients of the multiple devices; establishing a conference leader connection with a speaker client of the selected equipment based on the conference joining request of the selected equipment; pushing identification information of other equipment in the multiple equipment to a speaker client of the selected equipment; receiving a cross-device sharing instruction sent by the speaker client of the selected device based on the identification information of the target device, and forwarding the cross-device sharing instruction to the speaker client of the target device; and receiving desktop shared data sent by the main speaker client of the target equipment, and forwarding the desktop shared data to each participant client and the main speaker client of the selected equipment for displaying. The invention realizes the effect of cross-device sharing.
Description
Technical Field
The present invention relates to the field of desktop sharing technologies, and in particular, to a method, a system, and a readable storage medium for cross-device sharing.
Background
At present, with the development of computer technology, network technology and communication technology, the application of netmeeting is more and more extensive, such as remote monitoring, remote teaching, remote medical diagnosis and the like. By using the conference system, people far away from thousands of miles can hold various conferences together or discuss academic problems with technicians far away. The system greatly facilitates real and intuitive communication among the cooperative members by transmitting the video and audio information of the writing members; at present, a network conference system can provide a desktop sharing function, that is, a client of a desktop sharer can acquire information of a client interface in real time, and then send the information of the client interface to clients of other participants through a server.
In the existing network conference, it is common that one user has a plurality of devices (a plurality of mobile phones, a plurality of desktop systems and the like). When a user enters a meeting through a network, the user needs to share the devices and perform operations on the devices, but in the conventional method, the user logs in each device and enters the meeting through each device, each device shares a desktop or an application program of the user and performs related operations, and the user experience is poor when the user is not around the device and cannot share the device.
Disclosure of Invention
In view of the above problems, it is an object of the present invention to provide a cross-device sharing method, system and readable storage medium, which can achieve the cross-device sharing effect.
The first aspect of the present invention provides a cross-device sharing method, including the following steps:
receiving a login request sent by a speaker through a speaker client installed in a plurality of devices;
respectively verifying login requests sent by the speaker client sides of the multiple devices, and respectively establishing long network connection with the speaker client sides of the multiple devices after the login requests are verified;
receiving an conference joining request sent by a speaker through a speaker client of a selected device in a plurality of devices, and establishing conference long connection with the speaker client of the selected device based on the conference joining request;
pushing identification information of other equipment in the multiple equipment to a speaker client of the selected equipment;
receiving a cross-device sharing instruction sent by the speaker client of the selected device based on the identification information of the target device, and forwarding the cross-device sharing instruction to the speaker client of the target device;
and receiving desktop shared data sent by the main speaker client of the target equipment, and forwarding the desktop shared data to each participant client and the main speaker client of the selected equipment for displaying.
In this scheme, after the participant client and the speaker client of the selected device are forwarded to the participant client for display, the method further includes:
receiving an operation instruction of a speaker client of the selected equipment for desktop sharing data of the target equipment;
forwarding the operation instruction to a speaker client of the target equipment, and executing operation by the speaker client of the target equipment based on the operation instruction;
and receiving the newly shared desktop change content after the main speaker client of the target equipment executes the operation, and forwarding the newly shared desktop change content to each participant client and the main speaker client of the selected equipment for refreshing and displaying.
In this embodiment, the method further includes:
receiving desktop sharing data sent by a main speaker client of the target equipment, and forwarding the desktop sharing data to each participant client and a main speaker client of the selected equipment in a sharing picture mode for displaying;
opening the operation authority of the speaker client of the selected equipment, and capturing the trigger action of a keyboard mouse or a touch screen of the local side terminal on a certain coordinate position in the shared picture by the speaker client of the selected equipment;
and receiving a trigger action aiming at a certain coordinate position in the shared picture sent by the speaker client of the selected equipment, forwarding the trigger action to the speaker client of the target equipment, and simulating and executing the operation process by the speaker client of the target equipment based on the trigger action of the coordinate position.
In this embodiment, the method further includes:
respectively issuing digital certificates to a plurality of devices of a speaker, associating the digital certificates with a plurality of device identification information of the speaker, and storing the digital certificates in a local database;
after meeting leader connection is established, opening the control authority of a speaker client of the selected equipment on desktop shared data of the target equipment;
receiving an operation instruction and signature information of a speaker client of the selected equipment aiming at the desktop shared data of the target equipment;
judging whether the login ID of the main speaker client of the selected equipment is consistent with the login ID of the main speaker client of the target equipment;
if the identification information of the selected equipment is consistent with the identification information of the selected equipment, acquiring a corresponding digital certificate from a local database;
and verifying the signature of the signature information by adopting the public key of the digital certificate, and after the signature passes the verification, the operation instruction is valid and effective.
In this scheme, after receiving the desktop sharing data sent by the speaker client of the target device, the method further includes:
preferentially forwarding the desktop sharing data sent by the speaker client of the target equipment to the speaker client of the selected equipment for display so that the speaker can check the desktop sharing data;
when receiving the auditing passing information fed back by the main speaker client of the selected equipment, forwarding the desktop sharing data to each participant client; and when receiving the auditing failure information fed back by the main speaker client of the selected equipment, stopping forwarding the desktop sharing data to each participant client.
In this embodiment, the method further includes:
if the number of the target devices is multiple, receiving management and control instructions of desktop sharing data of the multiple target devices, which are sent by the main speaker client of the selected device, on the display modes of the various participant clients and the main speaker client of the selected device;
and processing desktop shared data of the target devices according to the control instruction, and forwarding the processed shared data to each participant client and the speaker client of the selected device.
The second aspect of the present invention further provides a cross-device shared system, including a memory and a processor, where the memory includes a cross-device shared method program, and when executed by the processor, the cross-device shared method program implements the following steps:
receiving a login request sent by a speaker through a speaker client installed in a plurality of devices;
respectively verifying login requests sent by the speaker client sides of the multiple devices, and respectively establishing long network connection with the speaker client sides of the multiple devices after the login requests are verified;
receiving an conference joining request sent by a speaker through a speaker client of a selected device in a plurality of devices, and establishing conference long connection with the speaker client of the selected device based on the conference joining request;
pushing identification information of other equipment in the multiple equipment to a speaker client of the selected equipment;
receiving a cross-device sharing instruction sent by the speaker client of the selected device based on the identification information of the target device, and forwarding the cross-device sharing instruction to the speaker client of the target device;
and receiving desktop shared data sent by the main speaker client of the target equipment, and forwarding the desktop shared data to each participant client and the main speaker client of the selected equipment for displaying.
In this scheme, when executed by the processor, the cross-device sharing method further implements the following steps:
receiving an operation instruction of a speaker client of the selected equipment for desktop sharing data of the target equipment;
forwarding the operation instruction to a speaker client of the target equipment, and executing operation by the speaker client of the target equipment based on the operation instruction;
and receiving the newly shared desktop change content after the main speaker client of the target equipment executes the operation, and forwarding the newly shared desktop change content to each participant client and the main speaker client of the selected equipment for refreshing and displaying.
In this scheme, when executed by the processor, the cross-device sharing method further implements the following steps:
receiving desktop sharing data sent by a main speaker client of the target equipment, and forwarding the desktop sharing data to each participant client and a main speaker client of the selected equipment in a sharing picture mode for displaying;
opening the operation authority of the speaker client of the selected equipment, and capturing the trigger action of a keyboard mouse or a touch screen of the local side terminal on a certain coordinate position in the shared picture by the speaker client of the selected equipment;
and receiving a trigger action aiming at a certain coordinate position in the shared picture sent by the speaker client of the selected equipment, forwarding the trigger action to the speaker client of the target equipment, and simulating and executing the operation process by the speaker client of the target equipment based on the trigger action of the coordinate position.
The third aspect of the present invention also provides a computer-readable storage medium, which includes a cross-device sharing method program, and when the cross-device sharing method program is executed by a processor, the steps of the cross-device sharing method are implemented as described above.
The cross-device sharing method, the cross-device sharing system and the readable storage medium enable a user to achieve the purpose of sharing other remote devices through the devices at the user, further achieve the cross-device sharing effect, and further enhance the sharing experience of the user.
Drawings
FIG. 1 illustrates a flow chart of a cross device sharing method of the present invention;
FIG. 2 illustrates a flowchart of a cross device sharing method of a particular embodiment of the present invention;
FIG. 3 is a schematic diagram of a selected device web conference interaction interface in accordance with an embodiment of the present invention;
FIG. 4 illustrates a toolbar view of a selected device web conference interaction interface in accordance with an embodiment of the present invention;
5-7 are diagrams illustrating the display effect of the shared desktop data at different time periods according to an embodiment of the present invention;
FIG. 8 is a system block diagram illustrating cross device sharing in accordance with the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
FIG. 1 is a flow chart of a cross-device sharing method of the present invention.
As shown in fig. 1, a first aspect of the present invention provides a cross-device sharing method, including the following steps:
s102, receiving a login request sent by a speaker through a speaker client installed on a plurality of devices;
s104, verifying login requests sent by the speaker clients of the multiple devices respectively, and after the login requests pass the verification, establishing long network connection with the speaker clients of the multiple devices respectively;
s106, receiving a conference entrance request sent by a speaker through a speaker client of a selected device in the plurality of devices, and establishing conference leader connection with the speaker client of the selected device based on the conference entrance request;
s108, pushing identification information of other equipment in the multiple equipment to the speaker client of the selected equipment;
s110, receiving a cross-device sharing instruction sent by the speaker client of the selected device based on the identification information of the target device, and forwarding the cross-device sharing instruction to the speaker client of the target device;
and S112, receiving the desktop sharing data sent by the speaker client of the target equipment, and forwarding the desktop sharing data to the participant clients and the speaker client of the selected equipment for display.
It will be appreciated that the selected device and the target device are both comprised in a plurality of devices of the speaker. The two other devices are opposed, the first other device being a device other than the selected device of the plurality of devices of the speaker; the second other device is a device other than the target device among the plurality of devices of the speaker.
It can be understood that the speaker only has the selected device to enter the meeting, that is, the speaker side can only see the desktop shared data through the selected device, and other devices cannot see the desktop shared data because the selected device does not enter the meeting.
Before the above steps are performed, a network conference system needs to be set up, and the network conference system may include a plurality of devices of a speaker, a server, and at least one device of a participant. And the speaker client is respectively installed on a plurality of devices of the speaker, and the participant client is installed on the device of the participant. Preferably, the device may be a mobile phone, a PC, an IPAD, a smart watch, etc., but is not limited thereto. The devices of the speaker and the participants are in network communication with the server respectively. The server also comprises a login server and a conference server, wherein the login server is in communication connection with the conference server. Firstly, a speaker client and a participant client respectively send login requests to the login server, the login server verifies the information of each login request, after the verification is passed, the login is successful, and network long connection between the login server and the speaker client and between the login server and the participant client is established. Later, the speaker selects the equipment needing to enter the meeting from the multiple equipment, fills in the meeting number through the speaker client of the selected equipment, sends out a meeting entering request to the meeting server, and the meeting server verifies whether the meeting number is valid or not, and if the meeting number is valid, establishes the meeting length connection between the meeting server and the speaker client of the selected equipment. The conference server then requests the login server to acquire all the device identification information of the speaker, and specifically, the conference server may extract a speaker identity ID (such as an account number) from a speaker client when the conference server previously attended, and then request the login server to acquire all the device identification information of the speaker based on the speaker identity ID. When the login server receives the identity ID of the speaker and the acquisition request, all devices of the speaker matched with the identity ID of the speaker are searched and acquired based on the identity ID of the speaker, the identification information of all the devices of the speaker is returned to the conference server, and then the conference server pushes the identification information of all the devices to the client of the speaker of the selected device. And then the speaker client of the target device shares the desktop content of the speaker client of the target device to each participant client and the speaker client of the selected device based on the cross-device sharing instruction for display.
According to an embodiment of the present invention, after being forwarded to each participant client and the selected device's speaker client for presentation, the method further comprises:
receiving an operation instruction of a speaker client of the selected equipment for desktop sharing data of the target equipment;
forwarding the operation instruction to a speaker client of the target equipment, and executing operation by the speaker client of the target equipment based on the operation instruction;
and receiving the newly shared desktop change content after the main speaker client of the target equipment executes the operation, and forwarding the newly shared desktop change content to each participant client and the main speaker client of the selected equipment for refreshing and displaying.
It should be noted that the speaker can issue an operation instruction to the speaker client of the target device through the speaker client of the selected device, so that the speaker client of the target device adjusts the desktop shared data, thereby achieving the effect of cross-device shared control.
According to an embodiment of the invention, the method further comprises:
receiving desktop sharing data sent by a main speaker client of the target equipment, and forwarding the desktop sharing data to each participant client and a main speaker client of the selected equipment in a sharing picture mode for displaying;
opening the operation authority of the speaker client of the selected equipment, and capturing the trigger action of a keyboard mouse or a touch screen of the local side terminal on a certain coordinate position in the shared picture by the speaker client of the selected equipment;
and receiving a trigger action aiming at a certain coordinate position in the shared picture sent by the speaker client of the selected equipment, forwarding the trigger action to the speaker client of the target equipment, and simulating and executing the operation process by the speaker client of the target equipment based on the trigger action of the coordinate position.
It should be noted that, because the target device shares the desktop content and is a picture on the selected device or the participant device, and the speaker performs the mouse and keyboard operations on the selected device, the speaker client of the selected device captures the picture coordinate position of the mouse and keyboard operations and the mouse and keyboard operations, associates the mouse and keyboard operations and the picture coordinate position and sends them to the conference server, and then the conference server transfers them to the target device, and the speaker client of the target device determines the current operation area based on the picture window coordinate position, and virtualizes the mouse and the keyboard device at the side, and makes the virtual mouse and the keyboard device execute the received mouse and keyboard operations, the purpose of cross-device sharing operations can be achieved by the present embodiment.
According to an embodiment of the invention, the method further comprises:
respectively issuing digital certificates to a plurality of devices of a speaker, associating the digital certificates with a plurality of device identification information of the speaker, and storing the digital certificates in a local database;
after meeting leader connection is established, opening the control authority of a speaker client of the selected equipment on desktop shared data of the target equipment;
receiving an operation instruction and signature information of a speaker client of the selected equipment aiming at the desktop shared data of the target equipment;
judging whether the login ID of the main speaker client of the selected equipment is consistent with the login ID of the main speaker client of the target equipment;
if the identification information of the selected equipment is consistent with the identification information of the selected equipment, acquiring a corresponding digital certificate from a local database;
and verifying the signature of the signature information by adopting the public key of the digital certificate, and after the signature passes the verification, the operation instruction is valid and effective.
It should be noted that, in order to enhance the security of operating and controlling the target device, in this embodiment, after establishing the conference leader connection, the conference server may obtain the identification information of the selected device, and open the operating and controlling authority of the speaker client of the selected device, and later, when receiving the operation instruction, first verify whether the login ID of the speaker client of the device (i.e., the selected device) sending the operation instruction is consistent with the login ID of the speaker client of the target device, if so, it is indicated that the speaker is operating the client belonging to the ID number of the speaker, and for the speaker, it should obviously have the operating authority, and further pass through the first-level verification, and if not, it does not pass through the first-level verification. And after passing the first-stage verification, acquiring a corresponding digital certificate from a local database according to the identification information of the selected equipment, and verifying the signature of the signature information by adopting a public key of the digital certificate. Specifically, a speaker client of the selected device calculates a hash value of the operation instruction through a hash algorithm, then signs the hash value through a digital certificate private key, later, the conference server decrypts and verifies the signature of the signed hash value through a public key, after the signature passes the verification, calculates the hash value aiming at the operation instruction again, compares the hash value with the received hash value, if the hash value is consistent with the received hash value, verifies the integrity of the operation instruction, and proves that the operation instruction is not falsified by other people, and after the signature verification and the integrity verification pass, the second-stage verification is proved to pass. It can be understood that, in this embodiment, only after the first-level verification and the second-level verification pass, the operation instruction can be proved to be valid and effective.
It is understood that the operation instructions may also be encrypted to further enhance the security of data transmission.
According to an embodiment of the present invention, after receiving the desktop sharing data sent by the speaker client of the target device, the method further includes:
preferentially forwarding the desktop sharing data sent by the speaker client of the target equipment to the speaker client of the selected equipment for display so that the speaker can check the desktop sharing data;
when receiving the auditing passing information fed back by the main speaker client of the selected equipment, forwarding the desktop sharing data to each participant client; and when receiving the auditing failure information fed back by the main speaker client of the selected equipment, stopping forwarding the desktop sharing data to each participant client.
It should be noted that, the selected device and the target device may be far away from each other, for example, the selected device and the speaker are both in a company, the target device is at home, and while the target device shares a desktop, other family members may misoperate the target device, thereby causing the private data in the target device to be shared out, and further causing the leakage of the private data of the speaker. How to enable a main speaker of a company to safely share a desktop of a target device through a selected device, in this embodiment, when a conference server receives desktop shared data sent by a main speaker client of the target device, the main speaker client of the selected device is preferentially forwarded for display, after the main speaker checks the desktop shared data and confirms that the desktop shared data has no private data, audit pass or failure information can be sent to the conference server by clicking an audit option button of the main speaker client of the selected device, and the conference server determines whether to forward the desktop shared data to a participant client according to the received audit pass or failure information.
According to an embodiment of the invention, the method further comprises:
if the number of the target devices is multiple, receiving management and control instructions of desktop sharing data of the multiple target devices, which are sent by the main speaker client of the selected device, on the display modes of the various participant clients and the main speaker client of the selected device;
and processing desktop shared data of the target devices according to the control instruction, and forwarding the processed shared data to each participant client and the speaker client of the selected device.
It should be noted that, because the multiple target devices of the speaker respectively send their desktop shared data to the conference server, and the multiple desktop shared data are separated before, the conference server of this embodiment may send the multiple desktop shared data to the participant clients and the speaker client of the selected device in a separated manner, respectively, after receiving the multiple desktop shared data, and the conference server may also perform normalization processing on the multiple desktop shared data, so that the conference server performs management and control layout on the multiple desktop shared data according to the requirements of the speaker. That is, the management and control instruction is sent to the conference server by the speaker client of the selected device, so that the conference server processes the multiple desktop shared data according to the management and control instruction, for example, the multiple desktop shared data is presented in a window in a predetermined layout manner, but not limited thereto.
According to the embodiment of the invention, the display mode is as follows:
each participant client and the speaker client of the selected equipment perform self-defined display on the local side according to the self requirements; or
The method comprises the steps that a speaker client of the selected equipment designates the size proportion and the position relation of desktop sharing data of a plurality of pieces of equipment, and each participant client and the speaker client of the selected equipment are displayed according to the size proportion and the position relation; or
And the participant clients and the speaker client of the selected equipment respectively form a plurality of windows based on the desktop sharing data of the plurality of equipment, each window is used for displaying the desktop sharing data of the corresponding equipment, and the plurality of windows support the switching function.
In the first exhibition mode, the exhibition mode decision right is completely handed over to each participant and speaker. The conference server receives the plurality of desktop shared data, does not perform any processing on the desktop shared data, and directly forwards the desktop shared data to each participant client and the speaker client of the selected equipment, and after each participant client and the speaker client of the selected equipment receive the plurality of desktop shared data, the display mode of each desktop shared data can be set at the local side according to the personalized requirements of the user. For example, only individual desktop sharing data is displayed, other desktop sharing data are hidden, and the size and the coordinate position of each desktop sharing data displayed on the desktop of the participant client can be adjusted in a customized manner. But is not limited thereto.
For the second presentation, the presentation decision is completely handed to the speaker. The method comprises the steps that a speaker sends a display mode setting requirement to a conference server through a speaker client of a selected device, and the conference server arranges and arranges a plurality of desktop shared data according to the display mode setting requirement and enables the desktop shared data to be displayed according to a mode interface required by the speaker. In this way, the conference server directly forms a picture with a plurality of desktop sharing data, and sends the picture to each participant client and the speaker client of the selected device for display, and each participant client cannot adjust the desktop sharing data in the picture.
For the third display mode, the conference server respectively allocates a window to the desktop shared data according to the requirements of the speaker, so that the desktop shared data are respectively displayed on the corresponding windows, and then window programs carrying different desktop shared data are respectively sent to the participant clients and the speaker client of the selected device for display. It can be understood that a plurality of windows are usually displayed on the participant client in a layer-by-layer overlapping manner, only the desktop shared data of the top-layer window can be displayed, the desktop shared data of other windows are covered by the top-layer window, and the switching function is supported among the plurality of windows. Specifically, the windows below the top layer are exchanged with the top layer window, so that the switching display of the shared data of the two desktops is realized.
According to an embodiment of the present invention, after pushing the identification information of the other devices of the plurality of devices to the speaker client of the selected device, the method further comprises:
receiving a plurality of target device identification information and a cross-device sharing instruction provided by a speaker client of the selected device, wherein the plurality of target devices are included in a plurality of devices of the speaker;
and determining a plurality of target devices based on the identification information of the target devices, and sending the cross-device sharing instruction to the speaker clients of the target devices.
It should be noted that, when the conference server sends the cross-device sharing instruction, the speaker may select the corresponding target device based on the identification information of the device, and provide the selected target device to the conference server, and then the conference server selectively sends the cross-device sharing instruction to the corresponding target device based on the identification information of the target device, and subsequently only the target device may receive the cross-device sharing instruction and start to share the desktop. The embodiment can enable the speaker to autonomously select the target equipment needing sharing.
According to an embodiment of the invention, after receiving the plurality of target device identification information and the cross-device sharing instruction provided by the speaker client of the selected device, the method further comprises:
storing a plurality of target equipment identification information locally;
judging whether the currently received desktop sharing data sent by the client sides of the main speakers of the target devices are matched with the locally stored identification information of the target devices;
if not, continuing to wait for receiving the desktop shared data sent by the speaker clients of other target devices until the currently received desktop shared data sent by the speaker clients of the target devices are matched with the plurality of locally stored target device identification information; if yes, combining and processing the desktop sharing data of the target devices, and then forwarding the combined desktop sharing data to each participant client and the speaker client of the selected device for display.
It should be noted that the network links from the target devices of the speaker to the conference server are different. Such as: the computer equipment is usually connected with the conference server in a wired mode through a network; the mobile phone device is connected to the conference server through the 4G and 5G networks, and the time for the computer device and the mobile phone device to transmit the desktop sharing data to the conference server may be different. In order to implement merge sharing, the desktop sharing data of multiple devices needs to be unified and regulated on the conference server side. The conference server judges whether all target devices of a speaker send desktop sharing data or not, and judges whether all the desktop sharing data of the target devices are received completely or not; and if so, forwarding the regulated desktop sharing data of the target devices to each participant client.
FIG. 2 is a flowchart of a cross-device sharing method according to an embodiment of the present invention.
In fig. 2, the speaker is the speaker client of the selected device in the present invention, the PC at home is the target device in the present invention, and the participant is the participant client of the present invention.
Firstly, a speaker and a household PC respectively log in a server and establish network connection with the server;
the method comprises the following steps that a speaker and participants respectively send conference joining requests to a server based on the same conference numbers, and the speaker and the participants respectively enter a network conference;
a speaker selects a PC in a shared home and sends a cross-device sharing request to a server;
the server sends (cross-device) sharing instructions to the PC at home;
the PC at home transmits shared desktop data to the server;
the server sends the shared desktop data to the participants and the speaker;
later, the server receives an operation instruction sent by the speaker and forwards the operation instruction to a PC at home;
the PC in the house executes the operation and transmits the desktop modification data after the operation to the server;
and the server sends the desktop modification data to the participants and the speaker.
To further illustrate the technical solution of the present invention, a specific implementation scenario is illustrated below.
For example: the speaker has 2 computers, one at the company, one at home, the speaker at the company, and the company's computer as the selected device, and the home computer as the target device.
The conference system is logged on both computers, but only in the corporate computer. The speaker needs to share and operate his/her own company computer and home computer, respectively. The speaker enters the corporate meeting and presents an interactive interface in the web conference, as shown in fig. 3.
The speaker clicks on the share button in the toolbar and a menu is displayed, as shown in fig. 4, one of which is a shared remote desktop, displaying the user's multiple online devices. And the PC equipment in the house is selected, so that the connection with the PC equipment in the house can be established, and the sharing and the operation are realized.
The sharing is started by the PC device in the home of the speaker, the content is sent to the server, and both the speaker and the participants can see the content shared by the PC in the home, as shown in fig. 5.
The speaker can operate the desktop shared by the PC in the home, for example, close the application window, and the operation event is transmitted to the PC device in the remote home in real time, as shown in fig. 6.
The PC at home receives the event signaling, and completes the window closing operation, and both the speaker and the participants see the closed desktops, as shown in fig. 7.
FIG. 8 is a block diagram of a system for multi-device merged sharing according to the present invention.
As shown in fig. 8, the second aspect of the present invention further provides a cross-device shared system 8, which includes a memory 81 and a processor 82, where the memory includes a cross-device shared method program, and when executed by the processor, the cross-device shared method program implements the following steps:
receiving a login request sent by a speaker through a speaker client installed in a plurality of devices;
respectively verifying login requests sent by the speaker client sides of the multiple devices, and respectively establishing long network connection with the speaker client sides of the multiple devices after the login requests are verified;
receiving an conference joining request sent by a speaker through a speaker client of a selected device in a plurality of devices, and establishing conference long connection with the speaker client of the selected device based on the conference joining request;
pushing identification information of other equipment in the multiple equipment to a speaker client of the selected equipment;
receiving a cross-device sharing instruction sent by the speaker client of the selected device based on the identification information of the target device, and forwarding the cross-device sharing instruction to the speaker client of the target device;
and receiving desktop shared data sent by the main speaker client of the target equipment, and forwarding the desktop shared data to each participant client and the main speaker client of the selected equipment for displaying.
According to an embodiment of the present invention, when executed by the processor, the method program shared across devices further implements the steps of:
receiving an operation instruction of a speaker client of the selected equipment for desktop sharing data of the target equipment;
forwarding the operation instruction to a speaker client of the target equipment, and executing operation by the speaker client of the target equipment based on the operation instruction;
and receiving the newly shared desktop change content after the main speaker client of the target equipment executes the operation, and forwarding the newly shared desktop change content to each participant client and the main speaker client of the selected equipment for refreshing and displaying.
According to an embodiment of the present invention, when executed by the processor, the method program shared across devices further implements the steps of:
receiving desktop sharing data sent by a main speaker client of the target equipment, and forwarding the desktop sharing data to each participant client and a main speaker client of the selected equipment in a sharing picture mode for displaying;
opening the operation authority of the speaker client of the selected equipment, and capturing the trigger action of a keyboard mouse or a touch screen of the local side terminal on a certain coordinate position in the shared picture by the speaker client of the selected equipment;
and receiving a trigger action aiming at a certain coordinate position in the shared picture sent by the speaker client of the selected equipment, forwarding the trigger action to the speaker client of the target equipment, and simulating and executing the operation process by the speaker client of the target equipment based on the trigger action of the coordinate position.
The third aspect of the present invention also provides a computer-readable storage medium, which includes a cross-device sharing method program, and when the cross-device sharing method program is executed by a processor, the steps of the cross-device sharing method are implemented as described above.
The cross-device sharing method, the cross-device sharing system and the readable storage medium enable a user to achieve the purpose of sharing other remote devices through the devices at the user, further achieve the cross-device sharing effect, and further enhance the sharing experience of the user.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
Claims (10)
1. A method of cross-device sharing, comprising the steps of:
receiving a login request sent by a speaker through a speaker client installed in a plurality of devices;
respectively verifying login requests sent by the speaker client sides of the multiple devices, and respectively establishing long network connection with the speaker client sides of the multiple devices after the login requests are verified;
receiving an conference joining request sent by a speaker through a speaker client of a selected device in a plurality of devices, and establishing conference long connection with the speaker client of the selected device based on the conference joining request;
pushing identification information of other equipment in the multiple equipment to a speaker client of the selected equipment;
receiving a cross-device sharing instruction sent by the speaker client of the selected device based on the identification information of the target device, and forwarding the cross-device sharing instruction to the speaker client of the target device;
and receiving desktop shared data sent by the main speaker client of the target equipment, and forwarding the desktop shared data to each participant client and the main speaker client of the selected equipment for displaying.
2. The method of claim 1, wherein after forwarding to each participant client and the selected device's speaker client for presentation, the method further comprises:
receiving an operation instruction of a speaker client of the selected equipment for desktop sharing data of the target equipment;
forwarding the operation instruction to a speaker client of the target equipment, and executing operation by the speaker client of the target equipment based on the operation instruction;
and receiving the newly shared desktop change content after the main speaker client of the target equipment executes the operation, and forwarding the newly shared desktop change content to each participant client and the main speaker client of the selected equipment for refreshing and displaying.
3. The method of claim 2, wherein the method further comprises:
receiving desktop sharing data sent by a main speaker client of the target equipment, and forwarding the desktop sharing data to each participant client and a main speaker client of the selected equipment in a sharing picture mode for displaying;
opening the operation authority of the speaker client of the selected equipment, and capturing the trigger action of a keyboard mouse or a touch screen of the local side terminal on a certain coordinate position in the shared picture by the speaker client of the selected equipment;
and receiving a trigger action aiming at a certain coordinate position in the shared picture sent by the speaker client of the selected equipment, forwarding the trigger action to the speaker client of the target equipment, and simulating and executing the operation process by the speaker client of the target equipment based on the trigger action of the coordinate position.
4. The method of claim 2, wherein the method further comprises:
respectively issuing digital certificates to a plurality of devices of a speaker, associating the digital certificates with a plurality of device identification information of the speaker, and storing the digital certificates in a local database;
after meeting leader connection is established, opening the control authority of a speaker client of the selected equipment on desktop shared data of the target equipment;
receiving an operation instruction and signature information of a speaker client of the selected equipment aiming at the desktop shared data of the target equipment;
judging whether the login ID of the main speaker client of the selected equipment is consistent with the login ID of the main speaker client of the target equipment;
if the identification information of the selected equipment is consistent with the identification information of the selected equipment, acquiring a corresponding digital certificate from a local database;
and verifying the signature of the signature information by adopting the public key of the digital certificate, and after the signature passes the verification, the operation instruction is valid and effective.
5. The method of claim 1, wherein after receiving the desktop sharing data sent by the speaker client of the target device, the method further comprises:
preferentially forwarding the desktop sharing data sent by the speaker client of the target equipment to the speaker client of the selected equipment for display so that the speaker can check the desktop sharing data;
when receiving the auditing passing information fed back by the main speaker client of the selected equipment, forwarding the desktop sharing data to each participant client; and when receiving the auditing failure information fed back by the main speaker client of the selected equipment, stopping forwarding the desktop sharing data to each participant client.
6. The method of claim 1, wherein the method further comprises:
if the number of the target devices is multiple, receiving management and control instructions of desktop sharing data of the multiple target devices, which are sent by the main speaker client of the selected device, on the display modes of the various participant clients and the main speaker client of the selected device;
and processing desktop shared data of the target devices according to the control instruction, and forwarding the processed shared data to each participant client and the speaker client of the selected device.
7. A cross-device shared system, comprising a memory and a processor, wherein the memory includes a cross-device shared method program, and wherein the cross-device shared method program when executed by the processor implements the steps of:
receiving a login request sent by a speaker through a speaker client installed in a plurality of devices;
respectively verifying login requests sent by the speaker client sides of the multiple devices, and respectively establishing long network connection with the speaker client sides of the multiple devices after the login requests are verified;
receiving an conference joining request sent by a speaker through a speaker client of a selected device in a plurality of devices, and establishing conference long connection with the speaker client of the selected device based on the conference joining request;
pushing identification information of other equipment in the multiple equipment to a speaker client of the selected equipment;
receiving a cross-device sharing instruction sent by the speaker client of the selected device based on the identification information of the target device, and forwarding the cross-device sharing instruction to the speaker client of the target device;
and receiving desktop shared data sent by the main speaker client of the target equipment, and forwarding the desktop shared data to each participant client and the main speaker client of the selected equipment for displaying.
8. The cross-device sharing system according to claim 7, wherein the cross-device sharing method program further implements the following steps when executed by the processor:
receiving an operation instruction of a speaker client of the selected equipment for desktop sharing data of the target equipment;
forwarding the operation instruction to a speaker client of the target equipment, and executing operation by the speaker client of the target equipment based on the operation instruction;
and receiving the newly shared desktop change content after the main speaker client of the target equipment executes the operation, and forwarding the newly shared desktop change content to each participant client and the main speaker client of the selected equipment for refreshing and displaying.
9. The cross-device sharing system according to claim 8, wherein the cross-device sharing method program further implements the following steps when executed by the processor:
receiving desktop sharing data sent by a main speaker client of the target equipment, and forwarding the desktop sharing data to each participant client and a main speaker client of the selected equipment in a sharing picture mode for displaying;
opening the operation authority of the speaker client of the selected equipment, and capturing the trigger action of a keyboard mouse or a touch screen of the local side terminal on a certain coordinate position in the shared picture by the speaker client of the selected equipment;
and receiving a trigger action aiming at a certain coordinate position in the shared picture sent by the speaker client of the selected equipment, forwarding the trigger action to the speaker client of the target equipment, and simulating and executing the operation process by the speaker client of the target equipment based on the trigger action of the coordinate position.
10. A computer-readable storage medium, comprising a cross-device shared method program which, when executed by a processor, performs the steps of a cross-device shared method as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110559743.2A CN112988025A (en) | 2021-05-21 | 2021-05-21 | Cross-device sharing method, system and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110559743.2A CN112988025A (en) | 2021-05-21 | 2021-05-21 | Cross-device sharing method, system and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112988025A true CN112988025A (en) | 2021-06-18 |
Family
ID=76337129
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110559743.2A Pending CN112988025A (en) | 2021-05-21 | 2021-05-21 | Cross-device sharing method, system and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112988025A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101494547A (en) * | 2009-03-05 | 2009-07-29 | 广东威创视讯科技股份有限公司 | Method and system for implementing conference combining local conference and network conference equipment |
| CN101834905A (en) * | 2010-05-13 | 2010-09-15 | 中兴通讯股份有限公司 | Remote document sharing method and remote document sharing server |
| CN101964151A (en) * | 2010-08-13 | 2011-02-02 | 同济大学 | Remote access and video conference system-based remote practical training method |
| US8175244B1 (en) * | 2011-07-22 | 2012-05-08 | Frankel David P | Method and system for tele-conferencing with simultaneous interpretation and automatic floor control |
| CN103414751A (en) * | 2013-07-16 | 2013-11-27 | 广东工业大学 | PC screen content sharing/interaction control method |
-
2021
- 2021-05-21 CN CN202110559743.2A patent/CN112988025A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101494547A (en) * | 2009-03-05 | 2009-07-29 | 广东威创视讯科技股份有限公司 | Method and system for implementing conference combining local conference and network conference equipment |
| CN101834905A (en) * | 2010-05-13 | 2010-09-15 | 中兴通讯股份有限公司 | Remote document sharing method and remote document sharing server |
| CN101964151A (en) * | 2010-08-13 | 2011-02-02 | 同济大学 | Remote access and video conference system-based remote practical training method |
| US8175244B1 (en) * | 2011-07-22 | 2012-05-08 | Frankel David P | Method and system for tele-conferencing with simultaneous interpretation and automatic floor control |
| CN103414751A (en) * | 2013-07-16 | 2013-11-27 | 广东工业大学 | PC screen content sharing/interaction control method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3453146B1 (en) | Communication system | |
| US10630663B1 (en) | Secure telecommunications | |
| JP6293269B2 (en) | Content viewing confirmation apparatus and method | |
| CN109120597B (en) | Identity verification and login method and device and computer equipment | |
| US9275254B2 (en) | Augmented reality system for public and private seminars | |
| US10637805B2 (en) | Instant messaging method, server, and storage medium | |
| CN111711528B (en) | Control method and device for network conference, computer readable storage medium and equipment | |
| CN112783461A (en) | Screen projection method and device, electronic equipment and storage medium | |
| US10372882B2 (en) | Media distribution network, associated program products, and methods of using the same | |
| US11811827B2 (en) | Securing endpoints for virtual meetings | |
| US20230139813A1 (en) | Authentication of video communications in a virtual environment | |
| US20240086630A1 (en) | Methods and systems for populating application-specific information using overlay applications | |
| CN108665595A (en) | A kind of Intelligent visible access control system | |
| US20230017859A1 (en) | Meeting control method and apparatus, device, and medium | |
| CN112988025A (en) | Cross-device sharing method, system and readable storage medium | |
| CN113420133A (en) | Session processing method, device, equipment and storage medium | |
| CN113037517B (en) | Method, system and readable storage medium for multi-device merging and sharing | |
| CN112838979A (en) | Case discussion information interaction method and system | |
| JP2020194343A (en) | Information processing system, information processing device, control method of information processing system, and program | |
| KR102573946B1 (en) | On-line group viewing service system, server and method | |
| KR20230173358A (en) | Electronic Voting Method using WebRTC | |
| CN114401450A (en) | Intelligent secrecy method and system for live user information | |
| TWI553595B (en) | Access control system and its method | |
| CN115134100A (en) | Multimedia session access method, device, electronic equipment and storage medium | |
| CN117205572A (en) | Cloud game playing permission determination method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210618 |