CN115016749A - Screen projection content control method, device, system and storage medium - Google Patents
Screen projection content control method, device, system and storage medium Download PDFInfo
- Publication number
- CN115016749A CN115016749A CN202210001425.9A CN202210001425A CN115016749A CN 115016749 A CN115016749 A CN 115016749A CN 202210001425 A CN202210001425 A CN 202210001425A CN 115016749 A CN115016749 A CN 115016749A
- Authority
- CN
- China
- Prior art keywords
- screen
- data
- terminal
- screen projection
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
A plurality of terminal devices project screens to a large-screen device, and a cooperative window is formed on the side of the large-screen device to display the screen-projecting content. When the user can not watch the large-screen projection content, the content synchronously coming from the large screen is obtained through the terminal connected with the large screen, so that the user can know the corresponding content, the problem that the user can not watch the large screen directly is solved, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of communication, in particular to a screen projection content control method, equipment, a system and a storage medium.
Background
With the rapid development of the internet technology, screen projection is widely applied to the work and life of people, and great convenience is brought to the work and life of people. For some meeting scenes with brainstorming storms, a plurality of people may be required to throw a mobile phone end to a large screen, large-screen multi-window control can be achieved, if some people in the meeting are far away from the large screen and cannot see the contents thrown in the meeting, or temporary things temporarily leave a meeting room for a short time, the contents thrown in the meeting cannot be continuously checked, and the meeting contents cannot be timely acquired after the meeting.
Disclosure of Invention
The method for controlling the screen projection content provided by the embodiment of the invention can acquire the content synchronously coming from the large screen through the terminal connected with the large screen when the user cannot watch the large screen projection content, so that the user can know the corresponding content, the problem that the user cannot watch the large screen directly is solved, and the user experience is improved.
In a first aspect, an embodiment of the present application provides a method for controlling screen projection content, which is applied to a distributed system, where the distributed system includes a plurality of first terminal devices and a large-screen device, and the method includes: the first terminal devices send respective screen projection data to the large-screen device; the large-screen device receives screen projection data of a plurality of first terminal devices to the large-screen device, displays a plurality of collaboration windows to respectively display screen projection contents of the plurality of first terminal devices, and transmits the screen projection contents displayed by the plurality of collaboration windows to the first terminal device, so that the first terminal device synchronously displays the plurality of collaboration windows; and generating synchronous data based on the operation of the user in the target cooperation window, and transmitting the synchronous data to the first terminal equipment.
In a second aspect, an embodiment of the present application provides a method for controlling screen projection content, which is applied to a large-screen device, and includes:
the large-screen device receives screen projection data of a plurality of first terminal devices to the large-screen device, displays a plurality of collaboration windows to respectively display screen projection contents of the plurality of first terminal devices, and transmits the screen projection contents displayed by the plurality of collaboration windows to the first terminal device, so that the first terminal device synchronously displays the plurality of collaboration windows; generating synchronization data based on user operations within the target collaboration window; and transmitting the synchronous data to the first terminal equipment.
Further, generating synchronization data based on user operations within the cooperative window of the large screen device comprises: generating corresponding incremental data based on each modification operation of a user within a cooperative window of the large-screen device, wherein the synchronization data comprises the incremental data.
Further, generating synchronization data based on user operations within the collaboration window of the large screen device comprises: and saving the full data of the screen projection contents at the end of screen projection, wherein the synchronous data comprises the full data of the screen projection contents.
Further, before the generating synchronization data based on the user's operation within the cooperative window of the large-screen device, the method further includes: and synchronizing the initial screen projection content of each terminal device to the non-source device connected with the large-screen device.
Further, the synchronizing the synchronization data to the target terminal device connected to the large screen device includes: and synchronizing the synchronous data to the non-source equipment connected with the large-screen equipment.
Further, the synchronizing the synchronization data to the non-source device connected to the large screen device includes: and updating corresponding data in the distributed database based on user modification so that the non-source equipment connected with the large-screen equipment acquires corresponding updated data through the distributed database.
Further, before the generating synchronization data based on the user's operation within the cooperative window of the large-screen device, the method further includes: establishing a data updating channel with the plurality of terminal devices; the synchronizing the synchronization data to the non-source device connected to the large screen device comprises: and synchronizing synchronous data to the non-source equipment connected with the large-screen equipment through the data updating channel.
In a third aspect, an embodiment of the present application provides a screen projection content control method, which is applied to a terminal device, and includes: the terminal equipment sends the data for projecting the screen to the large-screen equipment; receiving screen projection contents displayed by a plurality of collaborative windows sent by the large-screen device, and synchronously displaying the collaborative windows on the terminal device; and receiving synchronous data which is sent by the large-screen equipment and generated based on the operation of the user in the target cooperation window, and updating the content in the corresponding cooperation window displayed by the terminal equipment based on the synchronous data.
In a fourth aspect, an embodiment of the present application provides a large-screen device, where the large-screen device includes: one or more processors and a memory for storing at least one instruction which, when loaded and executed by the processors, implements the screen-casting content control method provided by the second aspect.
In a fifth aspect, an embodiment of the present application further provides a terminal device, including: one or more processors and a memory for storing at least one instruction which, when loaded and executed by the processors, implements the screen-casting content control method provided by the third aspect.
In a sixth aspect, an embodiment of the present application provides a distributed system, where the system includes the large-screen device provided in the fourth aspect and multiple terminal devices provided in the fifth aspect.
In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the screen-casting content control method provided in the first aspect, the second aspect, or the third aspect.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of a system architecture according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a multi-device screen projection connection provided by an embodiment of the present application;
fig. 3 is a flowchart of a collaboration window control method according to an embodiment of the present application;
FIG. 4a is a schematic view of a window layout for multi-device screen projection provided in an embodiment of the present application;
FIG. 4b is a schematic view of a window layout for multi-device screen projection according to yet another embodiment of the present application;
FIG. 4c is a schematic view of a window layout for multi-device screen projection according to yet another embodiment of the present application;
FIG. 5 is a flow chart of data back control provided in accordance with yet another embodiment of the present application;
FIG. 6 is a flowchart of a method for controlling content for a screen shot according to yet another embodiment of the present application;
FIG. 7 is a schematic diagram of screen shot data synchronization provided in accordance with yet another embodiment of the present application;
fig. 8 is a schematic diagram of an apparatus architecture according to still another embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
The embodiment of the present application relates to a scene in which multiple terminals project screens on the same large-screen device, and fig. 1 is a schematic view of the scene provided in an embodiment of the present application, and as shown in fig. 1, the scene may include a screen projection receiving end T 1 And a plurality of screen projection sending terminals m 1 ～m n The plurality of screen projection sending terminals m 1 ～m n And projection screen receiving terminal T 1 After the connection is established, screen projection data are respectively sent to a screen projection receiving end T 1 And then projection screen receiving terminal T 1 And laying out the cooperative windows according to the quantity of the received screen projection data, and displaying corresponding screen projection pictures in the corresponding cooperative windows.
Fig. 2 is a schematic diagram of multi-device screen projection connection provided in an embodiment of the present application, and as shown in fig. 2, an implementation manner of a multi-terminal device (serving as a screen projection transmitting end) to project a screen to a large-screen device (serving as a screen projection receiving end) includes:
1. the plurality of terminal devices are respectively in communication connection with the large-screen device, and for example, the plurality of terminal devices can be in socket connection with the large-screen device through WIFI.
2. Each terminal device can transmit Display data to the data control layer, and transmit the data to the large-screen device through the data transmission module, wherein the data transmission is based on the RSPT protocol. In an embodiment, the data control module of the terminal device may further encrypt the data and transmit the encrypted data to the large-screen device through the data transmission module.
3. After the large screen receives the data stream sent by the terminal equipment through the data transmission module, the data decoding is completed on the data, and the data is transmitted to the multi-screen control module. If the data is encrypted, the large-screen device can also decrypt the encrypted device.
4. And a multi-screen control module of the large-screen equipment performs cooperative window layout and controls the corresponding cooperative windows to display corresponding screen projection contents.
For example, the large screen in the system is used as a screen projection receiving end T 1 The mobile phone and the tablet computer are used as screen projection sending terminals to project screens to the large screen, and specifically, the mobile phone and the tablet computer can be respectively connected with the large screen in a communication mode, for example, socket connection is established through WIFI. And then after the communication connection is established, the mobile phone and the tablet personal computer can transmit screen projection data to the large screen through the data transmission module, the large screen receives the screen projection data sent by the mobile phone and the tablet personal computer through the data transmission module, the screen projection data are decoded through the data decoding module and then transmitted to the multi-screen control module, and the multi-screen control module carries out collaborative window layout and controls the corresponding collaborative windows to display corresponding screen projection contents.
Fig. 3 is a flowchart of a cooperative window control method for multi-device screen projection according to an embodiment of the present application, and as shown in fig. 3, the control method includes the following steps:
step 301: and the screen projection sending end sends the video stream data of the terminal screen as screen projection data to the screen projection receiving end.
Step 302: and the screen projection receiving end distributes the cooperative windows according to the number of the current screen projection sending ends.
Step 303: and the screen projection receiving end decodes the received screen projection data to obtain screen projection contents suitable for the cooperative window display.
Step 304: and the screen projection receiving end displays the screen projection content on the corresponding collaborative window.
In the specific implementation of step 301, in the case that the screen-casting transmitting end and the screen-casting receiving end establish a wireless connection, the screen-casting transmitting end transmits screen-casting data to the screen-casting receiving end. The screen projection sending terminal can establish socket connection with the screen projection receiving terminal through WIFI, and then the screen projection sending terminal can send video stream data (display data) of the terminal to the screen projection receiving terminal as screen projection data, wherein the screen projection sending terminal and the screen projection receiving terminal can transmit the screen projection data based on an RSPT protocol.
In another embodiment, before sending video stream data (display data) of the terminal to the screen projection receiving end as the screen projection data, the screen projection sending end may encrypt the display data to ensure the security of the data.
In the specific implementation of step 302, the screen-casting receiving end may perform layout of the collaboration windows according to the number of the current screen-casting sending ends. Specifically, when a new screen projection sending terminal requests screen projection, the screen projection receiving terminal can perform default layout on the cooperative window according to the total number of the current screen projection sending terminals. For example, as shown in fig. 4a, there is currently one screen-casting sending end m 1 At screen projection receiving terminal T 1 The screen is projected upwards, and the screen projection receiving end T is arranged 1 Display screen projection sending end m in collaboration window 1 1 The screen shot content. If a screen projection sending end m is added 2 Request to be at the same screen projection receiving end T 1 On the screen, and then the screen receiving end T 1 The total number of screen-throwing transmitting terminals which can be determined to throw the screen on the equipment at present is 2 (namely, two screen-throwing transmitting terminals throw the screen on the screen-throwing receiving terminal at the same time), and the screen-throwing receiving terminalT 1 Two isometric collaboration windows, namely a collaboration window 1 and a collaboration window 2, are configured on a display interface, wherein the collaboration window 1 and a screen projection sending end m are respectively arranged 1 Correspondingly, configured to display screen projection sending end m 1 The screen-casting content of (2) cooperates with the window and the screen-casting sending terminal m 2 Correspondingly, configured to display screen projection sending end m 1 The screen projection content. And setting a default layout mode of the multiple collaboration windows according to the user requirement.
In the specific implementation of step 303, the screen projection receiving end may perform data decoding on the screen projection data sent by each screen projection sending end, and convert the decoded screen projection data into screen projection content suitable for display of the corresponding collaboration window, specifically, because there is a large difference between the sizes of the display screens of the screen projection sending end (e.g., a mobile phone) and the screen projection receiving end (e.g., a large screen), it is necessary to convert the data stream applied to the screen projection sending end into the data stream suitable for display of the corresponding collaboration window.
It should be noted that, if the screen projection data sent by the screen projection sending end is encrypted, the screen projection receiving end may decrypt based on the corresponding key information.
In the specific implementation of step 304, the screen-projecting receiving end displays the corresponding screen-projecting content in the corresponding collaboration window according to the converted data stream suitable for the display of the corresponding collaboration window. For example, as shown in fig. 2, a screen-casting sending end m is added 2 Request to be at the same screen projection receiving terminal T 1 On the screen, screen-casting sending terminal m 1 The corresponding collaboration window is reconfigured, and the screen projection sending end m 1 The corresponding data stream has been converted into a data stream suitable for the reconfigured collaboration window 1, and the display of the screen shot transmitting end m in the reconfigured collaboration window 1 is continued 1 The screen projection content. Further, the screen projection receiving end is a screen projection sending end m 2 Configuring a corresponding cooperative window 2, and displaying a screen projection sending end m in the cooperative window 2 2 The screen projection content.
In some embodiments, when multiple devices perform simultaneous screen projection on the same device, the screen projection receiving end may further adjust the layout of the collaboration window according to user operations, for exampleAs shown in fig. 4b, there are currently three screen-casting transmitting terminals simultaneously at the screen-casting receiving terminal T 1 And performing screen projection, specifically, displaying the screen projection contents of the three screen projection sending ends in the collaboration window 1, the collaboration window 2, and the collaboration window 3, respectively, and changing the layout of the three collaboration windows according to a user operation, for example, changing the layout of the collaboration window shown on the right side of fig. 4b, or changing the layout of the collaboration window to the layout of the collaboration window shown in fig. 4c in an overlapping manner. It should be noted that the window layout manners provided in the embodiments of the present application include, but are not limited to, the above layout manners.
In some application scenarios of multi-device screen projection, a user performs corresponding operations (for example, operations such as drawing and dragging an object in a collaboration window) on a screen projection receiving end, and in order to synchronize the operations of the user in the collaboration window of the screen projection receiving end to an application corresponding to a screen projection sending end, an embodiment of the present application further provides a screen projection content data back control method, fig. 5 is a schematic diagram of a data back control process provided in an embodiment of the present application, and the data back control process shown in fig. 5 includes the following steps:
step 501: and the screen projection receiving end acquires the position information operated by the user in the cooperative window and sends the position information to the corresponding screen projection sending end.
Step 502: and after receiving the position information, the screen-casting sending end triggers and simulates an input event.
Step 503: and triggering an operation event to the target application based on the position information according to the monitored input event.
In the specific implementation of step 501, when the user performs a corresponding operation on the collaboration window on the screen-casting receiving end, the screen-casting receiving end may obtain position information of the user operation in the collaboration window, specifically, may collect coordinate information of the user operation in the collaboration window, and further, the screen-casting receiving end may further convert the coordinate information in the collaboration window into corresponding coordinate information in a display interface of the screen-casting sending end according to the screen-casting data sent by the screen-casting sending end, and send the converted coordinate information to the corresponding screen-casting sending end according to a pairing relationship between the collaboration window and the screen-casting sending end.
In the specific implementation of step 502, the screen-casting receiving end transmits the coordinate information to a FWK layer (frame layer) of the screen-casting transmitting end through a transmission channel, the FWK layer transmits the received coordinate information to a data inverse control module of the terminal, and the data inverse control module simulates an Input event (Input event), that is, a behavior corresponding to an operation of a user on a collaboration window on the screen-casting receiving end is simulated at the screen-casting transmitting end.
In the specific implementation of step 503, the application layer of the screen-casting sending end acquires the coordinate information according to the monitored Input event and triggers an operation event for the target application based on the coordinate information, so as to synchronize the operation of the user in the collaboration window of the screen-casting receiving end to the application of the screen-casting sending end.
For example, a user performs an image drawing operation on a collaboration window of a screen projection receiving end, the screen projection receiving end sends coordinate information corresponding to the drawing operation to a screen projection sending end, the screen projection sending end further simulates an Input event, and an application layer acquires corresponding coordinate information according to the monitored Input event and triggers the drawing event, so that drawing patterns are synchronized to the application end.
In order to solve the problem that a user cannot continuously view large-screen display content and cannot acquire participated content in time, embodiments of the present application provide a screen-projection content control method, by which a large-screen device can acquire large-screen synchronized content through a terminal connected to a large screen when the user cannot view the large-screen content, so that the user can know corresponding content.
Fig. 6 is a flowchart of a screen projection content control method according to an embodiment of the present application, and as shown in fig. 6, the screen projection content control method may include the following steps:
step 601: after the cooperative connection between the large-screen device and the terminal device is established and before the terminal device casts the screen to the large-screen device, inquiring whether the terminal device authorizes the large-screen device to synchronize the screen casting content of the terminal to other terminal devices connected with the large-screen device, if the authorization is synchronous, executing step 602a, and if the synchronization is refused, executing step 602 b.
Step 602 a: the large-screen equipment receives screen projection data of the terminal equipment and displays screen projection contents based on the screen projection data.
Step 602 b: and the large-screen equipment receives screen projection data of the terminal equipment and displays screen projection contents based on the screen projection data.
Step 603 a: and performing data back control on the corresponding terminal equipment based on the modification operation of the user on the large-screen equipment.
Step 603 b: and performing data inverse control on the corresponding terminal equipment based on the modification operation of the user on the large-screen equipment.
Step 604 a: and generating synchronous data based on the modification operation or the storage operation of the user on the large-screen equipment, and synchronizing the synchronous data to other terminal equipment connected with the large-screen equipment.
In the specific implementation of step 601, in a scene where a plurality of terminal devices project screens to a large-screen device, the plurality of terminal devices only need to be connected to the large-screen device and do not need to be discovered by other terminal devices connected to the large-screen device. After the cooperative connection between the large-screen device and the terminal device is established and before the terminal device casts the screen to the large-screen device, the large-screen device may send request information to the terminal device to inquire whether the terminal device authorizes the large-screen device to synchronize the screen casting content of the terminal to other terminal devices connected to the large-screen device, if the synchronization is authorized, step 602a is executed, and if the synchronization is rejected, step 602b is executed.
In the specific implementation of step 602a or step 602b, after the large-screen device receives the screen projection data of the terminal device, a collaboration window may be generated on the large screen based on the screen projection data to display screen projection contents of multiple terminals, and a specific multi-user screen projection manner may be the same as or similar to that in the embodiment shown in fig. 3, and is not described herein again.
In the specific implementation of step 603a or step 603b, the large-screen device may perform data back control on the corresponding terminal device based on a modification operation performed by the user in the collaboration window of the large-screen device. The implementation manner of the specific data back control may be the same as or similar to that in the embodiment shown in fig. 5, and is not described herein again.
In a specific implementation of step 604a, the large-screen device may generate synchronization data based on a modification operation or a saving operation of a user in a collaboration window of the large-screen device, and synchronize the synchronization data to other terminal devices connected to the large-screen device. In an initial stage of screen projection from the plurality of terminal devices to the large-screen device, the large-screen device may synchronize screen projection initial contents of the terminal devices with the non-source device connected to the large-screen device. It should be noted that, when the terminal device is connected to the large screen and serves as a mutual communication device, in addition to establishing a data display channel for sending screen projection data (display data), a data update channel may also be established, and the large screen device may synchronize the screen projection content corresponding control policy of each terminal device with the non-source device connected to the large screen device through the data update channel.
For example, fig. 7 is a schematic diagram of screen projection data synchronization provided in an embodiment of the present application, and as shown in fig. 7, a terminal device a, a terminal device B, and a terminal device C simultaneously project respective memo data to a large-screen device, and a terminal device D and a terminal device E establish connection with the large-screen device and mutually trust, that is, five terminal devices (terminal device a, terminal device B, terminal device C, terminal device D, and terminal device E) currently establish connection with the large-screen device. When the terminal device a, the terminal device B, and the terminal device C project screens to the large-screen device, the large-screen device may synchronize memo data of the terminal device a to the non-source device connected to the large-screen device through the data update channel, that is, synchronize the memo data of the terminal device a to the terminal device B, the terminal device C, the terminal device D, and the terminal device E.
Further, in an actual application scenario, the user needs to modify the memo data in the cooperative window of the large-screen device, and then the large-screen device may generate the synchronization data based on the modification operation or the saving operation of the user in the cooperative window of the large-screen device, and synchronize the synchronization data to the non-source device connected to the large-screen device.
In one embodiment, the large-screen device may generate the synchronization data based on a modification operation of the user in the cooperative window, and in order to reduce the amount of the interactive data, the generated synchronization data may be incremental data instead of full data. And then the large-screen device can synchronize the synchronous data to the non-source device connected with the large-screen device, so that the non-source device connected with the large-screen device can acquire the latest data in the collaboration window.
In another embodiment, to further reduce the amount of interactive data between the large-screen device and the terminal device, when the user modifies in the cooperative window, the large-screen device does not synchronize incremental data with the non-source device connected to the large-screen device any longer, but when the screen projection is finished, the large-screen device stores the screen projection contents (i.e., the full data of the final version) of all the terminal devices, and synchronizes the contents of the final versions stored in each cooperative window to the non-source device connected to the large-screen device.
The transmission of the synchronous data can be synchronized to the corresponding terminal equipment in a distributed database mode, for example, when the terminal equipment throws memo data, the rapid synchronous updating of low delay increment can be realized through the distributed database capability of the memo.
In other scenes, the devices mutually trust through a large screen, and further share other data and functions among the devices through mutual trust authority. For example, the device a can share other data to other devices through a large screen if permitted.
Fig. 8 is a schematic diagram of an apparatus architecture according to still another embodiment of the present application, as shown in fig. 8, a screen projection content of a terminal apparatus a is a memo apparatus, after a user modifies a memo in a corresponding collaboration window on a large screen apparatus side, synchronization is initiated according to an editing content change, memo data in a distributed database is updated, and then the large screen apparatus completes data synchronization through a data update channel, that is, the memo data in the distributed database on the terminal apparatus a side is updated synchronously, further, a memo application can be notified that data update is currently performed, and then a current UI of the memo is updated, so that rapid data synchronization update is achieved.
The embodiment of the present application further provides an electronic device, which includes one or more processors and a memory, where the memory is used to store at least one instruction, and the instruction is loaded by the processor and executed to implement the screen-casting content control method provided in any embodiment of the present application. In one embodiment, the electronic device may be a large screen device or a terminal device.
Still another embodiment of the present application further provides a distributed system, where the system includes a first device (large screen device) and a plurality of second devices (terminal devices), where the first device and the plurality of second devices may be electronic devices provided in the foregoing embodiments of the present application, and the plurality of second devices may project a screen to the first device. In one embodiment, the first device may be a large screen device and the second device may be a terminal device.
Still another embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the screen projection content control method provided in any of the embodiments of the present application.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions in actual implementation, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or in the form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a Processor (Processor) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not depart from the spirit of the corresponding technical solutions of the embodiments of the present invention.
Claims (13)
1. A screen projection content control method is applied to a distributed system, wherein the distributed system comprises a plurality of first terminal devices and a large-screen device, and the method comprises the following steps:
the first terminal devices send respective screen projection data to the large-screen device;
the large-screen device receives data of a plurality of first terminal devices projecting screens to the large-screen device, displays a plurality of cooperative windows to respectively display screen projecting contents of the plurality of first terminal devices, and transmits the screen projecting contents displayed by the plurality of cooperative windows to the first terminal device, so that the first terminal device synchronously displays the plurality of cooperative windows;
and generating synchronous data based on the operation of the user in the target cooperation window, and transmitting the synchronous data to the first terminal equipment.
2. A screen projection content control method is applied to a large-screen device and comprises the following steps:
the large-screen device receives data of a plurality of first terminal devices projecting screens to the large-screen device, the large-screen device displays a plurality of cooperative windows to display screen projecting contents of the plurality of first terminal devices respectively,
the large-screen device transmits the screen projection contents displayed by the multiple collaborative windows to the first terminal device, so that the first terminal device synchronously displays the multiple collaborative windows;
generating synchronization data based on user operations within the target collaboration window;
and transmitting the synchronous data to the first terminal equipment.
3. The method of claim 1, further comprising, prior to the generating corresponding synchronized data based on user operations within a target collaboration window:
and synchronizing the screen projection initial content of each first terminal device to the first terminal devices except the target screen projection source device in the first target terminal device.
4. The method of claim 3, wherein generating the corresponding synchronization data based on the user's operation within the target collaboration window comprises:
and after the screen projection content in the target cooperation window is modified once, generating corresponding incremental data based on the current modification operation, wherein the incremental data is new information, difference information and deletion information of the current screen projection content after the modification operation is performed compared with the historical screen projection content before the modification operation is performed, and the synchronization data comprises the incremental data.
5. The method of claim 3, wherein generating the corresponding synchronization data based on the user's operation within the target collaboration window comprises:
when it is determined that any one of the first terminal devices finishes screen projection, generating corresponding full data based on all modification operations, wherein the full data is the final screen projection content of the first terminal device finishing screen projection, and the synchronization data comprises the full data of the screen projection content.
6. The method according to any one of claims 2-5, wherein the plurality of first terminal devices project screens to a large-screen device, and wherein forming a plurality of collaborative windows on the large-screen device side to display the projected screens of the plurality of first terminal devices respectively comprises:
the large-screen equipment and the plurality of first terminal equipment establish a first data channel;
receiving screen projection data sent by the first terminal equipment through the first data channel;
displaying corresponding screen projection contents in corresponding collaborative windows based on the screen projection data; and
saving the screen projection data in a distributed database of large-screen equipment;
before the synchronizing the synchronization data to the first target terminal device, the method further includes:
and updating the distributed database of the large-screen equipment according to the synchronous data.
7. The method of claim 6, further comprising, prior to the generating the corresponding synchronization data based on the user's operation within the target collaboration window:
establishing a second data channel with the plurality of first terminal devices;
the synchronizing the synchronization data to the first target terminal device comprises:
and synchronizing the updated synchronization data in the distributed database of the large-screen device to the first target terminal through the second data channel.
8. The method according to claim 6, wherein a plurality of second terminal devices are in communication connection with the large-screen device through a third data channel, and the second terminal devices and the large-screen device are mutually trusted devices; before generating corresponding synchronization data based on the user's operation in the target cooperation window, the method further includes:
synchronizing the initial screen-casting content of each first terminal device to the second target terminal devices through the third data channel, wherein the second target terminal devices are one or more of the plurality of second terminal devices;
after the generating of the corresponding synchronization data based on the user's operation in the target cooperation window, the method further includes:
and synchronizing the updated synchronization data in the distributed database of the large-screen device to the second target terminal device through the third data channel.
9. A screen projection content control method is applied to terminal equipment and comprises the following steps:
the terminal equipment sends the data for projecting the screen to the large-screen equipment;
receiving screen projection contents displayed by a plurality of collaborative windows sent by the large-screen device, and synchronously displaying the collaborative windows on the terminal device;
and receiving synchronous data which is sent by the large-screen equipment and generated based on the operation of the user in the target cooperation window, and updating the content in the corresponding cooperation window displayed by the terminal equipment based on the synchronous data.
10. A large screen device, characterized in that the large screen device comprises:
one or more processors and memory for storing at least one instruction which, when loaded and executed by the processors, implements a screen-casting content control method as claimed in any one of claims 2-8.
11. A terminal device, characterized in that the terminal device comprises:
one or more processors and memory for storing at least one instruction which, when loaded and executed by a processor, implements the screen-casting content control method of claim 9.
12. A distributed system, characterized in that the system comprises a large screen device as claimed in claim 10 and a plurality of terminal devices as claimed in claim 11.
13. A computer-readable storage medium, on which a computer program is stored, the computer program, when being executed by a processor, implementing a screen-casting content control method according to any one of claims 1 to 9.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2021110520801 | 2021-09-08 | ||
| CN202111052080 | 2021-09-08 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115016749A true CN115016749A (en) | 2022-09-06 |
Family
ID=83064200
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210001425.9A Pending CN115016749A (en) | 2021-09-08 | 2022-01-04 | Screen projection content control method, device, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115016749A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111831242A (en) * | 2019-04-23 | 2020-10-27 | 阿里巴巴集团控股有限公司 | Information display method, screen projection end, display end, storage medium and system |
| CN112394892A (en) * | 2019-08-15 | 2021-02-23 | 北京字节跳动网络技术有限公司 | Screen projection method, screen projection equipment, mobile terminal and storage medium |
| CN112423076A (en) * | 2020-11-18 | 2021-02-26 | 努比亚技术有限公司 | Audio screen projection synchronous control method and device and computer readable storage medium |
| CN112988102A (en) * | 2021-05-11 | 2021-06-18 | 荣耀终端有限公司 | Screen projection method and device |
| CN113286190A (en) * | 2021-05-19 | 2021-08-20 | 湖南快乐阳光互动娱乐传媒有限公司 | Cross-network and same-screen control method and device and cross-network and same-screen system |
-
2022
- 2022-01-04 CN CN202210001425.9A patent/CN115016749A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111831242A (en) * | 2019-04-23 | 2020-10-27 | 阿里巴巴集团控股有限公司 | Information display method, screen projection end, display end, storage medium and system |
| CN112394892A (en) * | 2019-08-15 | 2021-02-23 | 北京字节跳动网络技术有限公司 | Screen projection method, screen projection equipment, mobile terminal and storage medium |
| CN112423076A (en) * | 2020-11-18 | 2021-02-26 | 努比亚技术有限公司 | Audio screen projection synchronous control method and device and computer readable storage medium |
| CN112988102A (en) * | 2021-05-11 | 2021-06-18 | 荣耀终端有限公司 | Screen projection method and device |
| CN113286190A (en) * | 2021-05-19 | 2021-08-20 | 湖南快乐阳光互动娱乐传媒有限公司 | Cross-network and same-screen control method and device and cross-network and same-screen system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110597774B (en) | File sharing method, system, device, computing equipment and terminal equipment | |
| CN106227480B (en) | Server, client and multi-screen interaction method and system | |
| US9722986B2 (en) | Electronic tool and methods for meetings | |
| US10431187B2 (en) | Terminal apparatus, screen recording method, program, and information processing system | |
| CN105308934B (en) | Method and apparatus for controlling content shared between devices in wireless communication system | |
| US20200293261A1 (en) | User Interaction with Shared Content During a Virtual Meeting | |
| US20160085381A1 (en) | Managing and synchronizing views in multi-user application with a canvas | |
| US9621627B2 (en) | Dynamically launching a server-based application on a mobile device | |
| EP2756667B1 (en) | Electronic tool and methods for meetings | |
| CN108965217B (en) | Multi-screen multimedia interaction system based on C/S framework | |
| US20200293493A1 (en) | Enabling User Interaction with Shared Content During a Virtual Meeting | |
| CN111711528B (en) | Control method and device for network conference, computer readable storage medium and equipment | |
| EP2843972A1 (en) | Information synchronization method, device and communication terminal based on personal information management system | |
| WO2018010504A1 (en) | Videoconferencing control method, apparatus, and system | |
| US9860487B2 (en) | Video conference data generation | |
| CN114071230B (en) | Multi-terminal screen throwing method, computer equipment and computer readable storage medium | |
| WO2015184877A1 (en) | Method and system for operating presentation document, control apparatus, and presentation apparatus | |
| KR20120079636A (en) | Method for sharing document work in multilateral conference | |
| CN115016749A (en) | Screen projection content control method, device, system and storage medium | |
| JP6703259B2 (en) | Information processing system, conference server, control method thereof, and program | |
| US11102205B2 (en) | System for remotely controlling a document | |
| CN108965079A (en) | A kind of intelligent home furnishing control method and system | |
| KR102540516B1 (en) | Apparatus, user device and method for providing augmented reality contents | |
| KR101844931B1 (en) | Data management apparatus, system and method for dividing display | |
| CN109660776B (en) | Projection system, intermediary device, communication device and conference control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |