CN111263218A - Method and system for realizing synchronous interaction of multiple devices - Google Patents
Method and system for realizing synchronous interaction of multiple devices Download PDFInfo
- Publication number
- CN111263218A CN111263218A CN202010112393.0A CN202010112393A CN111263218A CN 111263218 A CN111263218 A CN 111263218A CN 202010112393 A CN202010112393 A CN 202010112393A CN 111263218 A CN111263218 A CN 111263218A
- Authority
- CN
- China
- Prior art keywords
- data
- processing module
- user operation
- screen picture
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4113—PC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
Abstract
The invention discloses a method and a system for realizing synchronous interaction of multiple devices. The method comprises the steps that a first device encodes a screen picture into screen picture data through video, and transmits the screen picture data to a second device; and the second equipment performs video decoding on the screen picture data and then displays the screen picture data, so that synchronous display interaction between the first equipment and the second equipment is realized.
Description
Technical Field
The invention relates to the technical field of communication interaction, in particular to a method and a system for realizing synchronous interaction of multiple devices.
Background
In the field of software development related to the existing multi-terminal equipment, the following problems exist:
1. multimedia multi-screen protocols such as DLNA, mirast, etc., which all achieve the screen-casting effect of only specific media. DLNA is the media resource played by the opposite terminal, and MIRACAS is the synchronous playing of the screen and the audio of the opposite terminal to the home terminal. The media protocol is effective for media control, but has no effect on non-media control interaction, and is not strong in universality.
2. The remote desktop class, such as a remote desktop under windows, may log on a remote server locally, and although the desktop of the remote server can be visually displayed on a local machine and can directly control resources on the remote server, it is still useless for the client to interact with the server resources, and is only limited to the resources of the remote server itself.
3. Remote desktop variants, similar to remote desktops, for different device types, such as handset to PC, also do not enable direct interaction of both resources.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art. Therefore, the invention provides a method and a system for realizing synchronous interaction of multiple devices, which can realize synchronous interaction among the multiple devices.
In a first aspect, an embodiment of the present invention provides a method for implementing synchronous interaction among multiple devices, including:
the first device encodes the screen picture into screen picture data through video coding and transmits the screen picture data to the second device;
and the second equipment performs video decoding on the screen picture data and then displays the screen picture data.
The method for realizing the synchronous interaction of the multiple devices in the embodiment of the invention at least has the following beneficial effects: the screen picture is subjected to video coding through the first equipment to form screen picture data, the screen picture data are transmitted to the second equipment, and the second equipment performs video decoding on the screen picture data and then displays the screen picture data, so that synchronous display interaction between the first equipment and the second equipment is realized.
According to other embodiments of the present invention, a method for implementing synchronous interaction of multiple devices further comprises:
the second equipment acquires a user operation instruction and sends the user operation instruction to the first equipment;
and the first equipment downloads data from the second equipment according to the user operation instruction.
According to other embodiments of the present invention, a method for implementing synchronous interaction of multiple devices further comprises:
the second equipment acquires a user operation instruction and sends the user operation instruction to the first equipment;
and the first equipment provides data to the second equipment according to the user operation instruction.
According to another embodiment of the present invention, the user operation instruction includes: user operation information, user data type, user data location, and target location.
According to other embodiments of the present invention, the user operation information includes one or more of drag, single click, double click and selection.
According to the method for realizing the synchronous interaction of the multiple devices, the data comprises one or more of word documents, video files, audio files, excel documents, ppt presentations and mails.
According to another embodiment of the present invention, the first device is a mobile terminal, and the mobile terminal includes one or more of a mobile phone, a tablet computer, and a wearable device.
According to another embodiment of the present invention, in the method for implementing synchronous interaction between multiple devices, the second device is a PC.
In a second aspect, an embodiment of the present invention provides a system for implementing synchronous interaction among multiple devices, including a first device and a second device, where the first device and the second device communicate with each other;
the first device comprises a screen picture coding module used for coding the screen picture of the first device into screen picture data through video;
the second device comprises a screen picture decoding module used for displaying the screen picture data after video decoding.
According to another embodiment of the present invention, a system for implementing multi-device synchronous interaction, where the first device further includes a first event processing module and a first data processing module, and the second device further includes a second event processing module and a second data processing module;
the second event processing module is used for acquiring a user operation instruction and sending the user operation instruction to the first event processing module, the first event processing module analyzes the user operation instruction, and determines to download data from the second equipment or provide data to the second equipment according to an analysis result;
if the data is determined to be downloaded from the second device, the first event processing module sends a first response message to the second event processing module, the second event processing module notifies the second data processing module to prepare the data, and responds to the first event processing module, and the first data processing module sends a request to the second data processing module to start downloading the data;
if the data are provided to the second device, the first event processing module informs the first data processing module of preparing the data, a second response message is sent to the second event processing module, and the second data processing module sends a request to the first data processing module to start receiving the data.
Drawings
FIG. 1 is a flow chart illustrating a method for implementing synchronous interaction among multiple devices according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a mobile phone mapping window and a PC desktop window in an embodiment of the present invention;
FIG. 3 is another flowchart illustrating a method for implementing synchronous interaction among multiple devices according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of synchronous document interaction between a mobile phone and a PC side in the embodiment of the present invention;
FIG. 5 is a schematic flowchart of a method for implementing synchronous interaction among multiple devices in an embodiment of the present invention;
fig. 6 is a schematic structural diagram of synchronous video interaction between the mobile phone and the PC in the embodiment of the present invention.
Detailed Description
The concept and technical effects of the present invention will be clearly and completely described below in conjunction with the embodiments to fully understand the objects, features and effects of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments, and those skilled in the art can obtain other embodiments without inventive effort based on the embodiments of the present invention, and all embodiments are within the protection scope of the present invention.
In the description of the present invention, if an orientation description is referred to, for example, the orientations or positional relationships indicated by "upper", "lower", "front", "rear", "left", "right", etc. are based on the orientations or positional relationships shown in the drawings, only for convenience of describing the present invention and simplifying the description, but not for indicating or implying that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention. If a feature is referred to as being "disposed," "secured," "connected," or "mounted" to another feature, it can be directly disposed, secured, or connected to the other feature or indirectly disposed, secured, connected, or mounted to the other feature.
In the description of the embodiments of the present invention, if "a number" is referred to, it means one or more, if "a plurality" is referred to, it means two or more, if "greater than", "less than" or "more than" is referred to, it is understood that the number is not included, and if "greater than", "lower" or "inner" is referred to, it is understood that the number is included. If reference is made to "first" or "second", this should be understood to distinguish between features and not to indicate or imply relative importance or to implicitly indicate the number of indicated features or to implicitly indicate the precedence of the indicated features.
Example one
As shown in fig. 1, the method for implementing synchronous interaction among multiple devices in the embodiment of the present invention includes the following steps:
s100, the first equipment encodes the screen picture into screen picture data through video coding and transmits the screen picture data to the second equipment;
and S200, the second equipment performs video decoding on the screen picture data and then displays the screen picture data.
In this embodiment, the first device is a mobile terminal, and the mobile terminal includes one or more of a mobile phone, a tablet computer, and a wearable device.
In this embodiment, the second device is a PC.
Taking the first device as a mobile phone as an example:
the mobile phone end program establishes link connection with the PC end program through a network (wifi/hotspot and the like), the mobile phone end interaction background service program encodes screen picture data, and the screen picture data is decoded and displayed through the PC end interaction foreground service to form a screen projection effect, so that synchronous display interaction of the mobile phone and the PC end is realized.
As shown in fig. 2, the mobile phone mapping window B is a mapping window of the mobile phone terminal screen at the PC terminal, and is displayed in the PC desktop window a.
Further, as shown in fig. 3, the method for implementing synchronous interaction of multiple devices further includes the steps of:
s300, the second equipment acquires a user operation instruction and sends the user operation instruction to the first equipment;
s400, the first equipment downloads data from the second equipment according to the user operation instruction.
Still take the first device as a mobile phone as an example:
a user wants to open a document on the PC side on the mobile phone, by dragging a document (e.g., a docword document) in the PC desktop window a to a corresponding application (e.g., an office application) in the mobile phone mapping window B, as shown in fig. 2 by operation 201, and opening the document (e.g., the office application) on the mobile phone side by the corresponding document application, a screen as shown in fig. 4 is obtained. When the document is processed at the mobile phone end, the mobile phone mapping window B in the PC desktop window A can synchronously display the document processing process, so that the synchronous document interaction between the mobile phone and the PC end is realized.
Further, as shown in fig. 5, the method for implementing synchronous interaction among multiple devices further includes the steps of:
s500, the second equipment acquires a user operation instruction and sends the user operation instruction to the first equipment;
s600, the first equipment provides data for the second equipment according to the user operation instruction.
Still take the first device as a mobile phone as an example:
when a user wants to open a video on a mobile phone on a PC, the user can open a video (such as a media video player) on the PC through a corresponding video player application by dragging a video file (such as an avi video file) of a mobile phone mapping window B to a video player application (such as a media video player) in a PC desktop window a (as shown in fig. 2 by operation 202), so as to obtain a picture shown in fig. 6, thereby implementing synchronous video interaction between the mobile phone and the PC.
In this embodiment, the data may include not only the word document and the video file, but also an audio file, an excel document, a ppt presentation, an email, and the like.
In this embodiment, the user operation instruction includes: user operation information, user data type, user data location, and target location.
The user operation information refers to the operation type of the user, such as drag, single click, double click, selection, and the like. Fig. 3 illustrates the drag as an example.
The user data type refers to a data type, such as the data type of a word document is.
The user data location refers to a storage path or a storage location of data.
The user target position refers to a coordinate position of the data when the window is displayed.
Example two
The embodiment provides a system for realizing synchronous interaction of multiple devices, which comprises a first device and a second device, wherein the first device and the second device are communicated with each other;
the first device comprises a screen picture coding module, a screen picture coding module and a screen picture decoding module, wherein the screen picture coding module is used for carrying out video coding on a screen picture of the first device into screen picture data;
the second device comprises a screen picture decoding module used for displaying the screen picture data after video decoding.
Furthermore, the first device further comprises a first event processing module and a first data processing module, and the second device further comprises a second event processing module and a second data processing module;
the second event processing module is used for acquiring a user operation instruction and sending the user operation instruction to the first event processing module, the first event processing module analyzes the user operation instruction, and determines to download data from the second equipment or provide data to the second equipment according to an analysis result;
if the data is determined to be downloaded from the second device, the first event processing module sends a first response message to the second event processing module, the second event processing module informs the second data processing module of preparing the data, and responds to the first event processing module, and the first data processing module sends a request to the second data processing module to start downloading the data;
if the data are provided for the second device, the first event processing module informs the first data processing module of preparing the data, a second response message is sent to the second event processing module, and the second data processing module sends a request to the first data processing module to start receiving the data.
In this embodiment, the first device is a mobile terminal, and the mobile terminal includes one or more of a mobile phone, a tablet computer, and a wearable device.
In this embodiment, the second device is a PC.
In this embodiment, please refer to a description of the synchronous interaction method in this embodiment for a working process of a system for implementing synchronous interaction among multiple devices, which is not described herein again.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge of those skilled in the art without departing from the gist of the present invention. Furthermore, the embodiments of the present invention and the features of the embodiments may be combined with each other without conflict.
Claims (10)
1. A method for realizing synchronous interaction of multiple devices is characterized by comprising the following steps:
the first device encodes the screen picture into screen picture data through video coding and transmits the screen picture data to the second device;
and the second equipment performs video decoding on the screen picture data and then displays the screen picture data.
2. The method for implementing synchronous interaction among multiple devices according to claim 1, further comprising:
the second equipment acquires a user operation instruction and sends the user operation instruction to the first equipment;
and the first equipment downloads data from the second equipment according to the user operation instruction.
3. The method for implementing synchronous interaction among multiple devices according to claim 2, further comprising:
the second equipment acquires a user operation instruction and sends the user operation instruction to the first equipment;
and the first equipment provides data to the second equipment according to the user operation instruction.
4. The method of claim 3, wherein the user operation instruction comprises: user operation information, user data type, user data location, and target location.
5. The method of claim 4, wherein the user operation information comprises one or more of drag, single click, double click, and selection.
6. The method of claim 5, wherein the data comprises one or more of a word document, a video file, an audio file, an excel document, a ppt presentation, and a mail.
7. The method for realizing multi-device synchronous interaction according to any one of claims 1-6, wherein the first device is a mobile terminal, and the mobile terminal comprises one or more of a mobile phone, a tablet computer, and a wearable device.
8. The method for implementing multi-device synchronous interaction according to any one of claims 1-6, wherein the second device is a PC.
9. A system for realizing synchronous interaction of multiple devices is characterized by comprising a first device and a second device, wherein the first device and the second device are communicated with each other;
the first device comprises a screen picture coding module used for coding the screen picture of the first device into screen picture data through video;
the second device comprises a screen picture decoding module used for displaying the screen picture data after video decoding.
10. The system of claim 9, wherein the first device further comprises a first event processing module and a first data processing module, and the second device further comprises a second event processing module and a second data processing module;
the second event processing module is used for acquiring a user operation instruction and sending the user operation instruction to the first event processing module, the first event processing module analyzes the user operation instruction, and determines to download data from the second equipment or provide data to the second equipment according to an analysis result;
if the data is determined to be downloaded from the second device, the first event processing module sends a first response message to the second event processing module, the second event processing module notifies the second data processing module to prepare the data, and responds to the first event processing module, and the first data processing module sends a request to the second data processing module to start downloading the data;
if the data are provided to the second device, the first event processing module informs the first data processing module of preparing the data, a second response message is sent to the second event processing module, and the second data processing module sends a request to the first data processing module to start receiving the data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010112393.0A CN111263218A (en) | 2020-02-24 | 2020-02-24 | Method and system for realizing synchronous interaction of multiple devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010112393.0A CN111263218A (en) | 2020-02-24 | 2020-02-24 | Method and system for realizing synchronous interaction of multiple devices |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111263218A true CN111263218A (en) | 2020-06-09 |
Family
ID=70951226
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010112393.0A Pending CN111263218A (en) | 2020-02-24 | 2020-02-24 | Method and system for realizing synchronous interaction of multiple devices |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111263218A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022100308A1 (en) * | 2020-11-16 | 2022-05-19 | Oppo广东移动通信有限公司 | Information processing method and related apparatus |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103685389A (en) * | 2012-09-13 | 2014-03-26 | 卓望数码技术（深圳）有限公司 | System and method for realizing user interface interaction through remotely controlling data terminal |
| CN105359121A (en) * | 2013-07-12 | 2016-02-24 | 三星电子株式会社 | Remote operation of applications using received data |
| WO2016173422A1 (en) * | 2015-04-29 | 2016-11-03 | 努比亚技术有限公司 | Multi-screen interaction method and system |
| CN109408168A (en) * | 2018-09-25 | 2019-03-01 | 维沃移动通信有限公司 | A kind of remote interaction method and terminal device |
| CN109413273A (en) * | 2018-09-16 | 2019-03-01 | 苏州云巢文化传媒有限公司 | Electric room synchronous method, system and electronic lock screen synch system and medium |
| CN109918032A (en) * | 2017-12-11 | 2019-06-21 | 卓望数码技术（深圳）有限公司 | Screen sharing method and system between a kind of Intelligent mobile equipment |
-
2020
- 2020-02-24 CN CN202010112393.0A patent/CN111263218A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103685389A (en) * | 2012-09-13 | 2014-03-26 | 卓望数码技术（深圳）有限公司 | System and method for realizing user interface interaction through remotely controlling data terminal |
| CN105359121A (en) * | 2013-07-12 | 2016-02-24 | 三星电子株式会社 | Remote operation of applications using received data |
| WO2016173422A1 (en) * | 2015-04-29 | 2016-11-03 | 努比亚技术有限公司 | Multi-screen interaction method and system |
| CN109918032A (en) * | 2017-12-11 | 2019-06-21 | 卓望数码技术（深圳）有限公司 | Screen sharing method and system between a kind of Intelligent mobile equipment |
| CN109413273A (en) * | 2018-09-16 | 2019-03-01 | 苏州云巢文化传媒有限公司 | Electric room synchronous method, system and electronic lock screen synch system and medium |
| CN109408168A (en) * | 2018-09-25 | 2019-03-01 | 维沃移动通信有限公司 | A kind of remote interaction method and terminal device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022100308A1 (en) * | 2020-11-16 | 2022-05-19 | Oppo广东移动通信有限公司 | Information processing method and related apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10237327B2 (en) | Methods and systems for accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via HTTP API utilizing a transcoding server | |
| EP2649499B1 (en) | Methods and systems for conducting a remote desktop session via html that supports a 2d canvas and dynamic drawing | |
| US7167897B2 (en) | Accessories providing a telephone conference application one or more capabilities independent of the teleconference application | |
| EP2649533B1 (en) | Methods and systems for facilitating a remote desktop session utilizing long polling | |
| US20200301648A1 (en) | Method of operating a shared object in a video call | |
| CN102158553A (en) | Method and device for playing multi-media files for remote desktop | |
| EP2930898B1 (en) | Method for sharing file and handheld device | |
| CN112073758B (en) | Cloud desktop screen projection method and device, computer equipment, computer readable storage medium and cloud desktop screen projection interaction system | |
| US20070078987A1 (en) | Multi-mode remote user interface server | |
| US10223062B1 (en) | Method and apparatus of capturing a screen image of a remotely managed machine | |
| US20240089529A1 (en) | Content collaboration method and electronic device | |
| US11528447B2 (en) | Remote controlled video messaging session | |
| CN113687888A (en) | File sharing method compatible with Android application running on Linux system | |
| CN104320491A (en) | Method for synchronous display between mobile device and web terminal | |
| CN105577617B (en) | A kind of client, terminal device, host, document transmission system and method | |
| CN110275787B (en) | Online platform data transmission method, device, medium and electronic equipment | |
| AU2020305669A1 (en) | Special effect synchronization method, device, and storage medium | |
| CN111263218A (en) | Method and system for realizing synchronous interaction of multiple devices | |
| CN104639501A (en) | Data stream transmission method, equipment and system | |
| CN114286137A (en) | Mirror image screen projection method, display device and terminal | |
| CN114025244A (en) | Audio and video pushing method, device, equipment and computer readable storage medium | |
| WO2016070373A1 (en) | Method for implementing synchronous preview display between mobile terminal and web terminal | |
| US20080270512A1 (en) | Virtual network projection system supporting multiple projection sources and method thereof | |
| CN113709541A (en) | WEB-based multi-terminal equipment interaction method, system and terminal equipment | |
| CN110896405B (en) | Method, device, equipment and storage medium for remote control interaction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200609 |