WO2020042321A1 - 投屏的控制方法、装置和系统 - Google Patents

投屏的控制方法、装置和系统 Download PDF

Info

Publication number
WO2020042321A1
WO2020042321A1 PCT/CN2018/112719 CN2018112719W WO2020042321A1 WO 2020042321 A1 WO2020042321 A1 WO 2020042321A1 CN 2018112719 W CN2018112719 W CN 2018112719W WO 2020042321 A1 WO2020042321 A1 WO 2020042321A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
screen
server
target
identification information
Prior art date
Application number
PCT/CN2018/112719
Other languages
English (en)
French (fr)
Inventor
郭庆伟
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Priority to EP18931871.0A priority Critical patent/EP3842919A4/en
Publication of WO2020042321A1 publication Critical patent/WO2020042321A1/zh
Priority to US17/187,062 priority patent/US11237791B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup

Definitions

  • the present application relates to the field of screen projection, and in particular, to a method, device, and system for controlling screen projection.
  • the wireless screen transmission solution refers to that after the screen image is encoded by the transmitting end and transmitted to the receiving end (such as an interactive tablet), the receiving end decodes and renders it.
  • the commonly used wireless screen control method is that the terminal installs a wireless screen transmission terminal program, and then can send a screen to the receiving terminal through the transmission terminal program, but in such a scenario, if the same user needs to To screen the content on the terminal, you need to install the sender program on each terminal and then operate on multiple terminals separately, resulting in a very complicated process of screen projection. It can be known that the existing screen-casting scheme is relatively simple, and it is difficult to meet the needs of users in multiple scenarios.
  • At least part of the embodiments of the present application provide a method, a device and a system for controlling a projection screen, so as to solve at least the existing projection screen technology, the projection screen sending end can only perform the projection screen control on its own content, resulting in In the case of a projection screen sending end, different projection screen sending ends need to be controlled separately, and the operation is complicated and complicated.
  • a method for controlling a screen which includes: a first terminal acquires a device list, where the device list includes identification information of a second terminal, and the second terminal is connected to the first terminal.
  • the terminal uses the same account to log in to the terminal of the server; the first terminal receives a selection instruction, where the selection instruction is used to select target identification information from the device list; the first terminal sends a screen-casting control instruction to the server, where the screen-casting control instruction includes the target
  • the identification information and the screen projection control instruction are forwarded to the target second terminal corresponding to the target identification information via the server, so as to control the target second terminal to project the screen to the first screen receiving terminal.
  • the first terminal receives the device list sent by the server, and the server generates the device list after the first terminal and the second terminal log in to the server using the same account.
  • the first terminal generates a screen projection control instruction according to the selection instruction, wherein the screen projection control instruction includes identification information of the target second terminal; the first terminal sends the screen projection control instruction to the server.
  • the first terminal before the first terminal obtains the device list, the first terminal establishes a first communication link with the second projection screen receiving end; the second terminal establishes the second communication with the first projection screen receiving end link.
  • the first terminal receives a screen casting instruction; the first terminal projects a screen to the second screen receiving terminal.
  • the first terminal intercepts the current display content; the first terminal encodes the intercepted current display content and sends the encoding result to the second projection screen receiving end, where the second projection screen receiving end decodes the encoding result, And display the decoded content.
  • the first terminal sends a screen projection control instruction to the server, where the screen projection control instruction is forwarded to the target second terminal via the server to control the target second
  • the terminal stops projecting to the first projecting screen receiving terminal.
  • a method for controlling a screen including: the server sends a device list of the first terminal to the first terminal, where the device list includes an identifier of the second terminal Information, the second terminal is a terminal that uses the same account as the first terminal to log in to the server; the server receives the screen control instruction sent by the first terminal, wherein the screen control instruction is determined according to the selection instruction received by the first terminal, Select the target identification information from the device list; the server forwards the screen projection control instruction to the target second terminal corresponding to the target identification information, so as to control the target second terminal to screen to the first screen receiving terminal.
  • the server determines a terminal that logs in to the server using the same account; the server generates a device list of the first terminal according to identification information of other terminals except the first terminal.
  • the server parses the target identification information from the screen projection control instruction; the server determines the target second terminal according to the target identification information; and the server forwards the screen projection control instruction to the target second terminal.
  • a screen projection control system including: a first terminal, acquiring a device list, receiving a selection instruction, and sending a screen projection control instruction to a server, wherein the device list
  • the second terminal includes identification information of the second terminal.
  • the second terminal is a terminal that accesses the same server as the first terminal, and the selection instruction is used to select target identification information from the device list.
  • the server communicates with the first terminal and is used for The screen control instruction is forwarded to the target second terminal corresponding to the identification information; the target second terminal communicates with the server and the receiving terminal for projecting a screen to the first screen receiving terminal according to the screen control instruction; the first screen receiving terminal, Communicates with the target second terminal and is used to display the screen-casting content of the target second terminal.
  • the first terminal and the second terminal are in the same local area network.
  • the first projection screen receiving terminal and the second projection screen receiving terminal are both interactive smart tablets.
  • a device for controlling a screen including: an obtaining module configured to obtain a device list by a first terminal, where the device list includes identification information of a second terminal, The second terminal is a terminal that accesses the same server as the first terminal; the first receiving module is configured to receive a selection instruction from the first terminal, where the selection instruction is used to select target identification information from a device list; a first sending module, It is set that the first terminal sends a screen control instruction to the server, wherein the screen control instruction includes target identification information, and the screen control instruction is forwarded to the target second terminal corresponding to the target identification information via the server to control the target second terminal to screen To the first projection screen receiving end.
  • a method for controlling a screen including: a second sending module configured to send a device list of the first terminal to the first terminal by the server, wherein the device list
  • the second terminal includes identification information of the second terminal.
  • the second terminal is a terminal that uses the same account as the first terminal to log in to the server.
  • the second receiving module is configured to receive the screen control instruction sent by the first terminal.
  • the screen control instruction is based on The selection instruction received by the first terminal is determined, and the selection instruction is used to select the target second terminal from the device list;
  • the forwarding module is configured to forward the screen control instruction to the target second terminal corresponding to the target identification information to control the target first
  • the two terminals cast a screen to the receiving end of the first screen.
  • a storage medium includes a stored program, and when the program runs, controlling a device where the storage medium is located performs the following steps: the first terminal obtains a device list, where The device list includes identification information of the second terminal, and the second terminal is a terminal accessing the same server as the first terminal; the first terminal receives a selection instruction, where the selection instruction is used to select target identification information from the device list; The first terminal sends a screen-casting control instruction to the server, where the screen-casting control instruction includes target identification information, and the screen-casting control instruction is forwarded to the target second terminal corresponding to the target identification information via the server to control the target second terminal to screen-cast to the first A projection screen receiving end.
  • a storage medium includes a stored program, and when the program runs, controlling a device where the storage medium is located performs the following steps: the first terminal obtains a device list, where The device list includes identification information of the second terminal, and the second terminal is a terminal accessing the same server as the first terminal; the first terminal receives a selection instruction, where the selection instruction is used to select target identification information from the device list; The first terminal sends a screen-casting control instruction to the server, where the screen-casting control instruction includes target identification information, and the screen-casting control instruction is forwarded to the target second terminal corresponding to the target identification information via the server to control the target second terminal to screen-cast to the first A projection screen receiving end.
  • the first terminal obtains a device list, where the device list includes identification information of the second terminal, the second terminal is a terminal that allows the first terminal to perform screen control, and the first terminal receives the selection An instruction, wherein the selection instruction is used to select a target second terminal from the device list, and the first terminal sends a screen projection control instruction to the server, wherein the screen control instruction is used to control the target second terminal to perform screen projection, and the server will cast the screen
  • the control instruction is forwarded to the target second terminal to control the target second terminal to cast a screen.
  • the above solution realizes the technical effect of controlling multiple screens by one terminal through the server's forwarding of screen projection control instructions, and solves the problem that in the existing screen projection technology, the screen projection sender can only perform screen control on its own content.
  • the screen projection sender can only perform screen control on its own content.
  • FIG. 1 is a flowchart of a method for controlling a projection screen according to an embodiment of the present application
  • FIG. 2 is a flowchart of another method for controlling a projection screen according to an embodiment of the present application
  • FIG. 3 is a schematic diagram of a method for controlling a screen according to an embodiment of the present application.
  • FIG. 4 is a flowchart of a method for controlling a screen according to an embodiment of the present application.
  • FIG. 5 is a flowchart of another method for controlling a projection screen according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of another screen control system according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of another device for controlling a screen according to an embodiment of the present application.
  • FIG. 8 is a schematic diagram of another device for controlling a screen according to an embodiment of the present application.
  • a projection screen application software is installed in the projection screen client and / or interactive smart tablet, and the projection screen application software may be pre-installed in the above projection screen client and / or interactive smart tablet, or may be in the projection screen.
  • the client and / or the interactive smart tablet launches the projection screen application, it is downloaded and installed from a third-party device or server.
  • the third-party device is not limited in the embodiment.
  • the screen projection application software is used to obtain the content displayed by the screen projection client as the screen projection data and instruct the interactive smart tablet to display the content.
  • the screen-casting client and the interactive smart tablet are installed with the screen-casting application software as an example for description.
  • the screen projection application software of the screen projection client is used to obtain the screen projection data and send the screen projection data directly or indirectly to the interactive smart tablet. If it is sent indirectly, the screen-casting client can send it to the interactive smart tablet through a relay device.
  • the relay device can be a wireless screen transmission device or other devices with data transfer / processing functions.
  • the screen projection application software of the interactive smart tablet is used to receive the screen projection data and convert the screen projection data into corresponding content, which is convenient for the interactive smart tablet to display.
  • the resolution of the display screen of the projection screen client is different from that of the interactive smart tablet, and the projection screen data is obtained based on the resolution of the projection screen client. Therefore, in order to display on the display of the interactive smart tablet, Screen projection data.
  • the screen projection application software needs to determine the screen mapping relationship according to the resolution of the screen of the projection client and the display of the interactive smart tablet, and then convert the screen projection data to obtain the screen projection content according to the screen mapping relationship.
  • the display contents of the projection screen content and the projection screen data are substantially the same, except that the resolutions are different.
  • an embodiment of a method for controlling a screen is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and Although the logical order is shown in the flowchart, in some cases the steps shown or described may be performed in a different order than here.
  • FIG. 1 is a flowchart of a method for controlling a projection screen according to an embodiment of the present application. As shown in FIG. 1, the method includes the following steps:
  • Step S102 The first terminal obtains a device list, where the device list includes identification information of the second terminal, and the second terminal is a terminal that accesses the same server as the first terminal.
  • the first terminal is a control terminal that performs screen projection control
  • the device list is sent by the screen projection server to the first terminal, and is used to provide the first terminal with identification information of the second terminal.
  • the second terminal is a controlled terminal that can be screen-controlled by the first terminal.
  • the second terminal may be a terminal that is in the same local area network as the first terminal and has established a communication relationship with the server.
  • the first terminal obtaining the device list includes: the first terminal receives the device list sent by the server, and the server generates the device list after the first terminal and the second terminal log in to the server using the same account.
  • the server determines which terminals are allowed to perform screen control with each other.
  • the user may select any one of the terminals as the first terminal, and initiate the acquisition of the device list from the server. request.
  • the other terminals except the first terminal are second terminals.
  • the server composes a device list according to the identification information of the second terminal.
  • the device list may be triplet information, including: account number, device name, terminal UUID, and account number is the login.
  • the device name is the terminal name.
  • the server sends the device list to the first terminal, and the first terminal receives the device list.
  • the terminals connected to the same router use the same account to log in to the server, and the user selects one of the terminals to operate.
  • the terminal is the first terminal, and the other terminal is the second terminal.
  • the terminal sends a request to obtain a device list.
  • the server forms a device list according to the identification information of the second terminal, and returns the device list to the first terminal.
  • Step S104 The first terminal receives a selection instruction, where the selection instruction is used to select target identification information from a device list.
  • the selection instruction may be issued by the user by operating the first terminal.
  • the selection instruction is used to select a second terminal from the device list that needs to be screen-controlled.
  • the number of selected target second terminals may be one or Multiple.
  • the first terminal displays the foregoing device list through a preset window
  • the device list displays identification information of a second terminal allowed to be controlled by the first terminal, and a second terminal allowed to be controlled by the first terminal
  • the terminal may be a terminal that logs in to the server using the same account as the first terminal, and the user selects the identification information of the target second terminal to be controlled from the displayed device list, thereby sending a selection instruction to the first terminal.
  • step S106 the first terminal sends a screen control instruction to the server, where the screen control instruction includes target identification information, and the screen control instruction is forwarded to the target second terminal corresponding to the target identification information via the server to control the target second terminal to cast Screen to the first projection screen receiving end.
  • the above-mentioned screen-casting control instruction includes identification information of the target second terminal, and is used by the server to determine the target second terminal selected by the user according to the target identification information.
  • the selection instruction received by the first terminal is a trigger condition for the first terminal to send a screen control instruction. After the selection instruction received by the first terminal, according to the received selection instruction, a structure is sent to the server to cast. Screen control instructions.
  • the first terminal after receiving the selection instruction and determining the target second terminal, constructs a projection control instruction according to the identification information of the target second terminal, and sends the projection control instruction to the server.
  • the server performs subsequent projection control.
  • the server After receiving the screen-casting control instruction, the server sends the screen-casting control instruction to the target second terminal according to the identification information of the target second terminal carried in the screen-casting control instruction, so that the first terminal can cast the target second terminal. Screen controls.
  • the first terminal sends a screen projection control instruction to the server, including: the first terminal generates a screen projection control instruction according to the selection instruction, wherein the screen projection control instruction includes identification information of the target second terminal; A terminal sends a screen control instruction to the server.
  • the selection instruction received by the first terminal is used to determine a target second terminal.
  • the screen control instruction sent by the first terminal to the server is generated according to the selection instruction, so that the screen control instruction carries the target second terminal. Identification information.
  • the second terminal identification information in the device list is a UUID (Universally Unique Identifier) of the second terminal.
  • the first terminal determines that the target second terminal is based on the selection instruction.
  • the second terminal whose identification information is "23sdfifkkkrff44rtyg44555ertfgywe", so the first terminal can generate a screen control instruction (23sdfifkkkrff44rtyg44555ertfgywe, start screen projection), and send the screen control instruction to the server.
  • the server After the server receives the screen control instruction, it can The identification information of the target second terminal carried in the screen projection control instruction finds the target second terminal, and then performs screen control on the target second terminal.
  • the above solution is applicable to a scenario where a user needs to perform screen control on multiple terminals.
  • the first terminal obtains a device list, where the device list includes identification information of the second terminal, the second terminal is a terminal that accesses the same server as the first terminal, and the first terminal Receive a selection instruction, where the selection instruction is used to select target identification information from a device list, and the first terminal sends a screen control instruction to the server, where the screen control instruction includes the target identification information, and the screen control instruction is forwarded to the target via the server
  • the target second terminal corresponding to the identification information is used to control the target second terminal to cast a screen to the first screen receiving terminal.
  • the above solution realizes the technical effect of controlling multiple screens by one terminal through the server's forwarding of screen projection control instructions, and solves the problem that in the existing screen projection technology, the screen projection sender can only perform screen control on its own content. In the case where there are multiple projection screen sending ends, different projection screen sending ends need to be controlled separately, resulting in a complicated and tedious operation.
  • FIG. 2 is another screen projection method according to the embodiment of the present application.
  • the flowchart of the control method, as shown in FIG. 2, includes:
  • Step S21 The first terminal establishes a first communication link with the second projection screen receiving end.
  • the above-mentioned projection screen receiving end may be an interactive smart tablet.
  • the first terminal After the first terminal establishes communication with the second screen-receiving terminal, when the first terminal is screen-casting, it can cast the screen to the second screen-receiving terminal through the established communication link.
  • the first communication link may be a socket link.
  • the first terminal can establish a socket connection after obtaining the IP address and port of the receiving end of the projection screen.
  • Step S23 The second terminal establishes a second communication link with the first projection screen receiving end.
  • the second communication link has the same settings as the second communication link. It should be noted that the first projection screen receiving end and the second projection screen receiving end may be the same device, or may be two different devices, respectively.
  • the first communication link includes a first sub-link and a second sub-link, wherein the first sub-link is used to transmit a screen-casting control signaling of a first terminal, and the second The sub-link is used for transmitting multimedia data of the first terminal;
  • the second communication link includes: a third sub-link and a fourth sub-link, wherein the third sub-link is used for transmitting the second terminal's Screen casting control signaling, the fourth sub-link is used to transmit multimedia data of the second terminal.
  • each of the first communication link and the second communication link may include two socket connections, one of which is used to transmit the projection control signaling, and the other is used to transmit the multimedia data, such as video, to the receiver of the projection screen.
  • Stream and audio stream may be used to transmit the multimedia data, such as video, to the receiver of the projection screen.
  • the projection screen control signaling and multimedia data are sent separately.
  • the transmission of multimedia data may cause a freeze. If the projection screen control message is transmitted, If the command and multimedia data are transmitted through the same link, the projection control signaling may be delayed.
  • the projection control signaling and the multimedia data are sent through different communication links. The amount of data is small, so even in the case of a poor network status, the screen-casting control signaling can reach the screen-receiving end in time without being affected by the network status.
  • step S25 the first terminal and the second terminal use the same account to log in to the server.
  • the above server is a server that forwards the screen-casting control instruction
  • the account number may be an account number registered on the server in advance through information such as a phone number, an employee number, and an email address.
  • a user registers a corresponding account on the server by using an employee ID and a password in advance.
  • users log in to their accounts on each terminal to connect to the server, and then they can control themselves and other terminals to cast screens through one of the terminals.
  • the second terminal is a terminal that uses the same account as the first terminal to log in to the server, and is used to determine a second terminal that is allowed to be screen-controlled by the first terminal.
  • the above solution is based on an account system. After using the same account to log in to the server on different terminals, the logged-in terminals can complete the screen control of each other.
  • Step S27 The first terminal obtains a device list, where the device list includes identification information of the second terminal, and the second terminal is a terminal that accesses the same server as the first terminal.
  • Step S29 The first terminal receives a selection instruction, where the selection instruction is used to select target identification information from a device list.
  • Step S211 The first terminal sends a screen control instruction to the server, where the screen control instruction includes target identification information, and the screen control instruction is forwarded to the target second terminal corresponding to the target identification information via the server to control the target second terminal to cast. Screen to the first projection screen receiving end.
  • FIG. 3 is a schematic diagram of a method for controlling a projection screen according to an embodiment of the present application.
  • the receiving end of the projection screen includes an interactive intelligent tablet receiving terminal 1 and an interactive intelligent tablet receiving terminal 2.
  • the server is deployed at a remote location. Cloud server.
  • the terminal accesses the server through the public network.
  • the terminals include terminal A and terminal B. If the user uses terminal A to control terminal B to cast a screen, terminal A is the first terminal described above, and terminal B is the target second terminal. If the user uses terminal B to control terminal A to cast a screen, terminal B is the first terminal described above, and the terminal A is the target second terminal.
  • terminal A and interactive smart tablet receiver 1 are connected to the same wireless router
  • terminal B and interactive smart tablet receiver 2 are connected to the same wireless router
  • terminal A and terminal B run wireless screens respectively.
  • the sending end programs can communicate with the public network control server through the public network
  • the interactive smart tablet receiving end 1 and the interactive smart tablet receiving end 2 run the wireless screen receiving end programs.
  • the control server (Web background service) runs in a public network environment and is responsible for maintaining a list of connected devices and querying and forwarding control instructions.
  • Terminal A and terminal B establish connections with interactive smart tablet receiver 1 and interactive smart tablet receiver 2 through sockets (including but not limited to using sockets), and terminal A and terminal B establish two socket connections with interactive smart tablet receivers, respectively.
  • One is used to transmit operation control signaling, and the other is used to transmit multimedia (screen video stream and audio stream) data, so that terminals A and B can complete wireless screen transfer operations independently.
  • terminal A and terminal B When terminal A and terminal B establish connections with interactive smart tablet receiver 1 and interactive smart tablet receiver 2, respectively, terminal A and terminal B log in to the public network control server through the account (such as the user's mobile phone number), and then control with the public network
  • the server establishes a connection (such as a WebSocket connection), and the public network control server maintains a list of terminal devices that are logged in and connected.
  • each device in the device list is represented by a triple, including: account, device name , Terminal UUID.
  • the public network control server will report equipment items with the same account to the remaining terminals (excluding themselves), so that terminal A and terminal B respectively obtain their own accounts through the public network control server.
  • the login device list of terminal A includes: iPhone
  • the login device list of terminal B includes: Macbook.
  • the user When the user controls the screen of another terminal A logged in through mobile terminal B, the user clicks the device list (such as Macbook) on terminal B, and then terminal A sends a command to start the screen to the public network control server (the instruction It can be a two-tuple: device UUID, operation type, where the device UUID user represents the id of the device uniqueness flag, and the operation type can include: start screen projection or receive screen projection), for example: (device uuid, start), public
  • the network control server sends this instruction to terminal A by querying the device list maintained by itself. After receiving the instruction to start the screen projection, terminal A completes the screen projection through the socket connection established with the interactive smart tablet receiver 1 before.
  • step S213 the first terminal receives a screen casting instruction, where the screen casting instruction is used to control the first terminal to cast a screen to the second screen receiving terminal.
  • the above-mentioned screen-casting instruction is a screen-casting instruction sent directly to the first terminal.
  • the screen-casting control instruction is used to control the target second terminal to screen-cast, and the above-mentioned screen-casting instruction The screen instruction is used to control the first terminal to cast a screen.
  • the first terminal control menu has a screen-casting control, and the user can trigger the screen-controlling control to realize the screen-casting control of the first terminal.
  • Step S215 The first terminal casts a screen to the second screen-receiving end.
  • the second screen projection receiving end is a screen projection receiving end that has a communication link with the first terminal in advance.
  • the first terminal casting a screen to the second screen projection receiving end includes: the first terminal intercepts the current display content ; The first terminal performs encoding processing on the intercepted current display content, and sends the encoding result to the second projection screen receiving end, where the second projection screen receiving end decodes the encoding result and displays the decoded content.
  • the first terminal intercepts the current display content according to a certain sampling period to obtain an image of the current display interface, and then encodes the image to obtain an image-encoded data stream.
  • the first terminal encodes the data stream.
  • the purpose of the projection screen is not limited to the projection screen.
  • step S217 the first terminal sends a screen end control instruction to the server, wherein the screen end control instruction is forwarded to the target second terminal via the server to control the target second terminal to stop projecting the screen to the first screen receiver.
  • the above-mentioned screen-stop control instruction may be issued by the user to the first terminal, and the first terminal forwards the screen-control control instruction sent by the user to the server.
  • the instruction to end the projection control may also include identification information of the target second terminal, which is used to enable the server to find the target second terminal according to the identification information in the instruction to end the projection control, and to end the projection control The instruction is sent to the target second terminal. After the target second terminal receives the instruction to end the projection screen, it terminates sending the data stream obtained by encoding the current display content to the first projection screen receiver.
  • FIG. 4 is a flowchart of a method for controlling screen projection according to an embodiment of the present application. The method is applied to the structure of FIG. 2. An example of performing screen projection using the method for controlling screen projection is described below with reference to FIGS. 3 and 4. .
  • the terminal A starts a program for transmitting the wireless screen.
  • terminal A is the sending end, and the sending end program can be started by launching the screen casting application on terminal A.
  • Terminal A establishes a connection with the interactive smart tablet.
  • the terminal A is installed with a screen-casting application at the transmitting end for running the program of the wireless screen transmitting end, and the interactive smart tablet is installed with a screen-receiving application at the receiving end for running the long-screen receiving end of the wireless screen.
  • Terminal A establishes a connection with the wireless screen receiving terminal program of the interactive smart tablet through the wireless screen transmitting terminal program.
  • terminal A can establish two socket connections (through two ports) through the IP address and port of the interactive tablet, one of which is used to transmit screen control signaling and the other is used to transmit screen video Stream and audio streaming data.
  • Terminal A logs in to the public network control server through the account.
  • terminal A After terminal A establishes a connection with the interactive smart tablet receiver, terminal A logs in to the public network control service through an account (such as the user's mobile phone number), and the public network control server will add a device list item, such as (1886886688, iPhone, 23sdfifkkkrff44rtyg44555ertfgywe); Terminal A then establishes a connection with the public network control server (for example, WebSocket).
  • the public network control server for example, WebSocket
  • the terminal B starts a program of the wireless screen transmitting terminal.
  • Terminal B establishes a connection with the interactive smart tablet.
  • the interactive smart tablet and the interactive smart tablet in step S42 may be the same interactive smart tablet.
  • terminal B establishes two socket connections (two ports) by interacting with the IP address and port of the smart tablet, one of which is used to transmit screen control signaling and the other is used to transmit screen video stream and audio Streaming data.
  • Terminal B is connected to the public network control server.
  • terminal B After terminal B establishes a connection with the interactive smart tablet receiver, terminal B logs in to the public network control service through an account (such as the user's mobile phone number), and the public network control server will add a device list item, such as (1886886688, Macbook, uydfhy7893ijuduy765tgyhytrfedwsd); Terminal B then establishes a connection with the public network control server (for example, WebSocket).
  • the public network control server for example, WebSocket
  • both terminal A and terminal B can complete their own screen projection.
  • terminal A When terminal A needs to perform screen projection, it can perform screen projection according to the connection established in S42, and when terminal B needs to perform screen projection, it can perform screen projection according to the connection established in S45.
  • Control terminal A to project a screen on terminal B It includes the following steps:
  • the user sends an instruction to start screen projection to the public network control server by clicking an entry (for example, Macbook) in the registered device list on the terminal B.
  • an entry for example, Macbook
  • the user when the user clicks an entry item, the user sends a selection instruction to terminal B.
  • terminal B two terminals, terminal A and terminal B, are included. Therefore, the device list received by terminal B includes an entry corresponding to terminal A. item.
  • the screen projection control instruction may be (23sdfifkkkrff44rtyg44555ertfgywe, start screen projection), where "23sdfifkkkrff44rtyg44555ertfgywe" is the UUID of terminal A.
  • the public network control server inquires its own device list according to the device UUID in the instruction, finds the corresponding item (ie terminal A), and then sends the screen control instruction to terminal A through the WebSocket connection established in S43.
  • the terminal A then completes the screen casting through the connection established in step S42. So far, the user has completed the control of operating the screen of terminal A on terminal B.
  • the user can also control terminal B to cast a screen on terminal A.
  • the specific process is similar to that in S48, and is not repeated here.
  • FIG. 5 is another screen projection method according to the embodiment of the present application.
  • the flowchart of the control method, as shown in FIG. 5, includes:
  • step S51 the server sends a device list of the first terminal to the first terminal, where the device list includes identification information of the second terminal, and the second terminal is a terminal accessing the same server as the first terminal.
  • the server may return the device list of the first terminal to the first terminal after receiving the request for obtaining the device list sent by the first terminal; the server may also directly directly access the server after the first terminal accesses the server. Send its corresponding device list to the first terminal.
  • the first terminal may be any terminal that communicates with the server, and the second terminal is a terminal other than the terminal itself in the system.
  • the server may send a corresponding device list to each terminal, and the device list includes identification information of other terminals except the terminal itself.
  • the identification information of the second terminal may be the UUID of the second terminal.
  • the server determines which terminals are allowed to control each other for screen projection control, and the user may select among them. Any terminal serves as the first terminal, and initiates a request for obtaining a device list to the server. All other terminals except the first terminal are second terminals.
  • the server composes a device list according to the identification information of the second terminal, and sends the device list to the first terminal.
  • the first terminal receives the device list.
  • terminals connected to the same router use the same account to log in to the server, and the user selects one of the terminals to operate.
  • the terminal is the first terminal, and the other terminal is the second terminal.
  • the terminal sends a request for obtaining a device list.
  • the server forms a device list according to the identification information of the second terminal, and returns the device list to the first terminal.
  • step S53 the server receives a screen-casting control instruction sent by the first terminal, where the screen-casting control instruction is determined according to a selection instruction received by the first terminal, and the selection instruction is used to select target identification information from a device list.
  • the above-mentioned screen-casting control instruction includes identification information of the target second terminal, and is used by the server to determine the target second terminal selected by the user. It can be understood that the selection instruction received by the first terminal is a trigger condition for the first terminal to send a screen control instruction. After the selection instruction received by the first terminal, according to the received selection instruction, a structure is sent to the server to cast. Screen control instructions.
  • the first terminal after receiving the selection instruction and determining the target second terminal, constructs a projection control instruction according to the identification information of the target second terminal, and sends the projection control instruction to the server.
  • the server performs subsequent projection control.
  • step S55 the server forwards the screen projection control instruction to the target second terminal corresponding to the target identification information, so as to control the target second terminal to screen to the first screen receiving terminal.
  • the server After receiving the screen projection control instruction, the server sends the screen projection control instruction to the target second terminal according to the identification information of the target second terminal carried in the screen projection control instruction, thereby realizing the control of the screen projection of the target second terminal. .
  • the above solution is applicable to a scenario where a user needs to perform screen control on multiple terminals.
  • the server receives the device list acquisition request of the first terminal, and the server sends the device list of the first terminal to the first terminal.
  • the device list includes identification information of the second terminal.
  • the two terminals are terminals that access the same server as the first terminal, and receive the screen-casting control instruction sent by the first terminal, where the screen-casting control instruction is determined according to a selection instruction received by the first terminal, and the selection instruction is used for Select the target identification information in the device list, forward the screen projection control instruction to the target second terminal corresponding to the target identification information, and control the target second terminal to screen.
  • the above solution realizes the technical effect of controlling multiple screens by one terminal through the server's forwarding of screen projection control instructions, and solves the problem that in the existing screen projection technology, the screen projection sender can only perform screen control on its own content.
  • the screen projection sender can only perform screen control on its own content.
  • the server sending the device list of the first terminal to the first terminal includes: the server determines the terminal that uses the same account to log in to the server; the server according to the identification information of other terminals except the first terminal, Generate a device list of the first terminal.
  • forwarding the screen-casting control instruction to the target second terminal corresponding to the target identification information to control the target second-terminal to cast a screen to the first screen-receiving terminal includes: the server sends the screen-casting control instruction The target identification information is parsed in the server; the server determines the target second terminal according to the target identification information; the server forwards the screen control instruction to the target second terminal.
  • the identification information of the target second terminal may be a UUID of the target second terminal.
  • the screen projection control instruction is (23sdfifkkkrff44rtyg44555ertfgywe, start screen projection)
  • the server parses the target second terminal identification information "23sdfifkkkrff44rtyg44555ertfgywe" after receiving the screen control instruction, and according to the identification information Find the target second terminal. After finding the target second terminal, the server forwards the screen-casting control instruction to the target second terminal, thereby controlling the target second terminal to perform screen-casting.
  • FIG. 6 is a schematic diagram of another screen projection control system according to the embodiment of the present application. As shown in FIG. 6, the system includes:
  • the first terminal 60 obtains a device list, receives a selection instruction, and sends a screen control instruction to the server.
  • the device list includes identification information of the second terminal, and the second terminal is a terminal that accesses the same server as the first terminal.
  • the selection instruction is used to select target identification information from the device list.
  • the first terminal is a terminal that performs screen projection control
  • the device list is sent by the screen projection server to the first terminal, and is used to provide the first terminal with identification information of the second terminal.
  • the second terminal is a terminal that can be screen-controlled by the first terminal.
  • the above-mentioned selection instruction may be issued by a user by operating the first terminal.
  • the selection instruction is used to select a second terminal from the device list that needs to be screen-controlled, and the number of selected target second terminals may be one or more.
  • the second terminal that is allowed to be screen-controlled by the first terminal may be a terminal that is in the same local area network as the first terminal and has established a communication relationship with the server.
  • the above-mentioned screen control instruction includes identification information of the target second terminal, and is used by the server to determine the target second terminal selected by the user.
  • the first terminal sends a device list acquisition request to the server to obtain the device list returned by the server, and the user selects a target second terminal in the device list that needs to perform screen control, the first terminal According to the user's selection, a projection control instruction carrying identification information of the target second terminal is generated, and the projection control instruction is sent to the server.
  • the server 62 is in communication with the first terminal and is configured to forward the screen control instruction to the target second terminal corresponding to the identification information.
  • the server After receiving the screen projection control instruction, the server sends the screen projection control instruction to the target second terminal according to the identification information of the target second terminal carried in the screen projection control instruction, thereby realizing the control of the screen projection of the target second terminal. .
  • the target second terminal 64 is in communication with the server and the receiving end, and is configured to cast a screen to the first projection screen receiving end according to the screen projection control instruction.
  • the target second terminal can connect to the socket through the IP address and port of the receiving end.
  • the socket connection is two socket connections, one of which is used to transmit screen control signaling and the other is used to transmit screen video stream and Audio streaming data.
  • the communication between the target second terminal and the server may be to access the server through the public network, and is used to receive the screen-casting control instruction sent by the server.
  • the first projection screen receiving end 66 is in communication with the target second terminal, and is configured to display the projection content of the target second terminal.
  • the technical effect of controlling the target second terminal to cast a screen to the receiving end is achieved through the first terminal.
  • the first terminal and the second terminal are not limited to which terminal in the system, and the identities of the two can be interchanged, that is, the terminal to be operated is the above-mentioned first terminal, and the terminal to be controlled is the above-mentioned second terminal.
  • the first terminal and the second terminal can also be controlled by establishing a connection with the receiving terminal or other receiving terminals. Screen itself to the receiving end.
  • the above solution is applicable to a scenario where a user needs to perform screen control on multiple terminals.
  • the first terminal and the second terminal are in the same local area network.
  • the first terminal and the second terminal are on the same local area network, and the first terminal and the second terminal may be connected to the same router.
  • the first terminal and the second terminal use the same account to log in to the service.
  • the server determines the terminals that are allowed to control each other for screen projection control.
  • the user can select any one of the terminals as the first terminal and initiate a device list acquisition with the server. Request. All other terminals except the first terminal are second terminals.
  • the server composes a device list according to the identification information of the second terminal, and sends the device list to the first terminal.
  • the first terminal receives the device list.
  • the terminals connected to the same router use the same account to log in to the server, and the user selects one of the terminals to operate.
  • the terminal is the first terminal, and the other terminal is the second terminal.
  • the terminal sends a request to obtain a device list.
  • the server forms a device list according to the identification information of the second terminal, and returns the device list to the first terminal.
  • first communication link between the first terminal and the second projection screen receiving end; and a second communication link between the second terminal and the first projection screen receiving end.
  • both the first communication link and the second communication link may be socket links.
  • the first terminal and the second terminal can establish a socket connection after obtaining the IP address and port of the projection screen receiving end.
  • first communication link may include two socket connections, one of which is used for transmitting projection screen control signaling, and the other is multimedia data, such as video stream and audio stream, transmitted by the user to the receiving end of the projection screen.
  • the projection screen control signaling and multimedia data are sent separately.
  • the transmission of multimedia data may cause a freeze. If the projection screen control message is transmitted, If the command and multimedia data are transmitted through the same link, the projection control signaling may be delayed.
  • the projection control signaling and the multimedia data are sent through different communication links. The amount of data is small, so even in the case of a poor network status, the screen-casting control signaling can reach the screen-receiving end in time without being affected by the network status.
  • the first projection screen receiving end and the second projection screen receiving end are both interactive smart tablets.
  • FIG. 7 is a schematic diagram of another screen projection control device according to an embodiment of the present application. As shown in FIG. 7, the device includes:
  • the obtaining module 702 is configured to obtain a device list by the first terminal, where the device list includes identification information of the second terminal, and the second terminal is a terminal that accesses the same server as the first terminal;
  • the first receiving module 704 is configured to receive a selection instruction by a first terminal, where the selection instruction is used to select target identification information from a device list;
  • the first sending module 706 is configured to send a screen control instruction to the server by the first terminal, where the screen control instruction includes target identification information, and the screen control instruction is forwarded to the target second terminal corresponding to the target identification information via the server to control The target second terminal projects the screen to the first screen receiving terminal.
  • the foregoing apparatus further includes a login module configured to log in to the server using the same account before the first terminal obtains the device list.
  • the obtaining module includes a receiving submodule configured to receive the device list sent by the server from the first terminal, where the server generates the device list after the first terminal and the second terminal log in to the server using the same account.
  • the first sending module includes: a generating sub-module configured to generate, by the first terminal, a projection control instruction according to the selection instruction, wherein the projection control instruction includes identification information of the target second terminal; A module configured to send a screen control instruction to a server by a first terminal.
  • the foregoing apparatus further includes: a first establishing module configured to establish a first communication link between the first terminal and the second projection screen receiving end before the first terminal obtains the device list;
  • the second establishing module is configured to establish a second communication link between the second terminal and the first projection screen receiving end.
  • the first communication link includes a first sub-link and a second sub-link, where the first sub-link is used to transmit the screen-casting control signaling of the first terminal, and the second The sub-link is used to transmit multimedia data of the first terminal;
  • the second communication link includes: a third sub-link and a fourth sub-link, wherein the third sub-link is used to transmit the screen control information of the second terminal Let the fourth sub-link be used for transmitting multimedia data of the second terminal.
  • the above device further includes: a second receiving module configured to receive the screen-casting instruction from the first terminal, wherein the screen-casting instruction is used to control the first terminal to screen-cast to the second screen-screen receiving terminal;
  • the screen-casting module is configured so that the first terminal projects a screen to the second screen-receiving terminal.
  • the screen-casting module includes: an interception module configured to intercept the current display content of the first terminal; an encoding module configured to encode the intercepted current display content of the first terminal and send the encoding result To the second projection screen receiving end, where the second projection screen receiving end decodes the encoding result and displays the decoded content
  • the foregoing apparatus further includes: a second sending module configured to send the screen-end control instruction to the server after the first terminal sends the screen-cast control instruction to the server, where the The screen control instruction is forwarded to the target second terminal via the server, so as to control the target second terminal to stop projecting the screen to the first screen receiving terminal.
  • a second sending module configured to send the screen-end control instruction to the server after the first terminal sends the screen-cast control instruction to the server, where the The screen control instruction is forwarded to the target second terminal via the server, so as to control the target second terminal to stop projecting the screen to the first screen receiving terminal.
  • FIG. 8 is a schematic diagram of another screen projection control apparatus according to an embodiment of the present application. As shown in FIG. 8, the apparatus includes:
  • the third sending module 802 is configured to send the device list of the first terminal to the first terminal by the server, where the device list includes identification information of the second terminal, and the second terminal is a terminal that uses the same account as the first terminal to log in to the server .
  • the second receiving module 804 is configured for the server to receive the screen-casting control instruction sent by the first terminal, where the screen-casting control instruction is determined according to a selection instruction received by the first terminal, and the selection instruction is used to select target identification information from the device list.
  • the forwarding module 806 is configured for the server to forward the screen projection control instruction to the target second terminal corresponding to the target identification information, so as to control the target second terminal to screen to the first screen receiving terminal.
  • the third sending module includes: a determining sub-module configured to be a server that determines a terminal that uses the same account to log in to the server; and generating a sub-module configured to be configured by the server according to the identity of other terminals except the first terminal Information to generate a device list of the first terminal.
  • the forwarding module includes a parsing sub-module configured to the server to parse the identification information of the target second terminal from the screen control instruction; a determination sub-module set to the server to determine the target Two terminals; a forwarding sub-module, configured to be configured by the server to forward the screen control instruction to the second terminal.
  • a storage medium includes a stored program, and when the program runs, controlling a device where the storage medium is located performs the following steps: a first terminal obtains a device list, where the device list includes a second Identification information of the terminal, the second terminal is a terminal accessing the same server as the first terminal; the first terminal receives a selection instruction, wherein the selection instruction is used to select target identification information from a device list; the first terminal sends a vote to the server
  • the screen control instruction includes target identification information, and the screen control instruction is forwarded by the server to the target second terminal corresponding to the target identification information, so as to control the target second terminal to screen to the first screen receiving terminal.
  • the device where the storage medium is located is also controlled to perform other steps in Embodiment 1 or Embodiment 2.
  • a processor configured to run a program.
  • the program executes the following steps: the first terminal obtains a device list, where the device list includes identification information of the second terminal, and The two terminals are terminals accessing the same server as the first terminal; the first terminal receives a selection instruction, where the selection instruction is used to select target identification information from a device list; the first terminal sends a screen-casting control instruction to the server, where: The screen-casting control instruction includes target identification information, and the screen-casting control instruction is forwarded to the target second terminal corresponding to the target identification information via the server, so as to control the target second terminal to screen-cast to the first screen-receiving end.
  • the disclosed technical content can be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the unit may be a logical function division.
  • multiple units or components may be combined or may be combined. Integration into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, units or modules, and may be electrical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each of the units may exist separately physically, or two or more units may be integrated into one unit.
  • the above integrated unit may be implemented in the form of hardware or in the form of software functional unit.
  • the integrated unit When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium.
  • the technical solution of the present application is essentially a part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium. , Including a number of instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present application.
  • the foregoing storage media include: U disks, Read-Only Memory (ROM), Random Access Memory (RAM), mobile hard disks, magnetic disks, or optical disks, and other media that can store program codes .
  • the first terminal obtains a device list, where the device list includes identification information of the second terminal, and the second terminal is a terminal that accesses the same server as the first terminal; the first terminal receives a selection instruction, The selection instruction is used to select target identification information from the device list.
  • the first terminal sends a screen projection control instruction to the server, where the screen projection control instruction includes the target identification information, and the screen projection control instruction is forwarded to the server corresponding to the target identification information via the server.
  • the target second terminal is configured to control the target second terminal to cast a screen to a first screen receiving terminal.
  • the screen-casting control instruction is forwarded by the server, the technical effect of controlling the screen-casting of multiple terminals by one terminal is realized, and in the existing screen-casting technology, the screen-casting sender can only perform screen-controlling on its own content, resulting in In the case where there are multiple projection screen sending ends, different projection screen sending ends need to be controlled separately, and the operation is complicated and complicated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Information Transfer Between Computers (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本申请公开了一种投屏的控制方法、装置和系统。其中，该方法包括：第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端；第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。本申请解决了现有的投屏技术中，投屏发送端只能对自身的内容进行投屏控制，导致在具有多个投屏发送端的情况下，需要对不同的投屏发送端分别进行控制，操作繁琐复杂的技术问题。

Description

投屏的控制方法、装置和系统
本申请要求于2018年8月28日提交中国专利局、申请号为201810988562.X、申请名称“投屏的控制方法、装置和系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及投屏领域，具体而言，涉及一种投屏的控制方法、装置和系统。
背景技术
无线传屏方案指的是，发送端将屏幕图像进行编码后，传输至接收端(例如交互平板等)，接收端进行解码后渲染出来。
目前常用的无线传屏控制方法是，终端安装无线传屏发送端程序，然后可以通过发送端程序向接收端进行投屏，但在这样的一种场景中，如果同一个用户需要将多个不同的终端上的内容进行投屏，则需要在每个终端上都安装发送端程序，然后在多个终端上分别进行操作，导致投屏的过程非常复杂。由此可知，现有的投屏方案较为单一，难以满足用户在多种场景下的需求。
针对现有技术中，终端只能对自身的内容进行投屏控制，导致投屏的控制方法单一的问题，目前尚未提出有效的解决方案。
发明内容
本申请至少部分实施例提供了一种投屏的控制方法、装置和系统，以至少解决现有的投屏技术中，投屏发送端只能对自身的内容进行投屏控制，导致在具有多个投屏发送端的情况下，需要对不同的投屏发送端分别进行控制，操作繁琐复杂的技术问题。
根据本申请其中一实施例的一个方面，提供了一种投屏的控制方法，包括：第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端使用同一账号登录服务器的终端；第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
可选地，第一终端接收服务器发送的设备列表，其中，服务器在第一终端和第二终端使用同一账号登录服务器后生成设备列表。
可选地，第一终端根据选择指令生成投屏控制指令，其中，投屏控制指令包括目标第二终端的标识信息；第一终端将投屏控制指令发送至服务器。
可选地，在第一终端获取设备列表之前，第一终端建立与第二投屏接收端之间的第一通信链路；第二终端建立与第一投屏接收端之间的第二通信链路。
可选地，第一终端接收投屏指令；第一终端向第二投屏接收端投屏。
可选地，第一终端截取当前显示内容；第一终端对截取的当前显示内容进行编码处理，并将编码结果发送至第二投屏接收端，其中，第二投屏接收端解码编码结果，并显示解码得到的内容。
可选地，在第一终端向服务器发送投屏控制指令之后，第一终端向服务器发送结束投屏控制指令，其中，结束投屏控制指令经由服务器转发至目标第二终端，以控制目标第二终端停止向第一投屏接收端投屏。
根据本申请其中一实施例的另一方面，还提供了一种投屏的控制方法，包括：服务器将第一终端的设备列表发送至第一终端，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端使用同一账号登录服务器的终端；服务器接收第一终端发送的投屏控制指令，其中，投屏控制指令根据第一终端接收到的选择指令确定，选择指令用于从设备列表中选择目标标识信息；服务器将投屏控制指令转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
可选地，服务器确定使用同一账号登录服务器的终端；服务器根据除第一终端之外的其他终端的标识信息，生成第一终端的设备列表。
可选地，服务器从投屏控制指令中解析出目标标识信息；服务器根据目标标识信息确定目标第二终端；服务器将投屏控制指令转发至目标第二终端。
根据本申请其中一实施例的另一方面，还提供了一种投屏的控制系统，包括：第一终端，获取设备列表，接收选择指令，并向服务器发送投屏控制指令，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端，选择指令用于从设备列表中选择目标标识信息；服务器，与第一终端通信，用于将投屏控制指令转发至标识信息对应的目标第二终端；目标第二终端，与服务器和接收端通信，用于根据投屏控制指令投屏至第一投屏接收端；第一投屏接收端，与目标第二终端通信，用于显示目标第二终端的投屏内容。
可选地，第一终端和第二终端处于同一局域网络中。
可选地，第一终端与第二投屏接收端之间具有的第一通信链路；第二终端与第一投屏接收端之间的第二通信链路。
可选地，第一投屏接收端和第二投屏接收端均为交互智能平板。
根据本申请其中一实施例的另一方面，还提供了一种投屏的控制装置，包括：获取模块，设置为第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端；第一接收模块，设置为第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一发送模块，设置为第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
根据本申请其中一实施例的另一方面，还提供了一种投屏的控制方法，包括：第二发送模块，设置为服务器将第一终端的设备列表发送至第一终端，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端使用同一账号登录服务器的终端；第二接收模块，设置为接收第一终端发送的投屏控制指令，其中，投屏控制指令根据第一终端接收到的选择指令确定，选择指令用于从设备列表中选择目标第二终端；转发模块，设置为将投屏控制指令转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
根据本申请其中一实施例的另一方面，还提供了一种存储介质，存储介质包括存储的程序，其中，在程序运行时控制存储介质所在设备执行如下步骤：第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端；第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
根据本申请其中一实施例的另一方面，还提供了一种存储介质，存储介质包括存储的程序，其中，在程序运行时控制存储介质所在设备执行如下步骤：第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端；第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
在本申请至少部分实施例中，第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为允许被第一终端进行投屏控制的终端，第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标第二终端，第一终端向服务器发送投屏控制指令，其中，投屏控制指令用于控制目标第二终端进行投屏，服务器将 投屏控制指令转发至目标第二终端，以控制目标第二终端投屏。上述方案通过服务器转发投屏控制指令，实现了由一个终端控制多个终端投屏的技术效果，解决了现有的投屏技术中，投屏发送端只能对自身的内容进行投屏控制，导致在具有多个投屏发送端的情况下，需要对不同的投屏发送端分别进行控制，操作繁琐复杂问题。
附图说明
此处所说明的附图用来提供对本申请的进一步理解，构成本申请的一部分，本申请的示意性实施例及其说明用于解释本申请，并不构成对本申请的不当限定。在附图中：
图1是根据本申请实施例的投屏的控制方法的流程图；
图2是根据本申请实施例的另一种投屏的控制方法的流程图；
图3是根据本申请实施例的一种投屏控制方法的示意图；
图4是根据本申请实施例的一种投屏控制方法的流程图；
图5是根据本申请实施例的另一种投屏的控制方法的流程图；
图6是根据本申请实施例的另一种投屏的控制系统的示意图；
图7是根据本申请实施例的另一种投屏的控制装置的示意图；以及
图8是根据本申请实施例的另一种投屏的控制装置的示意图。
具体实施方式
为了使本技术领域的人员更好地理解本申请方案，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分的实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都应当属于本申请保护的范围。
需要说明的是，本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方 法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
可选的，投屏客户端和/或交互智能平板中安装有投屏应用软件，该投屏应用软件可以预先安装在上述投屏客户端和/或交互智能平板中，也可以是在投屏客户端和/或交互智能平板启动投屏应用时，从第三方设备或服务器进行下载并安装使用。其中，第三方设备在实施例中不作限定。
可选的，投屏应用软件用于获取投屏客户端显示的内容，将其作为投屏数据，并指示交互智能平板显示该内容。实施例中以投屏客户端和交互智能平板中同时安装有投屏应用软件为例进行说明。其中，投屏客户端的投屏应用软件用于获取投屏数据，并将投屏数据直接或间接发送至交互智能平板。如果是间接发送的话，投屏客户端可以通过中转设备发送至交互智能平板，该中转设备可以是无线传屏装置，也可以是具有数据中转/处理功能的其它设备。
交互智能平板的投屏应用软件用于接收投屏数据，并将投屏数据转换成相应的内容，便于交互智能平板进行显示。需要说明的是，投屏客户端的显示屏与交互智能平板的显示屏的分辨率不同，而投屏数据是基于投屏客户端的分辨率获取的，因此，为了在交互智能平板的显示屏中显示投屏数据，投屏应用软件需要根据投屏客户端的显示屏和交互智能平板的显示屏的分辨率确定屏幕映射关系，进而根据屏幕映射关系对投屏数据进行转换以得到投屏内容。需要说明的是，在实施例中，投屏内容和投屏数据的显示内容实质相同，仅是分辨率不同。
实施例1
根据本申请实施例，提供了一种投屏的控制方法的实施例，需要说明的是，在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行，并且，虽然在流程图中示出了逻辑顺序，但是在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤。
图1是根据本申请实施例的投屏的控制方法的流程图，如图1所示，该方法包括如下步骤：
步骤S102，第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端。
可选的，上述第一终端为进行投屏控制的控制端，设备列表由投屏服务器发送至第一终端，用于向第一终端提供第二终端的标识信息。该第二终端是可以被第一终端进行投屏控制的被控端。
上述第二终端，可以是与第一终端处于同一局域网络，并与服务器建立了通信关系的终端。
作为一种可选的实施例，第一终端获取设备列表，包括：第一终端接收服务器发送的设备列表，其中，服务器在第一终端和第二终端使用同一账号登录服务器后生成设备列表。
可选的，服务器在第一终端和第二终端使用同一账号登录服务器后，确定了允许互相进行投屏控制的终端，用户可以选择其中任意一个终端作为第一终端，向服务器发起获取设备列表的请求。除第一终端之外的其他终端均为第二终端，服务器根据第二终端的标识信息构成设备列表，设备列表可以是三元组信息，包括：账号，设备名，终端UUID，账号即为登录服务器的账号，设备名为终端名称。服务器将设备列表发送至第一终端，第一终端则接收到设备列表。
在一种可选的实施例中，连接至同一路由器的终端使用同一账户登录服务器，用户选择其中一个终端进行操作，该终端即为第一终端，其他终端即为第二终端，用户通过第一终端发出获取设备列表的请求。服务器接收到该获取设备列表的请求后，根据第二终端的标识信息构成设备列表，并将设备列表返回至第一终端。
步骤S104，第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息。
可选的，上述选择指令可以由用户通过操作第一终端发出，选择指令用于从设备列表中选择出需要进行投屏控制的第二终端，所选择的目标第二终端的数量可以是一个或多个。
在一种可选的实施例中，第一终端通过预设窗口显示上述设备列表，设备列表中显示有允许被第一终端控制的第二终端的标识信息，允许被第一终端控制的第二终端可以是使用与第一终端相同的账号登录服务器的终端，用户在显示的设备列表中，选择需要控制的目标第二终端的标识信息，从而向第一终端发送了选择指令。
步骤S106，第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
可选的，上述投屏控制指令中包括目标第二终端的标识信息，用于服务器根据目标标识信息确定用户所选的目标第二终端。
可以理解为，上述第一终端接收到的选择指令，是第一终端发送投屏控制指令的触发条件，当第一终端接收到的选择指令之后，根据接收到的选择指令，构造发送给 服务器投屏控制指令。
在一种可选的实施例中，第一终端在接收选择指令，确定目标第二终端后，根据目标第二终端的标识信息构造投屏控制指令，并将投屏控制指令发送至服务器，由服务器进行之后的投屏控制。
服务器在接收到投屏控制指令之后，根据投屏控制指令中携带的目标第二终端的标识信息，将投屏控制指令发送给目标第二终端，从而实现由第一终端对目标第二终端投屏的控制。
作为一种可选的实施例，第一终端向服务器发送投屏控制指令，包括：第一终端根据选择指令生成投屏控制指令，其中，投屏控制指令包括目标第二终端的标识信息；第一终端将投屏控制指令发送至服务器。
可选的，第一终端接收到的选择指令，用于确定目标第二终端。为了使服务器能够确定目标第二终端，以对目标第二终端进行控制，第一终端发送给服务器的投屏控制指令根据选择指令生成的，从而使投屏控制指令中携带有目标第二终端的标识信息。
在一种可选的实施例中，设备列表中的第二终端标识信息为第二终端的UUID(Universally Unique Identifier，通用唯一识别码)，例如，第一终端根据选择指令确定目标第二终端是标识信息为“23sdfifkkkrff44rtyg44555ertfgywe”的第二终端，因此第一终端可以生成投屏控制指令(23sdfifkkkrff44rtyg44555ertfgywe，开始投屏)，并将投屏控制指令发送至服务器，服务器接收到投屏控制指令后，可以根据投屏控制指令中携带的目标第二终端的标识信息找到目标第二终端，进而对目标第二终端进行投屏控制。
上述方案适用于一个用户需要对多台终端进行投屏控制的场景。以会议场景为例，如果存储在多台设备上的内容都需要在会议上投屏，会议的主持需要在不同的终端上来回进行切换，如果使用上述方案，会议的主持者只需要在一个主控制终端(即上述第一终端)进行控制，则可以完成对局域网内所有终端的投屏控制，简化了控制多个终端投屏的操作，增加了投屏控制的便捷程度。
由上可知，本申请上述实施例中，第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端，第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息，第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。上述方案通过服务器转发投屏控制指令，实现了由一个终端控制多个终端投屏的技术效果，解决了现有的投屏技术中，投屏发送端只能对自身的内容进行投屏 控制，在具有多个投屏发送端的情况下，需要对不同的投屏发送端分别进行控制，导致操作复杂繁琐的问题。
实施例2
根据本申请实施例，提供了一种投屏的控制方法的实施例，该实施例中的步服务器可以为实施例1中的服务器，图2是根据本申请实施例的另一种投屏的控制方法的流程图，结合图2所示，该方法包括：
步骤S21，第一终端建立与第二投屏接收端之间的第一通信链路。
可选的，上述投屏接收端可以是交互智能平板。第一终端与第二投屏接收端建立通信后，当第一终端在进行投屏时，即可通过已建立的通信链路，向第二投屏接收端投屏。
在一种可选的实施例中，上述第一通信链路可以为socket链路。第一终端在获取到投屏接收端的IP地址和端口之后就可以建立socket连接。
步骤S23，第二终端建立与第一投屏接收端之间的第二通信链路。
可选的，第二通信链路与第二通信链路具有相同的设置。需要说明的是，上述第一投屏接收端与上述第二投屏接收端可以为同一个设备，也可以分别为不同的两个设备。
进一步的，所述第一通信链路包括：第一子链路和第二子链路，其中，所述第一子链路用于传输第一终端的投屏控制信令，所述第二子链路用于传输第一终端的多媒体数据；所述第二通信链路包括：第三子链路和第四子链路，其中，所述第三子链路用于传输第二终端的投屏控制信令，所述第四子链路用于传输第二终端的多媒体数据。
在上述方案中，第一通信链路和第二通信链路均可以包括两条socket连接，其中一条用于传输投屏控制信令，另一条用于传输至投屏接收端的多媒体数据，例如视频流和音频流。
通过上述方案建立两条socket连接，从而使得对投屏控制信令和多媒体数据单独进行发送，尤其的网络状态较差的情况下，多媒体数据的传输可能会产生卡顿，如果将投屏控制信令和多媒体数据通过同一条链路进行传输，则可能会导致投屏控制信令的延迟，而上述方案将投屏控制信令和多媒体数据通过不同的通信链路进行发送，由于投屏控制信令的数据量较小，因此即使在网络状态较差的情况下，投屏控制信令也能够及时到达投屏接收端，不会受到网络状态的影响。
步骤S25，第一终端和第二终端使用同一账号登录服务器。
可选的，上述服务器即为转发投屏控制指令的服务器，账号可以是预先通过电话号码、工号、邮箱等信息在服务器上注册的账号。
在一种可选的实施例中，以会议场景为例，用户预先通过工号和密码在服务器上注册对应的账号。在会议上，如果需要对多台终端进行控制，用户在每台终端上都登录自己的账号，以与服务器连接，然后就可以通过其中一台终端控制自身以及其他终端进行投屏。
在上述方案中，第二终端为与第一终端使用同一账户登录服务器的终端，用于确定允许被第一终端进行投屏控制的第二终端。
上述方案基于账号体系，使用同一个账号在不同的终端上登录服务器后，已登录的终端之间就可以完成相互之间的投屏控制。
步骤S27，第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端。
步骤S29，第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息。
步骤S211，第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
图3是根据本申请实施例的一种投屏控制方法的示意图，结合图3所示，投屏接收端包括交互智能平板接收端1和交互智能平板接收端2，服务器为部署在远端的云服务器，终端通过公网访问该服务器。终端包括终端A和终端B。如果用户使用终端A控制终端B投屏，则终端A为上述第一终端，终端B为上述目标第二终端，如果用户使用终端B控制终端A投屏，则终端B为上述第一终端，终端A为上述目标第二终端。
该实施例中，终端A与交互智能平板接收端1连接在同一个无线路由器下，终端B与交互智能平板接收端2连接在同一个无线路由器下，终端A和终端B中分别运行无线传屏的发送端程序，且均能通过公网与公网控制服务器通信，交互智能平板接收端1和交互智能平板接收端2中运行无线传屏接收端程序。控制服务器(Web后台服务)运行在公网环境，负责维护已连接设备列表以及查询转发控制指令。
终端A和终端B通过socket(包括但不限于使用socket)分别与交互智能平板接收端1和交互智能平板接收端2建立连接，终端A和终端B分别建立两条与交互智能平板接收端的socket连接，一条用来传输操作控制信令，一条用于传输多媒体(屏幕视频流和音频流)数据，这样终端A和B就可以单独完成无线传屏操作。
终端A和终端B在分别与交互智能平板接收端1和交互智能平板接收端2建立连接的同时，终端A和终端B通过账号(例如用户手机号)登录公网控制服务器，然后与公网控制服务器分别建立连接(例如WebSocket连接)，公网控制服务器维护已经登录且连接的终端设备列表，公网控制服务器中，设备列表中的每一个设备用一个三元组表示，包括：账号，设备名，终端UUID。终端A和B与公网控制服务器建立连接时，公网控制服务器会报告具有相同账号的设备项目至其余终端(排除自己)，这样终端A和终端B通过公网控制服务器就分别获取到了自己账号登录的其他设备，且构造一个不包含自己的登录设备列表，例如，终端A的登录设备列表包括：iPhone，终端B的登录设备列表包括：Macbook。
当用户通过移动终端B控制其登录的另一台终端A传屏时，用户通过终端B上点击设备列表(例如Macbook)，然后终端A向公网控制服务器发送一条投屏开始的指令(该指令可以是一个二元组：设备UUID，操作类型，其中，设备UUID用户表示设备唯一性标志的id，操作类型可以包括：开始投屏或接收投屏)，例如：(设备uuid，开始)，公网控制服务器通过查询自己维护的设备列表，将此指令发送给终端A，终端A收到投屏开始的指令后，通过与之前与交互智能平板接收端1建立的socket连接完成投屏。
步骤S213，第一终端接收投屏指令，其中，投屏指令用于控制第一终端向第二投屏接收端投屏。
可选的，上述投屏指令是直接发送至第一终端的投屏指令，与上述投屏控制指令相比，其区别在于，投屏控制指令用于控制目标第二终端投屏，而上述投屏指令用于控制第一终端投屏。
在一种可选的实施例中，第一终端控制菜单中具有投屏控制控件，用户可以通过触发该投屏控制控件，实现对第一终端的投屏控制。
步骤S215，第一终端向第二投屏接收端投屏。
上述第二投屏接收端为与第一终端预先建立有通信链路的投屏接收端，可选的，第一终端向第二投屏接收端投屏，包括：第一终端截取当前显示内容；第一终端对截取的当前显示内容进行编码处理，并将编码结果发送至第二投屏接收端，其中，第二投屏接收端解码编码结果，并显示解码得到的内容。
在一种可选的实施例中，第一终端按照一定的采样周期截取当前显示内容，得到当前显示界面的图像，再将图像进行编码，得到图像编码后的数据流，第一终端将数据流发送至第二投屏接收端，第二投屏接收端对数据流进行解码，得到第一终端当前显示界面的图像，第二投屏接收端显示解码结果，从而实现了第一终端向第二投屏接 收端投屏的目的。
步骤S217，第一终端向服务器发送结束投屏控制指令，其中，结束投屏控制指令经由服务器转发至目标第二终端，以控制目标第二终端停止向第一投屏接收端投屏。
可选的，上述结束投屏控制指令可以由用户向第一终端发出，第一终端接收用户发送的结束投屏控制指令后，将其转发至服务器。需要说明的是，结束投屏控制指令中也可以包括目标第二终端的标识信息，用于使服务器可以根据结束投屏控制指令中的标识信息查找到目标第二终端，并将结束投屏控制指令发送至目标第二终端。在目标第二终端接收到结束投屏控制指令后，终止向第一投屏接收端发送编码当前显示内容得到的数据流。
图4是根据本申请实施例的一种投屏控制方法的流程图，该方法应用在图2的结构中，下面结合图3和图4对使用上述投屏控制方法进行投屏的示例进行说明。
S41，终端A上启动无线传屏发送端程序。
在投屏的过程中，终端A即为发送端，可以通过启动终端A上的投屏应用来启动发送端程序。
S42，终端A与交互智能平板建立连接。
终端A安装有发送端投屏应用，用于运行无线传屏发送端程序，交互智能平板安装有接收端投屏应用，用于运行无线传屏接收端长须。终端A通过无线传屏发送端程序与交互智能平板的无线传屏接收端程序建立连接。
在同一个无线局域网中，终端A通过交互式平板的IP地址和端口就可以建立两条socket连接(通过两个端口)，其中一条用于传输投屏控制信令，另一条用于传输屏幕视频流和音频流媒体数据。
S43，终端A通过账号登录公网控制服务器。
终端A与交互智能平板接收端建立连接后，终端A就通过账号(例如用户手机号)登录至公网控制服务，公网控制服务器会增加一条设备列表项目，例如(1886886688，iPhone，23sdfifkkkrff44rtyg44555ertfgywe)；然后终端A与公网控制服务器建立一条连接(例如WebSocket)。
S44，终端B启动无线传屏发送端程序。
S45，终端B与交互智能平板建立连接。
上述交互智能平板与步骤S42中的交互智能平板可以为同一个交互智能平板。
在同一个无线局域网中，终端B通过交互智能平板的IP地址和端口建立两条socket连接(两个端口)，其中一条用于传输投屏控制信令，另一条用于传输屏幕视频流和音频流媒体数据。
S46，终端B与公网控制服务器连接。
终端B与交互智能平板接收端建立连接后，终端B就通过账号(例如用户手机号)登录至公网控制服务，公网控制服务器会增加一条设备列表项目，例如(1886886688，Macbook，uydfhy7893ijuduy765tgyhytrfedwsd)；然后终端B与公网控制服务器建立一条连接(例如WebSocket)。
S47，终端A和终端B均可完成自身投屏。
当终端A需要进行投屏时，可以根据S42中建立的连接进行投屏，当终端B需要进行投屏时，可以根据S45中建立的连接进行投屏。
S48，在终端B上控制终端A投屏。具体包括如下几个步骤：
a、用户在终端B上通过点击已登录设备列表中的条目项(例如Macbook)向公网控制服务器发送一条开始投屏的指令。
可选的，上述用户点击条目项即为向终端B发送选择指令，在该示例中包括终端A和终端B两个终端，因此终端B接收到的设备列表中，包括与终端A对应的一个条目项。该投屏控制指令可以是(23sdfifkkkrff44rtyg44555ertfgywe，开始投屏)，其中“23sdfifkkkrff44rtyg44555ertfgywe”为终端A的UUID。
b、公网控制服务器根据指令中的设备UUID查询自身的设备列表，找到对应的项目(即终端A)，然后通过S43中建立的WebSocket连接将投屏控制指令发送给终端A。
c、终端A再通过步骤S42中建立的连接完成投屏。至此用户在终端B上就完成了操作终端A投屏的控制。
同样的，用户还可以在终端A上控制终端B投屏，具体过程与S48中类似，此处不再赘述。
实施例3
根据本申请实施例，提供了一种投屏的控制方法的实施例，该实施例中的步服务器可以为实施例1中的服务器，图5是根据本申请实施例的另一种投屏的控制方法的流程图，结合图5所示，该方法包括：
步骤S51，服务器将第一终端的设备列表发送至第一终端，其中，设备列表中包 括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端。
首先，需要说明的是，服务器可以在接收到第一终端发送的获取设备列表的请求后，向第一终端的设备列表返回至第一终端；服务器还可以当第一终端接入服务器后就直接向第一终端发送其对应的设备列表。
还需要说明的是，上述第一终端可以是与服务器通信的任意一个终端，第二终端则为系统中除终端本身之外的其他终端。在一种可选的实施例中，服务器可以向每个终端都发送其对应的设备列表，设备列表中包括了除终端本身之外的其他终端的标识信息。
可选的，第二终端的标识信息可以是第二终端的UUID，服务器在第一终端和第二终端使用同一账号登录服务器后，确定了允许控制互相进行投屏控制的终端，用户可以选择其中任意一个终端作为第一终端，向服务器发起获取设备列表的请求。除第一终端之外的其他终端均为第二终端，服务器根据第二终端的标识信息构成设备列表，发送至第一终端，第一终端则接收到设备列表。
在一种可选的实施例中，连接至同一路由器的终端使用同样账户登录服务器，用户选择其中一个终端进行操作，该终端即为第一终端，其他终端即为第二终端，用户通过第一终端发出获取设备列表的请求，服务器接收到该获取设备列表的请求后，根据第二终端的标识信息构成设备列表，并将设备列表返回至第一终端。
步骤S53，服务器接收第一终端发送的投屏控制指令，其中，投屏控制指令根据第一终端接收到的选择指令确定，选择指令用于从设备列表中选择目标标识信息。
可选的，上述投屏控制指令中包括目标第二终端的标识信息，用于服务器确定用户所选的目标第二终端。可以理解为，上述第一终端接收到的选择指令，是第一终端发送投屏控制指令的触发条件，当第一终端接收到的选择指令之后，根据接收到的选择指令，构造发送给服务器投屏控制指令。
在一种可选的实施例中，第一终端在接收选择指令，确定目标第二终端后，根据目标第二终端的标识信息构造投屏控制指令，并将投屏控制指令发送至服务器，由服务器进行之后的投屏控制。
步骤S55，服务器将投屏控制指令转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
服务器在接收到投屏控制指令之后，根据投屏控制指令中携带的目标第二终端的标识信息，将投屏控制指令发送给目标第二终端，从而实现来对目标第二终端投屏的控制。
上述方案适用于一个用户需要对多台终端进行投屏控制的场景。以会议场景为例，如果存储在多台设备上的内容都需要在会议上投屏，会议的主持需要在不同的终端上来回进行切换，如果使用上述方案，会议的主持者只需要在一个主控制终端(即上述第一终端)进行控制，则可以完成对局域网内所有终端的投屏控制，简化了控制多个终端投屏的操作，增加了投屏控制的便捷程度。
由上可知，本申请上述实施例中，服务器接收第一终端的设备列表获取请求，服务器将第一终端的设备列表发送至第一终端，其中，设备列表中包括第二终端的标识信息，第二终端为与所述第一终端接入同一个服务器的终端，接收第一终端发送的投屏控制指令，其中，投屏控制指令根据第一终端接收到的选择指令确定，选择指令用于从设备列表中选择目标标识信息，将投屏控制指令转发至目标标识信息对应的目标第二终端，控制目标第二终端投屏。上述方案通过服务器转发投屏控制指令，实现了由一个终端控制多个终端投屏的技术效果，解决了现有的投屏技术中，投屏发送端只能对自身的内容进行投屏控制，导致在具有多个投屏发送端的情况下，需要对不同的投屏发送端分别进行控制，操作繁琐复杂的问题。
作为一种可选的实施例，服务器将第一终端的设备列表发送至第一终端，包括：服务器确定使用同一账号登录服务器的终端；服务器根据除第一终端之外的其他终端的标识信息，生成第一终端的设备列表。
作为一种可选的实施例，将投屏控制指令转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端，包括：服务器从投屏控制指令中解析出目标标识信息；服务器根据目标标识信息确定目标第二终端；服务器将投屏控制指令转发至目标第二终端。
可选的，上述目标第二终端的标识信息可以为目标第二终端的UUID。在一种可选的实施例中，以投屏控制指令为(23sdfifkkkrff44rtyg44555ertfgywe，开始投屏)，服务器接收到投屏控制指令后解析出目标第二终端的标识信息“23sdfifkkkrff44rtyg44555ertfgywe”，并根据该标识信息查找到目标第二终端。在查找到目标第二终端后，服务器向目标第二终端转发投屏控制指令，从而控制目标第二终端进行投屏。
实施例4
根据本申请实施例，提供了一种投屏的控制系统的实施例，图6是根据本申请实施例的另一种投屏的控制系统的示意图，结合图6所示，该系统包括：
第一终端60，获取设备列表，接收选择指令，并向服务器发送投屏控制指令，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器 的终端，选择指令用于从设备列表中选择目标标识信息。
可选的，上述第一终端为进行投屏控制的终端，设备列表由投屏服务器发送至第一终端，用于向第一终端提供第二终端的标识信息。该第二终端是可以被第一终端进行投屏控制的终端。上述选择指令可以由用户通过操作第一终端发出，选择指令用于从设备列表中选择除需要进行投屏控制的第二终端，所选择的目标第二终端的数量可以是一个或多个。上述允许被第一终端进行投屏控制的第二终端，可以是与第一终端处于同一局域网络，并与服务器建立了通信关系的终端。上述投屏控制指令中包括目标第二终端的标识信息，用于服务器确定用户所选的目标第二终端。
在一种可选的实施例中，第一终端向服务器发送设备列表获取请求，从而获取到服务器返回的设备列表，用户在设备列表中选择需要进行投屏控制的目标第二终端，第一终端根据用户的选择，生成携带有目标第二终端的标识信息的投屏控制指令，并将投屏控制指令发送至服务器。
服务器62，与第一终端通信，用于将投屏控制指令转发至标识信息对应的目标第二终端。
服务器在接收到投屏控制指令之后，根据投屏控制指令中携带的目标第二终端的标识信息，将投屏控制指令发送给目标第二终端，从而实现来对目标第二终端投屏的控制。
目标第二终端64，与服务器和接收端通信，用于根据投屏控制指令投屏至第一投屏接收端。
可选的，目标第二终端可以通过接收端的IP地址和端口就可以socket连接，该socket连接为两条socket连接，其中一条用于传输投屏控制信令，另一条用于传输屏幕视频流和音频流媒体数据。
目标第二终端与服务器的通信可以是通过公网访问服务器，用于接收服务器发送的投屏控制指令。
第一投屏接收端66，与目标第二终端通信，用于显示目标第二终端的投屏内容。
在上述方案中，通过第一终端实现了控制目标第二终端向接收端投屏的技术效果。但第一终端和第二终端并不限于是系统中的哪一个终端，二者的身份可以互换，也即被操作的终端为上述第一终端，被控制的终端为上述第二终端。
还需要说明的是，上述方案与第一终端和第二终端对自身的投屏控制并不冲突，第一终端和第二终端也可以通过与上述接收端，或其他接收端建立连接，来控制自身向接收端投屏。
上述方案适用于一个用户需要对多台终端进行投屏控制的场景。以会议场景为例，如果存储在多台设备上的内容都需要在会议上投屏，会议的主持需要在不同的终端上来回进行切换，如果使用上述方案，会议的主持者只需要在一个主控制终端(即上述第一终端)进行控制，则可以完成对局域网内所有终端的投屏控制，简化了控制多个终端投屏的操作，增加了投屏控制的便捷程度。
作为一种可选的实施例，第一终端和第二终端处于同一局域网络中。
可选的，第一终端和第二终端处于同一局域网，可以是第一终端和第二终端连接至同一路由器。
作为一种可选的实施例，第一终端和第二终端使用同一账号登录服务。
可选的，服务器在第一终端和第二终端使用同一账号登录服务器后，确定了允许控制互相进行投屏控制的终端，用户可以选择其中任意一个终端作为第一终端，向服务器发起获取设备列表的请求。除第一终端之外的其他终端均为第二终端，服务器根据第二终端的标识信息构成设备列表，发送至第一终端，第一终端则接收到设备列表。
在一种可选的实施例中，连接至同一路由器的终端使用同一账户登录服务器，用户选择其中一个终端进行操作，该终端即为第一终端，其他终端即为第二终端，用户通过第一终端发出获取设备列表的请求。服务器接收到该获取设备列表的请求后，根据第二终端的标识信息构成设备列表，并将设备列表返回至第一终端。
作为一种可选的实施例，第一终端与第二投屏接收端之间具有第一通信链路；第二终端与第一投屏接收端之间具有第二通信链路。
在一种可选的实施例中，上述第一通信链路和第二通信链路均可以为socket链路。第一终端和第二终端在获取到投屏接收端的IP地址和端口之后就可以建立socket连接。
进一步的，上述第一通信链路可以包括两条socket连接，其中一条用于传输投屏控制信令，另一条用户传输至投屏接收端的多媒体数据，例如视频流和音频流。
通过上述方案建立两条socket连接，从而使得对投屏控制信令和多媒体数据单独进行发送，尤其的网络状态较差的情况下，多媒体数据的传输可能会产生卡顿，如果将投屏控制信令和多媒体数据通过同一条链路进行传输，则可能会导致投屏控制信令的延迟，而上述方案将投屏控制信令和多媒体数据通过不同的通信链路进行发送，由于投屏控制信令的数据量较小，因此即使在网络状态较差的情况下，投屏控制信令也能够及时到达投屏接收端，不会受到网络状态的影响。
作为一种可选的实施例，第一投屏接收端和第二投屏接收端均为交互智能平板。
实施例5
根据本申请实施例，提供了一种投屏的控制装置的实施例，图7是根据本申请实施例的另一种投屏的控制装置的示意图，结合图7所示，该装置包括：
获取模块702，设置为第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为为与第一终端接入同一个服务器的终端；
第一接收模块704，设置为第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；
第一发送模块706，设置为第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
作为一种可选的实施例，上述装置还包括：登录模块，设置为在第一终端获取设备列表之前，第一终端和第二终端使用同一账号登录服务器。
作为一种可选的实施例，获取模块包括：接收子模块，设置为第一终端接收服务器发送的设备列表，其中，服务器在第一终端和第二终端使用同一账号登录服务器后生成设备列表。
作为一种可选的实施例，第一发送模块包括：生成子模块，设置为第一终端根据选择指令生成投屏控制指令，其中，投屏控制指令包括目标第二终端的标识信息；发送子模块，设置为第一终端将投屏控制指令发送至服务器。
作为一种可选的实施例，上述装置还包括：第一建立模块，设置为在第一终端获取设备列表之前，第一终端建立与第二投屏接收端之间的第一通信链路；第二建立模块，设置为第二终端建立与第一投屏接收端之间的第二通信链路。
作为一种可选的实施例，第一通信链路包括：第一子链路和第二子链路，其中，第一子链路用于传输第一终端的投屏控制信令，第二子链路用于传输第一终端的多媒体数据；第二通信链路包括：第三子链路和第四子链路，其中，第三子链路用于传输第二终端的投屏控制信令，第四子链路用于传输第二终端的多媒体数据。
作为一种可选的实施例，上述装置还包括：第二接收模块，设置为第一终端接收投屏指令，其中，投屏指令用于控制第一终端向第二投屏接收端投屏；投屏模块，设置为第一终端向第二投屏接收端投屏。
作为一种可选的实施例，投屏模块包括：截取模块，设置为第一终端截取当前显示内容；编码模块，设置为第一终端对截取的当前显示内容进行编码处理，并将编码 结果发送至第二投屏接收端，其中，第二投屏接收端解码编码结果，并显示解码得到的内容
作为一种可选的实施例，上述装置还包括：第二发送模块，设置为在第一终端向服务器发送投屏控制指令之后，第一终端向服务器发送结束投屏控制指令，其中，结束投屏控制指令经由服务器转发至目标第二终端，以控制目标第二终端停止向第一投屏接收端投屏。
实施例6
根据本申请实施例，提供了一种投屏的控制装置的实施例，图8是根据本申请实施例的另一种投屏的控制装置的示意图，结合图8所示，该装置包括：
第三发送模块802，设置为服务器将第一终端的设备列表发送至第一终端，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端使用同一账号登录服务器的终端。
第二接收模块804，设置为服务器接收第一终端发送的投屏控制指令，其中，投屏控制指令根据第一终端接收到的选择指令确定，选择指令用于从设备列表中选择目标标识信息。
转发模块806，设置为服务器将投屏控制指令转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
作为一种可选的实施例，第三发送模块包括：确定子模块，设置为服务器确定使用同一账号登录服务器的终端；生成子模块，设置为服务器根据除第一终端之外的其他终端的标识信息，生成第一终端的设备列表。
作为一种可选的实施例，转发模块包括：解析子模块，设置为服务器从投屏控制指令中解析出目标第二终端的标识信息；确定子模块，设置为服务器根据目标标识信息确定目标第二终端；转发子模块，设置为服务器将投屏控制指令转发至第二终端。
实施例7
根据本申请实施例，提供了一种存储介质，存储介质包括存储的程序，其中，在程序运行时控制存储介质所在设备执行如下步骤：第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端；第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制 指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
进一步的，在程序运行时还控制存储介质所在设备执行实施例1或实施例2中的其他步骤。
实施例8
根据本申请实施例，提供了一种处理器，处理器设置为运行程序，其中，程序运行时执行如下步骤：第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端；第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。
进一步的，程序运行时还执行实施例1或实施例2中的其他步骤。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
在本申请的上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。
在本申请所提供的几个实施例中，应该理解到，所揭露的技术内容，可通过其它的方式实现。其中，以上所描述的装置实施例仅仅是示意性的，例如所述单元的划分，可以为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，单元或模块的间接耦合或通信连接，可以是电性或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的 形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述仅是本申请的优选实施方式，应当指出，对于本技术领域的普通技术人员来说，在不脱离本申请原理的前提下，还可以做出若干改进和润饰，这些改进和润饰也应视为本申请的保护范围。
工业实用性
在本申请实施例中，第一终端获取设备列表，其中，设备列表中包括第二终端的标识信息，第二终端为与第一终端接入同一个服务器的终端；第一终端接收选择指令，其中，选择指令用于从设备列表中选择目标标识信息；第一终端向服务器发送投屏控制指令，其中，投屏控制指令包括目标标识信息，投屏控制指令经由服务器转发至目标标识信息对应的目标第二终端，以控制目标第二终端投屏至第一投屏接收端。由于通过服务器转发投屏控制指令，实现了由一个终端控制多个终端投屏的技术效果，解决了现有的投屏技术中，投屏发送端只能对自身的内容进行投屏控制，导致在具有多个投屏发送端的情况下，需要对不同的投屏发送端分别进行控制，操作繁琐复杂问题。

Claims (20)

  1. 一种投屏的控制方法，包括：
    第一终端获取设备列表，其中，所述设备列表中包括第二终端的标识信息，所述第二终端为与所述第一终端接入同一个服务器的终端；
    所述第一终端接收选择指令，其中，所述选择指令用于从所述设备列表中选择目标标识信息；
    所述第一终端向服务器发送投屏控制指令，其中，所述投屏控制指令包括所述目标标识信息，所述投屏控制指令经由所述服务器转发至所述目标标识信息对应的目标第二终端，以控制所述目标第二终端投屏至第一投屏接收端。
  2. 根据权利要求1所述的方法，其中，在第一终端获取设备列表之前，所述方法还包括：所述第一终端和所述第二终端使用同一账号登录所述服务器。
  3. 根据权利要求2所述的方法，其中，第一终端获取设备列表，包括：
    所述第一终端接收所述服务器发送的所述设备列表，其中，所述服务器在所述第一终端和所述第二终端使用所述同一账号登录所述服务器后生成所述设备列表。
  4. 根据权利要求1所述的方法，其中，所述第一终端向服务器发送投屏控制指令，包括：
    所述第一终端根据所述选择指令生成所述投屏控制指令，其中，所述投屏控制指令包括所述目标第二终端的标识信息；
    所述第一终端将所述投屏控制指令发送至所述服务器。
  5. 根据权利要求1所述的方法，其中，在第一终端获取设备列表之前，所述方法还包括：
    所述第一终端建立与第二投屏接收端之间的第一通信链路；
    所述第二终端建立与所述第一投屏接收端之间的第二通信链路。
  6. 根据权利要求5所述的方法，其中，
    所述第一通信链路包括：第一子链路和第二子链路，其中，所述第一子链路用于传输所述第一终端的投屏控制信令，所述第二子链路用于传输所述第一终端多媒体数据；
    所述第二通信链路包括：第三子链路和第四子链路，其中，所述第三子链路 用于传输所述第二终端的投屏控制信令，所述第四子链路用于传输所述第二终端的多媒体数据。
  7. 根据权利要求6所述的方法，其中，所述方法还包括：
    所述第一终端接收投屏指令，其中，所述投屏指令用于控制所述第一终端向所述第二投屏接收端投屏；
    所述第一终端向所述第二投屏接收端投屏。
  8. 根据权利要求6所述的方法，其中，所述第一终端向所述第二投屏接收端投屏，包括：
    所述第一终端截取当前显示内容；
    所述第一终端对截取的所述当前显示内容进行编码处理，并将编码结果发送至所述第二投屏接收端，其中，所述第二投屏接收端解码所述编码结果，并显示解码得到的内容。
  9. 根据权利要求1所述的方法，其中，在所述第一终端向服务器发送投屏控制指令之后，所述方法还包括：
    所述第一终端向所述服务器发送结束投屏控制指令，其中，所述结束投屏控制指令经由所述服务器转发至所述目标第二终端，以控制所述目标第二终端停止向所述第一投屏接收端投屏。
  10. 一种投屏的控制方法，包括：
    服务器将第一终端的设备列表发送至所述第一终端，其中，所述设备列表中包括第二终端的标识信息，所述第二终端为与所述第一终端接入同一个服务器的终端；
    所述服务器接收所述第一终端发送的投屏控制指令，其中，所述投屏控制指令根据所述第一终端接收到的选择指令确定，所述选择指令用于从所述设备列表中选择目标标识信息；
    所述服务器将所述投屏控制指令转发至所述目标标识信息对应的目标第二终端，以控制所述目标第二终端投屏至第一投屏接收端。
  11. 根据权利要求10所述的方法，其中，所述服务器将所述第一终端的设备列表发送至所述第一终端，包括：
    所述服务器确定使用同一账号登录所述服务器的终端；
    所述服务器根据除所述第一终端之外的其他终端的标识信息，生成所述第一终端的设备列表。
  12. 根据权利要求10所述的方法，其中，将所述投屏控制指令转发至所述目标标识信息对应的目标第二终端，以控制所述目标第二终端投屏至第一投屏接收端，包括：
    所述服务器从所述投屏控制指令中解析出所述目标标识信息；
    所述服务器根据所述目标标识信息确定所述目标第二终端；
    所述服务器将所述投屏控制指令转发至所述目标第二终端。
  13. 一种投屏的控制系统，包括：
    第一终端，获取设备列表，接收选择指令，并向服务器发送投屏控制指令，其中，所述设备列表中包括第二终端的标识信息，所述第二终端为与所述第一终端接入同一个服务器的终端，所述选择指令用于从所述设备列表中选择目标标识信息；
    服务器，与所述第一终端通信，用于将所述投屏控制指令转发至所述标识信息对应的目标第二终端；
    所述目标第二终端，与所述服务器和接收端通信，用于根据所述投屏控制指令投屏至第一投屏接收端；
    所述第一投屏接收端，与所述目标第二终端通信，用于显示所述目标第二终端的投屏内容。
  14. 根据权利要求13所述的系统，其中，所述第一终端和所述第二终端处于同一局域网络中。
  15. 根据权利要求13所述的系统，其中，所述第一终端与第二投屏接收端之间具有第一通信链路；所述第二终端与所述第一投屏接收端之间具有第二通信链路。
  16. 根据权利要求15所述的系统，其中，所述第一投屏接收端和所述第二投屏接收端均为交互智能平板。
  17. 一种投屏的控制装置，包括：
    获取模块，设置为第一终端获取设备列表，其中，所述设备列表中包括第二终端的标识信息，所述第二终端为与所述第一终端接入同一个服务器的终端；
    第一接收模块，设置为所述第一终端接收选择指令，其中，所述选择指令用于从所述设备列表中选择目标标识信息；
    第一发送模块，设置为所述第一终端向服务器发送投屏控制指令，其中，所述投屏控制指令包括所述目标标识信息，所述投屏控制指令经由所述服务器转发至所述目标标识信息对应的目标第二终端，以控制所述目标第二终端投屏至第一投屏接收端。
  18. 一种投屏的控制装置，包括：
    第二发送模块，设置为服务器将第一终端的设备列表发送至所述第一终端，其中，所述设备列表中包括第二终端的标识信息，所述第二终端为与所述第一终端使用同一账号登录所述服务器的终端；
    第二接收模块，设置为接收所述第一终端发送的投屏控制指令，其中，所述投屏控制指令根据所述第一终端接收到的选择指令确定，所述选择指令用于从所述设备列表中选择目标第二终端；
    转发模块，设置为将所述投屏控制指令转发至目标标识信息对应的目标第二终端，以控制所述目标第二终端投屏至第一投屏接收端。
  19. 一种存储介质，所述存储介质包括存储的程序，其中，在所述程序运行时控制所述存储介质所在设备执行如下步骤：第一终端获取设备列表，其中，所述设备列表中包括第二终端的标识信息，所述第二终端为与所述第一终端接入同一个服务器的终端；所述第一终端接收选择指令，其中，所述选择指令用于从所述设备列表中选择目标标识信息；所述第一终端向服务器发送投屏控制指令，其中，所述投屏控制指令包括所述目标标识信息，所述投屏控制指令经由所述服务器转发至所述目标标识信息对应的目标第二终端，以控制所述目标第二终端投屏至第一投屏接收端。
  20. 一种处理器，所述处理器设置为运行程序，其中，所述程序运行时执行如下步骤：第一终端获取设备列表，其中，所述设备列表中包括第二终端的标识信息，所述第二终端为与所述第一终端接入同一个服务器的终端；所述第一终端接收选择指令，其中，所述选择指令用于从所述设备列表中选择目标标识信息；所述第一终端向服务器发送投屏控制指令，其中，所述投屏控制指令包括所述目标标识信息，所述投屏控制指令经由所述服务器转发至所述目标标识信息对应的目标第二终端，以控制所述目标第二终端投屏至第一投屏接收端。
PCT/CN2018/112719 2018-08-28 2018-10-30 投屏的控制方法、装置和系统 WO2020042321A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP18931871.0A EP3842919A4 (en) 2018-08-28 2018-10-30 METHOD, DEVICE AND SYSTEM FOR CONTROLLING A PROJECTION SCREEN
US17/187,062 US11237791B2 (en) 2018-08-28 2021-02-26 Method, device and system for controlling screen projection

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810988562.X 2018-08-28
CN201810988562.XA CN108989879B (zh) 2018-08-28 2018-08-28 投屏的控制方法、装置和系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/187,062 Continuation US11237791B2 (en) 2018-08-28 2021-02-26 Method, device and system for controlling screen projection

Publications (1)

Publication Number Publication Date
WO2020042321A1 true WO2020042321A1 (zh) 2020-03-05

Family

ID=64547244

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/112719 WO2020042321A1 (zh) 2018-08-28 2018-10-30 投屏的控制方法、装置和系统

Country Status (4)

Country Link
US (1) US11237791B2 (zh)
EP (1) EP3842919A4 (zh)
CN (1) CN108989879B (zh)
WO (1) WO2020042321A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112423073A (zh) * 2020-09-30 2021-02-26 西安万像电子科技有限公司 一种投屏设备的远程控制方法及系统
CN115460442A (zh) * 2022-08-11 2022-12-09 北京罗克维尔斯科技有限公司 投屏切换方法、装置、电子设备、可读存储介质和车辆

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109862404B (zh) * 2019-02-21 2021-02-02 深圳创维－Rgb电子有限公司 一种智能电视的交互方法、存储介质及智能电视
CN109996097B (zh) * 2019-03-12 2022-01-04 广州虎牙信息科技有限公司 一种投屏方法、系统及存储装置
CN109963178B (zh) * 2019-03-15 2022-04-26 北京领度信息技术有限公司 使用安全投屏器进行投屏的方法和安全投屏器
CN111061445A (zh) * 2019-04-26 2020-04-24 华为技术有限公司 投屏方法和计算设备
CN110191350A (zh) 2019-05-28 2019-08-30 上海哔哩哔哩科技有限公司 多端投屏方法、计算机设备及存储介质
CN110337014B (zh) * 2019-06-18 2022-08-09 北京世纪超星信息技术发展有限责任公司 一种实时投屏的方法
CN110474948B (zh) * 2019-06-18 2022-06-28 北京世纪超星信息技术发展有限责任公司 一种网络设备之间的交互方法
CN110244927A (zh) * 2019-07-03 2019-09-17 明基智能科技（上海）有限公司 一种智能显示系统及装置
CN115629730A (zh) 2019-07-23 2023-01-20 华为技术有限公司 显示方法及相关装置
CN110399112A (zh) * 2019-08-28 2019-11-01 北京小米移动软件有限公司 一种投屏方法及装置
CN110602087B (zh) * 2019-09-10 2021-08-24 腾讯科技（深圳）有限公司 智能投屏方法、装置、智能终端及服务器
CN110611711A (zh) * 2019-09-11 2019-12-24 广州视源电子科技股份有限公司 一种教学系统、教学系统通信方法和装置及存储介质
CN110662211A (zh) * 2019-09-24 2020-01-07 广州视源电子科技股份有限公司 无线通信系统、无线连接建立方法和装置、智能交互平板
CN112738559B (zh) * 2019-10-28 2023-05-26 阿里巴巴集团控股有限公司 投屏实现方法、装置及系统
CN112738011B (zh) * 2019-10-28 2024-04-05 阿里巴巴集团控股有限公司 投屏实现方法、装置及系统
CN112738575A (zh) * 2019-10-28 2021-04-30 阿里巴巴集团控股有限公司 投屏实现方法、装置及系统
CN111107223B (zh) * 2019-12-25 2021-08-24 维沃移动通信有限公司 一种消息处理方法及电子设备
CN113031890A (zh) * 2019-12-25 2021-06-25 上海博泰悦臻电子设备制造有限公司 控制移动终端进行投屏交互的方法以及装置
CN111212090A (zh) * 2020-02-20 2020-05-29 上海聚力传媒技术有限公司 终端列表获取方法、装置、计算机设备和存储介质
CN111629371B (zh) * 2020-05-06 2021-09-03 上海幻电信息科技有限公司 投屏方法和系统
CN111965996A (zh) * 2020-06-29 2020-11-20 北京百度网讯科技有限公司 智能设备控制方法、装置、设备和存储介质
CN114077409A (zh) * 2020-08-05 2022-02-22 中兴通讯股份有限公司 投屏方法及装置、电子设备和计算机可读介质
CN112069011B (zh) * 2020-09-08 2024-09-13 西安万像电子科技有限公司 信息获取方法及装置、电子设备
CN112019889B (zh) * 2020-10-26 2023-06-20 深圳乐播科技有限公司 基于云端的投屏系统及投屏方法
CN112367390A (zh) * 2020-11-03 2021-02-12 深圳乐播科技有限公司 终端间服务共享的方法、装置、设备及存储介质
CN112287234B (zh) * 2020-11-16 2023-05-30 Oppo广东移动通信有限公司 信息检索方法、装置及存储介质
CN112394898A (zh) * 2020-11-23 2021-02-23 深圳乐播科技有限公司 投屏方法、装置、系统、投屏设备及存储介质
CN112565461B (zh) * 2020-12-30 2022-04-08 深圳乐播科技有限公司 投屏设备服务代理发现方法、装置、设备及可读存储介质
CN112804732B (zh) * 2021-01-14 2023-03-14 Oppo广东移动通信有限公司 识别电子设备的方法、装置及电子设备
CN115225692B (zh) * 2021-04-16 2024-03-26 广州视源电子科技股份有限公司 信息处理方法、装置及存储介质
CN113691790A (zh) * 2021-08-10 2021-11-23 北京小米移动软件有限公司 多媒体数据处理方法及装置、电子设备及存储介质
CN114173183B (zh) * 2021-09-26 2023-01-24 荣耀终端有限公司 投屏方法和电子设备
CN114827682B (zh) * 2022-04-08 2024-08-23 北京字节跳动网络技术有限公司 投屏方法、系统、设备及存储介质
CN117041506B (zh) * 2022-07-26 2024-09-17 深圳Tcl新技术有限公司 投屏控制方法、装置、投屏接收端和计算机可读存储介质
CN115729504B (zh) * 2022-10-08 2023-07-21 珠海金智维信息科技有限公司 基于远程操控大屏的数据可视化系统、方法和装置
CN116679895B (zh) * 2022-10-26 2024-06-07 荣耀终端有限公司 一种协同业务的调度方法、电子设备及协同系统
CN117251129B (zh) * 2023-11-17 2024-03-01 德卡云创科技(西安)有限公司 一种基于中转编译的跨平台同屏方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197084A (zh) * 2017-04-24 2017-09-22 努比亚技术有限公司 一种移动终端间投影的方法和第一移动终端
CN107526561A (zh) * 2017-08-15 2017-12-29 努比亚技术有限公司 屏幕投影的信息显示方法、移动终端及存储介质
CN108200468A (zh) * 2018-01-09 2018-06-22 武汉斗鱼网络科技有限公司 投屏实现方法、存储介质、电子设备及系统

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0855156A (ja) * 1994-07-12 1996-02-27 Internatl Business Mach Corp <Ibm> 工程安全管理のためのコンピュータ・システムおよび方法
KR101757230B1 (ko) * 2010-01-20 2017-07-13 삼성전자주식회사 멀티미디어 데이터 제공 시스템에서 컨텐츠 재생 방법 및 장치
US20120173622A1 (en) * 2011-01-04 2012-07-05 Samsung Electronics Co., Ltd. Social screen casting
US8589509B2 (en) 2011-01-05 2013-11-19 Cloudium Systems Limited Controlling and optimizing system latency
CN102571979B (zh) * 2012-02-10 2019-04-19 上海视畅信息科技有限公司 多屏互动设备及其绑定方法
KR101952682B1 (ko) 2012-04-23 2019-02-27 엘지전자 주식회사 이동 단말기 및 그 제어방법
CN102833632B (zh) * 2012-08-24 2016-12-21 Tcl集团股份有限公司 多屏互动主从控制设备管理方法、智能电视及控制设备
CN102883135B (zh) * 2012-11-01 2015-08-26 成都飞视美视频技术有限公司 屏幕共享及控制方法
CN103491179B (zh) * 2013-09-27 2017-01-18 百视通网络电视技术发展有限责任公司 基于Web的多屏互动方法及系统
CN103561088B (zh) * 2013-10-30 2016-10-26 乐视致新电子科技（天津）有限公司 一种基于账号登录的远程控制方法及装置
CN104902199A (zh) * 2014-03-03 2015-09-09 中兴通讯股份有限公司 一种投影方法及终端、系统
CN104159057A (zh) 2014-06-12 2014-11-19 惠州Tcl移动通信有限公司 无线投影系统以及无线投影仪
US10257701B2 (en) * 2014-06-24 2019-04-09 Google Llc Methods, systems, and media for authenticating a connection between a user device and a streaming media content device
KR20160028713A (ko) * 2014-09-04 2016-03-14 삼성전자주식회사 사용자 단말기, 디스플레이 장치, 디스플레이 장치 제어 시스템 및 그 방법
CN104978973B (zh) 2014-10-22 2019-08-13 广州酷狗计算机科技有限公司 一种音频处理方法及装置
CN104657099B (zh) * 2015-01-15 2019-04-12 小米科技有限责任公司 屏幕投射方法、装置及系统
CN105262974A (zh) * 2015-08-12 2016-01-20 北京恒泰实达科技股份有限公司 一种实现多人屏幕无线共享的方法
CN105592146A (zh) * 2015-12-16 2016-05-18 小米科技有限责任公司 设备控制方法、装置及终端
CN107197364A (zh) * 2016-03-15 2017-09-22 上海创功通讯技术有限公司 屏幕共享的系统及方法
CN106341382B (zh) * 2016-04-11 2019-12-03 上海建朗信息科技有限公司 会议设备之间的多设备屏幕共享系统
JP6747025B2 (ja) * 2016-04-13 2020-08-26 セイコーエプソン株式会社 表示システム、表示装置、及び、表示システムの制御方法
CN206100345U (zh) 2016-09-30 2017-04-12 西安万像电子科技有限公司 无线传屏设备
CN106487622B (zh) * 2016-10-24 2019-10-25 北京小米移动软件有限公司 设备控制权分享方法及装置
US10455632B2 (en) * 2016-11-30 2019-10-22 Microsoft Technology Licensing, Llc Dynamic identification of network connection preferences
CN106713291A (zh) * 2016-12-12 2017-05-24 广东中信通网络工程有限公司 多屏互动方法、通信终端及服务器
CN107370668B (zh) * 2017-08-25 2020-04-28 北京百度网讯科技有限公司 智能设备远程控制的方法、装置和系统
CN108134813A (zh) * 2017-11-20 2018-06-08 珠海格力电器股份有限公司 设备及其远程控制方法、装置、存储介质和处理器
CN107995215B (zh) * 2017-12-20 2020-09-01 青岛海信智慧家居系统股份有限公司 智能家居设备的控制方法、装置及云平台服务器

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197084A (zh) * 2017-04-24 2017-09-22 努比亚技术有限公司 一种移动终端间投影的方法和第一移动终端
CN107526561A (zh) * 2017-08-15 2017-12-29 努比亚技术有限公司 屏幕投影的信息显示方法、移动终端及存储介质
CN108200468A (zh) * 2018-01-09 2018-06-22 武汉斗鱼网络科技有限公司 投屏实现方法、存储介质、电子设备及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3842919A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112423073A (zh) * 2020-09-30 2021-02-26 西安万像电子科技有限公司 一种投屏设备的远程控制方法及系统
CN112423073B (zh) * 2020-09-30 2024-06-04 西安万像电子科技有限公司 一种投屏设备的远程控制方法及系统
CN115460442A (zh) * 2022-08-11 2022-12-09 北京罗克维尔斯科技有限公司 投屏切换方法、装置、电子设备、可读存储介质和车辆
CN115460442B (zh) * 2022-08-11 2024-02-20 北京罗克维尔斯科技有限公司 投屏切换方法、装置、电子设备、可读存储介质和车辆

Also Published As

Publication number Publication date
EP3842919A1 (en) 2021-06-30
US20210182013A1 (en) 2021-06-17
CN108989879B (zh) 2021-06-15
EP3842919A4 (en) 2021-10-27
US11237791B2 (en) 2022-02-01
CN108989879A (zh) 2018-12-11

Similar Documents

Publication Publication Date Title
WO2020042321A1 (zh) 投屏的控制方法、装置和系统
US9602553B2 (en) Method, apparatus, and system for implementing VOIP call in cloud computing environment
US7996540B2 (en) Method and system for replacing media stream in a communication process of a terminal
US10194180B2 (en) Systems and methods for transmitting video data over a network
US20130022033A1 (en) Method and terminal for access control of network service
US20180091581A1 (en) Method of switching download mode, control method thereof and control system thereof
WO2014169581A1 (zh) 远程无线屏幕共享方法、装置及系统
WO2017088634A1 (zh) 第三方应用认证方法、认证服务器、终端及管理服务器
US11310194B2 (en) Cloud access to local network addresses
EP2584760B1 (en) Method for realizing video browsing, ip multimedia subsystem (ims) video monitoring system, and monitoring front end
EP3032838A1 (en) Message processing method, device, gateway, set-top box and internet protocol television system
WO2014183404A1 (zh) 数据传输方法、装置及系统、终端
CN111427527A (zh) 投屏方法、装置、设备及计算机可读存储介质
CN111988471B (zh) 无线话机系统、无线通话方法及可读存储介质
WO2017219852A1 (zh) 数据信息的共享方法及装置、终端
WO2014117408A1 (zh) 流媒体数据传输的方法及装置
CN114764286A (zh) 一种应用程序登录方法及系统
US20140149570A1 (en) Provisioning ip terminals
CN109104774B (zh) 数据传输方法和系统
AU2013262210B2 (en) Transmission method for media data stream and thin client
CN112565182B (zh) 数据处理方法、系统、电子设备及网关设备
CN106658450B (zh) 一种远程异构网络移动实时通讯方法
US20060143314A1 (en) Remote USB videophone communication
KR101080383B1 (ko) 브이오아이피 호설정 방법 및 이를 수행하는 브이오아이피 통신 시스템
CN111885223A (zh) 一种分布式云手机及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18931871

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018931871

Country of ref document: EP

Effective date: 20210325