CN107465723B - Multi-screen interactive connection method and system, mobile terminal and readable storage medium - Google Patents

Multi-screen interactive connection method and system, mobile terminal and readable storage medium Download PDF

Info

Publication number
CN107465723B
CN107465723B CN201710558894.XA CN201710558894A CN107465723B CN 107465723 B CN107465723 B CN 107465723B CN 201710558894 A CN201710558894 A CN 201710558894A CN 107465723 B CN107465723 B CN 107465723B
Authority
CN
China
Prior art keywords
mobile terminal
connection
television
terminal
network information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710558894.XA
Other languages
Chinese (zh)
Other versions
CN107465723A (en
Inventor
那强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to CN201710558894.XA priority Critical patent/CN107465723B/en
Publication of CN107465723A publication Critical patent/CN107465723A/en
Application granted granted Critical
Publication of CN107465723B publication Critical patent/CN107465723B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions

Abstract

The invention discloses a multi-screen interactive connection method, which comprises the following steps: the mobile terminal logs in a signaling server, so that the signaling server reads first network information of the mobile terminal; the method comprises the steps that after receiving login success information returned by a signaling server, a mobile terminal sends a multi-screen interaction request to an account server, so that the account server sends the multi-screen interaction request to a corresponding television end, when the television end receives the multi-screen interaction request, the mobile terminal logs in the signaling server, the signaling server reads second network information of the television end, and exchanges first network information and second network information; and when receiving second network information returned by the signaling server, the mobile terminal establishes point-to-point connection with the television terminal according to the received second network information. The invention also discloses a multi-screen interactive connection system, a mobile terminal and a readable storage medium. The invention realizes the beneficial effect of multi-screen interaction of the terminal in the wide area network by establishing the point-to-point connection channel of the terminal.

Description

Multi-screen interactive connection method and system, mobile terminal and readable storage medium
Technical Field
The invention relates to the field of terminal multi-screen interaction, in particular to a multi-screen interaction connection method, a multi-screen interaction connection system, a mobile terminal and a readable storage medium.
Background
With the increasing popularity of Internet Protocol Television (IPTV), a new portal is opened for the access of mobile devices, and users can enjoy IPTV services in three ways at home: the method includes the steps of; the network set top box and the common television set are arranged; and the mobile terminal (such as a mobile phone, a tablet computer and the like) is adopted. The method can well adapt to the rapid development trend of the current network and fully and effectively utilize network resources. The interaction between the mobile terminal and the TV is a technique known as "multi-screen interaction".
However, in terms of the implementation means of the multi-screen interaction technology, the mobile terminal and the TV are mostly connected through a certain public or private protocol in a Local Area Network (LAN) to achieve the purpose of controlling TV and resource sharing. If the connection mode of multi-screen interaction can be extended from a Local Area Network (LAN) to a Wide Area Network (WAN), the limitation of regions and environments on multi-screen interaction is greatly reduced under the current powerful Internet environment.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a multi-screen interactive connection method, and aims to solve the technical problem of multi-screen interaction of terminals in a non-local area network.
In order to achieve the above object, the present invention provides a multi-screen interactive connection method, including:
when a multi-screen interaction request is received, a mobile terminal logs in a signaling server so that the signaling server reads and stores first network information of the mobile terminal;
the mobile terminal sends a multi-screen interaction request to an account server after receiving login success information returned by the signaling server, so that the account server sends the multi-screen interaction request to a corresponding television terminal, wherein the television terminal logs in the signaling server when receiving the multi-screen interaction request, and the signaling server reads second network information of the television terminal and exchanges the first network information and the second network information;
and when second network information returned by the signaling server is received, the mobile terminal establishes point-to-point connection with the television according to the received second network information, wherein the television establishes connection with the television according to the received first network information.
Preferably, after the step of establishing, by the mobile terminal, a peer-to-peer connection with the television terminal according to the received second network information when the second network information returned by the signaling server is received, the method further includes:
the mobile terminal sends a communication command to the television terminal based on point-to-point connection established with the television terminal, wherein the communication command comprises setting parameters of multi-screen interaction, and the television terminal sets the multi-screen interaction according to the setting parameters.
Preferably, after the step of establishing the peer-to-peer connection with the television terminal according to the received second network information, the mobile terminal further includes:
when receiving an exit instruction, the mobile terminal sends a disconnection command to the television end, so that the television end exits the current multi-screen interaction operation according to the received disconnection command and returns an exit operation instruction to the mobile terminal;
and the mobile terminal disconnects the point-to-point connection after receiving the quitting operation instruction returned by the television terminal.
Preferably, before the step of establishing the peer-to-peer connection with the television terminal according to the received second network information, the mobile terminal further includes:
the mobile terminal receives a connection approval invitation returned by the account server; the connection invitation agreement is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal, and the connection invitation agreement is also sent to the television terminal.
Preferably, after the step of sending a multi-screen interaction request to an account server after the mobile terminal receives the login success information returned by the signaling server, the method further includes:
when the mobile terminal receives a connection rejection request returned by the account server, adjusting parameter setting corresponding to the rejection content according to the rejection content of the connection rejection request, and then retransmitting a multi-screen interactive connection request to the account server;
the connection rejection request is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is inconsistent with the user account applied by the television terminal.
In addition, to achieve the above object, the present invention also provides a mobile terminal, including: the multi-screen interactive connection method comprises a memory, a processor and a multi-screen interactive connection program which is stored on the memory and can run on the processor, wherein the multi-screen interactive connection program realizes the steps of the multi-screen interactive connection method when being executed by the processor.
In addition, to achieve the above object, the present invention further provides a computer-readable storage medium, wherein a multi-screen interactive connection program is stored on the computer-readable storage medium, and when executed by a processor, the multi-screen interactive connection establishment program implements the steps of the multi-screen interactive connection method as described above.
In addition, the embodiment of the present invention further provides a multi-screen interactive connection system, where the system includes a mobile terminal, a television terminal, a signaling server, and an account server, where:
the mobile terminal is used for logging in a signaling server when receiving a multi-screen interaction request, sending the multi-screen interaction request to an account server after receiving login success information returned by the signaling server, and establishing point-to-point connection with a television terminal according to received second network information when receiving information;
the signaling server is used for reading and storing first network information of the mobile terminal when the login of the mobile terminal is detected, reading second network information of the television terminal when the login of the television terminal is detected, and exchanging the first network information and the second network information;
the account server is used for forwarding the multi-screen interaction request to the corresponding television terminal when receiving the multi-screen interaction request sent by the mobile terminal;
the television end is used for logging in the signaling server when receiving a multi-screen interaction request, and establishing connection with the mobile terminal according to first network information fed back by the signaling server.
Preferably, the mobile terminal is further configured to receive an invitation for agreeing to connect returned by the account server;
and the account server is also used for returning an agreement connection invitation to the television terminal and the mobile terminal after confirming that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal.
Preferably, the mobile terminal is further configured to, when receiving a connection rejection request returned by the account server, adjust, according to the content of rejection of the connection rejection request, a parameter setting corresponding to the content of rejection and then resend the multi-screen interactive connection request to the account server;
and the account server is also used for returning a connection rejection request to the mobile terminal when the user account information extracted from the multi-screen interaction request is determined to be inconsistent with the user account applied by the television terminal.
When a multi-screen interaction request is received, a mobile terminal logs in a signaling server so that the signaling server reads and stores first network information of the mobile terminal; the mobile terminal sends a multi-screen interaction request to an account server after receiving login success information returned by the signaling server, so that the account server sends the multi-screen interaction request to a corresponding television terminal, wherein the television terminal logs in the signaling server when receiving the multi-screen interaction request, and the signaling server reads second network information of the television terminal and exchanges the first network information and the second network information; and when second network information returned by the signaling server is received, the mobile terminal establishes point-to-point connection with the television according to the received second network information, wherein the television establishes connection with the television according to the received first network information. After network information of the connection terminal provided by the signaling server is exchanged, point-to-point connection channel connection is carried out, so that the beneficial effect of multi-screen interaction operation of the terminal in the wide area network is realized.
Drawings
FIG. 1 is a schematic structural diagram of a terminal/device of a hardware operating environment according to an embodiment of a multi-screen interactive connection method of the present invention;
FIG. 2 is a flowchart illustrating a multi-screen interactive connection method according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a multi-screen interactive connection method according to a second embodiment of the present invention;
fig. 4 is a schematic terminal interaction diagram of the multi-screen interaction connection system of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: when a multi-screen interaction request is received, a mobile terminal logs in a signaling server so that the signaling server reads and stores first network information of the mobile terminal; the mobile terminal sends a multi-screen interaction request to an account server after receiving login success information returned by the signaling server, so that the account server sends the multi-screen interaction request to a corresponding television terminal, wherein the television terminal logs in the signaling server when receiving the multi-screen interaction request, and the signaling server reads second network information of the television terminal and exchanges the first network information and the second network information; and when second network information returned by the signaling server is received, the mobile terminal establishes point-to-point connection with the television according to the received second network information, wherein the television establishes connection with the television according to the received first network information.
Because the prior art can only realize multi-screen interaction operation of a terminal in a local area network, under the condition of no local area network and when the requirement of multi-screen interaction operation exists, the limitation of regions and environments on multi-screen interaction is higher.
The invention provides a solution, which enables terminals to establish multi-screen interaction connection channels between the terminals through an NAT holing function under an IEC framework, and realizes multi-screen interaction of the terminals in a wide area network.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of a multi-screen interactive connection method of the present invention.
The terminal of the embodiment of the invention can be a PC, and can also be a mobile terminal device with a display function, such as a smart phone, a tablet computer, an electronic book reader, a portable computer and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a multi-screen interactive connection program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call the multi-screen interactive connection program stored in the memory 1005, and perform the following operations:
when a multi-screen interaction request is received, a mobile terminal logs in a signaling server so that the signaling server reads and stores first network information of the mobile terminal;
the mobile terminal sends a multi-screen interaction request to an account server after receiving login success information returned by the signaling server, so that the account server sends the multi-screen interaction request to a corresponding television terminal, wherein the television terminal logs in the signaling server when receiving the multi-screen interaction request, and the signaling server reads second network information of the television terminal and exchanges the first network information and the second network information;
and when second network information returned by the signaling server is received, the mobile terminal establishes point-to-point connection with the television according to the received second network information, wherein the television establishes connection with the television according to the received first network information.
Further, the processor 1001 may call the multi-screen interactive connection program stored in the memory 1005, and further perform the following operations:
the mobile terminal sends a communication command to the television terminal based on point-to-point connection established with the television terminal, wherein the communication command comprises setting parameters of multi-screen interaction, and the television terminal sets the multi-screen interaction according to the setting parameters.
Further, the processor 1001 may call the multi-screen interactive connection program stored in the memory 1005, and further perform the following operations:
when receiving an exit instruction, the mobile terminal sends a disconnection command to the television end, so that the television end exits the current multi-screen interaction operation according to the received disconnection command and returns an exit operation instruction to the mobile terminal;
and the mobile terminal disconnects the point-to-point connection after receiving the quitting operation instruction returned by the television terminal.
Further, the processor 1001 may call the multi-screen interactive connection program stored in the memory 1005, and further perform the following operations:
the mobile terminal receives a connection approval invitation returned by the account server; the connection invitation agreement is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal, and the connection invitation agreement is also sent to the television terminal.
Further, the processor 1001 may call the multi-screen interactive connection program stored in the memory 1005, and further perform the following operations:
when the mobile terminal receives a connection rejection request returned by the account server, adjusting parameter setting corresponding to the rejection content according to the rejection content of the connection rejection request, and then retransmitting a multi-screen interactive connection request to the account server;
the connection rejection request is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is inconsistent with the user account applied by the television terminal.
Referring to fig. 2, fig. 2 is a schematic flowchart of a multi-screen interactive connection method according to a first embodiment of the present invention, including the following steps:
step S10, when receiving a multi-screen interaction request, the mobile terminal logs in a signaling server so that the signaling server reads and stores first network information of the mobile terminal;
and sending a multi-screen interaction request to the current mobile terminal based on the multi-screen interaction requirement of the current terminal. And when the mobile terminal receives the multi-screen interaction request, sending a login protocol to a corresponding signaling server to log in the signaling server. After the mobile terminal logs in the signaling server, the signaling server reads the network information of the mobile terminal, defines the network information as first network information, and stores the first network information based on the identifier of the mobile terminal. And returning a successful login instruction to the mobile terminal. And the signaling server is defined as a server for identifying the hidden IP address of the terminal. The specific implementation manner is a signaling server implementation step in the prior art, and is not described herein again.
Step S20, after receiving login success information returned by the signaling server, the mobile terminal sends a multi-screen interaction request to an account server, so that the account server sends the multi-screen interaction request to a corresponding television terminal, wherein when receiving the multi-screen interaction request, the television terminal logs in the signaling server, and the signaling server reads second network information of the television terminal and exchanges the first network information and the second network information;
and after the mobile terminal receives a login success instruction returned by the signaling server, sending a multi-screen interaction request to a corresponding account server. And the account server is defined as a user account application terminal list. And after receiving the multi-screen interaction request, the account server sends the multi-screen interaction request to a corresponding television terminal based on an analysis result of the multi-screen interaction request. The account server analyzes the content of the multi-screen interaction request, extracts corresponding television terminal information, and sends the multi-screen interaction request to the television terminal based on the television terminal information. And after receiving the multi-screen interaction request at the television end, sending a login protocol to the signaling server so that the signaling server reads the network information of the television end. And the signaling server reads the network information of the television terminal based on the television terminal sending the login protocol and defines the network information as second network information. And sending the second network information to a mobile terminal corresponding to the stored first network information, and sending the stored first network information to the television terminal, so as to realize network information exchange between the mobile terminal and the television terminal.
In addition, after the step of sending a multi-screen interaction request to an account server after the mobile terminal receives the login success information returned by the signaling server, the method further includes:
when the mobile terminal receives a connection rejection request returned by the account server, adjusting parameter setting corresponding to the rejection content according to the rejection content of the connection rejection request, and then retransmitting a multi-screen interactive connection request to the account server; the connection rejection request is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is inconsistent with the user account applied by the television terminal.
When the mobile terminal receives a connection rejection request returned by the account server, the source of the request is the account server, the account server searches television terminal information applying the user account in a corresponding stored user account application terminal list by taking the user account information as a screening condition, and if the stored user account application terminal list does not have a television terminal applying the user account except the mobile terminal. And returning a prompt of refusing the multi-screen interactive connection invitation to the mobile terminal. And the mobile terminal correspondingly adjusts the parameter setting corresponding to the mobile terminal according to the prompt content of the multi-screen interactive connection invitation so that the setting content of the mobile terminal meets the condition of the multi-screen interactive connection invitation. For example, the prompt content for rejecting the multi-screen interactive connection invitation is that the mobile terminal has started the connection of the firewall shielding terminal, and the mobile terminal closes the firewall shielding function in the firewall setting.
Further, it is further required to determine whether the television terminal allows multi-screen interaction connection, that is, after receiving a login success instruction returned by the signaling server, the mobile terminal sends a multi-screen interaction request to an account server, so that before the step of sending the multi-screen interaction request to the corresponding television terminal by the account server, the method further includes:
confirming whether the television end agrees with multi-screen interactive connection or not;
if the television end agrees with multi-screen interaction connection, executing the step of sending the multi-screen interaction request to the corresponding television end;
and if the television end does not agree with the multi-screen interaction connection, sending a connection request for starting the multi-screen interaction to the television end.
Step S30, when receiving the second network information returned by the signaling server, the mobile terminal establishes a multi-screen interactive connection with the television according to the received second network information, where the television establishes a connection with the television according to the received first network information.
After the mobile terminal and the television end exchange terminal exchange network information mutually, namely on the premise that the mobile terminal and the television end have multi-screen interactive connection, an ICE (Internet communications interface) frame is integrated through a corresponding WebRTC (Web real-time communication) object, NAT (network address translation) punching operation is carried out, and a point-to-point connection channel is established between the mobile terminal and the television end. And after the connection channel is established, the target terminal and the target connection terminal realize multi-screen interaction operation. The WebRTC object integrates an ICE frame to perform NAT holing operation, and is a function related to the ICE frame of the WebRTC object in the prior art, which is not described herein again.
Before the step of establishing the point-to-point connection with the television terminal according to the received second network information, the mobile terminal further includes:
the mobile terminal receives a connection approval invitation returned by the account server; the connection invitation agreement is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal, and the connection invitation agreement is also sent to the television terminal.
The mobile terminal receives a multi-screen interaction connection agreement invitation returned by the account server, and the origin of the multi-screen interaction agreement invitation is that when the account server receives the multi-screen interaction request, the multi-screen interaction request is based on and used for extracting user account information of the mobile terminal, and the user account information is used as a screening condition to search television terminal information applying the user account in a corresponding stored user account application terminal list. Searching whether a user account number of which the television application is the same as that of the mobile terminal exists; the user account is account information of the APK application corresponding to the mobile terminal. The multi-screen interaction operation between the mobile terminal and the television is realized on the premise that the mobile terminal and the television use the same user account. And searching for television terminal information applying the user account in a corresponding stored user account application terminal list by taking the user account information as a screening condition, and if the television terminal applying the user account is also available in the stored user account application terminal list except the mobile terminal, confirming that the television terminal is a corresponding multi-screen interaction terminal of the mobile terminal, namely, the account server sends the multi-screen interaction request to the searched television terminal applying the user account, so that the television terminal logs in a signaling server after receiving the prompt of agreeing to connect the invitation. And after receiving the connection approval invitation, the mobile terminal waits for the second network information of the television terminal read by the signaling server based on the login of the television terminal and returns the second network information to the mobile terminal. And after the mobile terminal receives the second network information, calling an ICE (Internet communications and Internet communications) frame integrated by a preset WebRTC object, performing NAT (network Address translation) punching, and establishing a multi-screen interactive connection channel with the television terminal.
After the mobile terminal enters the multi-screen interaction operation step, that is, after the step of establishing the point-to-point connection with the television terminal according to the received second network information is performed when the second network information returned by the signaling server is received, the method further includes:
the mobile terminal sends a communication command to the television terminal based on point-to-point connection established with the television terminal, wherein the communication command comprises setting parameters of multi-screen interaction, and the television terminal sets the multi-screen interaction according to the setting parameters.
After the mobile terminal and the television end establish a point-to-point connection channel, the mobile terminal sends a communication command to the television end based on the connection channel, so that the mobile terminal executes the communication command based on an implementation mode of the multi-screen interaction connection channel, and because the communication command comprises parameter setting of multi-screen interaction operation, the television end analyzes the content of the multi-screen interaction setting parameter of the communication command after receiving the communication command, and is used for confirming that the content is set based on the interaction terminal in the current multi-screen interaction operation mode. And after the television terminal completes the analysis of the communication command, returning execution success information to the mobile terminal, so that the mobile terminal enters a multi-screen interaction operation mode after receiving the execution success information.
In this embodiment, when a multi-screen interaction request is received, a mobile terminal logs in a signaling server, so that the signaling server reads network information of the mobile terminal, and after login success information returned by the signaling server is received, sends the multi-screen interaction request to an account server, so that the account server forwards the multi-screen interaction request to a corresponding television, and the television logs in the signaling server and exchanges network information with the mobile terminal, and after network information exchange is successful, a point-to-point connection channel between the mobile terminal and the television is established, so as to implement a multi-screen interaction connection channel in a wide area network. According to the method, the multi-screen interaction of the terminal is realized, because the multi-screen interaction operation is a connection channel realized based on NAT holing, the connection mode of the multi-screen interaction is expanded from a local area network to a wide area network, and the multi-screen interaction operation of the terminal is realized under the condition that the local area network cannot be connected.
Further, referring to fig. 3, fig. 3 is a flowchart illustrating a multi-screen interactive connection method according to a second embodiment of the present invention, and based on the second embodiment of the multi-screen interactive connection method illustrated in fig. 2, after the step of the mobile terminal establishing a point-to-point connection with the television according to the received network information, the method further includes:
step S40, when receiving an exit instruction, the mobile terminal sends a disconnection command to the television end, so that the television end exits the current multi-screen interaction operation according to the received disconnection command, and returns an exit operation instruction to the mobile terminal;
and step S50, the mobile terminal disconnects the point-to-point connection after receiving the quit operation instruction returned by the television terminal.
And after receiving and exiting the current multi-screen interaction operation mode, the mobile terminal sends a disconnection instruction to the television terminal based on the currently connected television terminal. Because the multi-screen interaction instruction is established by the mobile terminal based on the agreement of the connection invitation of the television terminal, when exiting the multi-screen interaction mode, a disconnection instruction needs to be sent to the television terminal. And when the television end in the multi-screen interactive connection state receives the disconnection command, the multi-screen interactive operation mode is controlled to exit, namely a point-to-point connection channel with the mobile terminal is disconnected. And after the point-to-point connection channel is disconnected, returning information that the current multi-screen interaction operation is quitted to the mobile terminal. And after the mobile terminal receives the quitted information, the point-to-point connection is disconnected at the relevant setting position of the mobile terminal. And returning to the terminal state before connection to wait for the next connection.
In this embodiment, the mobile terminal sends the disconnection request, and disconnects the current point-to-point connection channel after the corresponding television terminal disconnects the point-to-point connection channel, so that good user experience is provided for the current multi-screen interaction operation.
In addition, an embodiment of the present invention further provides a multi-screen interactive connection system, and referring to fig. 4, fig. 4 is a schematic terminal interaction diagram of the multi-screen interactive connection system of the present invention, where the system includes: mobile terminal, TV end, signaling server and account server, wherein:
the mobile terminal is used for logging in a signaling server when receiving a multi-screen interaction request, sending the multi-screen interaction request to an account server after receiving login success information returned by the signaling server, and establishing point-to-point connection with a television terminal according to received second network information when receiving the second network information returned by the signaling server;
the signaling server is used for reading and storing first network information of the mobile terminal when the login of the mobile terminal is detected, reading second network information of the television terminal when the login of the television terminal is detected, and exchanging the first network information and the second network information;
the account server is used for forwarding the multi-screen interaction request to the corresponding television terminal when receiving the multi-screen interaction request sent by the mobile terminal;
the television end is used for logging in the signaling server when receiving a multi-screen interaction request, and establishing connection with the mobile terminal according to first network information fed back by the signaling server. In this embodiment, in a system interaction manner of the multi-screen interaction connection system of the present invention, the mobile terminal sends a multi-screen interaction operation request to the account server to enable the account server to search for a television connection terminal corresponding to the mobile terminal, and reads network information of the mobile terminal and the television terminal through the login signaling server, and establishes a point-to-point connection relationship between the mobile terminal and the television terminal after exchanging the network information of the mobile terminal and the television terminal. By the method, the terminal establishes the point-to-point connection channel, and the beneficial effect of multi-screen interaction operation of the terminal in the wide area network is further realized.
Further, the mobile terminal is further configured to receive a connection approval invitation returned by the account server; and the account server is also used for returning an agreement connection invitation to the television terminal and the mobile terminal after confirming that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal.
Further, the mobile terminal is further configured to, when receiving a connection rejection request returned by the account server, adjust parameter settings corresponding to the connection rejection content according to the connection rejection request, and then resend the multi-screen interactive connection request to the account server; and the account server is also used for returning a connection rejection request to the mobile terminal when the user account information extracted from the multi-screen interaction request is determined to be inconsistent with the user account applied by the television terminal.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a multi-screen interactive connection program is stored on the computer-readable storage medium, and when executed by a processor, the multi-screen interactive connection program implements the following operations:
when a multi-screen interaction request is received, a mobile terminal logs in a signaling server so that the signaling server reads and stores first network information of the mobile terminal;
the mobile terminal sends a multi-screen interaction request to an account server after receiving login success information returned by the signaling server, so that the account server sends the multi-screen interaction request to a corresponding television terminal, wherein the television terminal logs in the signaling server when receiving the multi-screen interaction request, and the signaling server reads second network information of the television terminal and exchanges the first network information and the second network information;
and when second network information returned by the signaling server is received, the mobile terminal establishes point-to-point connection with the television according to the received second network information, wherein the television establishes connection with the television according to the received first network information.
Further, when executed by the processor, the multi-screen interactive connection program further implements the following operations:
the mobile terminal sends a communication command to the television terminal based on point-to-point connection established with the television terminal, wherein the communication command comprises setting parameters of multi-screen interaction, and the television terminal sets the multi-screen interaction according to the setting parameters.
Further, when executed by the processor, the multi-screen interactive connection program further implements the following operations:
when receiving an exit instruction, the mobile terminal sends a disconnection command to the television end, so that the television end exits the current multi-screen interaction operation according to the received disconnection command and returns an exit operation instruction to the mobile terminal;
and the mobile terminal disconnects the point-to-point connection after receiving the quitting operation instruction returned by the television terminal.
Further, when executed by the processor, the multi-screen interactive connection program further implements the following operations:
the mobile terminal receives a connection approval invitation returned by the account server; the connection invitation agreement is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal, and the connection invitation agreement is also sent to the television terminal.
Further, when executed by the processor, the multi-screen interactive connection program further implements the following operations:
when the mobile terminal receives a connection rejection request returned by the account server, adjusting parameter setting corresponding to the rejection content according to the rejection content of the connection rejection request, and then retransmitting a multi-screen interactive connection request to the account server;
the connection rejection request is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is inconsistent with the user account applied by the television terminal.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (8)

1. A multi-screen interactive connection method is characterized by comprising the following steps:
when a multi-screen interaction request is received, a mobile terminal logs in a signaling server so that the signaling server reads and stores first network information of the mobile terminal;
the mobile terminal sends a multi-screen interaction request to an account server after receiving login success information returned by the signaling server;
searching for television terminal information applying the user account in an application terminal list corresponding to a stored user account, and if the television terminal applying the user account does not exist in the application terminal list of the stored user account except the mobile terminal, returning a prompt of rejecting a multi-screen interactive connection invitation to the mobile terminal; when the mobile terminal receives a connection rejection request returned by the account server, adjusting parameter setting corresponding to the rejection content according to the rejection content of the connection rejection request, and then retransmitting a multi-screen interactive connection request to the account server; the connection rejection request is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is inconsistent with the user account applied by the television terminal; enabling the account server to send the multi-screen interaction request to a corresponding television end, wherein the television end logs in the signaling server when receiving the multi-screen interaction request, and the signaling server reads second network information of the television end and exchanges the first network information and the second network information;
and when receiving second network information returned by the signaling server, the mobile terminal establishes point-to-point connection with the television terminal according to the received second network information, wherein the television terminal establishes connection with the mobile terminal according to the received first network information.
2. A multi-screen interactive connection method as claimed in claim 1, wherein after the step of the mobile terminal establishing a point-to-point connection with the television terminal according to the received second network information when receiving the second network information returned by the signaling server, the method further comprises:
the mobile terminal sends a communication command to the television terminal based on point-to-point connection established with the television terminal, wherein the communication command comprises setting parameters of multi-screen interaction, and the television terminal sets the multi-screen interaction according to the setting parameters.
3. A multi-screen interactive connection method as claimed in any one of claims 1 to 2, wherein after the step of the mobile terminal establishing a point-to-point connection with the television terminal according to the received second network information, the method further comprises:
when receiving an exit instruction, the mobile terminal sends a disconnection command to the television end, so that the television end exits the current multi-screen interaction operation according to the received disconnection command and returns an exit operation instruction to the mobile terminal;
and the mobile terminal disconnects the point-to-point connection after receiving the quitting operation instruction returned by the television terminal.
4. A multi-screen interactive connection method as claimed in claim 1, wherein before the step of the mobile terminal establishing a point-to-point connection with the tv according to the received second network information, the method further comprises:
the mobile terminal receives a connection approval invitation returned by the account server; the connection invitation agreement is prompt information returned after the account server confirms that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal, and the connection invitation agreement is also sent to the television terminal.
5. A mobile terminal, characterized in that the mobile terminal comprises: the multi-screen interactive connection method comprises a memory, a processor and a multi-screen interactive connection program stored on the memory and capable of running on the processor, wherein the steps of the multi-screen interactive connection method according to any one of claims 1 to 4 are realized when the multi-screen interactive connection program is executed by the processor.
6. A computer-readable storage medium, wherein a multi-screen interactive connection program is stored on the computer-readable storage medium, and when executed by a processor, the multi-screen interactive connection establishment program implements the steps of the multi-screen interactive connection method according to any one of claims 1 to 4.
7. The utility model provides a many screen interaction connected system, its characterized in that, the system includes mobile terminal, TV end, signaling server and account number server, wherein:
the mobile terminal is used for logging in a signaling server when receiving a multi-screen interaction request, sending the multi-screen interaction request to an account server after receiving login success information returned by the signaling server, and establishing point-to-point connection with a television terminal according to received second network information when receiving the second network information returned by the signaling server; the multi-screen interaction connection request processing module is further used for adjusting parameter setting corresponding to rejection content according to the rejection content of the connection rejection request and then retransmitting the multi-screen interaction connection request to the account server when receiving the connection rejection request returned by the account server;
the signaling server is used for reading and storing first network information of the mobile terminal when the login of the mobile terminal is detected, reading second network information of the television terminal when the login of the television terminal is detected, and exchanging the first network information and the second network information;
the account server is used for forwarding the multi-screen interaction request to the corresponding television terminal when receiving the multi-screen interaction request sent by the mobile terminal; the multi-screen interaction connection invitation processing method comprises the steps that television terminal information applying a user account is searched in an application terminal list corresponding to the stored user account, and if the television terminal applying the user account does not exist in the application terminal list of the stored user account except the mobile terminal, a prompt of rejecting multi-screen interaction connection invitation is returned to the mobile terminal; the multi-screen interaction request processing module is also used for returning a connection rejection request to the mobile terminal when confirming that the user account information extracted from the multi-screen interaction request is inconsistent with the user account applied by the television terminal;
the television end is used for logging in the signaling server when receiving a multi-screen interaction request, and establishing connection with the mobile terminal according to first network information fed back by the signaling server.
8. A multi-screen interactive interface system as recited in claim 7,
the mobile terminal is also used for receiving a connection approval invitation returned by the account server;
and the account server is also used for returning an agreement connection invitation to the television terminal and the mobile terminal after confirming that the user account information extracted from the multi-screen interaction request is consistent with the user account applied by the television terminal.
CN201710558894.XA 2017-07-10 2017-07-10 Multi-screen interactive connection method and system, mobile terminal and readable storage medium Active CN107465723B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710558894.XA CN107465723B (en) 2017-07-10 2017-07-10 Multi-screen interactive connection method and system, mobile terminal and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710558894.XA CN107465723B (en) 2017-07-10 2017-07-10 Multi-screen interactive connection method and system, mobile terminal and readable storage medium

Publications (2)

Publication Number Publication Date
CN107465723A CN107465723A (en) 2017-12-12
CN107465723B true CN107465723B (en) 2021-06-15

Family

ID=60543906

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710558894.XA Active CN107465723B (en) 2017-07-10 2017-07-10 Multi-screen interactive connection method and system, mobile terminal and readable storage medium

Country Status (1)

Country Link
CN (1) CN107465723B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109167827A (en) * 2018-08-21 2019-01-08 奇酷互联网络科技(深圳)有限公司 Method, computer equipment and the storage medium of mobile terminal synchronization application
CN111586042A (en) * 2020-05-07 2020-08-25 深圳康佳电子科技有限公司 Multi-screen interaction method, terminal and storage medium
CN111787078B (en) * 2020-06-19 2023-05-05 揭阳市聆讯软件有限公司 Signaling control system and communication method based on elevator Internet of things

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103581740A (en) * 2013-10-25 2014-02-12 中兴通讯股份有限公司 Distributed IPTV multi-screen gateway and IPTV multi-screen interaction method
CN105187387A (en) * 2015-08-07 2015-12-23 海信集团有限公司 Service discovery method and terminal

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106454472B (en) * 2012-05-17 2021-06-04 华为技术有限公司 Multi-screen interaction method and system
CN102802048B (en) * 2012-08-24 2015-08-05 乐视致新电子科技(天津)有限公司 A kind of Multi-screen interaction system and method
CN102833632B (en) * 2012-08-24 2016-12-21 Tcl集团股份有限公司 Multi-screen interactive master & slave control device management method, intelligent television and control equipment
CN102891886B (en) * 2012-09-14 2015-05-20 吉视传媒股份有限公司 Multi-screen interacting method and system based on cloud computing
CN103491179B (en) * 2013-09-27 2017-01-18 百视通网络电视技术发展有限责任公司 Multi-screen interaction method and system based on Web
CN103702175B (en) * 2013-12-28 2017-02-01 珠海全志科技股份有限公司 Multi-screen interactive method and multi-screen interactive device
CN106412680B (en) * 2015-07-31 2021-01-22 中兴通讯股份有限公司 Multi-screen control method and device
CN106572382A (en) * 2015-10-12 2017-04-19 中兴通讯股份有限公司 Multi-screen interaction method and system and extensible messaging and presence protocol (XMPP) system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103581740A (en) * 2013-10-25 2014-02-12 中兴通讯股份有限公司 Distributed IPTV multi-screen gateway and IPTV multi-screen interaction method
CN105187387A (en) * 2015-08-07 2015-12-23 海信集团有限公司 Service discovery method and terminal

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
《《多屏互动》常见问题及解决办法!》;微笑 一路向前;《https://www.znds.com/forum.php?mod=viewthread&ordertype=1&tid=413306》;20160507;全文 *
《投屏神器连接不上电视?投屏神器连接失败原因[图]》;xl;《https://www.yqdown.com/shoujisoft/shoujizixun/131577.htm》;20170512;全文 *

Also Published As

Publication number Publication date
CN107465723A (en) 2017-12-12

Similar Documents

Publication Publication Date Title
US10805380B2 (en) Data transmission method and device
US10841636B2 (en) Information processing apparatus, mobile terminal, information processing method, program, and information processing system
US20190166206A1 (en) System capable of interacting with devices on a network
US9467650B2 (en) Method and apparatus for transmitting media stream in video conference
CN106161571B (en) WebRTC-based remote operation method and system
JP6072132B2 (en) Method of establishing a communication path using active connection of relay server of mobile terminal
US10034057B2 (en) Message processing method, device, gateway, STB and IPTV
US20150289301A1 (en) Terminal matching method, terminal and system
CN107465723B (en) Multi-screen interactive connection method and system, mobile terminal and readable storage medium
EP3996355B1 (en) Method for transferring media stream and user equipment
CN104270662A (en) System of terminal equipment for controlling intelligent television through browser
CN105975225B (en) Multi-screen interactive connection method, device and system
CN110932953A (en) Intelligent household control method and device, computer equipment and storage medium
CN106572382A (en) Multi-screen interaction method and system and extensible messaging and presence protocol (XMPP) system
CN103812900A (en) Data synchronization method, device and system
CN109474646B (en) Communication connection method, device, system and storage medium
CN111901151A (en) Method, device, equipment and medium for gateway equipment to manage IOT equipment
CN104202432B (en) Remote web management system and management method
CN104301400A (en) Multi-screen cooperation and resource sharing method on basis of Samba protocol
CN113132997A (en) Communication method, device and system of intelligent household equipment
CN103795748A (en) Method for downloading mobile internet website content information
CN211378259U (en) Intelligent household equipment and communication system thereof
CN114064165A (en) Application page processing method and device
CN109561331A (en) A kind of exchange method and system of set-top box and intelligent terminal
CN111818170B (en) Network communication method and system and intelligent sound box

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant