CN107040498B - Same-screen method and terminal - Google Patents
Same-screen method and terminal Download PDFInfo
- Publication number
- CN107040498B CN107040498B CN201610077632.7A CN201610077632A CN107040498B CN 107040498 B CN107040498 B CN 107040498B CN 201610077632 A CN201610077632 A CN 201610077632A CN 107040498 B CN107040498 B CN 107040498B
- Authority
- CN
- China
- Prior art keywords
- terminal
- video data
- data stream
- transmission
- feedback information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 73
- 230000005540 biological transmission Effects 0.000 claims description 93
- 230000008569 process Effects 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 9
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/14—Direct-mode setup
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The embodiment of the invention discloses a same-screen method and a terminal. The on-screen method comprises the following steps: the method comprises the steps that a first terminal and a second terminal establish same-screen connection; selecting at least one path of original data flow, and sending the original data flow to a second terminal by using the same-screen connection; and the original data stream is used for being output by the second terminal, so that the same screen with the first terminal is realized.
Description
Technical Field
The invention relates to a same-screen technology in the field of wireless communication, in particular to a same-screen method and a terminal.
Background
The wireless co-screen between terminals is an emerging application on mobile terminals at present, and multimedia contents on the mobile terminals are pushed to remote equipment for displaying by means of a wireless network. The method comprises the following three steps that in the process of realizing the video call of the intelligent terminal in the local area network on the same screen:
1) the terminal periodically intercepts the content of the current screen;
2) the terminal encodes the intercepted screen content;
3) and transmitting the encoded content to receiving end equipment in the local area network through a wireless on-screen protocol.
Although the method realizes wireless co-screen between terminals, the following problems exist:
firstly, the screen of the sending end is intercepted, and there may exist some information users who do not want to intercept and send the information to the receiving end.
Secondly, the resolution of the screen content transmitted to the sending end depends on the resolution of the screen of the sending end, which obviously may cause the phenomenon of poor playing effect of the receiving end;
thirdly, the sending end needs to perform screen capture coding on the screen content, resources of the sending end can be consumed, and phenomena such as unsmooth screen display and the like can be caused due to the fact that resources of the sending end are in shortage and the system runs slowly.
Disclosure of Invention
In view of the above, embodiments of the present invention are directed to a method and a terminal for same screen, which at least partially solve one of the above problems.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
the first aspect of the embodiments of the present invention provides a method for sharing a screen, where the method includes:
the method comprises the steps that a first terminal and a second terminal establish same-screen connection;
selecting at least one path of original data flow, and sending the original data flow to a second terminal by using the same-screen connection;
and the original data stream is used for being output by the second terminal, so that the same screen with the first terminal is realized.
Based on the above scheme, the selecting at least one path of original data stream, and sending to the second terminal by using the same-screen connection, includes:
and selecting the local data stream of the first terminal and/or receiving a remote data stream sent by remote equipment and sending the remote data stream to the second terminal.
Based on the above scheme, the method further comprises:
the first terminal sends an inquiry for determining whether the second terminal supports N paths of data stream transmission; wherein N is an integer not less than 2;
receiving feedback information sent by the second terminal based on the inquiry;
the selecting at least one path of original data flow, and sending to the second terminal by using the same-screen connection, includes:
when the feedback information indicates that the second terminal supports N paths of data stream transmission, M paths of original data streams are selected to be sent to the second terminal; wherein M is a positive integer not greater than N.
Based on the above scheme, the feedback information includes port parameters for the second terminal to receive N-channel data stream transmission;
when the feedback information indicates that the second terminal supports N-channel data stream transmission, selecting M channels of original data streams to send to the second terminal, including:
and sending the M paths of original data streams to the second terminal according to the port parameters.
Based on the above scheme, the method further comprises:
based on the port parameters, carrying out session negotiation and establishing a transmission session for carrying out M-path original data stream transmission;
when the feedback information indicates that the second terminal supports N-channel data stream transmission, selecting M channels of original data streams to send to the second terminal, including:
and sending the M paths of original data streams to a second terminal based on the transmission session.
A second aspect of the embodiments of the present invention provides a method for displaying a same screen, where the method includes:
the second terminal and the first terminal establish same-screen connection;
receiving at least one path of original data stream sent by the first terminal through the same-screen connection;
and displaying the original data stream.
Based on the above scheme, the method further comprises:
receiving a query that the first terminal determines whether the second terminal supports N-path data stream transmission; n is an integer not less than 2;
based on the query, forming feedback information according to the capability parameters of the second terminal;
and sending the feedback information to the first terminal.
Based on the above scheme, when the second terminal supports N-way data stream transmission, the feedback information includes a port parameter supporting N-way data stream transmission.
Based on the above scheme, the method further comprises:
carrying out session negotiation with the first terminal and establishing a transmission session for carrying out M-path original data stream transmission; wherein M is a positive integer not greater than N;
the receiving, through the on-screen connection, at least one path of original data stream sent by the first terminal includes:
and receiving the original data stream sent by the first terminal based on the transmission session.
A third aspect of the embodiments of the present invention provides a terminal, where the terminal is a first terminal; the first terminal includes:
the first connection unit is used for establishing same-screen connection with the second terminal;
the first sending unit is used for selecting at least one path of original data flow and sending the original data flow to the second terminal by using the same-screen connection;
and the original data stream is used for being output by the second terminal, so that the same screen with the first terminal is realized.
Based on the above scheme, the first sending unit is configured to select a local data stream of the first terminal and/or receive a remote data stream sent by a remote device and send the remote data stream to the second terminal.
Based on the above scheme, the first sending unit is configured to send an inquiry for determining whether the second terminal supports N-way data stream transmission; wherein N is an integer not less than 2;
the terminal further comprises:
a first receiving unit, configured to receive feedback information sent by the second terminal based on the query;
the first sending unit is further configured to select M original data streams to send to the second terminal when the feedback information indicates that the second terminal supports N data stream transmission; wherein M is a positive integer not greater than N.
Based on the above scheme, the feedback information includes port parameters for the second terminal to receive N-channel data stream transmission;
and the first sending unit is configured to send the M original data streams to the second terminal according to the port parameter.
Based on the above scheme, the terminal further includes:
a negotiation unit, configured to perform session negotiation based on the port parameter and establish a transmission session for transmitting M paths of original data streams;
and the first sending unit is used for sending the M paths of original data streams to a second terminal based on the transmission session.
A fourth aspect of the embodiments of the present invention provides a terminal, where the terminal is a second terminal; the second terminal includes:
the second connection unit is used for establishing same-screen connection with the first terminal;
a second receiving unit, configured to receive, through the on-screen connection, at least one original data stream sent by the first terminal;
and the display unit is used for displaying the original data stream.
Based on the above scheme, the second receiving unit is configured to receive an inquiry that the first terminal determines whether the second terminal supports N-way data stream transmission; n is an integer not less than 2;
the second terminal further includes:
a forming unit, configured to form feedback information according to the capability parameter of the second terminal based on the query;
a second sending unit, configured to send the feedback information to the first terminal.
Based on the above scheme, when the second terminal supports N-way data stream transmission, the feedback information includes a port parameter supporting N-way data stream transmission.
Based on the above scheme, the second terminal further includes:
a session unit, configured to perform session negotiation with the first terminal and establish a transmission session for transmitting M paths of original data streams; wherein M is a positive integer not greater than N;
the second receiving unit is specifically configured to receive, based on the transmission session, an original data stream sent by the first terminal.
According to the same-screen method and the terminal provided by the embodiment of the invention, the video sent by the first terminal to the second terminal is an original data stream, and is not a data stream formed by screen capture coding of the first terminal; firstly, the system resources consumed by the first terminal due to screen capture and coding and the busy caused by the system resources are reduced, so that the bad phenomena of same-screen blockage and the like caused by the shortage of the system resources of the first terminal are avoided; secondly, as the original data stream is transmitted, the video resolution of the data stream is not limited to the display resolution of the first terminal, so that the second terminal can obtain better display effect; and then, the first terminal is allowed to transmit the displayed partial data stream to the second terminal, and partial same screen between the first terminal and the second terminal is realized, so that the user requirement that the user only uses the same screen on the second terminal is met, and the intelligence of the terminal and the use satisfaction of the user are improved.
Drawings
Fig. 1 is a schematic flow chart of a first on-screen method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a second on-screen method according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of a third on-screen method according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating a capability negotiation flow between a first terminal and a second terminal according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a first terminal according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a second terminal according to an embodiment of the present invention.
Detailed Description
The technical solution of the present invention is further described in detail with reference to the drawings and the specific embodiments of the specification.
The first embodiment is as follows:
as shown in fig. 1, the present embodiment provides a method for the same screen, where the method includes:
step S110: the method comprises the steps that a first terminal and a second terminal establish same-screen connection;
step S120: selecting at least one path of original data flow, and sending the original data flow to a second terminal by using the same-screen connection;
and the original data stream is used for being output by the second terminal, so that the same screen with the first terminal is realized.
In this embodiment, both the first terminal and the second terminal may be wired terminals or mobile terminals; the first terminal and the second terminal can be mobile phones, tablet computers or wearable devices and the like. In this embodiment, the same-screen method may be a wireless same-screen method, that is, the first terminal and the second terminal are both wireless devices, and the transmitted data stream is transmitted by using wireless transmission.
The on-screen connection established between the first terminal and the second terminal may comprise an on-screen connection established based on a wireless network development WFD protocol. The first terminal can be a terminal supporting WiFi direct connection; the second terminal may be a terminal supporting WiFi display. In this embodiment, the first terminal may be a sending terminal performing the same screen; the second terminal may be a receiving terminal performing the same screen.
The original data stream may include information such as the original video stream. The original data stream comprises a part of display data stream currently displayed by the first terminal. In step S120, the original data stream transmitted by the first terminal to the second terminal is not the data stream formed by performing screen capture coding on the first terminal. Therefore, the first terminal does not need to capture the screen of the display screen of the first terminal and encode the captured screen, so that system resources consumed by the first terminal due to screen capture and encoding are reduced, resource consumption of the first terminal is reduced, and the phenomena of same-screen blockage and other faults caused by resource consumption of the first terminal are reduced.
Meanwhile, the second terminal receives the original data stream instead of the screen capture coded data, so that the display resolution of the first terminal is not limited, and the second terminal can provide a better video output effect.
In addition, in this embodiment, the first terminal sends the original data stream to the second terminal, so that the information displayed on the first terminal and originally not intended to be sent to the second terminal is not sent to the second terminal, thereby reducing interference of other information and avoiding the information displayed on the first terminal from being leaked. For example, when the first terminal and the third terminal are in a video call, the first terminal displays, in addition to the video displayed by the video call, each file on the desktop of the first terminal. If the data stream is formed in a screen capture coding mode and is sent to the second terminal, the second terminal can see not only the information of the video call, but also the file information on the desktop of the first terminal. In addition, if at this time, the user only wants to send the video sent by the third video to the second terminal, and if the western existing screen capture coding mode is adopted, it is obviously difficult to implement, and in this embodiment, only the original data stream sent by the third terminal to the first terminal needs to be forwarded to the first terminal, so that the user's requirements can be easily met, and the user satisfaction is improved.
The method further comprises the following steps:
receiving a user instruction:
the first terminal selects at least one path of original data stream to send to a second terminal, and the method comprises the following steps:
and selecting at least one path of the original data stream to be sent to the second terminal based on the user indication.
The user indication may comprise detecting which one or ones of the original data streams are selected by a user input. This facilitates user control of the video on the same screen. The step S120 may include: and selecting the local data stream of the first terminal and/or receiving a remote data stream sent by remote equipment and sending the remote data stream to the second terminal.
For example, when the first terminal performs a video call with the third terminal, the first terminal collects and forms a local video by itself, and simultaneously the first terminal receives a far-end video collected and sent by the third terminal. The original data stream transmitted to the first terminal in step S120 may be a local video collected by the first terminal itself, or a remote video received from a third terminal.
If the video on-screen method in the embodiment is applied to a video call process, a mobile phone can be used for carrying out video call to obtain video on-screen on large-screen equipment such as a tablet computer or a notebook computer with a larger screen, so that better experience of the video call can be obtained.
As shown in fig. 2, before step S120, the method further includes:
step S111: the first terminal sends an inquiry for determining whether the second terminal supports N paths of data stream transmission; wherein N is an integer not less than 2;
step S112: receiving feedback information sent by the second terminal based on the inquiry;
the step S120 may include:
when the feedback information indicates that the second terminal supports N paths of data stream transmission, M paths of original data streams are selected to be sent to the second terminal; wherein M is a positive integer not greater than N.
In this embodiment, the first terminal performs capability negotiation with the second terminal, and in the capability negotiation process, if the first terminal needs to send 2 or more than 2 data streams to the second terminal, it needs to determine whether the second terminal can receive two or more than two data streams simultaneously.
The feedback information comprises port parameters transmitted by the second terminal receiving N paths of data streams;
the step S120 may include: and sending the M paths of original data streams to the second terminal according to the port parameters.
The port parameter may include port information of the real-time transmission port. For example, where N is equal to 2, the port parameters may include port parameters of rtp-port0 and rtp-port 1. The rtp-port0 is real-time transport port0, and the rtp-port1 is real-time transport port 1.
In this real-time example, when N is an integer not less than 2, it indicates that the second terminal is capable of supporting real-time simultaneous transmission of multiple data streams. In this case, the second terminal may be capable of simultaneously receiving the multiple original data streams and outputting an output of the multiple original data streams.
The method further comprises the following steps:
based on the port parameters, carrying out session negotiation and establishing a transmission session for carrying out M-path original data stream transmission;
the step S120 specifically includes: and sending the M paths of original data streams to a second terminal based on the transmission session.
In this embodiment, in order to facilitate transmission of data streams, a transmission session needs to be established in this embodiment, and in this embodiment, transmission of multiple original data streams may be involved, so a transmission session needs to be established. Since multiple original data streams are involved, multiple transmission sessions will be established.
In short, the same-screen method in this embodiment changes the same-screen mode in which the display screen of the screenshot coding sending end is sent to the receiving end in the prior art, reduces the system consumption of the same-screen sending end, improves the same-screen effect, can realize partial same screen, and meets the user same-screen requirement in the same-screen process.
Example two:
as shown in fig. 3, the present embodiment provides a method for the same screen, where the method includes:
step S210: the second terminal and the first terminal establish same-screen connection;
step S220: receiving at least one path of original data stream sent by the first terminal through the same-screen connection;
step S230: and displaying the original data stream.
The method for the same screen in this embodiment may be the wireless same screen method, and in this embodiment, may be a method applied to a receiving end in the same screen method. The first terminal is a sending end of data stream in the process of the same screen, and the second terminal is a receiving end for receiving the data stream.
In this embodiment, the first terminal and the second terminal establish a co-screen connection, for example, a co-screen connection established based on a WFD protocol.
In step S220, the data stream received by the second terminal from the first terminal is the original data stream, but not the data stream after the screen capture coding of the first terminal, so that the second terminal displays the original data stream in step S230, and the video resolution of the data stream viewed by the second terminal is not limited to the screen resolution of the first terminal, which can improve the display effect of the second terminal; meanwhile, the original data stream is received by the second terminal, so that the bad phenomena of on-screen jamming and the like caused by the fact that the system of the first terminal is busy are avoided.
As shown in fig. 4, the method further comprises:
step S211: receiving a query that the first terminal determines whether the second terminal supports N-path data stream transmission; n is an integer not less than 2;
step S212: based on the query, forming feedback information according to the capability parameters of the second terminal;
step S213: and sending the feedback information to the first terminal.
In this embodiment, the first terminal and the second terminal perform capability negotiation, and at this time, the first terminal sends an inquiry to the second terminal to inquire whether the second terminal supports 2-way or more than 2-way data stream transmission. The second terminal will respond to the query in step S212, and form feedback information in response to the query according to the capability parameters of the second terminal itself, and the first terminal will send the feedback information in step S213.
Through inquiry, the first terminal is convenient to determine whether 2 or more than 2 original data streams can be simultaneously sent to the second terminal so as to carry out the same screen of the multiple data streams.
When the second terminal supports N-way data stream transmission, the feedback information includes a port parameter supporting N-way data stream transmission.
These port parameters may be the destination address of the port that is used to transmit the original data stream, which facilitates the transmission of the original data stream by the first terminal.
The method further comprises the following steps: carrying out session negotiation with the first terminal and establishing a transmission session for carrying out M-path original data stream transmission; wherein M is a positive integer not greater than N;
the step S220 may include:
and receiving the original data stream sent by the first terminal based on the transmission session.
In this embodiment, the second terminal also enables the first terminal to perform a session, and receives the original data stream sent by the first terminal based on the transmission session, so that smooth transmission of the original data stream can be ensured.
Example three:
as shown in fig. 5, the present embodiment provides a terminal, which is a first terminal; the first terminal includes:
a first connection unit 110 for establishing a same-screen connection with a second terminal;
a first sending unit 120, configured to select at least one path of original data stream, and send the selected at least one path of original data stream to a second terminal through the on-screen connection;
and the original data stream is used for being output by the second terminal, so that the same screen with the first terminal is realized.
The first connection unit 110 included in the first terminal according to this embodiment may include a communication interface, which may include a wired interface or a wireless interface; the wireless interface may include a transceiver antenna, or the like.
The hardware structure of the first sending unit 120 may also include a communication interface, and a sending interface that can be used to send a data stream to the second terminal, for example, a sending antenna, where the sending antenna may specifically be a WiFi antenna or the like.
The first terminal described in this embodiment may be an electronic device such as a mobile phone, a tablet computer, or a wearable device, and can directly send an original data stream for performing the same screen to the second terminal, instead of a data stream formed by a screen capture code displayed by the first terminal, and the first terminal has the characteristics of less operation for performing the same screen processing, less consumed system resources, and good same screen effect.
As a further improvement of this embodiment, the first sending unit 120 is configured to select a local data stream of the first terminal and/or receive a remote data stream sent by a remote device and send the remote data stream to the second terminal.
In this embodiment, the original data stream sent by the first sending unit 120 may be a local data stream of the first terminal, or a remote data stream received by the first terminal from a remote device. For example, the first terminal and the third terminal are in a video call, and the data stream formed during the video call may include a local data stream collected locally and also include a remote data stream received from the third terminal. At this time, the first sending unit 120 may send at least one of the local data stream and the remote data stream to the second terminal for the same screen.
The first sending unit 120 is configured to send an inquiry for determining whether the second terminal supports N-way data stream transmission; wherein N is an integer not less than 2;
the first terminal further comprises:
a first receiving unit, configured to receive feedback information sent by the second terminal based on the query;
the first sending unit 120 is further configured to select M original data streams to send to the second terminal when the feedback information indicates that the second terminal supports N data stream transmission; wherein M is a positive integer not greater than N.
In this embodiment, the first terminal further includes a first receiving unit, and the first receiving unit may include a receiving interface, and may be capable of receiving the feedback information sent by the second terminal. The first sending unit 120 further sends an inquiry for determining that the second terminal can simultaneously support N-channel data stream transmission to the second terminal, and the first sending unit 120 completes the capability notification with the second terminal for feedback information formed by a reply of the second terminal to the inquiry, thereby determining whether more than two channels of original data streams can be simultaneously sent to the second terminal.
The feedback information comprises port parameters transmitted by the second terminal receiving N paths of data streams;
the first sending unit 120 is configured to send the M original data streams to the second terminal according to the port parameter.
In this embodiment, the feedback information further includes port parameters, so that it is convenient for the first sending unit 120 to determine through which ports the original data stream is sent to the second terminal.
In addition, the first terminal further includes:
a negotiation unit, configured to perform session negotiation based on the port parameter and establish a transmission session for transmitting M paths of original data streams;
the first sending unit 120 is configured to send the M original data streams to the second terminal based on the transmission session.
In this embodiment, the first terminal further includes a negotiation unit, and the negotiation unit may include a communication interface, and performs a transmission session of original data stream transmission through information interaction with the second terminal.
After the negotiation unit and the second terminal complete session establishment, the first sending unit 120 transmits the M paths of original data streams based on the transmission session, thereby easily achieving transmission of the original data streams.
In short, the first terminal in this embodiment may be a hardware structure for implementing the same-screen method in the first embodiment, and has the characteristics of good same-screen effect, simple operation of the first terminal, low system resource consumption, and the like.
Example four:
as shown in fig. 6, this embodiment provides another terminal, which is a second terminal; the second terminal includes:
a second connection unit 210, configured to establish a same-screen connection with the first terminal;
a second receiving unit 220, configured to receive at least one original data stream sent by the first terminal through the on-screen connection;
a display unit 230, configured to display the original data stream.
The second connection unit 210 of this embodiment has a similar structure to the first connection unit in the first terminal, and may also include a communication interface, which can be used for the first terminal to establish a connection, where the connection is used for performing the same screen between the first terminal and the second terminal, so that the connection may be referred to as the same screen connection.
The second receiving unit 220 may comprise a receiving interface, such as a receiving antenna, capable of receiving one or more original data streams sent by the first terminal.
The display unit 230 may include various display screens; the display screen may include a liquid crystal display screen, an electronic ink display screen, a projection display screen, or an Organic Light Emitting Diode (OLED) display screen, etc. The display screen can be used for displaying the data stream, so that the same picture as the first terminal is displayed, and the same screen is realized.
In this embodiment, the second terminal may be a hardware structure for implementing the same-screen method according to the second embodiment, so that bad display such as stuck on the same screen can be reduced, and a same-screen effect is provided.
Further, the second receiving unit 220 is configured to receive an inquiry that the first terminal determines whether the second terminal supports N-way data stream transmission; n is an integer not less than 2;
the second terminal further includes:
a forming unit, configured to form feedback information according to the capability parameter of the second terminal based on the query;
a second sending unit, configured to send the feedback information to the first terminal.
In this embodiment, the second terminal further comprises a forming unit, which may comprise a processor or a processing circuit. The processor may include a central processing unit, microprocessor, digital signal processor, application processor, or programmable array, or the like. The processing circuitry may comprise an application specific integrated circuit or the like.
In this embodiment, the forming unit queries the capability of the second terminal according to the query, and forms corresponding feedback information. And finally, a second sending unit of the second terminal sends the feedback information to the first terminal, so that the capability of the second terminal of the first terminal is informed, and the first terminal can conveniently make a decision to transmit one or more paths of original data streams to the second terminal.
The second transmitting unit may include a transmitting interface, which may be a wired interface or a wireless interface, which may include a transmitting antenna. The transmit antennas may include WiFi antennas or the like.
In this embodiment, when the second terminal supports N-way data stream transmission, the feedback information includes a port parameter supporting the N-way data stream transmission.
And carrying port parameters in the feedback information, so that the first terminal can conveniently send the original data stream and the like according to the port parameters.
In addition, the second terminal further includes:
a session unit, configured to perform session negotiation with the first terminal and establish a transmission session for transmitting M paths of original data streams; wherein M is a positive integer not greater than N;
the second receiving unit 220 is specifically configured to receive, based on the transmission session, an original data stream sent by the first terminal.
In this embodiment, the session unit may include a communication interface and a processor or a processing circuit, where the communication interface is used for the first terminal to perform information interaction, and the processor or the processing circuit may be used to form interactive information and parse received information to complete establishment of the transmission session. The second receiving unit 220 can easily and quickly receive the original data stream based on the transmission session, thereby well implementing the same screen.
In short, the second terminal provided in this embodiment can implement the hardware structure of the same-screen method according to the second embodiment, and can improve the same-screen effect and the user satisfaction.
Several specific examples are provided below in conjunction with any of the embodiments described above.
Example one:
the working scenario of this example may be that, during a video call, the specific content of the video call, including the local data stream and the remote data stream, is displayed on a large screen through the same-screen protocol.
The on-screen method described in this example includes:
step 1: searching equipment in a current local area network on a first terminal for carrying out video call, and finding receiving terminal equipment supporting the same screen; the receiving end device is the second terminal.
Step 2: and based on the user indication, selecting to establish the same-screen connection between the first terminal of the video call and one of the receiving terminal devices.
And 3, step 3: and after the same-screen connection is established, selecting a path of video call data streaming on the first terminal to be output to the receiving terminal equipment.
And 4, step 4: switching the data streams based on the user indication can be selected, and different data streams are selected, wherein the different data streams comprise a local data stream or a remote data stream; or based on the user instruction, the two paths of data streams are selected to be simultaneously sent to the receiving end device, and the receiving end device needs to simultaneously output the two paths of data streams after receiving the two paths of data streams.
And 5, step 5: and terminating the transmission of the data stream based on the user instruction and terminating the video call or the same screen.
In the above steps, if the current data stream on the same screen is a single data stream, such as a local data stream or a remote data stream, the existing on-screen protocol may be adopted, and only the terminal needs to acquire a Real Time Protocol (RTP) data stream from a video call and transmit the RTP data stream to the receiving end through the on-screen protocol.
Example two:
in this example, a method of simultaneously transmitting two data streams and performing two data streams on the same screen is provided. The first terminal and the second terminal are in the same screen at this time, and the following improvement can be made on the basis of the existing same screen protocol. Taking the wireless display Miracast protocol as an example, the method includes two scenarios: outputting two paths of data streams on the same receiving end in a first scene; the second scenario is to output two data streams on different receiving end devices.
In the first scenario, the flow of modifying the Miracast protocol is as follows: after the sender and the receiver complete the M1 or M2 message, when the terminal sends the M3 message to the sender, a method parameter is added to inquire whether the current receiver supports two data streams. The parameters for the query may be: wfd _ supported _ second _ video. Here, the transmitting end is the first terminal, and the receiving end is the second terminal.
If the receiving end does not reply the field, the receiving end does not support the simultaneous transmission and display of two paths of data.
If the receiving end supports the decoding and displaying of two paths of data at the same time, the field carried in the replied M3 gives the contents of the rtp-port0 and rtp-port1 parameters of wfd-client-rtp-ports in the replied M3 message at the same time. The rtp-port0 represents real-time transport port 0; the rtp-port1 represents real-time transport port 1.
As shown in the following table:
in the following M4 message, the extension of wfd-url0 and wfd-url1 in the wfd-presentation-url parameter is required, as shown in the following table
The first receiving end in the table is a main receiving end, and the second receiving end is an auxiliary receiving end.
After the M3 or M4 message negotiation process is completed, the second way data stream is simultaneously transmitted to the receiving end in the M6 message according to the WFD session establishment procedure at the first terminal and the transmitting end. The second data stream may be one of the original data streams. The receiving end is responsible for analyzing and displaying the two paths of data, and the packed RTP stream needs to contain a Sequence Parameter Set (SPS) and a Picture Parameter Set (PPS) of a data source, so that the receiving end can analyze the data stream according to the SPS and the PPS and output a corresponding video conveniently.
Scenario 2 is to transmit two paths of data to different receiving ends.
After receiving the M3 reply message which does not support two-way data from the receiving end, the sending end broadcasts again to discover other receiving end devices, and the user selects a second receiving end device and establishes WFD connection with the current sending end, so that the second way of data uses WFD to transmit the data source to the second receiving end as the first way of data. The process is equivalent to performing two-time same-screen processes, that is, WFD connections are respectively established between a sending end and two different receiving ends, and no protocol modification is required, and detailed descriptions of the process are omitted.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (12)
1. A method for on-screen display, the method comprising:
acquiring a local video data stream and a remote video data stream generated by a first terminal and remote equipment in a video call process;
establishing the same-screen connection between the first terminal and the second terminal;
sending a query to the second terminal, the query being used to determine whether the second terminal supports at least two video data streams transmission;
receiving feedback information sent by the second terminal based on the inquiry;
when the feedback information indicates that the second terminal supports the transmission of at least two video data streams, selecting at least one video data stream from the local video data stream and the far-end video data stream and sending the selected video data stream to the second terminal for the output of the second terminal;
when the feedback information indicates that the second terminal does not support the transmission of at least two video data streams, one of the local video data stream and the remote video data stream is sent to the second terminal for the second terminal to output;
establishing the same-screen connection between the first terminal and the third terminal;
and sending the other one of the remote video data stream and the local video data stream to the third terminal for output by the third terminal.
2. The method of claim 1, wherein the feedback information comprises port parameters of at least two video data stream transmissions received by the second terminal;
when the feedback information indicates that the second terminal supports transmission of at least two video data streams, selecting at least one video data stream from the local video data stream and the remote video data stream and sending the selected video data stream to the second terminal, including:
and sending the at least one video data stream to the second terminal according to the port parameter.
3. The method of claim 2, further comprising:
based on the port parameters, carrying out session negotiation and establishing a transmission session for carrying out at least one path of video data stream transmission;
when the feedback information indicates that the second terminal supports transmission of at least two video data streams, selecting at least one video data stream from the local video data stream and the remote video data stream and sending the selected video data stream to the second terminal, including:
and sending the at least one video data stream to a second terminal based on the transmission session.
4. A method for on-screen display, the method comprising:
establishing the same-screen connection between the second terminal and the first terminal;
receiving a query sent by the first terminal, wherein the query is used for determining whether the second terminal supports at least two-path video data stream transmission;
based on the query, forming feedback information according to the capability parameters of the second terminal;
sending the feedback information to the first terminal;
when the feedback information indicates that the second terminal supports the transmission of at least two video data streams, receiving at least one video data stream sent by the first terminal; the at least one video data stream is a video data stream selected from a local video data stream and a remote video data stream generated by the first terminal and the remote device in the video call process;
displaying the at least one video data stream on the second terminal;
when the feedback information indicates that the second terminal does not support the transmission of at least two video data streams, receiving one of the local video data stream and the remote video data stream sent by the first terminal;
displaying one of the local video data stream and the remote video data stream on the second terminal.
5. The method of claim 4, wherein the feedback information comprises port parameters for supporting at least two video data streams when the second terminal supports at least two video data streams.
6. The method of claim 4, further comprising:
carrying out session negotiation with the first terminal and establishing a transmission session for carrying out at least one path of video data stream transmission;
when the feedback information indicates that the second terminal supports transmission of at least two video data streams, receiving at least one video data stream sent by the first terminal includes:
and receiving at least one video data stream sent by the first terminal based on the transmission session.
7. A terminal, wherein the terminal is a first terminal; the first terminal includes:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring a local video data stream and a remote video data stream which are generated by a first terminal and remote equipment in the video call process;
the first connection unit is used for establishing same-screen connection with the second terminal;
a first sending unit, configured to send a query to the second terminal, where the query is used to determine whether the second terminal supports at least two video data stream transmissions;
a first receiving unit, configured to receive feedback information sent by the second terminal based on the query;
the first sending unit is further configured to select at least one video data stream from the local video data stream and the remote video data stream to send to the second terminal for output by the second terminal when the feedback information indicates that the second terminal supports transmission of at least two video data streams; when the feedback information indicates that the second terminal does not support the transmission of at least two video data streams, one of the local video data stream and the remote video data stream is sent to the second terminal for the second terminal to output;
the first connection unit is also used for establishing the same-screen connection between the first terminal and the third terminal;
and the first sending unit is used for sending the other one of the remote video data stream and the local video data stream to the third terminal for the third terminal to output.
8. The terminal of claim 7, wherein the feedback information includes port parameters for the second terminal to receive at least two video data streams;
the first sending unit is further configured to send the at least one video data stream to the second terminal according to the port parameter.
9. The terminal of claim 8, wherein the first terminal further comprises:
a negotiation unit, configured to perform session negotiation and establish a transmission session for performing at least one path of video data stream transmission based on the port parameter;
and the first sending unit is used for sending the at least one video data stream to the second terminal based on the transmission session.
10. A terminal, wherein the terminal is a second terminal; the second terminal includes:
the second connection unit is used for establishing same-screen connection with the first terminal;
a second receiving unit, configured to receive an inquiry sent by the first terminal, where the inquiry is used to determine whether the second terminal supports at least two video data stream transmissions;
a forming unit, configured to form feedback information according to the capability parameter of the second terminal based on the query;
a second sending unit, configured to send the feedback information to the first terminal;
the second receiving unit is further configured to receive at least one video data stream sent by the first terminal when the feedback information indicates that the second terminal supports transmission of at least two video data streams; the at least one video data stream is a video data stream selected from a local video data stream and a remote video data stream generated by the first terminal and the remote device in the video call process;
the display unit is used for displaying the at least one video data stream on the second terminal;
a second receiving unit, configured to receive one of the local video data stream and the remote video data stream sent by the first terminal when the feedback information indicates that the second terminal does not support transmission of at least two video data streams;
a display unit further configured to display one of the local video data stream and the remote video data stream on the second terminal.
11. The terminal of claim 10, wherein the feedback information comprises port parameters for supporting at least two video data streams when the second terminal supports at least two video data streams.
12. The terminal of claim 10, wherein the second terminal further comprises:
a session unit, configured to perform session negotiation with the first terminal and establish a transmission session for performing at least one video data stream transmission;
the second receiving unit is specifically configured to receive at least one video data stream sent by the first terminal based on the transmission session.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610077632.7A CN107040498B (en) | 2016-02-03 | 2016-02-03 | Same-screen method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610077632.7A CN107040498B (en) | 2016-02-03 | 2016-02-03 | Same-screen method and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107040498A CN107040498A (en) | 2017-08-11 |
| CN107040498B true CN107040498B (en) | 2020-09-25 |
Family
ID=59532814
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610077632.7A Active CN107040498B (en) | 2016-02-03 | 2016-02-03 | Same-screen method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107040498B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107465941A (en) * | 2017-09-07 | 2017-12-12 | 北京奇艺世纪科技有限公司 | A kind of Desktop Share video broadcasting method, system and computer system |
| CN109068084A (en) * | 2018-08-31 | 2018-12-21 | 努比亚技术有限公司 | Video calling picture display process, mobile terminal and computer readable storage medium |
| CN109327728B (en) * | 2018-11-23 | 2021-10-15 | 深圳市鹰硕技术有限公司 | One-to-many same-screen method, device and system, same-screen equipment and storage medium |
| WO2020168499A1 (en) * | 2019-02-20 | 2020-08-27 | 深圳市鹰硕技术有限公司 | Screen-sharing teaching method, apparatus and system, and smart device and storage medium |
| CN111277807A (en) * | 2020-01-14 | 2020-06-12 | 广东小天才科技有限公司 | Projection implementation method, wearable device, display device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103648015A (en) * | 2013-11-18 | 2014-03-19 | 乐视致新电子科技（天津）有限公司 | Data display method and apparatus |
| CN103856809A (en) * | 2012-12-03 | 2014-06-11 | 中国移动通信集团公司 | Method, system and terminal equipment for multipoint at the same screen |
| CN103974062A (en) * | 2013-06-24 | 2014-08-06 | 福州瑞芯微电子有限公司 | Image display device, image display system and image display method |
| CN104052788A (en) * | 2013-03-12 | 2014-09-17 | 三星电子株式会社 | Method and device for sharing content |
| CN104661085A (en) * | 2013-11-22 | 2015-05-27 | 中兴通讯股份有限公司 | Multi-way wireless display method and device |
-
2016
- 2016-02-03 CN CN201610077632.7A patent/CN107040498B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103856809A (en) * | 2012-12-03 | 2014-06-11 | 中国移动通信集团公司 | Method, system and terminal equipment for multipoint at the same screen |
| CN104052788A (en) * | 2013-03-12 | 2014-09-17 | 三星电子株式会社 | Method and device for sharing content |
| CN103974062A (en) * | 2013-06-24 | 2014-08-06 | 福州瑞芯微电子有限公司 | Image display device, image display system and image display method |
| CN103648015A (en) * | 2013-11-18 | 2014-03-19 | 乐视致新电子科技（天津）有限公司 | Data display method and apparatus |
| CN104661085A (en) * | 2013-11-22 | 2015-05-27 | 中兴通讯股份有限公司 | Multi-way wireless display method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107040498A (en) | 2017-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10383098B2 (en) | Information processing device and information processing method | |
| CN107040498B (en) | Same-screen method and terminal | |
| US10009578B2 (en) | Mobile terminal, display apparatus and control method thereof | |
| US8887222B2 (en) | Multicasting in a wireless display system | |
| US9257097B2 (en) | Remote rendering for efficient use of wireless bandwidth for wireless docking | |
| US10979900B2 (en) | Information processing device and information processing method | |
| US11106421B2 (en) | Display method and system for wireless intelligent multi-screen display | |
| CN112350981B (en) | Method, device and system for switching communication protocol | |
| CN105573609A (en) | Content sharing method and device | |
| WO2019015428A1 (en) | Data transmission method, device, terminal, and computer-readable storage medium | |
| CN105472309B (en) | Data transmission method, device and system | |
| US20150201085A1 (en) | Seamlessly transferring a communication | |
| CN102611871A (en) | Method, system and mobile terminal for video communication and digital television receiving terminal | |
| CN104079597A (en) | Transfer method of media stream and user equipment | |
| CN104918131A (en) | Method, terminal and receiving equipment for establishing mirroring screen content transmission | |
| CN105704106B (en) | A kind of visualization IVR implementation method and mobile terminal | |
| CN106803917B (en) | Video call method for double-screen mobile terminal and double-screen mobile terminal | |
| US20180077450A1 (en) | Mobile atsc 3.0 receiver as remote antenna | |
| CN110418209A (en) | A kind of information processing method and terminal device applied to transmission of video | |
| CN104539707A (en) | Screen mapping method and system for in-vehicle infotainment device, mobile phone and PC terminal | |
| CN104580783A (en) | Information processing apparatus that controls transfer of image, and control method therefor | |
| US10582376B2 (en) | Information processing apparatus, information processing method, and source apparatus | |
| CN204145679U (en) | A kind of screen message interactive system based on multi-user's mouse | |
| CN115695928A (en) | Screen projection method and device, electronic equipment and storage medium | |
| CN102244822A (en) | Remote broadcast control method in IPTV (Internet Protocol Television) system, device and system thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |