CN106155606A - A kind of multi-screen interaction method and device - Google Patents

Abstract

The present invention provides a multi-screen interaction method and device. The multi-screen interaction method applied to the sending end includes: using the first transmission parameter to transmit the same-screen data to the receiving end; during the process of transmitting the same-screen data, real-time detection of trigger information for parameter adjustment ; When the detected trigger information satisfies the preset trigger condition, adjust the first transmission parameter to obtain a second transmission parameter, and use the second transmission parameter to transmit subsequent same-screen data. In the embodiment of the present invention, during the transmission of data on the same screen, the trigger information for adjusting the transmission parameters is detected in real time. The second transmission parameter of the screen transmission, and then use the second transmission parameter to transmit the subsequent same-screen data; this multi-screen interaction method realizes the dynamic negotiation of the sending end capability and the receiving end capability, and can adjust the transmission parameters in time to improve the efficiency of the same screen transmission and effects.

Description

A method and device for multi-screen interaction

technical field

The invention relates to the field of communication technologies, in particular to a multi-screen interaction method and device.

Background technique

The multi-screen interactive technology in the prior art mainly includes forced screen switching and resolution negotiation screen switching (a resolution negotiation mechanism is provided before screen switching), but the multi-screen interactive technology in the prior art mainly solves the problem of how to pre-negotiate, Changes in the use process cannot be resolved.

The multi-screen interactive solution includes screen sharing and content sharing. Screen sharing includes processes such as screen capture, encoding, packaging, and sending at the sending end, and receiving, unpacking, decoding, and playing at the receiving end. There is a problem with the same-screen solution, that is, all displays are screen copies. If the scene or reality faced by the receiving end and the sending end are different, it may be due to the difference in the situation of the sending end and the receiving end, resulting in low efficiency or inconsistent display methods. Require. For example, when a device with a high resolution transmits to a device with a low resolution, the sender can capture a screen with a resolution of 1280*1080, but the receiver can only display a screen with a resolution of 1280*720 or even lower rate, so for the sending end, it consumes more resources, but it does not have a better effect; another example is that the sending end is a horizontal screen and the receiving end is a vertical screen, so the display experience will be relatively poor. In such a situation A separate design solution is required to implement forced horizontal or vertical screens, but the application scenarios will be very limited.

Contents of the invention

The purpose of the present invention is to provide a multi-screen interaction method and device, which solves the problem of inefficiency or non-conformity of display mode caused by the difference between the sending end and the receiving end during the multi-screen interaction process, and dynamically negotiates the capabilities of the sending end and the receiving end , to improve the efficiency and effect of multi-screen interaction.

In order to achieve the above purpose, the embodiment of the present invention provides a multi-screen interaction method applied to the sending end, including:

Using the first transmission parameter to transmit the same-screen data to the receiving end;

In the process of transmitting data on the same screen, real-time detection of trigger information for parameter adjustment;

When the detected trigger information satisfies the preset trigger condition, adjust the first transmission parameter to obtain a second transmission parameter, and use the second transmission parameter to transmit subsequent same-screen data.

Wherein, the trigger information of the real-time detection parameter adjustment specifically includes:

Real-time detection of the current resource occupancy of the sender.

Wherein, when the detected trigger information satisfies a preset trigger condition, adjusting the first transmission parameter specifically includes:

When the detected current resource occupancy of the sending end exceeds the first preset condition or is lower than the second preset condition, adjust the first transmission parameter; wherein the second preset condition is lower than the first preset condition Default situation.

Wherein, the adjusting the first transmission parameter specifically includes:

If the resource occupancy information shows that the resource occupancy exceeds a first preset situation, the sending end actively reduces the first transmission parameter;

If the resource occupancy status information shows that the resource occupancy status is lower than a second preset status, acquiring capability parameter information currently supported by the receiving end, and adjusting the first capability parameter information based on the capability parameter information currently supported by the receiving end. - Transfer parameters.

Wherein, the trigger information of the real-time detection parameter adjustment specifically includes:

Sending a first inquiry message to the receiving end to inquire about the current network status information;

receiving a first query response message carrying current network status information returned by the receiving end;

Detecting the first query response message in real time to obtain current network status information.

Wherein, when the detected trigger information satisfies the preset trigger condition, adjusting the first transmission parameter specifically includes:

When it is detected that the current network condition is lower than the preset network condition, the first transmission parameter is adjusted.

Wherein, the trigger information of the real-time detection parameter adjustment specifically includes:

receiving a change message sent by the receiving end that identifies a change in the capability parameter of the receiving end.

Wherein, when the detected trigger information satisfies the preset trigger condition, adjusting the first transmission parameter specifically includes:

When the change message is detected, send a second inquiry message to the receiving end to inquire about the capability parameter information supported by the receiving end;

receiving and parsing the second inquiry response message carrying the capability parameter information supported by the receiving terminal returned by the receiving terminal, and obtaining the capability parameter information supported by the receiving terminal;

Adjusting the first transmission parameter according to the capability parameter information supported by the receiving end.

Wherein, before using the first transmission parameter to transmit the same-screen data to the receiving end, it also includes:

Negotiating with the receiving end to determine the capability parameter information jointly supported by the transmitting end and the receiving end, and determining the first transmission parameter according to the commonly supported capability parameter information.

Wherein, the negotiation with the receiving end to determine the capability parameter information jointly supported by the sending end and the receiving end includes:

sending a third inquiry message to the receiving end to inquire about the first capability parameter information supported by the receiving end;

receiving and parsing the third inquiry response message carrying the capability parameter information supported by the receiving terminal returned by the receiving terminal, and acquiring the first capability parameter information supported by the receiving terminal;

According to the first capability parameter information supported by the receiving end and the second capability parameter information supported by the sending end itself, determine the capability parameter information supported by both the sending end and the receiving end.

Wherein, the negotiation with the receiving end to determine the capability parameter information jointly supported by the sending end and the receiving end includes:

receiving a fourth inquiry message sent by the receiving end to inquire about the second capability parameter information supported by the sending end;

sending to the receiving end a fourth query response message carrying the second capability parameter information supported by the sending end, so that the receiving end can determining capability parameter information jointly supported by the sending end and the receiving end;

receiving capability parameter information jointly supported by the sending end and the receiving end sent by the receiving end.

The embodiment of the present invention also provides a multi-screen interaction method applied to the receiving end, including:

receiving the same-screen data transmitted by the sending end using the first transmission parameter;

During the process of transmitting the same-screen data, when the sending end detects that the trigger information satisfies the preset trigger condition, the same-screen data transmitted by the sending end using the adjusted second transmission parameters is received.

Wherein, when the trigger information is the current resource occupancy situation of the sending end, and the current resource occupancy situation of the sending end is lower than the second preset situation, the multi-screen interaction method further includes:

receiving a fifth inquiry message sent by the sending end to inquire about the capability parameter information currently supported by the receiving end;

Returning to the sending end a fifth query response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end and based on the information currently supported by the receiving end The capability parameter information adjusts the first transmission parameter.

Wherein, when the trigger information is current network status information, the multi-screen interaction method further includes:

receiving a first inquiry message sent by the sending end to inquire about current network status information;

Returning the first inquiry response message carrying the current network status information to the sending end, so that the sending end can obtain the current network status information therefrom.

Wherein, when the capability parameter of the receiving end changes, the multi-screen interaction method further includes:

Sending a change message identifying a change in the capability parameter of the receiving end to the sending end;

receiving a second inquiry message sent by the sending end after detecting the change message, inquiring about the capability parameter information currently supported by the receiving end;

Returning to the sending end a second query response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end The capability parameter information adjusts the first transmission parameter.

Wherein, before the same-screen data transmitted by the sending and receiving end using the first transmission parameter, it also includes:

Negotiating with the sending end to determine the capability parameter information supported by the sending end and the receiving end, so that the sending end can determine the first transmission parameter according to the commonly supported capability parameter information.

Wherein, the negotiation with the sending end to determine the capability parameter information jointly supported by the sending end and the receiving end includes:

receiving a third inquiry message sent by the sending end to inquire about the first capability parameter information supported by the receiving end;

return to the sending end a third inquiry response message carrying the first capability parameter information supported by the receiving end, so that the sending end can 2. Capability parameter information, which determines the capability parameter information jointly supported by the sending end and the receiving end.

Among them, negotiate with the sender to determine the capability parameter information jointly supported by the sender and the receiver, including:

Sending a fourth inquiry message to the sending end to inquire about the second capability parameter information supported by the sending end;

receiving and parsing the fourth inquiry response message carrying the second capability parameter information supported by the sender returned by the sender, and obtaining the second capability parameter information supported by the sender;

According to the second capability parameter information supported by the sending end and the first capability parameter information supported by the receiving end itself, determine the capability parameter information jointly supported by the sending end and the receiving end and set the jointly supported capabilities The parameter information is sent to the sending end.

The embodiment of the present invention also provides a multi-screen interactive device, which is applied to the sending end, including:

A transmission module, configured to transmit data on the same screen to the receiving end using the first transmission parameter;

The detection module is used to detect the trigger information of parameter adjustment in real time during the process of transmitting the data on the same screen;

An adjustment module, configured to adjust the first transmission parameter to obtain a second transmission parameter when the detected trigger information satisfies a preset trigger condition, and use the second transmission parameter to transmit subsequent same-screen data.

Wherein, the detection module includes:

The resource occupation detection module is used to detect the current resource occupation of the sending end in real time.

Wherein, the adjustment module includes:

A resource occupancy adjustment module, configured to adjust the first transmission parameter when the detected current resource occupancy of the sending end exceeds a first preset situation or is lower than a second preset situation; wherein, the second preset The condition is lower than the first predetermined condition.

Wherein, the resource occupation adjustment module includes:

The first adjustment submodule is configured to, if the resource occupancy information shows that the resource occupancy exceeds a first preset situation, the sending end actively reduces the first transmission parameter;

The second adjustment submodule is configured to obtain the capability parameter information currently supported by the receiving end if the resource occupation information shows that the resource occupation is lower than the second preset condition, and based on the information currently supported by the receiving end The capability parameter information adjusts the first transmission parameter.

Wherein, the detection module includes:

The first sending module is configured to send a first inquiry message to the receiving end to inquire about current network status information;

A first receiving module, configured to receive a first query response message carrying current network status information returned by the receiving end;

A network status detection module, configured to detect the first inquiry response message in real time to obtain current network status information.

Wherein, the adjustment module includes:

A network condition adjustment module, configured to adjust the first transmission parameter when it is detected that the current network condition is lower than the preset network condition.

Wherein, the detection module includes:

A capability change detection module, configured to receive a change message sent by the receiving end to identify a change in a capability parameter of the receiving end.

Wherein, the adjustment module includes:

The second sending module is configured to, when the change message is detected, send to the receiving end a second inquiry message inquiring about the capability parameter information supported by the receiving end;

The third receiving module receives and parses the second inquiry response message carrying the capability parameter information supported by the receiving terminal returned by the receiving terminal, and obtains the capability parameter information supported by the receiving terminal;

A capability adjustment module, configured to adjust the first transmission parameter according to the capability parameter information supported by the receiving end.

Wherein, the device also includes:

The first parameter determination module is configured to negotiate with the receiving end to determine the capability parameter information jointly supported by the transmitting end and the receiving end, and determine the first transmission parameter according to the jointly supported capability parameter information.

Wherein, the first parameter determination module includes:

A third sending module, configured to send to the receiving end a third inquiry message inquiring about the first capability parameter information supported by the receiving end;

The fourth receiving module is configured to receive and parse the third query response message returned by the receiving end carrying the capability parameter information supported by the receiving end, and obtain the first capability parameter information supported by the receiving end;

The first determining submodule is configured to determine capability parameter information supported by both the transmitting end and the receiving end according to the first capability parameter information supported by the receiving end and the second capability parameter information supported by the transmitting end itself.

Wherein, the first parameter determination module includes:

The fifth receiving module is configured to receive a fourth inquiry message sent by the receiving end to inquire about the second capability parameter information supported by the sending end;

The fourth sending module is configured to send to the receiving end a fourth query response message carrying the second capability parameter information supported by the sending end, so that the receiving end can use the first capability parameter information supported by itself and the sending end The supported second capability parameter information determines the capability parameter information jointly supported by the sending end and the receiving end;

The sixth receiving module is configured to receive capability parameter information jointly supported by the sending end and the receiving end sent by the receiving end.

The embodiment of the present invention also provides a multi-screen interactive device, which is applied to the receiving end, including:

The first data receiving module is used to receive the same-screen data transmitted by the sending end using the first transmission parameter;

The second data receiving module is configured to receive the same-screen data transmitted by the sending end using the adjusted second transmission parameters when the sending end detects that the trigger information satisfies a preset trigger condition during the process of transmitting the same-screen data.

Wherein, when the trigger information is the current resource occupancy situation of the sending end, and the current resource occupancy situation of the sending end is lower than the second preset situation, the multi-screen interaction device further includes:

A seventh receiving module, configured to receive a fifth inquiry message sent by the sending end to inquire about the capability parameter information currently supported by the receiving end;

A fifth sending module, configured to return to the sending end a fifth inquiry response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end and adjusting the first transmission parameter based on the capability parameter information currently supported by the receiving end.

Wherein, when the trigger information is current network status information, the multi-screen interaction device further includes:

An eighth receiving module, configured to receive a first inquiry message sent by the sending end to inquire about current network status information;

A sixth sending module, configured to return a first inquiry response message carrying current network status information to the sending end, so that the sending end can obtain the current network status information therefrom.

Wherein, when the capability parameter of the receiving end changes, the multi-screen interactive device further includes:

A seventh sending module, configured to send a change message identifying a change in the capability parameter of the receiving end to the sending end;

A ninth receiving module, configured to receive a second inquiry message sent by the sending end after detecting the change message, inquiring about the capability parameter information currently supported by the receiving end;

An eighth sending module, configured to return to the sending end a second inquiry response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end and Adjusting the first transmission parameter according to the capability parameter information currently supported by the receiving end.

Wherein, the multi-screen interactive device also includes:

The second parameter determination module is configured to negotiate with the sending end to determine the capability parameter information supported by the sending end and the receiving end, so that the sending end can determine the first transmission parameter according to the commonly supported capability parameter information.

Wherein, the second parameter determination module includes:

An inquiry receiving module, configured to receive a third inquiry message sent by the sending end to inquire about the first capability parameter information supported by the receiving end;

A return module, configured to return to the sending end a third inquiry response message carrying the first capability parameter information supported by the receiving end, so that the sending end can The second capability parameter information supported by the end itself determines the capability parameter information jointly supported by the sending end and the receiving end.

Wherein, the second parameter determination module includes:

An inquiry sending module, configured to send to the sending end a fourth inquiry message inquiring about the second capability parameter information supported by the sending end;

The receiving and parsing module is configured to receive and parse the fourth inquiry response message carrying the second capability parameter information supported by the sender returned by the sender, and obtain the second capability parameter information supported by the sender therefrom;

The second determining submodule is configured to determine the capability parameter information jointly supported by the transmitting terminal and the receiving terminal according to the second capability parameter information supported by the transmitting terminal and the first capability parameter information supported by the receiving terminal itself and sending the commonly supported capability parameter information to the sending end.

The technical solution of the present invention has at least the following beneficial effects:

In the multi-screen interaction method and device of the embodiment of the present invention, during the transmission process of data on the same screen, the trigger information for adjusting the transmission parameters is detected in real time. When the trigger information meets the trigger conditions, the sending end and the receiving end negotiate and adjust the first One transmission parameter, and then obtain the second transmission parameter suitable for the current same-screen transmission, and then use the second transmission parameter to transmit the subsequent same-screen data; this multi-screen interaction method realizes dynamic negotiation of the ability of the sending end and the ability of the receiving end, and can be adjusted in time Transfer parameters to improve the efficiency and effect of the same screen transfer.

Description of drawings

FIG. 1 shows a flow chart of basic steps of a multi-screen interaction method at a sending end in an embodiment of the present invention;

Fig. 2 shows the flow chart of the basic steps of the multi-screen interaction method of the receiving end according to the embodiment of the present invention;

Fig. 3 represents the RTSP-based screen sharing flowchart of the embodiment of the present invention;

FIG. 4 shows a structural diagram of a multi-screen interactive device at a sending end according to an embodiment of the present invention;

FIG. 5 shows a structural diagram of a multi-screen interactive device at a receiving end in an embodiment of the present invention;

Fig. 6 shows a multi-screen interactive principle diagram of the multi-screen interactive device at the sending end and the multi-screen interactive device at the receiving end provided by an embodiment of the present invention.

detailed description

In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments.

The present invention aims at the problem of inefficiency or non-conforming display mode caused by the difference between the sending end and the receiving end in the process of multi-screen interaction in the prior art, and provides a multi-screen interaction method and device, in the same-screen data transmission process , to detect the trigger information of transmission parameter adjustment in real time. When the trigger information satisfies the trigger condition, the sending end and the receiving end negotiate and adjust the first transmission parameter in real time, and then obtain the second transmission parameter suitable for the current same-screen transmission, and then use the second The transmission parameters transmit subsequent same-screen data; the multi-screen interaction method realizes dynamic negotiation of the capabilities of the sending end and the receiving end, and can adjust the transmission parameters in time to improve the efficiency and effect of the same-screen transmission.

It should be noted that the multi-screen interaction method provided by the embodiment of the present invention is applied to an environment including at least one sending end and at least one receiving end. One sending end can send data on the same screen to one receiving end or send data to multiple receiving ends. For the same screen data, if the same screen data is sent to multiple receivers, it can be sent using the principle of determining the corresponding multiple transmission parameters negotiated with multiple receivers, or it can be sent using the principle of determining unified transmission parameters based on the capabilities of multiple receivers , which is not specifically limited here; multiple senders can also be used to send data on the same screen to the same receiver, multiple senders negotiate with the receiver to determine multiple transmission parameters, and transmit the same screen data to the display on the receiver's preset display. In addition, the above-mentioned one-to-many or many-to-one data transmission mode is not the focus of this application, and belongs to a solution that can be realized by those skilled in the art, and will not be explained in detail here.

The following is a specific explanation of the embodiment of the present invention from the multi-screen interaction methods of the sending end and the receiving end respectively: As shown in Figure 1, the embodiment of the present invention provides a multi-screen interaction method, which is applied to the sending end, including:

Step 11, using the first transmission parameter to transmit the same-screen data to the receiving end;

Step 12, during the process of transmitting data on the same screen, real-time detection of trigger information for parameter adjustment;

Step 13, when the detected trigger information satisfies the preset trigger condition, adjust the first transmission parameter to obtain a second transmission parameter, and use the second transmission parameter to transmit subsequent same-screen data.

As shown in Figure 2, the embodiment of the present invention also provides a multi-screen interaction method applied to the receiving end, including:

Step 21, receiving the same-screen data transmitted by the sending end using the first transmission parameter;

Step 22: During the process of transmitting the same-screen data, when the sending end detects that the trigger information satisfies the preset trigger condition, receive the same-screen data transmitted by the sending end using the adjusted second transmission parameters.

In the above-mentioned embodiments of the present invention, the first transmission parameter is determined through negotiation between the sending end and the receiving end before transmitting the same-screen data, that is, before step 11 applied to the sending end, it also includes:

Step 14: Negotiate with the receiving end to determine capability parameter information supported by both the transmitting end and the receiving end, and determine a first transmission parameter according to the jointly supported capability parameter information.

Before step 21 applied to the receiving end also includes:

Step 23: Negotiate with the sending end to determine the capability parameter information supported by both the sending end and the receiving end, so that the sending end can determine the first transmission parameter according to the jointly supported capability parameter information.

Specifically, the contents of the first transmission parameter and the second transmission parameter include: (a) resolution; (b) screen rotation angle; (c) screen display ratio and mode; (d) frame rate; (e) other influence display and efficiency issues. Both the above-mentioned first transmission parameter and the second transmission parameter are adjustable parameters. By adjusting the first transmission parameter, a second transmission parameter more suitable for the current application scenario is obtained, thereby improving transmission efficiency and effect.

Further, step 14 and step 23 are the pre-negotiation process before screen transfer, the pre-negotiation process mainly includes the sending end actively inquiring about the capabilities of the receiving end to determine the commonly supported capability parameters, and then determining the first transmission parameter and the receiving end actively asking the sending end The capability determines the commonly supported capability parameter and returns it to the sender, and the sender sets the first transmission parameter.

That is, the situation where the sending end actively inquires is: the step 14 of the sending end includes:

Step 141, sending to the receiving end a third inquiry message inquiring about the first capability parameter information supported by the receiving end;

Step 142, receiving and analyzing the third inquiry response message carrying the capability parameter information supported by the receiving terminal returned by the receiving terminal, and obtaining the first capability parameter information supported by the receiving terminal;

Step 143, according to the first capability parameter information supported by the receiving end and the second capability parameter information supported by the sending end itself, determine the capability parameter information jointly supported by the sending end and the receiving end.

Step 23 at the receiving end includes:

Step 231, receiving a third inquiry message sent by the sending end inquiring about the first capability parameter information supported by the receiving end;

Step 232, return to the sending end a third inquiry response message carrying the first capability parameter information supported by the receiving end, so that the sending end can The supported second capability parameter information determines the capability parameter information jointly supported by the sending end and the receiving end.

For example, when the sending end actively inquires, that is, when the sending end is sending, it first inquires about the capabilities of the receiving end and negotiates with the receiving end, such as the hardware decoding ability and frame rate of the receiving end. If it is 720p@25fps, then even if it is The sending end can reach 1080p@30fps, so the sending end only provides lower resolution and frame rate, so that the resource burden of screen capture and encoding at the sending end can be reduced.

And the situation that the receiving end actively inquires is: the step 23 of the receiving end includes:

Step 233, sending a fourth inquiry message to the sending end to inquire about the second capability parameter information supported by the sending end;

Step 234, receiving and analyzing the fourth query response message carrying the second capability parameter information supported by the sender returned by the sender, and obtaining the second capability parameter information supported by the sender;

Step 235, according to the second capability parameter information supported by the sending end and the first capability parameter information supported by the receiving end itself, determine the capability parameter information jointly supported by the sending end and the receiving end and set the common The supported capability parameter information is sent to the sending end.

Step 14 at the sending end includes:

Step 144, receiving a fourth inquiry message sent by the receiving end to inquire about the second capability parameter information supported by the sending end;

Step 145: Send to the receiving end a fourth inquiry response message carrying the second capability parameter information supported by the sending end, so that the receiving end can use the first capability parameter information supported by itself and the second capability parameter information supported by the sending end The capability parameter information determines the capability parameter information jointly supported by the sending end and the receiving end;

Step 146, receiving capability parameter information jointly supported by the sending end and the receiving end sent by the receiving end.

For example, when the receiving end actively inquires, that is, before receiving the data on the same screen, the receiving end first inquires about the capability of the sending end, and negotiates with the sending end, such as the audio format, video format, several resolutions, and the corresponding frame rate of the sending end. , if the sender supports 1080p and 720p, and the receiver itself only supports 720p, then inform the sender that both the sender and the receiver support 720p resolution under the current environment, and the sender will provide the same screen data with 720p resolution during the sending process , which can reduce the resource burden of screen switching and encoding at the sending end and the resource burden of screen switching and decoding at the receiving end.

Further, steps 12 and 13 describe the dynamic adjustment of transmission parameters during the screen transfer process; specifically, only when the capability parameters, network conditions, or resource occupancy of one of the sending end or the receiving end change, it is necessary to Adjust transfer parameters. That is, the trigger information in step 12 mainly includes four aspects of information, 1) the current resource occupation of the sending end; 2) the current network status information; 3) the ability of the receiving end or the sending end is changed. The following describes how to trigger the adjustment and how to adjust it from the above three aspects.

When the trigger information is the current resource occupation of the sender, step 12 on the sender side specifically includes:

Step 121, real-time detection of the current resource occupancy of the sending end.

Correspondingly, step 13 specifically includes:

Step 131, when the detected current resource occupancy of the sending end exceeds the first preset condition or is lower than the second preset condition, adjust the first transmission parameter; wherein, the second preset condition is lower than the set Describe the first default situation.

And the step of adjusting the first transmission parameter specifically includes:

Step 132, if the resource occupancy information shows that the resource occupancy exceeds a first preset situation, the sending end actively reduces the first transmission parameter;

Step 133: If the resource occupancy information shows that the resource occupancy is lower than the second preset situation, obtain the capability parameter information currently supported by the receiving end, and adjust based on the capability parameter information currently supported by the receiving end The first transmission parameter.

The multi-screen interaction method of the receiving end corresponding to step 133 of the sending end, that is, when the trigger information is the current resource occupation of the sending end, and the current resource occupation of the sending end is lower than the second preset situation, the multi-screen Interactive methods also include:

Step 24, receiving a fifth inquiry message sent by the sending end to inquire about the capability parameter information currently supported by the receiving end;

Step 25, returning to the sending end a fifth inquiry response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end and based on the received The first transmission parameter is adjusted according to the capability parameter information currently supported by the terminal.

For example, the multi-screen interaction module at the sending end obtains current system resource occupancy such as CPU occupancy, memory occupancy, etc. through interaction with the system. First set the upper and lower limits of CPU and memory usage. If one of the values of CPU and memory exceeds the upper limit, the sender will actively reduce the frame rate and resolution; if the CPU and memory usage is lower than the lower limit, the sender can Send a message to the receiving end to obtain the parameters of the receiving end device at the current time (such as several resolutions (such as 1080p, 720p, 480p, etc.), and the corresponding frame rate, etc.), and the receiving end device includes the currently supported frames in the message response rate and resolution, the sender selects the highest frame rate and resolution that can be achieved according to the returned response message, and then transmits resources after adjusting the parameters.

Continuing from the above example, when the trigger information is current network status information, step 12 on the sending end side specifically includes:

Step 122, sending a first inquiry message inquiring about the current network status information to the receiving end;

Step 123, receiving a first query response message carrying current network status information returned by the receiving end;

Step 124: Detect the first query response message in real time to obtain current network status information.

Correspondingly, step 13 specifically includes:

Step 134, when it is detected that the current network condition is lower than the preset network condition, adjust the first transmission parameter.

The multi-screen interactive method of the receiving end corresponding to step 12 of the sending end, that is, when the trigger information is current network status information, the multi-screen interactive method further includes:

Step 26, receiving a first inquiry message sent by the sending end to inquire about current network status information;

Step 27: Return the first inquiry response message carrying the current network status information to the sending end, so that the sending end can obtain the current network status information therefrom.

For example, the multi-screen interaction module at the sending end interacts with the receiving end, and the sending end device sends the first query message (RTSP GET_PARAMETER request) to the receiving end to obtain current network status information (such as the current network packet loss rate, delay, etc. ); Specifically, the message needs to add parameters to indicate that the sending device needs to obtain the current network status information from the receiving device, and the parameters are defined as follows:

Packet loss rate: wfd_sink_network_packet_loss, delay: wfd_sink_network_time_delay. If the sender device finds the parameters wfd_sink_network_packet_loss (packet loss rate) and wfd_sink_network_time_delay (delay) in the first inquiry message, it needs to include the above parameters in the first inquiry response message to return the packet loss rate and delay information of the current network, And adjust the transmission parameters according to the information. Specifically, for example, if the packet loss rate is greater than the preset threshold, the sender will actively reduce the frame rate and resolution, or if the delay is greater than the preset threshold, the sender will also actively reduce the frame rate and resolution, etc.; or packet loss The transmission rate and delay are small. The sending end and the receiving end negotiate the resolution and frame rate currently supported by the receiving end, readjust the transmission parameters, and further improve the transmission efficiency and effect.

Following the above example, when the trigger information is that the ability of the receiving end or the sending end is changed, this situation mainly includes 3 scenarios. Scenario 1: Both the sending end and the receiving end provide a manual configuration interface, and the screen can be uploaded according to the user's choice Parameter replacement, so that during the screen transfer process, these parameters can be changed to improve efficiency. It should be noted that the adjustment priority of manual configuration is the highest, that is, no matter what the optimal transmission parameters negotiated by the system are, and regardless of whether the manual configuration scheme can improve efficiency, as long as one or both of the sending end or receiving end responds Manually configured parameters, the subsequent screen transfer process will be executed according to the manually configured parameters.

Scenario 2: The capability of the sender is changed. If the sender actively inquires about the capability of the receiver when determining the first transmission parameter, there is no need to ask the capability of the receiver again. It is only necessary to re-determine the capability parameters currently supported by both the sender and the receiver, and then Readjust the transmission parameters to adapt to the current application scenario and improve transmission efficiency; if the receiving end actively inquires about the capability of the sending end when determining the first transmission parameter, the sending end sends a change message of the capability parameter change to the receiving end, and the change message triggers The receiving end reacquires the current capability parameters of the sending end, and then re-determines the commonly supported capability parameters, and then readjusts the transmission parameters to adapt to the current application scenario and improve transmission efficiency.

Scenario 3, the capability of the receiving end is changed, which is the same as scenario 2. If the receiving end actively inquires about the capability of the sending end when determining the first transmission parameter, there is no need to inquire about the capabilities of the sending end, and it is only necessary to re-determine the capabilities supported by both the sending end and the current receiving end. capability parameters, and then readjust the transmission parameters to adapt to the current application scenario and improve transmission efficiency; if the sender actively inquires about the capability of the receiver when determining the first transmission parameter, the receiver sends a change message of the capability parameter change to the sender. The change message triggers the sending end to reacquire the current capability parameters of the receiving end, and then re-determines the commonly supported capability parameters, and then readjusts the transmission parameters to adapt to the current application scenario and improve transmission efficiency. Specifically, when the first transmission parameter is determined, when the sending end actively inquires about the capabilities of the receiving end, the multi-screen interaction method of the receiving end also includes:

Step 28, sending a change message identifying a change in the capability parameter of the receiving end to the sending end;

Step 29, receiving a second inquiry message sent by the sending end after detecting the change message, inquiring about the capability parameter information currently supported by the receiving end;

Step 210, returning to the sending end a second inquiry response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end and according to the received The first transmission parameter is adjusted according to the capability parameter information currently supported by the terminal.

Correspondingly, step 12 at the sending end specifically includes:

Step 125: Receive a change message from the receiving end that identifies a change in the capability parameter of the receiving end.

And step 13 specifically includes:

Step 135, when the change message is detected, send a second inquiry message to the receiving end to inquire about the capability parameter information supported by the receiving end;

Step 136, receiving and analyzing the second inquiry response message carrying the capability parameter information supported by the receiving terminal returned by the receiving terminal, and obtaining the capability parameter information supported by the receiving terminal;

Step 137: Adjust the first transmission parameter according to the capability parameter information supported by the receiving end.

For example, after a period of transmission, some parameters of the receiving end device will change, and the receiving end device sends a change message to the receiving end, triggering the sending end device to send a second inquiry message (RTSPGET_PARAMETER request) to the receiving end to obtain the current time of the receiving end Device parameters (such as several resolutions (such as 1080p, 720p, 480p, etc.), and the corresponding frame rate, the current angle of the screen, display ratio and display mode, etc.); specifically, the second inquiry message needs to add the following parameters To indicate that the sending device needs to obtain the current angle, display ratio and display mode of the receiving device's screen. These parameters are defined as follows:

Current angle: wfd_sink_screen_angle, display ratio: wfd_sink_screen_proportion, display mode: wfd_sink_screen_mode.

If the receiving device finds the parameters wfd_sink_screen_angle (current angle), wfd_sink_screen_proportion (display ratio), and wfd_sink_screen_mode (display mode) in the second inquiry message request, it needs to include these parameters in the second inquiry response message to return the angle of the current screen, Display scale and display mode information, the angle parameter value is 0, 90, 180, 270, that is, the angle between the current screen and the horizontal direction; the display scale parameter value is 1:18, 1:24, etc.; the display mode parameter value is 3: 4. 16:9, 16:10, etc.

After the sender device adjusts the corresponding parameters according to the second query response message (for example, the resolution is reduced from 1280*720 to 800*600, the display angle is changed from 0 degrees to 90 degrees), and then continues to send data on the same screen.

It should be noted that the specific content of the transmission parameters in the multi-screen interaction method provided by the embodiment of the present invention varies according to different application scenarios; that is, the sending end device negotiates with the receiving end device on parameters such as resolution for different transmission applications, Realize the adjustment of transmission parameters by the sender. For example, when video transmission is implemented between the sending end and the receiving end, the sending end can send a request message (RTSPGET_PARAMETER request) to the receiving end to obtain the current receiving end device parameters (such as several resolutions (such as 1080p, 720p, 480p, etc.) , and the corresponding frame rate, etc.), the receiving end device includes the currently accepted frame rate and resolution in the response, the sending end selects the highest frame rate and resolution that can be achieved according to the returned response message, and adjusts the parameters Then transfer resources; when the game application is transmitted between the sender and the receiver, it is only for displaying the approximate position for reverse control, and the sender can include the currently accepted frame rate and resolution in the response sent by the receiver. Rate, select the lowest frame rate and resolution that can be achieved, and adjust the transmission parameters accordingly. This method is used to adjust the resolution and frame rate of the screen transfer, and the screen transfer application or module needs to perceive the characteristics of the currently running application.

The multi-screen interactive solution includes screen sharing and content sharing. Screen sharing includes processes such as screen capture, encoding, packaging, and sending at the sending end, and includes receiving, unpacking, decoding, and playing processes at the receiving end. The specific description of content sharing is as follows, as shown in Figure 3, the description of the screen sharing process based on RTSP (Real-time Streaming Protocol):

In the WFD Capability Negotiation phase (WFD Capability Negotiation), that is, the capability information exchange phase between the two parties, the sending device participating in the communication first sends an M1 RTSP OPTIONS request message to the receiving device to obtain the RTSP method set supported by the receiving device. After receiving the request, the receiving end device sends an M1 response message. Then the receiving end device sends M2, namely RTSP OPTIONS request message to the sending end device to obtain the RTSP method set supported by the sending end device. After receiving the request, the sending device sends an M2 response message. After the M2 response message is sent successfully, the sending device sends an M3 RTSP GET_PARAMETER request message to the receiving device to obtain the WFD capability list of the receiving device it is interested in. The specific content includes (audio format, video format, several resolutions) (such as 1080p, 720p, 480p, etc.), and the corresponding frame rate, supported content protection methods). Then the receiving end device sends an M3 response message. According to the information carried in the response message, the sending device determines the parameter set of the subsequent WFD session (the direction is sent by the sending device and received by the receiving device) and sends it to the receiving device through the M4 request message RTSPSET_PARAMETER to set the parameters, and the receiving device replies M4 answers. If the receiving end device needs to know the capability information of the sending end device, it needs to send M3 or RTSP GET_PARAMETER request message to the sending end device to obtain the WFD capability list of the sending end device that it is interested in. The specific content includes (audio format, video format, Several resolutions (such as 1080p, 720p, 480p, etc.), and the corresponding frame rate, supported content protection methods). Then the sending end device sends an M3 response message. According to this response, the receiver device determines the parameter set of the subsequent WFD session (the direction is sent by the receiver device and received by the sender device) and sends it to the sender device through the M4, RTSP SET_PARAMETER request message, and the sender device replies with an M4 response.

Through the above-mentioned message interaction process, both parties in the communication know each other's capability information, and set a set of parameters that both parties can accept. Select the terminal device and start to initiate the data transmission on the same screen.

Further, when any of the above three trigger information meets the trigger condition after transmission for a period of time, the sending end device sends an M3 message (RTSP GET_PARAMETER request) to the receiving end to obtain the current time receiving end, device parameters (such as several resolution (such as 1080p, 720p, 480p, etc.), and the corresponding frame rate, the current angle of the screen, display ratio and display mode, etc.), the receiving end device returns an M3 response message, and the sending end device adjusts the transmission parameters according to the M3 response message Then continue to transmit data on the same screen.

It should be noted that the adjustment priorities of the above three trigger information are as follows: the adjustment priority is firstly set according to the user's needs and the user's input; When the rate is too high (CPU/memory/GPU), even if the current network delay and packet loss rate meet the requirements, it is necessary to reduce the bit rate and frame rate; and for the processing of increasing the frame rate and bit rate, it is necessary to first look at the network delay and packet loss rate meet the requirements, if so, increase the frame rate and bit rate, and then check whether the resource occupancy meets the requirements.

In order to better achieve the above purpose, as shown in Figure 4, the embodiment of the present invention also provides a multi-screen interactive device, which is applied to the sending end, including:

A transmission module 41, configured to transmit data on the same screen to the receiving end using the first transmission parameter;

The detection module 42 is used to detect the trigger information of parameter adjustment in real time during the process of transmitting the same screen data;

The adjustment module 43 is configured to adjust the first transmission parameter to obtain a second transmission parameter when the detected trigger information satisfies the preset trigger condition, and use the second transmission parameter to transmit subsequent same-screen data.

Further, in the above-mentioned embodiments of the present invention, the detection module 42 includes:

The resource occupation detection module is used to detect the current resource occupation of the sending end in real time.

Further, in the above-mentioned embodiments of the present invention, the adjustment module 43 includes:

A resource occupancy adjustment module, configured to adjust the first transmission parameter when the detected current resource occupancy of the sending end exceeds a first preset situation or is lower than a second preset situation; wherein, the second preset The condition is lower than the first predetermined condition.

Further, in the above-mentioned embodiments of the present invention, the resource occupation adjustment module includes:

The first adjustment submodule is configured to, if the resource occupancy information shows that the resource occupancy exceeds a first preset situation, the sending end actively reduces the first transmission parameter;

The second adjustment submodule is configured to obtain the capability parameter information currently supported by the receiving end if the resource occupation information shows that the resource occupation is lower than the second preset condition, and based on the information currently supported by the receiving end The capability parameter information adjusts the first transmission parameter.

Further, in the above-mentioned embodiments of the present invention, the detection module 42 includes:

The first sending module is configured to send a first inquiry message to the receiving end to inquire about current network status information;

A first receiving module, configured to receive a first query response message carrying current network status information returned by the receiving end;

A network status detection module, configured to detect the first inquiry response message in real time to obtain current network status information.

Further, in the above-mentioned embodiments of the present invention, the adjustment module 43 includes:

A network condition adjustment module, configured to adjust the first transmission parameter when it is detected that the current network condition is lower than the preset network condition.

Further, in the above-mentioned embodiments of the present invention, the detection module 42 includes:

A capability change detection module, configured to receive a change message sent by the receiving end to identify a change in a capability parameter of the receiving end.

Further, in the above-mentioned embodiments of the present invention, the adjustment module 43 includes:

The second sending module is configured to, when the change message is detected, send to the receiving end a second inquiry message inquiring about the capability parameter information supported by the receiving end;

The third receiving module receives and parses the second inquiry response message carrying the capability parameter information supported by the receiving terminal returned by the receiving terminal, and obtains the capability parameter information supported by the receiving terminal;

A capability adjustment module, configured to adjust the first transmission parameter according to the capability parameter information supported by the receiving end.

Further, in the above-mentioned embodiments of the present invention, the device further includes:

The first parameter determination module is configured to negotiate with the receiving end to determine the capability parameter information jointly supported by the transmitting end and the receiving end, and determine the first transmission parameter according to the jointly supported capability parameter information.

Further, in the above-mentioned embodiment of the present invention, the first parameter determination module includes:

A third sending module, configured to send to the receiving end a third inquiry message inquiring about the first capability parameter information supported by the receiving end;

The fourth receiving module is configured to receive and parse the third query response message returned by the receiving end carrying the capability parameter information supported by the receiving end, and obtain the first capability parameter information supported by the receiving end;

The first determining submodule is configured to determine capability parameter information supported by both the transmitting end and the receiving end according to the first capability parameter information supported by the receiving end and the second capability parameter information supported by the transmitting end itself.

Further, in the above-mentioned embodiment of the present invention, the first parameter determination module includes:

The fifth receiving module is configured to receive a fourth inquiry message sent by the receiving end to inquire about the second capability parameter information supported by the sending end;

The fourth sending module is configured to send to the receiving end a fourth inquiry response message carrying the second capability parameter information supported by the sending end, so that the receiving end can use the first capability parameter information supported by itself and the sending end The supported second capability parameter information determines the capability parameter information jointly supported by the sending end and the receiving end;

The sixth receiving module is configured to receive capability parameter information jointly supported by the sending end and the receiving end sent by the receiving end.

It should be noted that the multi-screen interaction device at the sending end provided in the above-mentioned embodiments of the present invention is a device applying the multi-screen interaction method at the sending end, and all the embodiments and beneficial effects of the multi-screen interaction method at the sending end are applicable. on the device.

In order to better achieve the above purpose, as shown in Figure 5, an embodiment of the present invention also provides a multi-screen interactive device, which is applied to the receiving end, including:

The first data receiving module 51 is used to receive the same-screen data transmitted by the sending end using the first transmission parameter;

The second data receiving module 52 is configured to receive the same-screen data transmitted by the sending end using the adjusted second transmission parameters when the sending end detects that the trigger information satisfies the preset trigger condition during the process of transmitting the same-screen data .

Further, in the above embodiments of the present invention, when the trigger information is the current resource occupation of the sending end, and the current resource occupation of the sending end is lower than the second preset situation, the multi-screen interaction device further includes :

A seventh receiving module, configured to receive a fifth inquiry message sent by the sending end to inquire about the capability parameter information currently supported by the receiving end;

A fifth sending module, configured to return to the sending end a fifth query response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end and adjusting the first transmission parameter based on the capability parameter information currently supported by the receiving end.

Further, in the above-mentioned embodiments of the present invention, when the trigger information is current network status information, the multi-screen interaction device further includes:

An eighth receiving module, configured to receive a first inquiry message sent by the sending end to inquire about current network status information;

A sixth sending module, configured to return a first inquiry response message carrying current network status information to the sending end, so that the sending end can obtain the current network status information therefrom.

Further, in the above-mentioned embodiment of the present invention, when the capability parameter of the receiving end changes, the multi-screen interaction device further includes:

A seventh sending module, configured to send a change message identifying a change in the capability parameter of the receiving end to the sending end;

A ninth receiving module, configured to receive a second inquiry message sent by the sending end after detecting the change message, inquiring about the capability parameter information currently supported by the receiving end;

An eighth sending module, configured to return to the sending end a second inquiry response message carrying the capability parameter information currently supported by the receiving end, so that the sending end can obtain the capability parameter information currently supported by the receiving end and Adjusting the first transmission parameter according to the capability parameter information currently supported by the receiving end.

Further, in the above-mentioned embodiment of the present invention, the multi-screen interactive device further includes:

The second parameter determination module is configured to negotiate with the sending end to determine the capability parameter information supported by the sending end and the receiving end, so that the sending end can determine the first transmission parameter according to the commonly supported capability parameter information.

Further, in the above-mentioned embodiment of the present invention, the second parameter determination module includes:

An inquiry receiving module, configured to receive a third inquiry message sent by the sending end to inquire about the first capability parameter information supported by the receiving end;

A return module, configured to return to the sending end a third inquiry response message carrying the first capability parameter information supported by the receiving end, so that the sending end can The second capability parameter information supported by the end itself determines the capability parameter information jointly supported by the sending end and the receiving end.

Further, in the above-mentioned embodiment of the present invention, the second parameter determination module includes:

An inquiry sending module, configured to send to the sending end a fourth inquiry message inquiring about the second capability parameter information supported by the sending end;

The receiving and parsing module is configured to receive and parse the fourth inquiry response message carrying the second capability parameter information supported by the sender returned by the sender, and obtain the second capability parameter information supported by the sender therefrom;

The second determining submodule is configured to determine the capability parameter information jointly supported by the transmitting terminal and the receiving terminal according to the second capability parameter information supported by the transmitting terminal and the first capability parameter information supported by the receiving terminal itself and sending the commonly supported capability parameter information to the sending end.

It should be noted that the multi-screen interaction device at the receiving end provided in the above-mentioned embodiments of the present invention is a device that applies the multi-screen interaction method at the receiving end, and all the embodiments and beneficial effects of the multi-screen interaction method at the receiving end are applicable. on the device.

To sum up, in the specific application of the embodiment of the present invention, the modification of the transmission parameters of the same-screen data is mainly combined with five factors as shown in Figure 6: 1) the current application program (i.e. the application environment); 2) from the operating system Resource occupancy obtained by the module; 3) Current network status information obtained from the network communication module; 4) Capability parameter modification of the sending end or receiving end; 5) User-defined settings. In the process of multi-screen interaction, combine one or more of the above five factors to comprehensively adjust the transmission parameters to match the current application environment and improve the effect and efficiency of transmission and display.

The above description is a preferred embodiment of the present invention, it should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, these improvements and modifications It should also be regarded as the protection scope of the present invention.

Claims (36)

1. a multi-screen interaction method, is applied to transmitting terminal, it is characterised in that include:

The first transmission parameter is utilized to transmit screen data to receiving terminal；

During transmission screen data, detect the trigger message of parameter adjustment in real time；

When the trigger message detecting meets preset trigger condition, adjust the described first transmission parameter, obtain Second transmission parameter, and utilize the described second transmission parameter to transmit follow-up screen data.

2. multi-screen interaction method according to claim 1, it is characterised in that described real-time detection parameter The trigger message adjusting, specifically includes:

Detect the current occupation condition of transmitting terminal in real time.

3. multi-screen interaction method according to claim 2, it is characterised in that described when touching of detecting When photos and sending messages meets preset trigger condition, adjust the described first transmission parameter, specifically include:

When the current occupation condition of the transmitting terminal detecting exceeds the first predetermined condition or pre-less than second If situation, then adjust the described first transmission parameter；Wherein, described second predetermined condition is first pre-less than described If situation.

4. multi-screen interaction method according to claim 3, it is characterised in that described adjustment described first Transmission parameter, specifically includes:

If described occupation condition information show described occupation condition more than the first predetermined condition, then institute State transmitting terminal and actively reduce the described first transmission parameter；

If described occupation condition information shows that described occupation condition is less than the second predetermined condition, then obtain Take the ability parameter information that described receiving terminal is currently supported, and the ability ginseng currently supported based on described receiving terminal Number information adjusts the described first transmission parameter.

5. multi-screen interaction method according to claim 1, it is characterised in that described real-time detection parameter The trigger message adjusting, specifically includes:

Send the first inquiry message of inquiry current network conditions information to receiving terminal；

Receive the first inquiry response messages carrying current network conditions information that described receiving terminal returns；

Described first inquiry response messages of detection in real time, it is thus achieved that current network conditions information.

6. multi-screen interaction method according to claim 5, it is characterised in that when the triggering letter detecting When breath meets preset trigger condition, adjust the described first transmission parameter, specifically include:

When detecting that current network conditions is less than default network condition, adjust the described first transmission parameter.

7. multi-screen interaction method according to claim 1, it is characterised in that described real-time detection parameter The trigger message adjusting, specifically includes:

Receive the change message of the mark receiving terminal ability parameter change that described receiving terminal sends.

8. multi-screen interaction method according to claim 7, it is characterised in that when the triggering letter detecting When breath meets preset trigger condition, adjust the described first transmission parameter, specifically include:

When described change message being detected, send, to receiving terminal, the ability parameter that the described receiving terminal of inquiry is supported Second inquiry message of information；

Receive and parse through the second of the ability parameter information carrying the support of described receiving terminal that described receiving terminal returns Inquiry response messages, therefrom obtains the ability parameter information that described receiving terminal is supported；

Adjust the described first transmission parameter according to the ability parameter information that described receiving terminal is supported.

9. multi-screen interaction method according to claim 1, it is characterised in that described utilize the first transmission Parameter also included before receiving terminal transmission screen data:

Consult to determine, with receiving terminal, the ability parameter information that transmitting terminal and receiving terminal are supported jointly, and according to described The common ability parameter information supported determines the first transmission parameter.

10. multi-screen interaction method according to claim 9, it is characterised in that described and receiving terminal is consulted Determine the ability parameter information that transmitting terminal and receiving terminal are supported jointly, specifically include:

Send the 3rd inquiry message of the first ability parameter information that the described receiving terminal of inquiry is supported to receiving terminal；

Receive and parse through the 3rd of the ability parameter information carrying the support of described receiving terminal that described receiving terminal returns the Inquiry response messages, therefrom obtains the first ability parameter information that described receiving terminal is supported；

The second energy that the first ability parameter information supported according to described receiving terminal and described transmitting terminal self are supported Force parameter information, determines the ability parameter information that transmitting terminal and receiving terminal are supported jointly.

11. multi-screen interaction methods according to claim 9, it is characterised in that described and receiving terminal is consulted Determine the ability parameter information that transmitting terminal and receiving terminal are supported jointly, specifically include:

4th inquiry of the second ability parameter information receiving the inquiry transmitting terminal support that described receiving terminal sends disappears Breath；

The 4th query-response sending the second ability parameter information carrying the support of described transmitting terminal to receiving terminal disappears Breath so that described receiving terminal can be supported according to the first ability parameter information self supported and described transmitting terminal The second ability parameter information determine the ability parameter information that described transmitting terminal and described receiving terminal are supported jointly；

Receive described transmitting terminal and the ability parameter information jointly supported of described receiving terminal that described receiving terminal sends.

12. 1 kinds of multi-screen interaction methods, are applied to receiving terminal, it is characterised in that include:

Receiving end/sending end utilizes the screen data of the first transmission parameter transmission；

During transmission screen data, when transmitting terminal detects that trigger message meets preset trigger condition, Receive described transmitting terminal and utilize the screen data of the second transmission parameter transmission after adjusting.

13. multi-screen interaction methods according to claim 12, it is characterised in that when trigger message is for sending out The current occupation condition of sending end, and the current occupation condition of described transmitting terminal presets feelings less than second During condition, described multi-screen interaction method also includes:

Receive the 5th inquiry of the ability parameter information that the described receiving terminal of inquiry that described transmitting terminal sends currently is supported Ask message；

Return the 5th inquiry sound carrying the ability parameter information that described receiving terminal is currently supported to described transmitting terminal Answer message so that described transmitting terminal can therefrom obtain the ability parameter information that described receiving terminal currently supports simultaneously The ability parameter information currently supported based on described receiving terminal adjusts the described first transmission parameter.

14. multi-screen interaction methods according to claim 12, it is characterised in that when described trigger message During for current network conditions information, described multi-screen interaction method also includes:

Receive the first inquiry message of the inquiry current network conditions information that described transmitting terminal sends；

Return the first inquiry response messages carrying current network conditions information to described transmitting terminal so that described Transmitting terminal can therefrom obtain current network conditions information.

15. multi-screen interaction methods according to claim 12, it is characterised in that when receiving terminal ability ginseng During number change, described multi-screen interaction method also includes:

Send the change message of mark receiving terminal ability parameter change to described transmitting terminal；

Receive what the described receiving terminal of inquiry sending after described transmitting terminal detects described change message was currently supported Second inquiry message of ability parameter information；

Return the second inquiry sound carrying the ability parameter information that described receiving terminal is currently supported to described transmitting terminal Answer message so that described transmitting terminal can therefrom obtain the ability parameter information that described receiving terminal currently supports simultaneously Adjust the described first transmission parameter according to the ability parameter information that described receiving terminal is currently supported.

16. multi-screen interaction methods according to claim 12, it is characterised in that described receiving end/sending end Also include before the screen data utilizing the first transmission parameter transmission:

Consult to determine the ability parameter information that transmitting terminal and receiving terminal are supported jointly with transmitting terminal so that transmitting terminal The first transmission parameter can be determined according to the ability parameter information of described common support.

17. multi-screen interaction methods according to claim 16, it is characterised in that described and transmitting terminal association Business determines the ability parameter information that transmitting terminal and receiving terminal are supported jointly, specifically includes:

Receive the 3rd inquiry of the first ability parameter information of the inquiry described receiving terminal support that described transmitting terminal sends Ask message；

Return the 3rd inquiry sound carrying the first ability parameter information that described receiving terminal is supported to described transmitting terminal Answer message so that transmitting terminal can be according to the first ability parameter information of described receiving terminal support and described transmission Hold the second ability parameter information self supported, determine the ability parameter letter that transmitting terminal and receiving terminal are supported jointly Breath.

18. multi-screen interaction methods according to claim 16, it is characterised in that consult really with transmitting terminal Determine transmitting terminal and ability parameter information that receiving terminal is supported jointly, specifically include:

Send the 4th inquiry message of the second ability parameter information that the described transmitting terminal of inquiry is supported to transmitting terminal；

Receive and parse through the second ability parameter information carrying the support of described transmitting terminal of described transmitting terminal return 4th inquiry response messages, therefrom obtains the second ability parameter information that described transmitting terminal is supported；

The first energy that the second ability parameter information supported according to described transmitting terminal and described receiving terminal self are supported Force parameter information, determines ability parameter information that described transmitting terminal and described receiving terminal support jointly and by described The common ability parameter information supported is sent to described transmitting terminal.

19. 1 kinds of multi-screen interactive device, are applied to transmitting terminal, it is characterised in that include:

Transport module, is used for utilizing the first transmission parameter to transmit screen data to receiving terminal；

Detection module, for, during transmission screen data, detecting the trigger message of parameter adjustment in real time；

Adjusting module, for when the trigger message detecting meets preset trigger condition, adjusts described first Transmission parameter, obtains the second transmission parameter, and utilizes the described second transmission parameter to transmit follow-up screen data.

20. multi-screen interactive device according to claim 19, it is characterised in that described detection module bag Include:

Resource occupation detection module, for the current occupation condition of real-time detection transmitting terminal.

21. multi-screen interactive device according to claim 20, it is characterised in that described adjusting module bag Include:

Resource occupation adjusting module, for exceeding first when the current occupation condition of the transmitting terminal detecting Predetermined condition or be less than the second predetermined condition, then adjust described first transmission parameter；Wherein, described second Predetermined condition is less than described first predetermined condition.

22. multi-screen interactive device according to claim 21, it is characterised in that described resource occupation is adjusted Mould preparation block includes:

For described occupation condition information, first adjustment submodule, if showing that described occupation condition surpasses Cross the first predetermined condition, then described transmitting terminal actively reduces the described first transmission parameter；

For described occupation condition information, second adjustment submodule, if showing that described occupation condition is low In the second predetermined condition, then obtain the ability parameter information that described receiving terminal is currently supported, and connect based on described The ability parameter information that receiving end is currently supported adjusts the described first transmission parameter.

23. multi-screen interactive device according to claim 19, it is characterised in that described detection module bag Include:

First sending module, for sending the first inquiry message of inquiry current network conditions information to receiving terminal；

First receiver module, for receive described receiving terminal return carry the first of current network conditions information Inquiry response messages；

Network condition detection module, for described first inquiry response messages of real-time detection, it is thus achieved that current network Condition information.

24. multi-screen interactive device according to claim 23, it is characterised in that described adjusting module bag Include:

Network condition adjusting module, for when detecting that current network conditions is less than default network condition, adjusts Whole described first transmission parameter.

25. multi-screen interactive device according to claim 19, it is characterised in that described detection module bag Include:

Capacity variation detection module, for receiving the mark receiving terminal ability parameter change that described receiving terminal sends Change message.

26. multi-screen interactive device according to claim 25, it is characterised in that described adjusting module bag Include:

Second sending module, for when described change message being detected, sends to receiving terminal and connects described in inquiry Second inquiry message of the ability parameter information that receiving end is supported；

3rd receiver module, receives and parses through the ability carrying the support of described receiving terminal that described receiving terminal returns Second inquiry response messages of parameter information, therefrom obtains the ability parameter information that described receiving terminal is supported；

Capacity adjusting module, the ability parameter information for supporting according to described receiving terminal adjusts described first and passes Defeated parameter.

27. multi-screen interactive device according to claim 19, it is characterised in that described device also includes:

First parameter determination module, for consulting to determine the energy that transmitting terminal and receiving terminal are supported jointly with receiving terminal Force parameter information, and determine the first transmission parameter according to the ability parameter information of described common support.

28. multi-screen interactive device according to claim 27, it is characterised in that described first parameter is true Cover half block includes:

3rd sending module, for sending, to receiving terminal, the first ability parameter letter that the described receiving terminal of inquiry is supported 3rd inquiry message of breath；

4th receiver module, for receive and parse through described receiving terminal return carry described receiving terminal support 3rd inquiry response messages of ability parameter information, therefrom obtains the first ability parameter that described receiving terminal is supported Information；

First determination submodule, for according to described receiving terminal support the first ability parameter information and described The second ability parameter information that sending end self is supported, determines the ability parameter that transmitting terminal and receiving terminal are supported jointly Information.

29. multi-screen interactive device according to claim 27, it is characterised in that described first parameter is true Cover half block includes:

5th receiver module, the second ability ginseng that the inquiry transmitting terminal sending for receiving described receiving terminal is supported 4th inquiry message of number information；

4th sending module, carries, for sending to receiving terminal, the second ability parameter letter that described transmitting terminal is supported 4th inquiry response messages of breath so that described receiving terminal can be according to the first ability parameter letter self supported The second ability parameter information that breath and described transmitting terminal are supported determines that described transmitting terminal and described receiving terminal prop up jointly The ability parameter information held；

6th receiver module, common for the described transmitting terminal and described receiving terminal receiving the transmission of described receiving terminal The ability parameter information supported.

30. 1 kinds of multi-screen interactive device, are applied to receiving terminal, it is characterised in that include:

First data reception module, utilizes the screen data of the first transmission parameter transmission for receiving end/sending end；

Second data reception module, for during transmission screen data, when transmitting terminal detects triggering When information meets preset trigger condition, receive described transmitting terminal and utilize the second transmission parameter transmission after adjusting Screen data.

31. multi-screen interactive device according to claim 30, it is characterised in that when trigger message is for sending out The current occupation condition of sending end, and the current occupation condition of described transmitting terminal presets feelings less than second During condition, described multi-screen interactive device also includes:

7th receiver module, the energy that the described receiving terminal of inquiry sending for receiving described transmitting terminal is currently supported 5th inquiry message of force parameter information；

5th sending module, carries, for returning to described transmitting terminal, the ability ginseng that described receiving terminal is currently supported 5th inquiry response messages of number information so that described transmitting terminal can therefrom obtain described receiving terminal and currently prop up The ability parameter information held the ability parameter information currently supported based on described receiving terminal adjust described first and pass Defeated parameter.

32. multi-screen interaction methods according to claim 30, it is characterised in that when described trigger message During for current network conditions information, described multi-screen interactive device also includes:

8th receiver module, for receiving the first of the inquiry current network conditions information that described transmitting terminal sends Inquiry message；

6th sending module, for returning the first inquiry carrying current network conditions information to described transmitting terminal Response message so that described transmitting terminal can therefrom obtain current network conditions information.

33. multi-screen interaction methods according to claim 30, it is characterised in that when receiving terminal ability ginseng During number change, described multi-screen interactive device also includes:

7th sending module, the change for sending mark receiving terminal ability parameter change to described transmitting terminal disappears Breath；

9th receiver module, for receiving the inquiry institute sending after described transmitting terminal detects described change message State the second inquiry message of the ability parameter information that receiving terminal is currently supported；

8th sending module, carries, for returning to described transmitting terminal, the ability ginseng that described receiving terminal is currently supported Second inquiry response messages of number information so that described transmitting terminal can therefrom obtain described receiving terminal and currently prop up The ability parameter information held the ability parameter information currently supported according to described receiving terminal adjust described first and pass Defeated parameter.

34. multi-screen interactive device according to claim 30, it is characterised in that described multi-screen interactive fills Put and also include:

Second parameter determination module, for consulting to determine the energy that transmitting terminal and receiving terminal are supported jointly with transmitting terminal Force parameter information so that transmitting terminal can determine the first transmission according to the ability parameter information of described common support Parameter.

35. multi-screen interactive device according to claim 34, it is characterised in that described second parameter is true Cover half block includes:

Inquiry receiver module, the first energy that the described receiving terminal of inquiry sending for receiving described transmitting terminal is supported 3rd inquiry message of force parameter information；

Return module, carry, for returning to described transmitting terminal, the first ability parameter letter that described receiving terminal is supported 3rd inquiry response messages of breath so that the first ability parameter that transmitting terminal can be supported according to described receiving terminal The second ability parameter information that information and described transmitting terminal self are supported, determines that transmitting terminal and receiving terminal prop up jointly The ability parameter information held.

36. multi-screen interactive device according to claim 34, it is characterised in that described second parameter is true Cover half block includes:

Inquiry sending module, for sending, to transmitting terminal, the second ability parameter letter that the described transmitting terminal of inquiry is supported 4th inquiry message of breath；

Receive parsing module, for receive and parse through described transmitting terminal return carry described transmitting terminal support 4th inquiry response messages of the second ability parameter information, therefrom obtains the second ability that described transmitting terminal is supported Parameter information；

Second determination submodule, for the second ability parameter information supported according to described transmitting terminal with described connect The first ability parameter information that receiving end self is supported, determines what described transmitting terminal and described receiving terminal were supported jointly Ability parameter information the ability parameter information by described common support are sent to described transmitting terminal.