CN112866767B

CN112866767B - Screen projection control method and device, electronic equipment and storage medium

Info

Publication number: CN112866767B
Application number: CN202110096575.8A
Authority: CN
Inventors: 陈国庆
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2021-01-25
Filing date: 2021-01-25
Publication date: 2023-07-21
Anticipated expiration: 2041-01-25
Also published as: CN112866767A

Abstract

The embodiment of the invention provides a screen projection control method, a device, electronic equipment and a storage medium, wherein the screen projection control method is applied to a control end, the control end is in communication connection with a receiving end, and the method comprises the following steps: acquiring a plurality of operation instructions continuously input by a user on the control end; when the current communication environment is detected to be a weak network environment, converting the plurality of operation instructions into first operation instructions; the first operation instruction and the plurality of operation instructions have the same control function on the control end; and sending the first operation instruction to the receiving end. According to the scheme, the problem of overtime of the instruction when a user sends the operation instruction to the receiving end through the control end under the weak network environment can be solved.

Description

Screen projection control method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of internet applications, and in particular, to a screen projection control method, a device, an electronic apparatus, and a storage medium.

Background

At present, a control end such as a smart phone and a receiving end such as a smart television and a television box are generally connected in the same local area network, and control operation instructions are sent to the receiving end through the control end, so that functions such as screen throwing are realized.

However, the communication environment of the local area network may become a weak network environment, which is easily caused by the increase of the number of intelligent devices in the local area network. In a weak network environment, when a user sends an operation instruction to a receiving end through a control end, the problem of overtime instruction usually occurs, namely after the user sends the operation instruction to the receiving end through the control end, the response of the receiving end is delayed or no response is generated, so that the user is prompted to frequently send the operation instruction through the control end, and the operation of the receiving end may be out of control.

Disclosure of Invention

The embodiment of the invention aims to provide a screen projection control method, a screen projection control device, electronic equipment and a storage medium, so as to solve the problem of overtime of instructions when a user sends an operation instruction to a receiving end through a control end in a weak network environment. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a screen projection control method, which is applied to a control end, where the control end is communicatively connected to a receiving end, and the method includes:

acquiring a plurality of operation instructions continuously input by a user on the control end;

when the current communication environment is detected to be a weak network environment, converting the plurality of operation instructions into first operation instructions, wherein the first operation instructions and the plurality of operation instructions have the same control function on the control end;

And sending the first operation instruction to the receiving end.

Optionally, the types of the plurality of operation instructions are the same;

the converting the plurality of operation instructions into a first operation instruction includes:

screening at least one target operation instruction from the plurality of operation instructions, and performing adjustment quantity processing on at least one target operation instruction to obtain a first operation instruction;

wherein, the adjusting quantity processing for any target operation instruction comprises the following steps: adjusting the adjustment amount of the target operation instruction to be the sum of the adjustment amount of the target operation instruction and the first adjustment amount; for the first target operation instruction, the first adjustment amount is the sum of adjustment amounts of operation instructions before the target operation instruction, and for the rest target operation instructions, the first adjustment amount is the sum of adjustment amounts of operation instructions between the target operation instruction and the previous adjacent target operation instruction.

Optionally, after the receiving end sends the first operation instruction, the method further includes:

receiving target screen-throwing state information fed back by the receiving end based on the first operation instruction, and acquiring pseudo screen-throwing state information corresponding to the rest operation instructions except the target operation instruction;

Updating the screen throwing state of the control end according to the pseudo screen throwing state information and the target screen throwing state information;

the pseudo screen-throwing state information is fed back after simulating the second operation instruction corresponding to the residual operation instruction executed by the receiving end;

the determining process of the second operation instruction corresponding to any remaining operation instruction comprises the following steps: adjusting the adjustment quantity of the residual operation instruction to be the sum of the adjustment quantity of the residual operation instruction and the second adjustment quantity to obtain a second operation instruction corresponding to the residual operation instruction; for the first remaining operation instruction, the second adjustment amount is the sum of adjustment amounts of operation instructions before the remaining operation instruction, and for the remaining operation instruction, the second adjustment amount is the sum of adjustment amounts of operation instructions between the remaining operation instruction and the previous adjacent remaining operation instruction.

Optionally, the obtaining the pseudo screen projection state information corresponding to the remaining operation instructions except the target operation instruction includes:

generating pseudo screen throwing state information corresponding to the residual operation instructions except the target operation instruction through a preset peer-to-peer model; the peer-to-peer model is a code model generated based on target code content in the receiving end, wherein the target code content is used for converting the residual operation instruction into a second operation instruction and generating screen projection state information corresponding to the second operation instruction.

Optionally, when the current communication environment is detected to be a weak network environment, the selecting the target operation instruction from the plurality of operation instructions includes:

if the network quality of the current communication environment is higher than a preset network quality threshold, selecting a target operation instruction from the plurality of operation instructions according to a time interval determined by the maximum delay of the current local area network;

and if the network quality of the current communication environment is lower than a preset network quality threshold, selecting the latest acquired operation instruction from the plurality of operation instructions as a target operation instruction.

Optionally, before the step of updating the screen-throwing state of the control end according to the pseudo screen-throwing state information and the target screen-throwing state information, the method further includes:

correcting the pseudo screen-throwing state information according to the received target screen-throwing state information to obtain corrected pseudo screen-throwing state information;

the updating the screen-throwing state of the control end according to the pseudo screen-throwing state information and the target screen-throwing state information comprises the following steps:

and updating the screen throwing state of the control end according to the corrected pseudo screen throwing state information and the target screen throwing state information.

In a second aspect, an embodiment of the present invention provides a screen projection control device, which is applied to a control end, where the control end is communicatively connected to a receiving end, and the device includes:

the instruction acquisition module is used for acquiring a plurality of operation instructions continuously input by a user on the control end;

the first processing module is used for converting the plurality of operation instructions into first operation instructions when the current communication environment is detected to be a weak network environment, wherein the first operation instructions and the plurality of operation instructions have the same control function on the control end;

the instruction sending module is used for sending the first operation instruction to the receiving end.

Optionally, the types of the plurality of operation instructions are the same;

the first processing module is specifically configured to screen at least one target operation instruction from the plurality of operation instructions, and perform adjustment quantity processing on at least one target operation instruction to obtain a first operation instruction;

Optionally, the apparatus further includes:

the second processing module is used for receiving target screen-throwing state information fed back by the receiving end based on the first operation instruction after the receiving end sends the first operation instruction, and obtaining pseudo screen-throwing state information corresponding to the rest operation instructions except the target operation instruction;

the first updating module is used for updating the screen throwing state of the control end according to the pseudo screen throwing state information and the target screen throwing state information;

Optionally, the second processing module is specifically configured to generate, through a preset peer-to-peer model, pseudo screen-on status information corresponding to a remaining operation instruction other than the target operation instruction; the peer-to-peer model is a code model generated based on target code content in the receiving end, wherein the target code content is used for converting the residual operation instruction into a second operation instruction and generating screen projection state information corresponding to the second operation instruction.

Optionally, the first processing module is specifically configured to screen the target operation instruction from the plurality of operation instructions according to a time interval determined by a maximum delay of the current local area network if the network quality of the current communication environment is higher than a preset network quality threshold;

Optionally, the apparatus further includes:

the state correction module is used for correcting the pseudo screen-throwing state information according to the received target screen-throwing state information before the step of updating the screen-throwing state of the control end according to the pseudo screen-throwing state information and the target screen-throwing state information, so as to obtain corrected pseudo screen-throwing state information;

The first updating module is specifically configured to update the screen-throwing state of the control end according to the corrected pseudo screen-throwing state information and the target screen-throwing state information.

In a third aspect, an embodiment of the present invention further provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

and a processor, configured to implement the method steps described in the first aspect when executing the program stored in the memory.

In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, where a computer program is stored, where the computer program is executed by a processor to implement the method steps described in the first aspect.

In the scheme provided by the embodiment of the invention, a plurality of operation instructions continuously input by a user on the control end are obtained; when the current communication environment is detected to be a weak network environment, converting the plurality of operation instructions into first operation instructions, wherein the first operation instructions and the plurality of operation instructions have the same control function on the control end; sending the first operation instruction to the receiving end; the phenomenon of response delay caused by sending too many instructions under the condition of network congestion can be avoided, and the problem of overtime instruction when a user sends an operation instruction to a receiving end through a control end under the weak network environment is effectively solved.

Drawings

In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flowchart of a screen-projection control method according to an embodiment of the present invention;

FIG. 2 is a flowchart of another screen-projection control method according to an embodiment of the present invention;

FIG. 3 is a flowchart of another screen-projection control method according to an embodiment of the present invention;

fig. 4 is a schematic diagram of a working principle of a screen projection control method according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a screen projection control device according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Aiming at the problem of overtime instruction when a user sends an operation instruction to a receiving end through a control end in a weak network environment, the embodiment of the invention provides a screen throwing control method, a screen throwing control device, electronic equipment and a storage medium.

The following first describes a screen-projection control method provided by the embodiment of the invention.

The screen projection control method provided by the embodiment of the invention is applied to the control end, and the control end is in communication connection with the receiving end. The control end is typically an intelligent mobile device, such as a smart phone, a tablet computer, a smart watch, etc., and the receiving end may be a smart television, a box, a projector, etc. The control end and the receiving end can be connected through a local area network, and the local area network can be a wireless local area network, such as an indoor WIFI network, or a wired local area network. The control end sends an operation instruction carrying the adjustment quantity to the receiving end through the local area network, wherein the operation instruction can be instructions such as volume adjustment, video playing progress adjustment and the like.

The screen projection control method provided by the embodiment of the invention is applied to a control end, and the control end is in communication connection with a receiving end, as shown in fig. 1, and comprises the following steps:

s101, acquiring a plurality of operation instructions continuously input by a user on the control end.

S102, converting the plurality of operation instructions into a first operation instruction when the current communication environment is detected to be a weak network environment.

The first operation instruction and the plurality of operation instructions have the same control function on the control end.

S103, sending the first operation instruction to the receiving end.

The scheme provided by the embodiment of the invention can avoid the phenomenon of response delay caused by sending too many instructions under the condition of network congestion, and effectively solves the problem of overtime instruction when a user sends an operation instruction to a receiving end through a control end under the weak network environment.

Referring to fig. 1, a detailed description is given of a screen projection control method provided in an embodiment of the present invention, and as shown in fig. 1, the method may include the following steps:

When the control end is connected with the receiving end through the local area network, a user can send an operation instruction to the receiving end through control of the control end. When the user continuously operates, a plurality of continuous operation instructions are generated, and the control end can acquire the plurality of continuous operation instructions. The continuous operation instruction refers to an operation instruction of which the interval time between two adjacent operation instructions is smaller than the preset time; the size of the preset time can be set according to actual conditions.

The types of the plurality of operation instructions may be the same or different. For example, the plurality of operation instructions may be operation instructions for turning up the volume, and may also include operation instructions for turning up the volume and turning up the brightness.

It should be noted that, the current communication environment may be determined according to network delay, network jitter, and packet loss rate of the lan. Network delay, network jitter and packet loss rate are used as a set of QoS (Quality of Service ) indicators for evaluating the quality of a local area network, and can be obtained by sending heartbeat packets. The network delay is the average delay time, the network jitter is the difference between the maximum delay and the minimum delay, and the packet loss rate is the ratio of unreturned packets to transmitted packets, for example, the ratio of unreturned packets/10 in 10 heartbeat packets transmitted at intervals of 5 s. For example, when the network delay q1 is greater than 50ms, the network jitter q2 is greater than 50ms, and the packet loss rate q3 is greater than 0.1, the current communication environment is determined to be a weak network environment.

It will be appreciated that a plurality of consecutive operating instructions may be stored in the cache, and that the screened operating instruction may be read from the cache when the first operating instruction is required.

In addition, there are various ways of converting the plurality of operation instructions into the first operation instruction.

For example, in one implementation, the plurality of operation instructions may be directly converted to the first operation instruction. For example, when the user continuously presses the volume up key 5, that is, generates volume up operation instructions with 5 volume up units of 1, the control end may directly convert the 5 volume up operation instructions into a first operation instruction with a control function of "a+5", where a represents a control volume and +5 represents an increase of five unit volumes. Because the volume control can be realized only through one first operation instruction, the phenomenon of response delay caused by sending too many instructions under the condition of network congestion can be effectively avoided.

In another implementation manner, for a plurality of operation instructions with the same type, at least one target operation instruction may be screened from the plurality of operation instructions, and adjustment quantity processing may be performed on at least one target operation instruction to obtain a first operation instruction.

The method for selecting the target operation instruction from the plurality of operation instructions is various.

For example, an odd operation instruction may be selected from a plurality of operation instructions as a target operation instruction according to an odd or even classification; of course, an even number of operation instructions may be selected from a plurality of operation instructions as the target operation instruction. For example, six continuous operation instructions acquired by the control end are in turn Action0, action1, action2, action3, action4 and Action5, and then the operation instructions of Action1, action3 and Action5 of the count item can be screened out from the six operation instructions according to odd classification; of course, the even number of operation instructions, action2, action4 and Action6, may be screened out from the six operation instructions according to the even number classification.

For example, the target operation instruction may be selected from the plurality of operation instructions according to a preset time interval according to a time when the plurality of continuous operation instructions are acquired.

According to different screening modes, the number of target operation instructions obtained by screening is different. It will be appreciated that the number of target operating instructions is less than the number of the plurality of operating instructions and is at least one.

The adjustment amount processing of the target operation instruction is described below by way of example. For example, the acquired operation instructions are Action0, action1, action2, action3, action4, and Action5, and the adjustment amounts of these instructions are assumed to be +1. And if the screening results in target operation instructions of Action1 and Action5. Taking Action1 as an example, if Action1 is converted into Action1, the control amount of Action1 is the sum of the adjustment amounts of the Action1 and the operation instruction before the Action1, that is, the sum of the adjustment amount +1 of Action1 and the adjustment amount +1 of the operation instruction Action0 before the Action1, +1+1= +2. Taking Action5 as an example, if Action5 is converted into Action5, the control amount of Action5 is the sum of the adjustment amount of Action5 and the adjustment amounts of operation instructions Action2, action3 and Action4 between Action5 and Action1, namely the adjustment amount +1 of Action5 and the adjustment amount +1 of operation instruction Action2 between Action5 and Action2, the adjustment amount +1 of Action3 and the adjustment amount +1 of Action4, and +1+1+1+1= +4.

S103, sending the first operation instruction to the receiving end.

After the target operation instruction is obtained through screening, the control end can send the first operation instruction corresponding to the target operation instruction to the receiving end.

In the screen throwing process, after the receiving end receives the operation instruction sent by the control end, the screen throwing state can be adjusted according to the adjustment quantity carried by the operation instruction. After the adjustment is completed, the receiving end returns screen-throwing state information after the adjustment of the receiving end state to the control end; and the control end updates the screen-throwing state according to the received screen-throwing state information.

Corresponding to the operation instruction, the screen projection state information can be the current volume of the receiving end or the playing progress and the like. For example, the current volume of the receiving end (such as the smart television) is 15, the volume of the control end (such as the smart phone) is 15, the user wants to turn up the volume of the receiving end to 18, presses the volume adjustment key "+" of the control end to generate an operation command, and the control end sends the operation command for turning up the volume to the receiving end. After receiving and executing the operation instruction for turning up the volume transmitted by the local area network, the receiving end adjusts the volume to 18; and the receiving end returns the screen-throwing state information of the volume up of the receiving end to the control end, and the control end updates the volume screen-throwing state according to the screen-throwing state information of the volume up of the receiving end, namely the original volume screen-throwing state 15 is updated to be 18.

In addition, when the local area network is blocked in the weak network environment and the control end such as the smart phone is continuously controlled by the user to control the working state (such as volume and video playing progress adjustment) of the receiving end such as the smart television, the screen-throwing state of the control end with the screen-throwing function such as DLNA ((Digital Living Network Alliance, digital living network alliance) can be blocked or unresponsive, and for this situation, the embodiment of the invention provides a screen-throwing control method, as shown in fig. 2, the method comprises the following steps:

s201, a plurality of operation instructions continuously input by a user on the control end are obtained.

S202, when the current communication environment is detected to be a weak network environment, a target operation instruction is screened from the plurality of operation instructions, and adjustment quantity processing is carried out on the target operation instruction, so that a first operation instruction is obtained.

The adjusting quantity processing for the target operation instruction comprises the following steps: for each target operation instruction, adjusting the adjustment amount of a first operation instruction corresponding to the target operation instruction to be the sum of the adjustment amount of the target operation instruction and the first adjustment amount; wherein, for the first target operation instruction, the first adjustment amount is the sum of adjustment amounts of operation instructions before the target operation instruction, and for the rest target operation instructions, the first adjustment amount is the sum of adjustment amounts of operation instructions between the target operation instruction and the previous adjacent target operation instruction.

S203, the first operation instruction is sent to the receiving end.

In the embodiment of the present invention, steps S201 to S203 may be the same as those of the above embodiment, and will not be described herein.

S204, receiving target screen-throwing state information fed back by the receiving end based on the first operation instruction, and obtaining pseudo screen-throwing state information corresponding to the rest operation instructions except the target operation instruction.

It is understood that the adjustment amount processing manner of the remaining operation instruction is the same as that of the adjustment amount processing of the target operation instruction, and will not be described herein.

And for the target screen-throwing state, after the receiving end receives and executes the first operation instruction, returning target screen-throwing state information after the first operation instruction is executed to the control end. Taking the first operation instruction ACTION1 as an example, after the receiving end receives the instruction of the ACTION1, the receiving end executes adjustment +2, for example, increases the volume 15 before adjustment by 2 to adjust to 17, and returns the target screen-throwing state information with the volume of 17 to the control end after the receiving end completes adjustment.

For the pseudo screen-throwing state information, the second operation instruction corresponding to the rest operation instructions except the target operation instruction is not sent to the receiving end, but the pseudo screen-throwing state information corresponding to the second operation instruction is directly obtained. Taking the above operation instructions Action0, action1, action2, action3, action4, and Action5 as examples, the remaining operation instructions Action0, action2, action3, and Action4 are not sent to the receiving end, but for Action0, action2, action3, and Action4, second operation instructions Action0, action2, action3, and Action4 are obtained, and pseudo screen state information corresponding to the second operation instructions Action0, action2, action3, and Action4 is generated.

On the one hand, after receiving a target operation instruction sent by a local area network, a receiving end executes a first operation instruction corresponding to the target operation instruction, and returns screen-throwing state information after receiving end state adjustment to a control end; on the other hand, aiming at the residual operation instructions except the target operation instruction in the operation instructions, the control end acquires the pseudo screen throwing state information corresponding to the residual operation instructions.

It can be understood that the control end is connected with the receiving end through the local area network, when the current communication environment is a weak network environment, a target operation instruction is screened from a plurality of operation instructions generated by the acquired user operation, and a first operation instruction corresponding to the target operation instruction is sent to the receiving end, so that target screen-throwing state information returned by the receiving end is obtained; the second operation instruction corresponding to the residual operation instruction is not sent to the receiving end, but the pseudo screen throwing state information corresponding to the residual operation instruction is directly obtained; the control end updates the screen throwing state of the control end according to the target screen throwing state information corresponding to the target operation instruction and the pseudo screen throwing state information corresponding to the residual operation instruction.

By screening the target operation instructions, the number of the operation instructions can be reduced, and fewer operation instructions can avoid aggravating the blocking degree of the local area network, so that the probability of overtime of the operation instructions or return delay of screen throwing state information is reduced. In addition, by directly acquiring the pseudo screen throwing state information corresponding to the residual operation instructions except the target operation instruction, the second operation instruction corresponding to the residual operation instruction does not pass through the local area network, overtime or packet loss cannot occur due to larger network delay, but the continuous multiple operation instructions are ensured to correspond to the screen throwing state information, namely the continuous multiple operation instructions are all corresponding to response results.

In one embodiment, the following implementation manner may be adopted, where the screen-throwing state information fed back by the receiving end after executing the remaining operation instruction is simulated:

and generating pseudo screen throwing state information corresponding to the residual operation instructions except the target operation instruction through a preset peer-to-peer model.

The peer-to-peer model is a code model generated based on target code content in the receiving end, wherein the target code content is used for converting the residual operation instruction into a second operation instruction and generating screen projection state information corresponding to the second operation instruction. The receiving end can be simulated through the peer-to-peer model to generate screen-throwing state information corresponding to any operation instruction; and simulating and executing a second operation instruction corresponding to the residual operation instruction to obtain the pseudo screen projection state information corresponding to any residual operation instruction.

It should be noted that, the preset peer-to-peer model may be set at the control end, or may be set at the server end connected with the control end in a communication manner; of course, in order to improve the processing efficiency, in a specific application, a preset peer-to-peer model is preferably set at the control end.

S205, updating the screen throwing state of the control end according to the pseudo screen throwing state information and the target screen throwing state information.

After receiving the target screen-throwing state information and obtaining the pseudo screen-throwing state information, the control end can update the screen-throwing state of the control end by utilizing the pseudo screen-throwing state information and the target screen-throwing state information. For example, the control end receives six continuous control instructions, namely, action0, action1, action2, action3, action4 and Action5, wherein the Action1 and the Action5 are target operation instructions obtained through screening, and the Action0, the Action2, the Action3 and the Action4 are residual operation instructions; the target screen-throwing state information corresponding to the target operation instructions Action1 and Action5 is the target screen-throwing state 1 and the target screen-throwing state 5, and the pseudo screen-throwing state information corresponding to the remaining operation instructions Action0, action2, action3 and Action4 is the pseudo state 0, the pseudo state 2, the pseudo state 3 and the pseudo state 4. After the pseudo-screen-throwing state information of the pseudo state 0, the pseudo state 2, the pseudo state 3, the pseudo state 4, the target screen-throwing state 1 and the target screen-throwing state 5 are obtained, the screen-throwing state of the control end can be updated according to the pseudo state 0, the target screen-throwing state 1, the pseudo state 2, the pseudo state 3, the pseudo state 4 and the target screen-throwing state 5 in sequence.

According to the scheme provided by the embodiment of the invention, a plurality of target operations are screened from a plurality of operation instructions, the first operation instructions corresponding to the target operation instructions are sent to the receiving end through the local area network, compared with the plurality of operation instructions which are obtained, the number of the first operation instructions transmitted through the local area network is obviously reduced, the blocking degree of a local area network can be prevented from being increased, the phenomenon of response delay caused by sending too many instructions under the condition of network congestion can be avoided, and the problem of instruction overtime when a user sends the operation instructions to the receiving end through the control end under the weak network environment is effectively solved. In addition, the embodiment of the invention can also reduce the probability of overtime of an operation instruction or return delay of screen throwing state information; for the residual operation instructions except the target operation instruction, the pseudo screen throwing state information corresponding to the residual operation instruction is directly obtained, and because the second operation instruction corresponding to the residual operation instruction is not transmitted through the local area network, overtime or packet loss cannot occur due to larger network delay; and the screen-throwing state of the control end is updated by directly acquiring the corresponding pseudo screen-throwing state information, so that the continuity of the screen-throwing state of the control end aiming at the screen-throwing operation of the user can be ensured. Therefore, through the scheme, the problem that the screen-throwing state of the control end is blocked or not responded can be solved, so that the operation experience of a user on the control end is smoother, and the screen-throwing operation experience of the user is effectively improved.

Considering that the second operation instruction corresponding to the remaining operation instruction is not actually sent to the receiving end through the local area network, the receiving end does not actually execute the second operation instruction corresponding to the remaining operation instruction, so that the pseudo screen-throwing state information corresponding to the remaining operation instruction is not the actual screen-throwing state information returned after the receiving end executes the second operation instruction corresponding to the remaining operation instruction, so that in order to improve the matching degree of the pseudo screen-throwing state information and the actual screen-throwing state information returned after the receiving end actually executes the second operation instruction corresponding to the remaining operation instruction, the continuity of screen-throwing state update of the control end is further ensured, and before the step of updating the screen-throwing state of the control end according to the pseudo screen-throwing state information and the target screen-throwing state information, the screen-throwing control method provided by the embodiment of the invention further comprises the following steps:

and correcting the pseudo-screen-throwing state information according to the received target screen-throwing state information to obtain corrected pseudo-screen-throwing state information.

There are various ways to correct the pseudo-screen-throwing state information. For example, in one implementation, a linear interpolation method may be used to correct the pseudo-screen-projection state information by using the target screen-projection state information returned by the actually executed target operation instruction. For example, the control end receives six consecutive control instructions, namely, action0, action1, action2, action3, action4 and Action5, wherein, action1 and Action5 are the target operation instructions obtained by screening, and Action0, action2, action3 and Action4 are the rest operation instructions. The second operation instructions corresponding to the Action1 and the Action5 are the Action1 and the Action5, and the target screen-throwing state information obtained by the receiving end executing the second operation instructions of the Action1 and the Action5 is the target screen-throwing state 1 and the target screen-throwing state 5. The second operation instructions corresponding to the Action0, the Action2, the Action3 and the Action4 are Action0, action2, action3 and Action4, and the pseudo screen-throwing state information generated by the control end for simulating and executing the second operation instructions of Action0, action2, action3 and Action4 is pseudo state 0, pseudo state 2, pseudo state 3 and pseudo state 4. Before the screen projection states of the control end are updated by using the pseudo state 0, the target screen projection state 1, the pseudo state 2, the pseudo state 3, the pseudo state 4 and the target screen projection state 5, the linear difference correction can be carried out on the pseudo state 0 and the pseudo state 4 by using the target screen projection state 1 and the target screen projection state 5, namely, interpolation corresponding to the pseudo state 0 and the pseudo state 4 is calculated according to a first-order polynomial generated by the target screen projection state 1 and the target screen projection state 5. And obtaining corrected pseudo-state zero and pseudo-state four. After the corrected pseudo screen-throwing state information is obtained, the screen-throwing state of the control end can be updated according to the corrected pseudo state zero, the target screen-throwing state 1, the pseudo state 2, the pseudo state 3, the pseudo state four and the target screen-throwing state 5.

In this embodiment, the target screen-throwing state information actually returned by the target operation instruction corrects the directly acquired pseudo screen-throwing state information to obtain corrected pseudo screen-throwing state information, and updates the control state according to the corrected pseudo screen-throwing state information and the target screen-throwing state information, so that the continuity of the control end screen-throwing state update can be effectively ensured, for example, the pseudo screen-throwing state information generated by the peer-to-peer model is prevented from being abnormal, the response result of the user in the control end operation is smoother, the smoothness of the user operation control end can be further improved, and the user screen-throwing operation experience is improved.

In order to enable the operation experience of the user on the control end to be smoother, the screen-throwing operation experience of the user is further improved, as shown in fig. 3, another screen-throwing control method provided by the embodiment of the invention can include the following steps:

s301, a plurality of operation instructions continuously input by a user on the control end are acquired.

In the embodiment of the present invention, the step S301 may be the same as the step S101 in the above embodiment, and will not be described herein.

S302, if the network quality of the current communication environment is higher than a preset network quality threshold, selecting a target operation instruction from the plurality of operation instructions according to a time interval determined by the maximum delay of the current local area network, and performing adjustment quantity processing on the target operation instruction to obtain a first operation instruction.

The control end can determine whether the current local area network state is higher than a preset network quality threshold according to network delay, network jitter and packet loss rate of the local area network. For example, when the network delay of the local area network is 50ms > q1 > 120ms, the network jitter is 50ms > q2 > 100ms, and the packet loss rate is 0.1 > q3 > 0.3, it may be determined that the network quality of the current communication environment is higher than the preset network quality threshold.

Specifically, if the network quality of the current communication environment is higher than a preset network quality threshold, selecting the target operation instruction from the plurality of operation instructions according to a time interval determined by the maximum delay of the current local area network may include the following steps:

step 1, if the network quality of the current communication environment is higher than a preset network quality threshold, determining a time interval for screening an operation instruction according to the maximum delay of the current local area network;

and 2, screening target operation instructions from the plurality of operation instructions by utilizing the time interval.

It should be noted that, in the weak network environment, if the network quality of the current communication environment is higher than the preset network quality threshold, the current lan may be considered to have a blocking condition, but the blocking condition is not particularly serious. At this time, when the mode of screening the target operation instruction from the plurality of operation instructions according to the preset time interval is adopted, in order to further reduce the probability of overtime of the operation instruction or return delay of the screen throwing state information, the target operation instruction can be screened from the plurality of operation instructions based on the preset time interval determined by the maximum delay of the local area network.

For example, taking six continuous operation instructions, namely, action0, action1, action2, action3, action4 and Action5, obtained by the control end as an example, it is assumed that the time of the six continuous operation instructions, namely, action0, action1, action2, action3, action4 and Action5, obtained by the control end is 0ms, 60ms, 90ms, 140ms, 180ms and 210ms in sequence; if the maximum delay of the local area network is 60ms, the target operation instructions, namely Action1 and Action4, can be directly obtained by screening from six continuous operation instructions with 60ms as a preset time interval. Of course, the target operation instructions may be screened by correction value correction (e.g. 60ms+10ms) based on 60ms of the maximum delay of the local area network, and if the corrected time interval is a predetermined time interval, the target operation instructions, namely, action2 and Action5, are screened. The screening mode based on the local area network maximum delay can accurately control the number of target operation instructions sent to the receiving end, so that the sent target operation instructions are matched with the local area network conditions, the probability of overtime of the operation instructions or delayed return of screen throwing state information is effectively reduced, the operation experience of a user on the control end is smoother, and the screen throwing operation experience of the user is further improved.

S303, if the network quality of the current communication environment is lower than a preset network quality threshold, selecting one operation instruction acquired latest from the plurality of operation instructions as a target operation instruction, and performing adjustment quantity processing on the target operation instruction to obtain a first operation instruction.

For another example, when the network delay q1 of the local area network is greater than 120ms, the network jitter q2 is greater than 100ms, and the packet loss rate q3 is greater than 0.3, it can be determined that the network quality of the current communication environment is lower than a preset network quality threshold.

It should be noted that, if the network quality of the current communication environment is lower than the preset network quality threshold, it may be considered that there is a particularly serious blocking in the current lan, and since the operation command sent to the receiving end is necessarily delayed, in this case, the blocking degree of the lan is only emphasized by screening the plurality of target operation commands, so that it is not necessary to screen the plurality of target operation commands. At this time, only one operation instruction which is acquired latest is selected from the plurality of operation instructions as a target operation instruction.

The manner of performing adjustment processing on the target operation instruction is the same as the processing manner in step S202 in the foregoing embodiment, and will not be described herein.

S304, the first operation instruction is sent to the receiving end.

S305, receiving target screen-throwing state information fed back by the receiving end based on the first operation instruction, and obtaining pseudo screen-throwing state information corresponding to the rest operation instructions except the target operation instruction.

The pseudo screen-throwing state information is fed back after simulating the second operation instruction corresponding to the residual operation instruction executed by the receiving end.

The second operation instruction is obtained by performing adjustment quantity processing on the remaining operation instructions; the adjusting quantity processing of the residual operation instruction comprises the following steps: for each remaining operation instruction, adjusting the adjustment amount of the second operation instruction corresponding to the remaining operation instruction to be the sum of the adjustment amount of the remaining operation instruction and the second adjustment amount; for the first remaining operation instruction, the second adjustment amount is the sum of adjustment amounts of the remaining operation instruction and operation instructions preceding the remaining operation instruction, and for the remaining operation instruction, the second adjustment amount is the sum of adjustment amounts of operation instructions between the remaining operation instruction and the preceding adjacent remaining operation instruction.

S306, updating the screen throwing state of the control end according to the pseudo screen throwing state information and the target screen throwing state information.

In the embodiment of the present invention, steps S304 to S306 may be the same as steps S203 to S205 in the above embodiment, and will not be described herein.

When the current communication environment is a weak network environment, the problem of overtime instruction and the problem of blocking or unresponsiveness of the screen throwing state of the control end when a user sends an operation instruction to the receiving end through the control end in the weak network environment can be effectively solved through the embodiment of the invention. In addition, when the current communication environment is a non-weak network environment, the screen projection control method provided by the embodiment of the invention further comprises the following steps after a plurality of continuous operation instructions are acquired:

step 1, if the current communication environment is a non-weak network environment, a plurality of operation instructions are sent to a receiving end.

Whether the current local area network state is a non-weak network environment can be determined according to the network delay, the network jitter and the packet loss rate of the local area network. For example, when the network delay q1 is less than 50ms, the network jitter q2 is less than 50ms, and the packet loss rate q3 is less than 0.1, it may be determined that the current communication environment is a non-weak network environment.

When the current communication environment is a non-weak network environment, the current local area network can be considered to be free from blocking, so that the acquired operation instructions can be directly sent to the receiving end.

And step 2, receiving screen-throwing state information fed back by the receiving end based on a plurality of operation instructions.

The receiving end executes a plurality of operation instructions and returns screen-throwing state information, and the control end can obtain the screen-throwing state information.

And step 3, updating the screen-throwing state of the control end according to the screen-throwing state information.

After receiving the screen-throwing state information, the control end can update the screen-throwing state of the control end by using the screen-throwing state information.

By the method, when the current communication environment is a non-weak network environment, screen throwing control can be conveniently realized.

In order to facilitate understanding of the solution of the foregoing embodiments of the present application, the working principle of the present application will be briefly described with reference to fig. 4.

As shown in fig. 4, the C-terminal is a transmitting terminal, and the R-terminal is a receiving terminal. The C end is provided with a DLNA service module, an intranet Qos calculation module and a screen throwing control device; the DLNA service module is used for realizing the screen throwing function of the C end; the intranet Qos calculation module is used for monitoring the current local area network state; the screen-projection control device is used for realizing the screen-projection control method in the embodiment of the invention, and specifically:

after the C terminal acquires a plurality of continuous operation instructions of Action0, action1, action2, action3, action4 and Action5, when the current local area network state monitored by the intranet Qos calculation module is Q1, namely when the current communication environment is a non-weak network environment, the C terminal directly transmits the plurality of operation instructions to the R terminal; the R end executes the operation instructions and feeds back screen throwing state information after the execution instructions to the C end; and the C-terminal receives the screen-throwing state information and updates the screen-throwing state according to the screen-throwing state information.

When the current local area network state monitored by the intranet Qos calculation module is Q2 or Q3, that is, when the current communication environment is a weak network environment, caching a plurality of operation instructions, namely, action0, action1, action2, action3, action4 and Action5, into an instruction cache queue. When the current local area network state is Q2, namely the network quality of the current communication environment is higher than a preset network quality threshold, screening target operation instructions Action0, action2, action4 and Action5 from a plurality of operation instructions at a preset time interval T, sending first operation instructions Action0, action2, action4 and Action5 corresponding to the target operation instructions to an R end, executing the plurality of first operation instruction operation instructions by the R end, and feeding back target screen throwing state information after executing the instructions to a C end; the rest operation instructions, action1 and Action3, directly generate pseudo-screen-throwing state information through a peer-to-peer model; the C-terminal receives the target screen-throwing state information, corrects the pseudo screen-throwing state information through linear interpolation according to the target screen-throwing state information, and obtains corrected pseudo screen-throwing state information; and finally updating the screen-throwing state according to the target screen-throwing state information and the corrected pseudo screen-throwing state information. When the current local area network state is Q3, namely the network quality of the current communication environment is lower than a preset network quality threshold, selecting one operation instruction Action5 acquired latest from a plurality of operation instructions as a target operation instruction, sending a second operation instruction Action5 corresponding to the target operation instruction to an R end, executing the second operation instruction Action5 by the R end, and feeding back target screen throwing state information after executing the instruction to a C end; referring to the dotted arrow in FIG. 3, the remaining operation instructions, action0, action1, action2, action3, action4, generate pseudo-screen-throwing status information directly through the peer-to-peer model; the C-terminal receives the target screen-throwing state information, corrects the pseudo screen-throwing state information through linear interpolation according to the target screen-throwing state information, and obtains corrected pseudo screen-throwing state information; and finally updating the screen-throwing state according to the target screen-throwing state information and the corrected pseudo screen-throwing state information.

Corresponding to the above method embodiment, as shown in fig. 5, an embodiment of the present invention further provides a screen projection control device, which is applied to a control end, where the control end is communicatively connected to a receiving end, and the device includes:

an instruction acquisition module 501, configured to acquire a plurality of operation instructions continuously input by a user on the control end;

the first processing module 502 is configured to convert the plurality of operation instructions into a first operation instruction when the current communication environment is detected to be a weak network environment, where the first operation instruction and the plurality of operation instructions have the same control function on the control end;

an instruction sending module 503, configured to send the first operation instruction to the receiving end.

Optionally, the types of the plurality of operation instructions are the same;

the first processing module 502 specifically screens at least one target operation instruction from the plurality of operation instructions, and performs adjustment quantity processing on at least one target operation instruction to obtain a first operation instruction;

Optionally, the apparatus further includes:

Optionally, the first processing module 502 is specifically configured to screen the target operation instruction from the plurality of operation instructions according to a time interval determined by a maximum delay of the current local area network if the network quality of the current communication environment is higher than a preset network quality threshold;

Optionally, the apparatus further includes:

As shown in fig. 6, the embodiment of the present invention further provides an electronic device, which includes a processor 601, a communication interface 602, a memory 603, and a communication bus 604, wherein the processor 601, the communication interface 602, and the memory 603 perform communication with each other through the communication bus 604,

a memory 603 for storing a computer program;

the processor 601 is configured to implement any one of the screen projection control methods according to the above embodiments when executing the program stored in the memory 603.

The communication bus mentioned by the above terminal may be a peripheral component interconnect standard (Peripheral Component Interconnect, abbreviated as PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, abbreviated as EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.

The communication interface is used for communication between the terminal and other devices.

The memory may include random access memory (Random Access Memory, RAM) or non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processing, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

In yet another embodiment of the present invention, a computer readable storage medium is provided, in which a computer program is stored, which when executed by a processor, implements a screen projection control method according to any one of the above embodiments.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present invention are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.) means from one website, computer, server, or data center. Computer readable storage media can be any available media that can be accessed by a computer or data storage devices, such as servers, data centers, etc., that contain an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.

In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments in part.

The foregoing is merely illustrative of the preferred embodiments of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. The screen projection control method is characterized by being applied to a control end, wherein the control end is in communication connection with a receiving end, and the method comprises the following steps:

acquiring a plurality of operation instructions continuously input by a user on the control end; the plurality of continuously input operation instructions refer to operation instructions of which the interval time between two adjacent operation instructions is smaller than the preset time;

and sending the first operation instruction to the receiving end.

2. The method of claim 1, wherein the plurality of operation instructions are of the same type;

3. The method of claim 2, wherein after sending the first operation instruction to the receiving end, the method further comprises:

4. The method according to claim 3, wherein the obtaining pseudo-screen status information corresponding to the remaining operation instructions except the target operation instruction includes:

5. The method according to any one of claims 2 to 4, wherein when detecting that the current communication environment is a weak network environment, selecting a target operation instruction from the plurality of operation instructions includes:

6. The method according to claim 3 or 4, wherein before the step of updating the screen-throwing status of the control end according to the pseudo-throwing status information and the target throwing status information, the method further comprises:

7. A screen projection control device, characterized by being applied to a control end, said control end being communicatively connected to a receiving end, said device comprising:

the instruction acquisition module is used for acquiring a plurality of operation instructions continuously input by a user on the control end; the plurality of continuously input operation instructions refer to operation instructions of which the interval time between two adjacent operation instructions is smaller than the preset time;

8. The apparatus of claim 7, wherein the plurality of operation instructions are of a same type;

9. The apparatus of claim 8, wherein the apparatus further comprises:

the second processing module is used for receiving target screen-throwing state information fed back by the receiving end based on the first operation instruction after the first operation instruction is sent to the receiving end, and obtaining pseudo screen-throwing state information corresponding to the rest operation instructions except the target operation instruction;

10. The apparatus according to claim 9, wherein:

the second processing module is specifically configured to generate pseudo screen-throwing status information corresponding to the remaining operation instructions except the target operation instruction through a preset peer-to-peer model; the peer-to-peer model is a code model generated based on target code content in the receiving end, wherein the target code content is used for converting the residual operation instruction into a second operation instruction and generating screen projection state information corresponding to the second operation instruction.

11. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

A memory for storing a computer program;

a processor for carrying out the method steps of any one of claims 1-6 when executing a program stored on a memory.

12. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored therein a computer program which, when executed by a processor, implements the method steps of any of claims 1-6.