CN112637672A

CN112637672A - Screen projection method, screen projection receiving terminal and screen projection sending terminal

Info

Publication number: CN112637672A
Application number: CN202011462465.0A
Authority: CN
Inventors: 李凌; 陈锡华
Original assignee: Shenzhen Happycast Technology Co Ltd
Current assignee: Shenzhen Happycast Technology Co Ltd
Priority date: 2020-12-11
Filing date: 2020-12-11
Publication date: 2021-04-09

Abstract

The invention discloses a screen projection method, a screen projection receiving terminal and a screen projection sending terminal, wherein the method comprises the following steps: acquiring at least one video playing window and the window layout of the at least one video playing window; sending the residual memory value to a screen projection sending terminal so that the screen projection sending terminal adjusts the resolution of the video to be played according to the residual memory value and takes the adjusted video to be played as the video to be projected; receiving videos to be launched sent by a screen launching sending terminal, and obtaining the number of the videos to be launched; selecting n video playing windows from at least one video playing window according to the number of the videos to be launched, and respectively playing the videos to be launched according to the window layout corresponding to the n video playing windows, wherein n is larger than or equal to 1 and is equal to the number of the videos to be launched. The invention can realize the simultaneous playing of a plurality of videos to be launched, achieves the function of multi-path screen projection, meets the application scene of multi-person screen projection, and greatly increases the application range of screen projection.

Description

Screen projection method, screen projection receiving terminal and screen projection sending terminal

Technical Field

The invention relates to the technical field of screen projection, in particular to a screen projection method, a screen projection receiving terminal and a screen projection sending terminal.

Background

With the rapid development of the internet technology, screen projection application software is more and more, screen projection is widely applied to life and work of people, and great convenience is brought to daily life and work of people; for example, the method is applied to a family scene, and a video on a mobile phone is projected to a television for playing.

However, when a device is projected, only one screen projection is often performed, that is, only one screen projection media stream sent by one terminal can be received, so that the current screen projection method cannot meet the requirements of multiple persons for screen projection, such as meeting room scenes and/or teaching scenes, and the application range of screen projection is greatly limited; therefore, how to realize multi-projection screen becomes a problem to be solved urgently.

Disclosure of Invention

In order to solve the problem that the conventional screen projection method can only project one screen and cannot project multiple screens, the invention aims to provide a screen projection method, a screen projection receiving terminal and a screen projection sending terminal which can simultaneously project multiple screens and meet the requirement of a scene of multiple screen projection.

In a first aspect, the present invention provides a screen projection method, including:

the method comprises the steps that a screen projection receiving terminal obtains at least one video playing window and window layout of the at least one video playing window, wherein each video playing window in the at least one video playing window is any region on a screen projection screen, the window layout is the arrangement position of each video playing window on the screen projection screen, and the video playing windows with different numbers at least correspond to one window layout;

the method comprises the steps that a screen projection receiving terminal sends a residual memory value to a screen projection sending terminal, so that the screen projection sending terminal adjusts the resolution ratio of a video to be played according to the residual memory value and takes the adjusted video to be played as the video to be projected, wherein the residual memory value is used for representing a processor memory value occupied by the screen projection receiving terminal when the projected video is decoded and rendered, and the projected video is obtained by the screen projection receiving terminal before the video to be projected is received;

receiving the residual memory value sent by the screen projection receiving terminal by the screen projection sending terminal;

the screen projection sending terminal adjusts the resolution of the video to be played according to the residual memory value;

the screen throwing sending terminal takes the adjusted video to be played as the video to be thrown;

the screen projection sending terminal sends the video to be projected to a screen projection receiving terminal;

the screen projection receiving terminal receives the videos to be projected sent by the screen projection sending terminal and obtains the number of the videos to be projected;

and the screen projection receiving terminal selects n video playing windows from the at least one video playing window according to the number of the videos to be projected, and respectively plays the videos to be projected according to the window layout corresponding to the n video playing windows, wherein n is more than or equal to 1 and is equal to the number of the videos to be projected.

Based on the disclosure, the invention firstly sets at least one video playing window and the corresponding window layout on the screen projection receiving terminal, so as to use the corresponding video playing window and the corresponding window layout as the playing areas of a plurality of subsequent videos to be projected, thereby realizing multi-path screen projection.

Secondly, the residual memory value is sent to the screen projection sending terminal, so that the screen projection sending terminal adjusts the resolution of the video to be played according to the residual memory value and takes the adjusted video to be played as the video to be projected; the essence is as follows: the method is equivalent to performing resolution processing on an original video, and selecting the resolution adaptive to the residual memory value, so that the best delivery effect can be achieved, and the problem that the screen cannot be delivered due to insufficient processing capacity of a screen delivery receiving terminal can be solved.

Finally, after receiving the videos to be launched sent by each screen launching sending terminal, the invention can select the video playing windows with the same number as the videos from at least one video playing window and the corresponding window layout thereof as the playing areas and the playing layouts of the videos to be launched according to the number of the videos to be launched, namely, each window correspondingly plays one video to be launched, thereby realizing the simultaneous playing of a plurality of videos to be launched (if the number of the videos to be launched is 2, 2 video playing windows and the window layout corresponding to 2 windows are selected).

Through the design, the multi-channel screen projection system can play a plurality of videos to be projected at the same time, achieves the function of multi-channel screen projection, meets the application scene of multi-user screen projection, and greatly increases the screen projection application range.

In one possible design, the screen projection sending terminal adjusts the resolution of the video to be played according to the remaining memory value, and the method comprises the following steps:

the screen projection sending terminal acquires the current resolution of the video to be played;

the screen projection sending terminal obtains a processing memory value of the video to be played according to the current resolution, wherein the processing memory value is a processor memory value occupied by the screen projection receiving terminal for decoding and rendering the video to be played under the current resolution;

judging whether the processing memory value is larger than the residual memory value or not by the screen projection sending terminal;

and if so, reducing the resolution of the video to be played.

Based on the disclosure, the invention discloses a specific method for adjusting the resolution of a video to be played, namely obtaining the memory value occupied by the screen projection receiving terminal for decoding and rendering the video with the current resolution according to the current resolution of the video to be played, comparing the memory value with the residual memory value, if the memory value is larger than the residual memory value, indicating that the screen projection receiving terminal cannot process the video with the resolution (namely, the screen projection receiving terminal does not have enough computing capability for decoding and rendering the video), and at the moment, the resolution needs to be reduced to meet the processing capability of the screen projection receiving terminal; through the design, the resolution of the video to be launched can be adjusted in real time according to the processing capacity of the screen launching receiving terminal, so that the launching requirements of videos with different resolutions can be met, and the optimal screen launching effect can be achieved.

In one possible design, the method further includes:

the screen projection receiving terminal sends the window layout corresponding to the n video playing windows to the screen projection sending terminal corresponding to the video to be projected;

the screen projection sending terminal receives the window layout sent by the screen projection receiving terminal;

a user of the screen projection sending terminal adjusts the arrangement positions of the n video playing windows according to the window layout to obtain an adjusted window layout;

the screen projection sending terminal sends the adjusted window layout to the screen projection receiving terminal;

and the screen projection receiving terminal receives the adjusted window layout sent by the screen projection sending terminal and adjusts the arrangement positions of the n video playing windows according to the adjusted window layout.

Based on the disclosure, the window layout corresponding to n video playing windows is sent to the screen projection sending terminal, which is equivalent to sending the layout of the video window being played to the user terminal; through the design, the user can directly adjust the window layout on the screen projection sending terminal, and the use convenience is greatly improved.

In one possible design, the method further includes:

the screen projection receiving terminal detects whether the size of each video playing window in the n video playing windows changes or not;

if so, the screen projection receiving terminal acquires the width and the height of the video playing window after the change;

the screen projection receiving terminal sends the width and the height to a target terminal;

the screen projection sending terminal receives the width and the height, and adjusts the resolution of the target video according to the width and the height to obtain an adjusted target video, wherein the target terminal is a screen projection sending terminal corresponding to the changed video playing window, and the target video is a video to be projected and played in the changed video playing window;

the screen projection sending terminal sends the adjusted target video to a screen projection receiving terminal;

the screen projection receiving terminal receives the adjusted target video sent by the target terminal;

and the screen projection receiving terminal plays the adjusted target video in the changed video playing window.

Based on the disclosure, when it is detected that the size of the video playing window changes, the width and the height of the changed window can be sent to the corresponding screen projecting sending terminal, so that the corresponding screen projecting sending terminal adjusts the resolution of the target video according to the width and the height, that is, the resolution of the target video is adapted to the changed window, and the playing definition of the target video is ensured.

In one possible design, the method further includes:

the screen projection receiving terminal detects whether any one of the n video playing windows is shielded by the other video playing windows;

if yes, the screen projection receiving terminal sends a stop instruction to a screen projection sending terminal corresponding to any video playing window;

and the screen projection sending terminal receives the stop instruction and suspends the sending of the video to be projected according to the stop instruction.

Based on the disclosure, the invention discloses that when the window being played is blocked, a stop instruction can be sent to the screen projection sending terminal corresponding to the blocked window so as to stop sending the video of the playing window. Through the design, resources can be saved, and the resource waste of the screen projection receiving terminal is avoided.

In a second aspect, the present invention provides a screen projection device, taking the screen projection device as a screen projection receiving terminal as an example, including: the device comprises a first acquisition unit, a first sending unit, a first receiving unit and a playing unit;

the first obtaining unit is configured to obtain at least one video playing window and a window layout of the at least one video playing window, where each video playing window in the at least one video playing window is an arbitrary region on a screen projection screen, the window layout is an arrangement position of each video playing window on the screen projection screen, and different numbers of video playing windows at least correspond to one window layout;

the first sending unit is used for sending a residual memory value to a screen-casting sending terminal so that the screen-casting sending terminal adjusts the resolution of a video to be played according to the residual memory value and takes the adjusted video to be played as a video to be launched, wherein the residual memory value is used for representing a processor memory value occupied by a screen-casting receiving terminal when the launched video is decoded and rendered, and the launched video is a video acquired by the screen-casting receiving terminal before the video to be launched is received;

the first receiving unit is used for acquiring videos to be launched sent by the screen launching sending terminal and acquiring the number of the videos to be launched;

the playing unit is used for selecting n video playing windows from the at least one video playing window according to the number of the videos to be launched, and respectively playing the videos to be launched according to the window layout corresponding to the n video playing windows, wherein n is larger than or equal to 1 and is equal to the number of the videos to be launched.

In one possible design, the screen projection receiving terminal further includes: a layout adjustment unit;

the first sending unit is further configured to send the window layout corresponding to the n video playing windows to a screen casting sending terminal corresponding to the video to be cast, so that a user of the screen casting sending terminal adjusts the arrangement positions of the n video playing windows according to the window layout to obtain an adjusted window layout;

the first receiving unit is further configured to receive the adjusted window layout sent by the screen-casting sending terminal;

and the layout adjusting unit is used for adjusting the arrangement positions of the n video playing windows according to the adjusted window layout.

In one possible design, the screen projection receiving terminal further includes: a detection unit and a window size acquisition unit;

the detection unit is used for detecting whether the size of each video playing window in the n video playing windows changes or not;

the window size obtaining unit is configured to obtain the width and height of each video playing window after change when the detecting unit detects that the size of each video playing window in the n video playing windows changes;

the first sending unit is further configured to send the width and the height to a target terminal, so that the target terminal adjusts the resolution of a target video according to the width and the height to obtain an adjusted target video, where the target terminal is a screen-casting sending terminal corresponding to the changed video playing window, and the target video is a video to be cast played in the changed video playing window;

the first receiving unit is configured to receive the adjusted target video sent by the target terminal;

the playing unit is further configured to play the adjusted target video in the changed video playing window.

In one possible design;

the detection unit is further configured to detect whether any one of the n video playing windows is blocked by the other video playing windows;

the first sending unit is further configured to send a stop instruction to the screen-casting sending terminal corresponding to any one of the n video playing windows when the detecting unit detects that any one of the n video playing windows is blocked by the other video playing windows, so that the screen-casting sending terminal corresponding to any one of the n video playing windows stops sending the video to be cast according to the stop instruction.

In a third aspect, the present invention provides another screen projection device, taking the screen projection device as a screen projection sending terminal as an example, including: a second receiving unit, a resolution adjusting unit and a second sending unit;

the second receiving unit is used for receiving the residual memory value sent by the screen projection receiving terminal;

the resolution adjusting unit is used for adjusting the resolution of the video to be played according to the residual memory value;

the resolution adjusting unit is also used for taking the adjusted video to be played as the video to be launched;

the second sending unit is configured to send the video to be launched to the screen-casting receiving terminal, so that the screen-casting receiving terminal selects n video playing windows from at least one video playing window, and plays the video to be launched according to window layouts corresponding to the n video playing windows, respectively.

In one possible design;

the resolution adjusting unit is used for acquiring the current resolution of the video to be played;

the resolution adjusting unit is used for obtaining a processing memory value of the video to be played according to the current resolution, wherein the processing memory value is a processor memory value occupied by the screen projection receiving terminal for decoding and rendering the video to be played under the current resolution;

the resolution adjusting unit is used for judging whether the processing memory value is larger than the residual memory value or not, and reducing the resolution of the video to be played when the processing memory value is judged to be larger than the residual memory value.

In a fourth aspect, the present invention provides a computer main device, including a memory, a processor and a transceiver, which are sequentially connected in communication, wherein the memory is used for storing a computer program, the transceiver is used for sending and receiving messages, and the processor is used for reading the computer program and executing the screen projection method as designed in any one of the first aspect, the second aspect, the first aspect or the second aspect.

In a fifth aspect, the present invention provides a computer-readable storage medium having stored thereon instructions which, when executed on a computer, perform the screen projection method as any one of the first, second, first or second aspects may be designed.

In a sixth aspect, the present invention provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of projecting a screen as may be devised in any one of the first, second, first or second aspects.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a screen projection system provided by the present invention.

Fig. 2 is a schematic flow chart of a screen projection method provided by the present invention.

Fig. 3 shows two window layouts corresponding to the case where the number of video playing windows provided by the present invention is 2.

Fig. 4 shows two window layouts corresponding to the case where the number of video playing windows provided by the present invention is 3.

Fig. 5 is a schematic diagram of a video playing window provided by the present invention when being blocked.

Fig. 6 is a schematic structural diagram of a screen projection receiving terminal provided by the present invention.

Fig. 7 is a schematic structural diagram of a screen projection sending terminal provided by the present invention.

Fig. 8 is a schematic structural diagram of a computer main device provided by the present invention.

Detailed Description

The invention is further described with reference to the following figures and specific embodiments. It should be noted that the following examples are provided to aid understanding of the present invention, but are not intended to limit the present invention. Specific structural and functional details disclosed herein are merely illustrative of example embodiments of the invention. This invention may, however, be embodied in many alternate forms and should not be construed as limited to the embodiments set forth herein.

It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of example embodiments of the present invention.

It should be understood that, for the term "and/or" as may appear herein, it is merely an associative relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, B exists alone, and A and B exist at the same time; for the term "/and" as may appear herein, which describes another associative object relationship, it means that two relationships may exist, e.g., a/and B, may mean: a exists independently, and A and B exist independently; in addition, for the character "/" that may appear herein, it generally means that the former and latter associated objects are in an "or" relationship.

It will be understood that when an element is referred to herein as being "connected," "connected," or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. Conversely, if a unit is referred to herein as being "directly connected" or "directly coupled" to another unit, it is intended that no intervening units are present. In addition, other words used to describe the relationship between elements should be interpreted in a similar manner (e.g., "between … …" versus "directly between … …", "adjacent" versus "directly adjacent", etc.).

It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments of the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, elements, components, and/or groups thereof.

It should also be noted that, in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may, in fact, be executed substantially concurrently, or the figures may sometimes be executed in the reverse order, depending upon the functionality/acts involved.

It should be understood that specific details are provided in the following description to facilitate a thorough understanding of example embodiments. However, it will be understood by those of ordinary skill in the art that the example embodiments may be practiced without these specific details. For example, systems may be shown in block diagrams in order not to obscure the examples in unnecessary detail. In other instances, well-known processes, structures and techniques may be shown without unnecessary detail in order to avoid obscuring example embodiments.

Examples

As shown in fig. 1, a system architecture is provided for the present application, which includes a screen projection sending terminal and a screen projection receiving terminal that are communicatively connected to each other; the screen projection receiving terminal is used as a screen projection end and used for receiving the media streams sent by each screen projection sending terminal and displaying the media streams on a screen of the screen projection sending terminal to finish screen projection.

In this embodiment, at least one video playing window and the window layout of the at least one video playing window are stored in the screen-casting receiving terminal, and after the screen-casting receiving terminal receives the videos to be launched, which are sent by each screen-casting sending terminal, n video playing windows (n is equal to the number of the videos to be launched) can be selected from the at least one video playing window according to the number of the received videos to be launched, and the videos to be launched are respectively played (i.e., each video playing window plays one video to be launched respectively). Through the design, the multi-channel screen projection system can simultaneously receive the videos to be projected, which are sent by the screen projection sending terminals, and simultaneously play the videos, namely, the multi-channel screen projection system can realize multi-channel screen projection, meet the application scene of multi-user screen projection, and greatly increase the screen projection application range.

As shown in fig. 2, the screen projection method provided in the first aspect of this embodiment can implement multi-way screen projection, is suitable for an application scenario in which multiple people project screens, and may include, but is not limited to, the following steps S101 to S104.

S101, a screen projection receiving terminal obtains at least one video playing window and the window layout of the at least one video playing window, wherein each video playing window in the at least one video playing window is any region on a screen projection screen, the window layout is the arrangement position of each video playing window on the screen projection screen, and the video playing windows with different numbers at least correspond to one window layout.

Step S101 is a process of setting at least one video playing window and a window layout corresponding to the video playing window on a screen projection receiving terminal; in this embodiment, for example, at least one video playing window and the window layout corresponding to the video playing window may include, but are not limited to: the screen projection receiving terminal is preset and can be directly called when in use.

In this embodiment, the essence of the video playing window is: any area selected on a screen projection screen on a screen projection receiving terminal is only used for playing the video in the selected area; similarly, when a plurality of video playing windows are arranged, the function of playing different contents in each video playing window can be realized, so that multi-path screen projection is realized.

In this embodiment, the manner of selecting the area from the screen projection screen as the video playing window may be, but is not limited to: the size of the video playing window is determined through four coordinates (such as coordinates of four end parts of the window) by using a coordinate determination area (for example, taking the upper left corner of the screen projection screen as a coordinate origin, establishing a coordinate system, taking the length of the screen projection screen as an x axis and the width as a y axis), so that the selection of the area is completed).

In this embodiment, the video playing window corresponds to a window layout, which substantially includes: and arranging the video playing windows on the screen projection screen according to a preset mode to form a fixed playing position.

In this embodiment, for example, different numbers of video playing windows correspond to at least one window layout; for example, when the number of video playing windows is 1, the method corresponds to a window layout (which may be, but is not limited to, the video playing window is a full screen); for another example, when the number of video playing windows is 2, at least one window layout corresponds to the video playing windows; for another example, when there are 3 video playing windows, there is at least one corresponding window layout; when the number of the video playing windows is the rest, the windows are respectively arranged correspondingly.

For example, as shown in fig. 3, fig. 3 shows a window layout corresponding to 2 video playing windows, where (a) in fig. 3 is a first window layout corresponding to 2 windows, and (b) in fig. 3 is another window layout.

Similarly, fig. 4 (a) is a first window layout corresponding to 3 video playing windows; and (b) in fig. 4 is another corresponding window layout.

And after the screen projection receiving terminal acquires at least one video playing window and the window layout corresponding to the video playing window, performing steps S102-S108, namely sending the residual memory value to the screen projection sending terminal so that the screen projection sending terminal can generate a video to be projected according to the residual memory value and play the video.

S102, the screen projection receiving terminal sends a residual memory value to the screen projection sending terminal, so that the screen projection sending terminal adjusts the resolution of the video to be played according to the residual memory value and takes the adjusted video to be played as the video to be projected, wherein the residual memory value is used for representing a processor memory value occupied by the screen projection receiving terminal when the video is decoded and rendered, and the projected video is the video acquired by the screen projection receiving terminal before the video to be projected is received.

And S103, receiving the residual memory value sent by the screen projection receiving terminal by the screen projection sending terminal.

And S104, adjusting the resolution of the video to be played by the screen projection sending terminal according to the residual memory value.

And S105, the screen throwing sending terminal takes the adjusted video to be played as the video to be thrown.

And S106, the screen projection sending terminal sends the video to be projected to the screen projection receiving terminal.

And S107, the screen projection receiving terminal receives the videos to be projected sent by the screen projection sending terminal and obtains the number of the videos to be projected.

Step S102 is a process of sending the remaining memory value to the screen-casting sending terminal by the screen-casting receiving terminal, so that the subsequent screen-casting sending terminal adjusts the resolution of the video to be played according to the remaining memory value.

In this embodiment, the remaining memory value is obtained according to the performance remaining memory of the processor after the screen projection receiving terminal processes the video to be projected, that is, before receiving the video to be projected, the screen projection receiving terminal receives the video played by the receiving terminal.

For example, if the screen projection receiving terminal does not receive any video to be projected, the remaining memory value is 100 minutes, and the screen projection receiving terminal needs to occupy 15% of the memory for decoding and rendering a video with the resolution of 720 p; decoding and rendering a video with a resolution of 1080p requires 25% of the memory; decoding and rendering a video with a resolution of 2k requires 40% memory.

Assuming that the screen projection receiving terminal is already playing 2 videos of 720p and 2 videos of 1080p before the video to be projected, at this time, the remaining memory value of the screen projection receiving terminal is: (100-15-15-25-25) ═ 20.

Step S104 is a process of adjusting the resolution of the video to be played according to the remaining memory value, so as to adjust the resolution to be suitable for the processor of the screen projection receiving terminal.

In this embodiment, the video to be played is a video that each screen projection sending terminal needs to play on the screen projection receiving terminal, that is, an original video, and the video to be played is a video to be played after resolution adjustment.

In this embodiment, the exemplary screen-projection sending terminal adjusts the resolution of the video to be played according to the remaining memory value, which may include, but is not limited to, the following steps S104a to S104d.

S104a, the screen projection sending terminal obtains the current resolution of the video to be played.

S104b, the screen projection sending terminal obtains a processing memory value of the video to be played according to the current resolution, wherein the processing memory value is a processor memory value occupied by the screen projection receiving terminal for decoding and rendering the video to be played under the current resolution.

S104c, the screen projection sending terminal judges whether the processing memory value is larger than the residual memory value.

And S104d, if yes, reducing the resolution of the video to be played.

The principle of adjusting the resolution in steps S104a to S104d is:

firstly, acquiring the current resolution of a video to be played, and then obtaining a processor memory value (namely a processing memory value) occupied by decoding and rendering the current resolution video according to the current resolution; and then, comparing the processed memory value with the residual memory value, if the processed memory value is greater than the residual memory value, indicating that the processor memory of the screen projection receiving terminal is insufficient and is not enough to decode and render the video to be played with the current resolution, and at this time, reducing the resolution of the video to be played so as to enable the processor of the screen projection receiving terminal to decode and render and complete the video projection.

For example, when the current resolution is 2k, according to the foregoing example, the screen-projection receiving terminal needs to occupy 40% of the memory for decoding and rendering the video with the resolution of 2k, i.e., the remaining memory value of 40 needs to be consumed.

The remaining memory value is 20, which is smaller than 40 memory values required by the current resolution, so that the current resolution needs to be reduced to meet the requirement that the resolution of the video to be launched is within the processing capacity of the screen-launching receiving terminal.

For example, the screen projection transmitting terminal reduces the resolution of 2k to 720p (only a memory value of 15 is required), thereby satisfying the processing capability of the screen projection receiving terminal.

In this embodiment, when the processing memory value is smaller than the remaining memory value, the screen-casting sending terminal may directly send the video to be played as the video to be cast to the screen-casting receiving terminal without reducing the resolution.

For example, when the resolution is 1080p, at this time, the screen-casting sending terminal may directly send the video to be played to the screen-casting receiving terminal as the video to be cast.

In this embodiment, when the remaining memory value is too small, even if the current resolution is reduced to the lowest resolution of the screen projection sending terminal, the required processing memory value is still larger than the remaining memory value, and at this time, a prompt message that the video access number of the screen projection receiving terminal is saturated can be displayed on the screen projection sending terminal, so as to remind the user that the screen projection receiving terminal cannot access the video at this time.

For example, the current resolution is 2k, it is assumed that the current remaining memory value of the screen projection sending terminal is 10, and the lowest resolution in the screen projection receiving terminal is 720p, and the occupied inner side is 15%, that is, a memory value of 15 is needed; at this time, even if the resolution is reduced from 2k to 720p, the processor memory value occupied for decoding and rendering the 720p video is 15, which is larger than the remaining memory value of 10, so that at this time, screen projection cannot be performed, and a prompt message that the video access number of the screen projection receiving terminal is saturated needs to be displayed on the screen projection transmitting terminal.

In this embodiment, the processing memory value may be preset on each screen projection sending terminal (i.e., the processor memory value occupied by the screen projection receiving terminal for decoding and rendering videos with different resolutions is stored in each screen projection sending terminal in advance), or may be sent to each screen projection generating terminal in real time by the screen projection receiving terminal.

After the resolution of the video to be played is adjusted according to the remaining memory value, steps S105, S106 and S107 may be performed to complete uploading of the video to be played, that is, the adjusted video to be played is sent to the screen-casting receiving terminal as the video to be cast, so as to play the video.

Through the steps, the resolution of the video to be launched can be adjusted in real time according to the processing capacity of the screen launching receiving terminal, so that the launching requirements of videos with different resolutions can be met, and the optimal screen launching effect can be achieved.

After the video to be launched is acquired, step S108 may be performed to complete the simultaneous playing of the multiple videos.

And S108, the screen throwing receiving terminal selects n video playing windows from the at least one video playing window according to the number of the videos to be thrown, and plays the videos to be thrown respectively according to the window layout corresponding to the n video playing windows, wherein n is more than or equal to 1 and is equal to the number of the videos to be thrown.

Step S108 is a process of selecting video playing windows with the same number as the number of the pieces of video to be played to play the video, so as to complete multi-channel screen casting.

For example, if the number of videos to be launched is 3, then 3 video playing windows are selected, and the window layouts corresponding to the 3 video playing windows are used for playing the videos, that is, each video playing window plays one video to be launched.

In this embodiment, when the window layout styles are greater than 1, the screen-casting receiving terminal may select one of the window layouts as a default layout, and directly select the default layout of the video playing window corresponding to the number of videos to be played after receiving the number of videos to be played corresponding to the number of videos to be played.

For example, assuming that the diagram (a) in fig. 3 is a default layout, when the screen-casting receiving terminal receives 2 videos to be cast, the layout mode shown in the diagram (a) in fig. 3 can be directly selected for playing the videos; for another example, assuming that the diagram (a) in fig. 4 is a default layout, when the screen-casting receiving terminal receives 3 videos to be cast, the layout mode shown in the diagram (a) in fig. 4 may be directly selected for playing the videos.

Naturally, the screen projection receiving terminal performs real-time adjustment of the window layout according to the number of received videos to be projected; for example, if the currently played video of the screen-casting receiving terminal is 1, when the second video to be cast is received, the window layout corresponding to the 2 videos to be cast is selected to play the two videos (as the layout mode shown in fig. 3 (a)).

Therefore, by the screen projection method described in detail in the steps S101 to S109, the present invention can realize simultaneous playing of a plurality of videos to be projected, achieve a function of multi-channel screen projection, satisfy an application scenario of multi-user screen projection, and greatly increase the application range of screen projection.

In a possible design, the first aspect of this embodiment may also perform real-time adjustment of the window layout at the screen-projection sending terminal, and may be but is not limited to the following steps S109 to S113.

And S109, the screen projection receiving terminal sends the window layout corresponding to the n video playing windows to the screen projection sending terminal corresponding to the video to be projected.

And S110, receiving the window layout sent by the screen projection receiving terminal by the screen projection sending terminal.

Step S109 and step S110 are processes of window layout synchronization, that is, the window layout used by the screen-casting receiving terminal is sent to each screen-casting sending terminal in real time, so that the user on the screen-casting sending terminal can perform real-time adjustment of the playing window according to the window layout.

And S111, adjusting the arrangement positions of the n video playing windows by a user of the screen projection sending terminal according to the window layout to obtain the adjusted window layout.

Step S111 is a process of performing real-time adjustment according to the window layout, and in this embodiment, the adjustment of the window layout may be performed in, but is not limited to, the following manner: the position is changed (for example, the positions of two video playing windows are inter-modulated), and/or the window size is changed (for example, a certain video playing window is enlarged or reduced, and the principle of enlarging or reducing the video window on a computer is consistent), and the like.

After the window layout is adjusted, the adjusted window layout can be synchronized to the screen projection receiving terminal, as shown in steps S112 and S113.

And S112, the screen projection sending terminal sends the adjusted window layout to the screen projection receiving terminal.

And S113, receiving the adjusted window layout sent by the screen projection sending terminal by the screen projection receiving terminal, and adjusting the arrangement positions of the n video playing windows according to the adjusted window layout.

Step S112 and step S113 are the process of adjusting the window layout of the screen projection receiving terminal; through the design, a user can directly adjust the window layout on the corresponding screen projection sending terminal (such as a mobile phone), and the use convenience is greatly improved.

In this embodiment, when the screen projection receiving terminal detects that the size of any video playing window in the video playing process changes, the changed window size can be sent to the corresponding screen projection sending terminal, so that the corresponding screen projection sending terminal can adjust the resolution of the played video, and the playing definition can be still ensured after the window changes; but not limited to, steps S114 to S120 as follows.

S114, the screen projection receiving terminal detects whether the size of each video playing window in the n video playing windows changes or not.

Step S114 is a process of detecting whether the size of the video playing window that is playing the video changes.

And S115, if yes, the screen projection receiving terminal acquires the width and the height of the changed video playing window.

Step S115 is to obtain the width and height of the changed video playing window, so as to provide data for the adjustment of the subsequent resolution.

And S116, the screen projection receiving terminal sends the width and the height to a target terminal.

And S117, the screen projection sending terminal receives the width and the height, and adjusts the resolution of the target video according to the width and the height to obtain an adjusted target video, wherein the target terminal is the screen projection sending terminal corresponding to the changed video playing window, and the target video is the video to be projected and played in the changed video playing window.

Step S116 and step S117 are processes of adjusting the resolution according to the width and the height; for example, the width and height of the video playing window after the change are 1920 × 1080, respectively, at this time, the screen-casting sending terminal can change the resolution of the video to 1920 × 1080 (that is, to 1080 p); for another example, if the width and height of the changed video playing window are 1280 × 720, respectively, the screen-projection sending terminal may change the resolution of the video to 1280 × 720 (i.e., to 720 p).

Of course, in this embodiment, the width and height of the changed video playing window both refer to the pixel width and pixel height on the screen projection screen.

After the resolution is adjusted according to the width and height of the changed video playing window, the adjusted video can be sent to the screen projection receiving terminal, so that the video can be played in the changed video playing window, and the playing definition is ensured, as shown in steps S118 to S120.

And S118, the screen projection sending terminal sends the adjusted target video to the screen projection receiving terminal.

And S119, receiving the adjusted target video sent by the target terminal by the screen projection receiving terminal.

And S120, the screen projection receiving terminal plays the adjusted target video in the changed video playing window.

Through the steps S114 to S120, when it is detected that the size of the video playing window changes, the width and the height of the changed window can be sent to the corresponding screen projecting sending terminal, so that the corresponding screen projecting sending terminal can adjust the resolution of the video according to the width and the height, that is, the resolution of the video is adapted to the changed window, thereby ensuring the playing definition.

In a possible design, the embodiment may further detect whether a video playing window that is playing the video is blocked, and if the video playing window is blocked, the video playing of the window may be paused to achieve the purpose of saving resources, as shown in the following steps S121 to S123.

And S121, the screen projection receiving terminal detects whether any one of the n video playing windows is shielded by the other video playing windows.

Step S121 is a process of detecting whether the window is blocked, and in this embodiment, the detection is implemented according to the coordinates, the width, and the height of the window.

As shown in FIG. 5, an occlusion diagram is given in FIG. 5, which includes a window A and a window B, wherein the coordinates of the upper left corner of the window A are (200,100), and the width and height are (400,200); the coordinates of the upper left corner of the B window are (300,150), width and height (450,250).

The meaning of (x, y, w, h) in fig. 5 is: (x, y) denotes the horizontal and vertical coordinates of the upper left corner of the window, and w and h denote the width and height, respectively.

By the above explanation, if the coordinates are overlapped, it can be determined that the two windows are overlapped; for example, if the coordinates of the window a and the window B partially overlap, the window a and the window B overlap.

When the overlapping of the windows is detected, which window is shielded can be known according to the hierarchical relation of the windows; in this embodiment, the window hierarchy is a lower layer created first and an upper layer created later according to the creation sequence, that is, the creation time of two windows is compared, so that the window hierarchy can be obtained.

When it is detected that the window is blocked, a stop instruction can be sent to the corresponding screen projection terminal, so that the screen projection sending terminal can pause sending of the video to be projected according to the stop instruction, and the purpose of stopping playing is achieved, as shown in step S122 and step S123.

And S122, if yes, the screen projection receiving terminal sends a stop instruction to a screen projection sending terminal corresponding to any video playing window.

And S123, receiving the stop instruction by the screen throwing sending terminal, and suspending sending of the video to be thrown according to the stop instruction.

Therefore, through the steps S121-S123, the method can detect whether the video playing window playing the video is shielded or not, and can pause the video playing of the window if the video playing window is shielded, so as to achieve the purpose of saving resources and avoid the resource waste of the screen projection receiving terminal.

As shown in fig. 6, a second aspect of the present embodiment provides a hardware device for implementing the screen projection method described in the first aspect of the embodiment, taking the device as a screen projection receiving terminal as an example, including: the device comprises a first acquisition unit, a first sending unit, a first receiving unit and a playing unit.

The first obtaining unit is configured to obtain at least one video playing window and a window layout of the at least one video playing window, where each video playing window in the at least one video playing window is an arbitrary region on a screen projection screen, the window layout is an arrangement position of each video playing window on the screen projection screen, and different numbers of video playing windows at least correspond to one window layout.

The first sending unit is used for sending a residual memory value to the screen projection sending terminal so that the screen projection sending terminal adjusts the resolution of the video to be played according to the residual memory value and takes the adjusted video to be played as the video to be released, wherein the residual memory value is used for representing the memory value of a processor occupied by the screen projection receiving terminal when the video is decoded and rendered, and the released video is the video acquired by the screen projection receiving terminal before the video to be released is received.

The first receiving unit is used for acquiring the videos to be launched sent by the screen launching sending terminal and obtaining the number of the videos to be launched.

In one possible design, the screen projection receiving terminal further includes: a layout adjusting unit.

The first sending unit is further configured to send the window layout corresponding to the n video playing windows to the screen projecting sending terminal corresponding to the video to be projected, so that a user of the screen projecting sending terminal adjusts the arrangement positions of the n video playing windows according to the window layout to obtain the adjusted window layout.

The first receiving unit is further configured to receive the adjusted window layout sent by the screen-casting sending terminal.

In one possible design, the screen projection receiving terminal further includes: a detection unit and a window size acquisition unit.

The detection unit is configured to detect whether the size of each video playing window in the n video playing windows changes.

The window size obtaining unit is configured to obtain the width and height of each video playing window after change when the detecting unit detects that the size of each video playing window in the n video playing windows changes.

The first sending unit is further configured to send the width and the height to a target terminal, so that the target terminal adjusts the resolution of the target video according to the width and the height to obtain an adjusted target video, where the target terminal is a screen-casting sending terminal corresponding to the changed video playing window, and the target video is a video to be cast played in the changed video playing window.

The first receiving unit is configured to receive the adjusted target video sent by the target terminal.

In one possible design:

the detection unit is further configured to detect whether any one of the n video playing windows is blocked by the remaining video playing windows.

For the working process, the working details, and the technical effects of the hardware apparatus provided in this embodiment, reference may be made to the first aspect of the embodiment, which is not described herein again.

As shown in fig. 7, a third aspect of the present embodiment provides a hardware device for implementing the screen projecting method described in the first aspect of the embodiment, taking the device as a screen projecting sending terminal as an example, including: a second receiving unit, a resolution adjusting unit and a second sending unit.

And the second receiving unit is used for receiving the residual memory value sent by the screen projection receiving terminal.

And the resolution adjusting unit is used for adjusting the resolution of the video to be played according to the residual memory value.

And the resolution adjusting unit also takes the adjusted video to be played as the video to be launched.

In one possible design:

the resolution adjusting unit is provided with a current resolution used for obtaining the video to be played.

The resolution adjusting unit is used for obtaining a processing memory value of the video to be played according to the current resolution, wherein the processing memory value is a processor memory value occupied by the screen projection receiving terminal for decoding and rendering the video to be played under the current resolution.

As shown in fig. 8, a fourth aspect of this embodiment provides a computer main device for implementing the screen projection method in the first aspect of the embodiment, including a memory, a processor, and a transceiver, which are sequentially connected in a communication manner, where the memory is used to store a computer program, the transceiver is used to transmit and receive messages, and the processor is used to read the computer program and execute the screen projection method in the first aspect of the embodiment.

For example, the Memory may include, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Flash Memory (Flash Memory), a First In First Out (FIFO), and/or a First In Last Out (FILO), and the like; the processor may not be limited to a microprocessor of a model number STM32F105 series, a reduced instruction set computer (RSIC) microprocessor, an architecture processor such as X86, or a processor integrated with a neural-Network Processing Unit (NPU); the transceiver may be, but is not limited to, a wireless fidelity (WIFI) wireless transceiver, a bluetooth wireless transceiver, a General Packet Radio Service (GPRS) wireless transceiver, a ZigBee wireless transceiver (ieee802.15.4 standard-based low power local area network protocol), a 3G transceiver, a 4G transceiver, and/or a 5G transceiver, etc. In addition, the computer main equipment can also include but is not limited to a power supply module, a display screen and other necessary components.

For the working process, the working details, and the technical effects of the computer main device provided in this embodiment, reference may be made to the first aspect of the embodiment, which is not described herein again.

A fifth aspect of the present embodiment provides a computer-readable storage medium storing instructions including the screen projection method according to the first aspect of the present invention, that is, the computer-readable storage medium has instructions stored thereon, and when the instructions are executed on a computer, the screen projection method according to the first aspect is performed. The computer-readable storage medium refers to a carrier for storing data, and may include, but is not limited to, floppy disks, optical disks, hard disks, flash memories, flash disks and/or Memory sticks (Memory sticks), etc., and the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.

For the working process, the working details, and the technical effects of the computer-readable storage medium provided in this embodiment, reference may be made to the first aspect of the embodiment, which is not described herein again.

A sixth aspect of the present embodiment provides a computer program product comprising instructions which, when run on a computer, wherein the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus, cause the computer to perform the screen projection method according to the first aspect of the present embodiment.

The embodiments described above are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device to perform the methods described in the embodiments or some portions of the embodiments.

The invention is not limited to the above alternative embodiments, and any other various forms of products can be obtained by anyone in the light of the present invention, but any changes in shape or structure thereof, which fall within the scope of the present invention as defined in the claims, fall within the scope of the present invention.

Claims

1. A screen projection method, comprising:

the method comprises the steps of obtaining at least one video playing window and window layout of the at least one video playing window, wherein each video playing window in the at least one video playing window is any area on a screen projection screen, the window layout is the arrangement position of each video playing window on the screen projection screen, and the video playing windows with different numbers at least correspond to one window layout;

sending a residual memory value to a screen projection sending terminal so that the screen projection sending terminal adjusts the resolution of a video to be played according to the residual memory value and takes the adjusted video to be played as a video to be projected, wherein the residual memory value is used for representing a processor memory value occupied by a screen projection receiving terminal when decoding and rendering the projected video, and the projected video is obtained by the screen projection receiving terminal before receiving the video to be projected;

receiving the video to be launched sent by the screen launching sending terminal, and obtaining the number of the video to be launched;

and selecting n video playing windows from the at least one video playing window according to the number of the videos to be launched, and respectively playing the videos to be launched according to the window layout corresponding to the n video playing windows, wherein n is more than or equal to 1 and is equal to the number of the videos to be launched.

2. The method of claim 1, wherein the method further comprises:

sending the window layout corresponding to the n video playing windows to a screen projection sending terminal corresponding to the video to be projected, so that a user of the screen projection sending terminal adjusts the arrangement positions of the n video playing windows according to the window layout to obtain the adjusted window layout;

receiving the adjusted window layout sent by the screen projection sending terminal;

and adjusting the arrangement positions of the n video playing windows according to the adjusted window layout.

3. The method of claim 1, wherein the method further comprises:

detecting whether the size of each video playing window in the n video playing windows changes or not;

if so, acquiring the width and height of the changed video playing window;

sending the width and the height to a target terminal so that the target terminal adjusts the resolution of a target video according to the width and the height to obtain an adjusted target video, wherein the target terminal is a screen projection sending terminal corresponding to the changed video playing window, and the target video is a video to be projected and played in the changed video playing window;

receiving the adjusted target video sent by the target terminal;

and playing the adjusted target video in the changed video playing window.

4. The method of claim 1, wherein the method further comprises:

detecting whether any one of the n video playing windows is shielded by the other video playing windows;

if so, sending a stop instruction to a screen projection sending terminal corresponding to any video playing window, so that the screen projection sending terminal corresponding to any video playing window can pause sending of the video to be projected according to the stop instruction.

5. A screen projection method, comprising:

receiving the residual memory value sent by the screen projection receiving terminal;

adjusting the resolution of the video to be played according to the residual memory value;

the adjusted video to be played is used as a video to be launched;

and sending the video to be launched to the screen launching receiving terminal so that the screen launching receiving terminal selects n video playing windows from at least one video playing window and plays the video to be launched respectively according to the window layout corresponding to the n video playing windows.

6. The method of claim 5, wherein adjusting the resolution of the video to be played according to the remaining memory value comprises:

acquiring the current resolution of the video to be played;

obtaining a processing memory value of the video to be played according to the current resolution, wherein the processing memory value is a processor memory value occupied by the screen projection receiving terminal for decoding and rendering the video to be played under the current resolution;

judging whether the processing memory value is larger than the residual memory value;

and if so, reducing the resolution of the video to be played.

7. A screen projection receiving terminal, comprising: the device comprises a first acquisition unit, a first sending unit, a first receiving unit and a playing unit;

the first sending unit is used for sending a residual memory value to the screen projection sending terminal so that the screen projection sending terminal adjusts the resolution of the video to be played according to the residual memory value and takes the adjusted video to be played as the video to be released, wherein the residual memory value is used for representing the memory value of a processor occupied by the screen projection receiving terminal when the video to be released is decoded and rendered, and the released video is the video acquired by the screen projection receiving terminal before the video to be released is received

8. A screen projection transmission terminal, comprising: a second receiving unit, a resolution adjusting unit and a second sending unit;

the resolution adjustment unit also takes the adjusted video to be played as the video to be launched

9. A computer master device, comprising: the screen projection system comprises a memory, a processor and a transceiver which are sequentially connected in a communication mode, wherein the memory is used for storing a computer program, the transceiver is used for transmitting and receiving messages, and the processor is used for reading the computer program and executing the screen projection method according to any one of claims 1 to 4 or 5 to 6.

10. A computer-readable storage medium having stored thereon instructions which, when run on a computer, cause the computer to perform the screen projection method of any of claims 1-4 or 5-6.