CN113206964B - Screen projection data display processing method and device, terminal equipment and storage medium - Google Patents
Screen projection data display processing method and device, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN113206964B CN113206964B CN202110472387.0A CN202110472387A CN113206964B CN 113206964 B CN113206964 B CN 113206964B CN 202110472387 A CN202110472387 A CN 202110472387A CN 113206964 B CN113206964 B CN 113206964B
- Authority
- CN
- China
- Prior art keywords
- screen
- data stream
- window
- video
- video playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims description 17
- 230000005540 biological transmission Effects 0.000 claims abstract description 82
- 239000000203 mixture Substances 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims abstract description 29
- 238000000034 method Methods 0.000 claims abstract description 27
- 238000005070 sampling Methods 0.000 claims description 23
- 238000004458 analytical method Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 11
- 238000000605 extraction Methods 0.000 claims description 4
- 230000008859 change Effects 0.000 abstract description 3
- 238000005266 casting Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000004806 packaging method and process Methods 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003997 social interaction Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4367—Establishing a secure communication between the client and a peripheral device or smart card
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/775—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a device for displaying and processing screen projection data, terminal equipment and a storage medium, wherein the method comprises the following steps: receiving a screen transmission data stream of a screen projection; analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream; judging the size and position of a video playing window and video composition information in the extracted window information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream; and displaying the generated full-screen data stream in a full screen mode. The invention can independently project videos played in a window mode in a mobile equipment terminal, such as a mobile phone, to large-screen equipment such as a television and the like and play the videos in a full screen mode. The method aims to solve the problem that the screen can only be projected on the mobile phone end screen data in the existing screen projection technology without change, and can meet the further requirement of a user on the screen projection function, so that the user can obtain more convenient and comprehensive screen projection video watching experience.
Description
Technical Field
The invention relates to the technical field of screen projection, in particular to a screen projection data display processing method and device, terminal equipment and a storage medium.
Background
With the development of science and technology, the demand of people for watching videos is no longer limited to small screens of mobile devices such as mobile phones, and the user experience brought by using a screen projection experience to check a large screen is already a function commonly used by many users, and the function is also the capability commonly possessed by the mobile phones and televisions. However, the existing screen projection technology can only project the content on the screen of the mobile device end to the screen projection receiving end without further considering the user's requirements, and the functions of selectively projecting the screen and enlarging the video window are achieved.
Thus, there is a need for improvement and development of the prior art.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method, an apparatus, a terminal device and a storage medium for processing screen projection data display, which are used for solving the above-mentioned defects in the prior art, and the present invention solves the problem that in the prior art, only the content on the screen of the mobile device end can be projected onto the screen projection receiving end without any change, and the screen can not be selectively projected and the video window can not be enlarged.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
a screen projection data display processing method, wherein the method comprises the following steps:
receiving a screen transmission data stream of screen projection;
analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
judging the size and position of a video playing window in the extracted window information and video composition information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream;
and displaying the generated full-screen data stream in a full screen mode.
The screen projection data display processing method includes the steps of analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream:
sampling and analyzing the data characteristics of the screen data stream in real time; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
and if the current screen transmission data stream contains the data stream of the video playing window, acquiring the window information of the video playing window.
The screen projection data display processing method comprises the steps of sampling and analyzing data characteristics of a screen transmission data stream in real time; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
carrying out real-time sampling analysis on the data characteristics of the screen data stream; and judging whether the data stream of the video playing window is included by identifying the playing progress bar in the screen transmission data stream and the switching times of the pictures in the same area.
The screen projection data display processing method comprises the following steps of:
and acquiring the size and position of a video playing window and video composition information.
The method for processing the screen projection data display comprises the following steps of judging the size and the position of a video playing window in the extracted window information and video composition information, and carrying out secondary coding on a picture display area to generate a full-screen data stream:
judging the size and position of a video playing window in the window information and video composition information;
when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
when the video composition information has a black edge, setting the size and the position of a window with the black edge removed as a picture display area;
and packaging the video of the picture display area into a full-screen data stream.
The screen projection data display processing method comprises the following steps of:
and adapting and displaying the full-screen data stream and the screen size.
The screen projection data display processing method comprises the following steps of:
setting a screen projection data display processing button;
when the small-window video does not need to be amplified independently, receiving an operation instruction of a user through the screen-projecting data display processing button, closing a screen-projecting data display processing function, and switching to screen-transmitting data stream playing;
when the mobile equipment is required to be used and a full-screen video is watched, receiving an operation instruction of a user through the screen-projecting data display processing button to start a screen-projecting data display processing function, switching to full-screen data stream playing when a video playing window is detected to exist in the screen-transmitting data stream, and switching to screen-transmitting data stream playing when no video playing window exists in the screen-transmitting data stream.
A screen-projected data display processing apparatus, wherein the apparatus comprises:
the receiving module is used for receiving screen transmission data flow of screen projection;
the analysis and extraction module is used for analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream;
the judging module is used for judging the size and position of a video playing window and video composition information in the extracted window information, and carrying out secondary coding on a picture display area to generate a full-screen data stream;
and the display control module is used for displaying the generated full-screen data stream in a full screen mode.
A terminal device comprises a memory, a processor and a screen projection data display processing program which is stored on the memory and can run on the memory, wherein when the processor executes the screen projection data display processing program, the steps of any screen projection data display processing program method are realized.
A computer-readable storage medium, wherein a screen-shot data display processing program is stored thereon, which, when executed by a processor, implements the steps of any one of the screen-shot data display processing methods.
Has the beneficial effects that: compared with the prior art, the method and the device have the advantages that according to the detection of the position and the size of the video display area in the screen of the mobile equipment and the detection of the composition of the video, the picture display area in the video playing window is independently extracted and amplified when the screen is projected, and the purpose that the video which is played in a windowed mode on the mobile equipment is directly projected into a full-screen video which is played in a full screen mode is achieved. The method and the device enable the user to watch the screen-projected video played in a full screen while browsing the comments, and not only project the display interface of the mobile device end as it is, but also provide convenience for the user to use.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a detailed implementation of a screen projection data display processing method according to an embodiment of the present invention.
Fig. 2 is a schematic flowchart of a process of analyzing screen data and extracting video playing window information according to an embodiment of the present invention.
Fig. 3 is a schematic flow diagram of determining video window information and generating a full-screen data stream according to an embodiment of the present invention.
Fig. 4 is a schematic flowchart of displaying a generated full-screen data stream in a full screen according to an embodiment of the present invention.
Fig. 5 is a schematic block diagram of a projection data display processing apparatus according to an embodiment of the present invention.
Fig. 6 is a schematic diagram of an internal structure of a terminal device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that, if directional indications (such as up, down, left, right, front, and back … …) are involved in the embodiment of the present invention, the directional indications are only used to explain the relative positional relationship between the components, the movement situation, and the like in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indications are changed accordingly.
In addition, if there is a description relating to "first", "second", etc. in the embodiments of the present invention, the description of "first", "second", etc. is for descriptive purposes only and is not to be construed as indicating or implying relative importance or to implicitly indicate the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
With the development of science and technology, people no longer meet the requirements of simple clothing and housing, but more and more pay attention to the spirit of entertainment and social interaction and the like, so that people can go to places such as malls, amusement parks, movie theaters and the like for relaxation and play during holidays, but for people who like to watch movies, the cost performance of going to the movie theaters is not high frequently, the movies shown in the movie theaters are only the latest movies and the most classic movies, a lot of movies and television plays which are wanted to be watched are not shown in the movie theaters, the home cinema is a good choice for the people at the moment, the most important part of the home theaters can watch videos on large screens, various screen projection software can meet the requirements of most people at the moment, and videos which are wanted to be watched can be projected on televisions through mobile equipment such as mobile phones without purchasing movie and television members and the like. However, the current screen projection technology can only project the picture displayed on the screen of the mobile phone as it is, and when a user wants to watch a video played in full screen, the windowed video needs to be manually amplified to full screen, and after full screen, the mobile phone can only be put on one side to wait for the video playing to be finished, or the mobile phone needs to manually quit the full screen mode when other videos need to be switched to watch, which is troublesome.
In order to solve the problems in the prior art, this embodiment provides a method for processing screen-casting data display, when a user uses a mobile phone to perform screen casting, a television receives a screen-transmitting data stream, detects whether a video playing area exists in a current mobile phone screen, and when the television detects that a video is playing on the screen of the mobile phone, acquires the position, size and video composition information of the video playing area, where the video composition includes a picture display portion and a black border portion, a black border inevitably appears when a vertical screen video is played in a horizontal screen window and a vertical screen window plays a horizontal screen video, and at this time, the black border needs to be cut off and the picture area in the video is maximized, the television displays the processed full-screen data stream to obtain a video in a playing window which is individually subjected to full-screen amplification, so as to improve the user experience of screen casting software during use, and is more beneficial to the operation of video switching compared with the existing screen casting technology, and operations such as reading comments and the like can be simultaneously performed when the video is played. Furthermore, the chat software can be opened in a split screen mode for chatting, the split screen technology is more and more mature along with the continuous progress of the mobile phone technology, and more things can be synchronously achieved when the video is watched through the screen projection technology by means of the technical scheme.
Real-time method
First embodiment
As shown in fig. 1, an embodiment of the present invention provides a screen projection data display processing method, which can be used in screen projection applications of a mobile phone and a television. In an embodiment of the present invention, the method includes the steps of:
and S100, receiving a screen transmission data stream of the screen projection.
In this embodiment, after the screen projection end is connected to the receiving end, the screen projection end sends a screen transmission data stream to the receiving end, where the screen transmission data stream is data obtained by packaging a picture and an audio content displayed on a current screen by the screen projection end, for example, a mobile phone, and is sent to the receiving end, for example, a large-screen device such as a television, in a data stream manner.
A mobile device such as a mobile phone that performs screen projection may be connected to a large screen such as a television in both wired and wireless modes. When the mobile phone is connected with the television through a wire, the mobile phone interface type is usually used for connecting with the HDMI connecting wire, the television is required to be switched to a corresponding HDMI interface channel to display the mobile phone information, and after the connection is completed, the mobile phone transmits the transmission screen data stream to the television through the connecting wire. When the mobile phone and the television are in wireless connection, the mobile phone and the television need to be connected to the same WIFI, and screen transmission data stream transmission is carried out through the WIFI.
Further, step S200, analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
in this embodiment, when the television receives the screen transmission data stream, whether a video playing window for playing a video exists in the currently received screen transmission data stream is analyzed, that is, whether a video playing window for playing a video exists on a current mobile phone screen, and if a video playing window exists, window information of the video playing window is further extracted.
Specifically, as shown in fig. 2, the step S200 includes:
step S201, carrying out real-time sampling analysis on data characteristics of the screen transmission data stream; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
step S202, if the current screen transmission data stream contains the data stream of the video playing window, the window information of the video playing window is obtained.
The method comprises the steps of carrying out real-time sampling analysis on data characteristics of a screen data stream; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
and judging whether the data stream of the video playing window is included or not by identifying the playing progress bar in the data stream and the switching times of the pictures in the same area.
If the current screen transmission data stream contains the data stream of the video playing window, the step of acquiring the window information of the video playing window comprises the following steps:
and acquiring the size and position of a video playing window and video composition information. The video composition refers to an area of a played picture and a black border part of an unplayed picture in the video playing window, wherein the black border does not appear in all video playing windows, and usually appears when a vertical screen video is played in a horizontal screen playing window and a horizontal screen video is played in a vertical screen playing window.
For example, when the mobile phone end is using the today's headline APP in the vertical screen mode, when the user is browsing the home page portion of the today's headline APP, only the text and the picture exist in the screen display range of the mobile phone, so at this time, the screen transmission data stream only includes the text and the picture information, and the television end does not detect the play progress bar and a certain area where the picture is continuously switched, and at this time, the television end does not process the screen transmission data stream. When a user clicks a certain video in the home page part of the today's headline APP, the today's headline APP enters a video watching mode, the video watching mode mainly comprises a playing video playing window displayed on the upper half part of the mobile phone screen and an unplayed video playing window displayed on the lower half part of the mobile phone screen, when the user wants to switch video watching, the user only needs to slide the mobile phone screen downwards to move the unplayed video playing window to the upper half part of the mobile phone screen for playing, and a new unplayed video playing window appears in the lower half part of the mobile phone screen. At this time, preset conditions that a playing progress bar and a certain area for continuously switching pictures exist in the mobile phone screen, the frequency for switching the pictures is greater than 1 second for 10 times or 1 second for 30 times, and the like exist, namely the television performs data sampling on the screen transmission data stream to detect that a video playing window exists at the mobile phone end, and window information of the video playing window is obtained, wherein the position and the size of the video playing window in a display screen of the mobile phone end, whether a black edge exists or not, and the size and the position of the black edge are included, when the position and the size of the video window and the position and the size of the black edge are obtained, a coordinate system can be established according to the resolution of the mobile phone screen contained in the screen transmission data stream, and the positions and the sizes of the video window and the black edge are calibrated through the coordinate system.
Further, step S300, determining the size and position of the video playing window and the video composition information in the extracted window information to obtain a picture display area, and performing secondary encoding on the picture display area to generate a full-screen data stream;
in this embodiment, the television end determines the extracted position of the video playing window and the position and size of the black edge, and performs secondary encoding on the picture display area to generate the full-screen data stream, so that the television end can achieve the effect when the mobile phone end plays the video in the full-screen data stream, and the full-screen data stream is obtained by performing processing such as extraction, black edge removal, amplification and the like on the video playing window area in the screen-transfer data stream by the television end, and can be directly played to obtain the data stream of the full-screen video.
Specifically, as shown in fig. 3, the step S300 includes:
step S301, judging the size and position of a video playing window and video composition information in window information;
step S302, when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
step S303, when a black edge exists in the video composition, setting the size and the position of a window with the black edge removed as a picture display area;
and step S304, packaging the image display area video into a full-screen data stream. The picture display area is an area where a playing picture actually exists after black edges are removed.
For example, the television end determines and extracts the size and position of a video playing window being played in the today's top APP, and if the video in the video playing window has no black edge, the size and position of the video playing window is 1080 × 960 pixels, and the video playing window is tightly attached to the upper edge of the mobile phone screen and just occupies half of the 1080P resolution screen, the size and position of the video playing window is set as a picture display area, and the television end extracts and enlarges the video in the picture display area in the screen transmission data stream into a 1080P video format and packages the video into a full-screen data stream. And when the video playing window has a black edge and the black edge occupies half of the video window on the left and right sides of the video picture, the television end remeasures the position and the size of the video window information to obtain new video window information with the size of 540 x 960, the new video window information is tightly attached to the upper edge of the screen and centered, the size and the position of the new video window are set as a picture display area, and the television end extracts and amplifies the video in the picture display area in the screen transmission data stream into a 1080P video format and packs the video into full-screen data stream without the black edge.
Further, in step S400, the generated full-screen data stream is displayed in full screen.
In this embodiment, the television end plays the full-screen data stream obtained by packaging on a display screen.
Specifically, as shown in fig. 4, the step S400 includes:
and S401, adapting and displaying the full-screen data stream and the screen size.
For example, when the television terminal packages the picture display area in the screen transmission data stream into a 1080P format full-screen data stream and displays the full-screen data stream on a 1080P display screen, the data stream does not need to be adapted to a screen for direct playing, and when the 1080P format full-screen data stream is played on a 4K television, the 1080P format full-screen data stream needs to be correspondingly amplified and adapted to the 4K display screen for playing. On the contrary, when the image display area is packed into a full-screen data stream of 4K format and played in a 1080P display screen, the full-screen data stream of 4K format needs to be correspondingly reduced and played.
In a second embodiment, in order to improve the accuracy of the judgment of the screen projection receiving end on the video playing window, a judgment process may be added to distinguish two situations, namely frequent switching of pictures in a certain area and frequent switching of pictures in a video playing area, which are caused by sliding a screen. Whether the video playing area is determined according to the frequency of switching pictures, namely the frame rate, the existing mobile devices such as mobile phones and tablets have a plurality of screens with high refresh rates such as 120Hz and 144Hz, and due to the limitation of the APP server, most of the default refresh rates of videos still stay at the levels of 25 frames, 30 frames and 60 frames, so that when a shot similar to translation also appears in the playing video, a step of detecting the picture refresh rate is added, and whether the translation area is a video area or a non-video area can be distinguished.
In the third embodiment, in order to improve the flexibility of the user when using the technical scheme, a setting button for starting and closing the screen projection data display processing is set in the screen projection scheme, so that the user can switch the data stream of the screen projection at the moment according to the requirement. The method comprises the steps that when a user does not need to independently amplify a small-window video, the processing is closed, the normal screen projection state can be returned, screen transmission data streams are played, namely, the screen display content of the mobile equipment is projected to the existing screen projection technology of a screen projection receiving end without moving, when the user needs to use the mobile equipment while browsing a large-screen video, the screen transmission data streams are clicked to be started, the receiving end such as a television end is used for carrying out real-time sampling analysis and judging whether a video playing window exists in the screen transmission data streams, if the video playing window exists, the full-screen data streams obtained through the processing are played, and if the video playing window disappears is detected, the played content is changed into the screen transmission data streams to maintain the continuity of the screen projection function of the user.
Exemplary device
As shown in fig. 5, an embodiment of the present invention provides a projection data display processing apparatus, including: a receiving module 510, an analyzing and extracting module 520, a judging module 530 and a display control module 540. Specifically, the receiving module 510 is configured to receive a screen-transmitting data stream of a screen projection; the analysis and extraction module 520 is configured to analyze the screen transmission data stream and extract window information of a video playing window in the screen transmission data stream; the judging module 530 is configured to judge the size and position of a video playing window and video composition information in the extracted window information, and perform secondary encoding on a picture display area to generate a full-screen data stream; the display control module 540 is configured to perform full-screen display on the generated full-screen data stream.
Based on the above embodiment, the present invention further provides a terminal device, and a schematic block diagram thereof may be as shown in fig. 6. The terminal equipment comprises a processor, a memory, a network interface and a display screen which are connected through a system bus. Wherein the processor of the terminal device is configured to provide computing and control capabilities. The memory of the terminal equipment comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program to run on the non-volatile storage medium. The network interface of the terminal device is used for connecting and communicating with an external terminal through a network. The computer program is executed by a processor to implement a projected data display process. The display screen of the terminal equipment can be a liquid crystal display screen or an electronic ink display screen.
It will be understood by those skilled in the art that the block diagram of fig. 6 is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation to the terminal equipment to which the solution of the present invention is applied, and a specific terminal equipment may include more or less components than those shown in the figure, or combine some components, or have different arrangements of components.
In one embodiment, there is provided a terminal device, the terminal device comprising a memory, a processor and a terminal data processing program stored on and executable on the processor, the processor performing the steps of:
receiving a screen transmission data stream of a screen projection;
analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
judging the size and position of a video playing window and video composition information in the extracted window information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream;
and displaying the generated full-screen data stream in a full screen mode.
The step of analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream comprises the following steps:
sampling and analyzing the data characteristics of the screen data stream in real time; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
and if the current screen transmission data stream contains the data stream of the video playing window, acquiring the window information of the video playing window.
The data characteristics of the screen data stream are sampled and analyzed in real time; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
sampling and analyzing the data characteristics of the screen data stream in real time; and judging whether the data stream of the video playing window is included by identifying the playing progress bar in the screen transmission data stream and the switching times of the pictures in the same area.
Wherein, the step of obtaining the window information of the video playing window comprises:
and acquiring the size and position of the video playing window and video composition information.
The step of judging the size, position and video composition information of the video playing window in the extracted window information, and performing secondary coding on the picture display area to generate a full-screen data stream comprises the following steps:
judging the size and position of a video playing window in the window information and video composition information;
when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
when the video composition information has a black edge, setting the size and the position of a window with the black edge removed as a picture display area;
and packaging the video of the picture display area into a full-screen data stream.
The step of displaying the generated full-screen data stream in full screen includes:
and adapting and displaying the full-screen data stream and the screen size.
After the step of displaying the generated full-screen data stream in full screen, the method further comprises:
setting a screen projection data display processing button;
when the small-window video does not need to be amplified independently, receiving an operation instruction of a user through the screen-projecting data display processing button, closing a screen-projecting data display processing function, and switching to screen-transmitting data stream playing;
when the mobile equipment is required to be used and the full-screen video is watched, the screen-casting data display processing function is started by receiving an operation instruction of a user through the screen-casting data display processing button, the screen-casting data display processing button is switched to the full-screen data stream to be played when a video playing window is detected to exist in the screen-transferring data stream, and the screen-transferring data stream is switched to the screen-transferring data stream to be played when the video playing window is detected to not exist in the screen-transferring data stream.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by hardware instructions of a computer program, which may be stored in a non-volatile computer-readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases or other media used in the embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus (Rambus) direct RAM (RDRAM), direct bused dynamic RAM (DRDRAM), and bused dynamic RAM (RDRAM).
In summary, the present invention discloses a method, an apparatus, a terminal device and a storage medium for displaying and processing screen projection data, wherein the method comprises: receiving a screen transmission data stream of screen projection; analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream; judging the size and position of a video playing window and video composition information in the extracted window information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream; and displaying the generated full-screen data stream in a full screen mode. The invention can independently project videos played in a window mode in a mobile equipment terminal, such as a mobile phone, to large-screen equipment such as a television and the like and play the videos in a full screen mode. The method and the device aim to solve the problem that the screen can only be projected on the mobile phone end screen data in the existing screen projection technology without change, further requirements of a user on the screen projection function can be met, and the user can obtain more convenient and comprehensive screen projection video watching experience.
It will be understood that the invention disclosed is not limited to the examples described above, but that modifications and variations can be effected by those skilled in the art in light of the above teachings, and that all such modifications and variations are intended to be within the scope of the invention as defined in the appended claims.
Claims (6)
1. A screen projection data display processing method is characterized by comprising the following steps:
receiving a screen transmission data stream of screen projection;
analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
obtaining a picture display area according to the size and position of a video playing window in the extracted window information and video composition information, and carrying out secondary coding on the picture display area to generate a full-screen data stream;
the generated full-screen data stream is displayed in a full screen mode;
the step of analyzing the screen transmission data stream and extracting the window information of the video playing window in the screen transmission data stream comprises the following steps:
carrying out real-time sampling analysis on the data characteristics of the screen transmission data stream; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
if the current screen transmission data stream contains the data stream of the video playing window, acquiring window information of the video playing window;
the data characteristics of the screen transmission data stream are sampled and analyzed in real time; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
carrying out real-time sampling analysis on the data characteristics of the screen transmission data stream; judging whether the data stream of the video playing window is included or not by identifying the playing progress bar in the screen transmission data stream and the switching times of the pictures in the same area;
the step of obtaining the window information of the video playing window comprises the following steps:
acquiring the size and position of a video playing window and video composition information;
the acquiring the size and the position of the video playing window and the video composition information comprises the following steps:
the method comprises the steps of obtaining the position and the size of a video playing window in a mobile phone end display screen, judging whether a black edge exists or not and the size and the position of the black edge, establishing a coordinate system according to the mobile phone screen resolution contained in a screen transmission data stream when the position and the size of the video playing window and the position and the size of the black edge are obtained, and calibrating the video playing window and the position and the size of the black edge through the coordinate system;
the step of performing secondary coding on the picture display area to generate a full-screen data stream according to the size and position of the video playing window in the extracted window information and the video composition information comprises the following steps:
judging whether black edges exist in video composition information in the window information;
when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
when the video composition information has a black edge, setting the size and the position of a window with the black edge removed as a picture display area;
and carrying out secondary coding on the picture display area to generate a full-screen data stream.
2. The screen-projection data display processing method of claim 1, wherein the step of displaying the generated full-screen data stream in full screen comprises:
and adapting and displaying the full-screen data stream and the screen size.
3. The screen-projection data display processing method of claim 1, wherein the step of displaying the generated full-screen data stream in full screen further comprises:
setting a screen projection data display processing button;
when the small-window video does not need to be amplified independently, receiving an operation instruction of a user through the screen-projecting data display processing button, closing a screen-projecting data display processing function, and switching to screen-transmitting data stream playing;
when the mobile equipment is required to be used and a full-screen video is watched, receiving an operation instruction of a user through the screen-projecting data display processing button to start a screen-projecting data display processing function, switching to full-screen data stream playing when a video playing window is detected to exist in the screen-transmitting data stream, and switching to screen-transmitting data stream playing when no video playing window exists in the screen-transmitting data stream.
4. A projected data display processing apparatus, the apparatus comprising:
the receiving module is used for receiving screen transmission data flow of screen projection;
the analysis and extraction module is used for analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream;
the step of analyzing the screen transmission data stream and extracting the window information of the video playing window in the screen transmission data stream comprises the following steps:
carrying out real-time sampling analysis on the data characteristics of the screen transmission data stream; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
if the current screen transmission data stream contains the data stream of the video playing window, window information of the video playing window is obtained;
the data characteristics of the screen transmission data stream are sampled and analyzed in real time; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
carrying out real-time sampling analysis on the data characteristics of the screen transmission data stream; judging whether the data stream of a video playing window is included or not by identifying a playing progress bar in the screen transmission data stream and the switching times of the pictures in the same area;
the step of obtaining the window information of the video playing window comprises the following steps:
acquiring the size and position of a video playing window and video composition information;
the acquiring the size and the position of the video playing window and the video composition information comprises the following steps:
the method comprises the steps of obtaining the position and the size of a video playing window in a mobile phone end display screen, judging whether a black edge exists or not and the size and the position of the black edge, establishing a coordinate system according to mobile phone screen resolution contained in a screen transmission data stream when the position and the size of the video playing window and the position and the size of the black edge are obtained, and calibrating the video playing window and the position and the size of the black edge through the coordinate system;
the judging module is used for carrying out secondary coding on the picture display area according to the size and position of the video playing window in the extracted window information and the video composition information to generate a full-screen data stream;
the step of performing secondary coding on the picture display area to generate a full-screen data stream according to the size and position of the video playing window in the extracted window information and the video composition information comprises the following steps:
judging whether black edges exist in video composition information in the window information;
when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
when the video composition information has a black edge, setting the size and the position of a window with the black edge removed as a picture display area;
carrying out secondary coding on the picture display area to generate a full-screen data stream;
and the display control module is used for displaying the generated full-screen data stream in a full screen mode.
5. A terminal device, characterized in that the terminal device comprises a memory, a processor and a screen projection data display processing program stored on the memory and capable of running on the memory, and when the processor executes the screen projection data display processing program, the steps of the screen projection data display processing method according to any one of claims 1-3 are realized.
6. A computer-readable storage medium, on which a screen projection data display processing program is stored, which when executed by a processor, implements the steps of the screen projection data display processing method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110472387.0A CN113206964B (en) | 2021-04-29 | 2021-04-29 | Screen projection data display processing method and device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110472387.0A CN113206964B (en) | 2021-04-29 | 2021-04-29 | Screen projection data display processing method and device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113206964A CN113206964A (en) | 2021-08-03 |
| CN113206964B true CN113206964B (en) | 2022-07-26 |
Family
ID=77027800
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110472387.0A Active CN113206964B (en) | 2021-04-29 | 2021-04-29 | Screen projection data display processing method and device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113206964B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891167B (en) * | 2021-08-27 | 2023-07-04 | 荣耀终端有限公司 | Screen projection method and electronic equipment |
| CN114222188A (en) * | 2021-12-28 | 2022-03-22 | 深圳小湃科技有限公司 | Full-screen display method, device and equipment based on rotary screen and storage medium |
| CN114463359A (en) * | 2022-01-30 | 2022-05-10 | 深圳创维－Rgb电子有限公司 | Screen projection display method and device, electronic equipment and readable storage medium |
| WO2024045026A1 (en) * | 2022-08-31 | 2024-03-07 | 广州视源电子科技股份有限公司 | Display method, electronic device, display device, screen mirroring device and medium |
| CN118368462A (en) * | 2023-01-17 | 2024-07-19 | 华为技术有限公司 | Screen throwing method |
| CN118741195A (en) * | 2023-03-28 | 2024-10-01 | 华为技术有限公司 | Video switching method and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107105184A (en) * | 2017-04-01 | 2017-08-29 | 深圳市蓝莓派科技有限公司 | A kind of same screen projective techniques of mobile terminal in portrait layout advertisement machine |
| CN110221798A (en) * | 2019-05-29 | 2019-09-10 | 华为技术有限公司 | A kind of throwing screen method, system and relevant apparatus |
| CN111625211A (en) * | 2019-12-03 | 2020-09-04 | 蘑菇车联信息科技有限公司 | Screen projection method and device, android device and display device |
| WO2020221039A1 (en) * | 2019-04-28 | 2020-11-05 | 华为技术有限公司 | Screen projection method, electronic device and screen projection system |
| CN112579030A (en) * | 2020-12-11 | 2021-03-30 | 联想(北京)有限公司 | Screen projection output control method and device and electronic equipment |
| CN112653923A (en) * | 2019-10-12 | 2021-04-13 | 中冶赛迪重庆信息技术有限公司 | Intelligent screen projection system and screen projection method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105828155A (en) * | 2016-03-21 | 2016-08-03 | 乐视网信息技术（北京）股份有限公司 | Video playing method and device |
-
2021
- 2021-04-29 CN CN202110472387.0A patent/CN113206964B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107105184A (en) * | 2017-04-01 | 2017-08-29 | 深圳市蓝莓派科技有限公司 | A kind of same screen projective techniques of mobile terminal in portrait layout advertisement machine |
| WO2020221039A1 (en) * | 2019-04-28 | 2020-11-05 | 华为技术有限公司 | Screen projection method, electronic device and screen projection system |
| CN110221798A (en) * | 2019-05-29 | 2019-09-10 | 华为技术有限公司 | A kind of throwing screen method, system and relevant apparatus |
| CN112653923A (en) * | 2019-10-12 | 2021-04-13 | 中冶赛迪重庆信息技术有限公司 | Intelligent screen projection system and screen projection method |
| CN111625211A (en) * | 2019-12-03 | 2020-09-04 | 蘑菇车联信息科技有限公司 | Screen projection method and device, android device and display device |
| CN112579030A (en) * | 2020-12-11 | 2021-03-30 | 联想(北京)有限公司 | Screen projection output control method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113206964A (en) | 2021-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113206964B (en) | Screen projection data display processing method and device, terminal equipment and storage medium | |
| EP3751862B1 (en) | Display method and device, television set, and storage medium | |
| CN113268622A (en) | Picture browsing method and device, electronic equipment and storage medium | |
| US8467509B2 (en) | Video displaying apparatus, video displaying system and video displaying method | |
| CN113905268A (en) | Black edge removing method for screen projection display of mobile terminal | |
| CN112533048B (en) | Video playing method, device and equipment | |
| CN113438436B (en) | Video playing method, video conference method, live broadcast method and related equipment | |
| CN103561312A (en) | Method and device for adjusting video playing interface | |
| US20120301030A1 (en) | Image processing apparatus, image processing method and recording medium | |
| CN113778360B (en) | Screen projection method and electronic equipment | |
| WO2017096854A1 (en) | Picture preview method and device for smart terminal | |
| CN111246270B (en) | Method, device, equipment and storage medium for displaying bullet screen | |
| US9319468B2 (en) | Information processing apparatus and information processing method | |
| CN113010135B (en) | Data processing method and device, display terminal and storage medium | |
| CN111432261A (en) | Video window picture display method and device | |
| CN103997519A (en) | Method and device for transmitting image | |
| CN113282262A (en) | Control method and device for screen projection display picture, mobile terminal and storage medium | |
| WO2022227974A1 (en) | Subtitle processing method, apparatus and device and storage medium | |
| CN107623798A (en) | A kind of method and device of video local scale | |
| CN103699657A (en) | Method and device for playing and processing multimedia of web pages | |
| EP2731099A1 (en) | Image output device, image output method, and program | |
| KR102152627B1 (en) | Method and apparatus for displaying contents related in mirroring picture | |
| TWI629898B (en) | Server device, client device and dynamic image transmission method for virtual desktop infrastructure | |
| CN112738620A (en) | Media resource screen projection method, equipment and system | |
| CN113438550A (en) | Video playing method, video conference method, live broadcasting method and related devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |