CN113206964A - Screen projection data display processing method and device, terminal equipment and storage medium - Google Patents
Screen projection data display processing method and device, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN113206964A CN113206964A CN202110472387.0A CN202110472387A CN113206964A CN 113206964 A CN113206964 A CN 113206964A CN 202110472387 A CN202110472387 A CN 202110472387A CN 113206964 A CN113206964 A CN 113206964A
- Authority
- CN
- China
- Prior art keywords
- screen
- data stream
- window
- video
- full
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims description 18
- 230000005540 biological transmission Effects 0.000 claims abstract description 69
- 239000000203 mixture Substances 0.000 claims abstract description 32
- 238000005070 sampling Methods 0.000 claims description 19
- 238000005266 casting Methods 0.000 claims description 12
- 230000006870 function Effects 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 abstract description 27
- 230000008859 change Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 230000003321 amplification Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003997 social interaction Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4367—Establishing a secure communication between the client and a peripheral device or smart card
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/775—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a device for displaying and processing screen projection data, terminal equipment and a storage medium, wherein the method comprises the following steps: receiving a screen transmission data stream of screen projection; analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream; judging the size and position of a video playing window in the extracted window information and video composition information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream; and displaying the generated full-screen data stream in a full screen mode. The invention can independently project videos played in a window mode in a mobile equipment terminal, such as a mobile phone, to large-screen equipment such as a television and the like and play the videos in a full screen mode. The method aims to solve the problem that the screen can only be projected on the mobile phone end screen data in the existing screen projection technology without change, and can meet the further requirement of a user on the screen projection function, so that the user can obtain more convenient and comprehensive screen projection video watching experience.
Description
Technical Field
The invention relates to the technical field of screen projection, in particular to a screen projection data display processing method, a screen projection data display processing device, terminal equipment and a storage medium.
Background
With the development of science and technology, the demand of people for watching videos is no longer limited to small screens of mobile devices such as mobile phones, and the user experience brought by using a projection screen experience large screen is a function commonly used by many users, and the function is also the capability of mobile phones and televisions generally. However, the existing screen projection technology can only project the content on the screen of the mobile device to the screen projection receiving end without further considering the requirements of the user, and the functions of selectively projecting the screen and amplifying the video window are achieved.
Thus, there is still a need for improvement and development of the prior art.
Disclosure of Invention
The present invention provides a method, an apparatus, a terminal device and a storage medium for processing screen projection data display, which solve the technical problem that in the prior art, only the content on the screen of a mobile device end can be projected onto a screen projection receiving end without moving, but the screen projection cannot be performed selectively and a video window cannot be enlarged.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
a screen projection data display processing method, wherein the method comprises the following steps:
receiving a screen transmission data stream of screen projection;
analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
judging the size and position of a video playing window in the extracted window information and video composition information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream;
and displaying the generated full-screen data stream in a full screen mode.
The screen projection data display processing method comprises the following steps of analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream:
sampling and analyzing the data characteristics of the screen data stream in real time; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
and if the current screen transmission data stream contains the data stream of the video playing window, acquiring the window information of the video playing window.
The screen projection data display processing method comprises the steps of sampling and analyzing data characteristics of a screen transmission data stream in real time; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
sampling and analyzing the data characteristics of the screen data stream in real time; and judging whether the data stream of the video playing window is included by identifying the playing progress bar in the screen transmission data stream and the switching times of the pictures in the same area.
The screen projection data display processing method comprises the following steps of:
and acquiring the size and position of the video playing window and video composition information.
The method for processing the screen projection data display comprises the following steps of judging the size and the position of a video playing window in the extracted window information and video composition information, and carrying out secondary coding on a picture display area to generate a full-screen data stream:
judging the size and position of a video playing window in the window information and video composition information;
when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
when a black edge exists in the video composition information, setting the size and the position of a window with the black edge removed as a picture display area;
and packaging the video of the picture display area into a full-screen data stream.
The method for processing the screen projection data display, wherein the step of displaying the generated full-screen data stream in a full-screen manner comprises the following steps:
and adapting and displaying the full-screen data stream and the screen size.
The method for processing the screen projection data display comprises the following steps of:
setting a screen projection data display processing button;
when the small window video does not need to be amplified independently, receiving an operation instruction of a user through the screen projection data display processing button to close the screen projection data display processing function, and switching to screen transmission data stream playing;
when the mobile equipment is required to be used and the full-screen video is watched, the screen-casting data display processing function is started by receiving an operation instruction of a user through the screen-casting data display processing button, the screen-casting data display processing button is switched to the full-screen data stream to be played when a video playing window is detected to exist in the screen-transferring data stream, and the screen-transferring data stream is switched to the screen-transferring data stream to be played when the video playing window is detected to not exist in the screen-transferring data stream.
A screen-projected data display processing apparatus, wherein the apparatus comprises:
the receiving module is used for receiving screen transmission data flow of screen projection;
the analysis and extraction module is used for analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream;
the judging module is used for judging the size and position of a video playing window and video composition information in the extracted window information, and carrying out secondary coding on a picture display area to generate a full-screen data stream;
and the display control module is used for displaying the generated full-screen data stream in a full screen mode.
A terminal device comprises a memory, a processor and a screen projection data display processing program which is stored on the memory and can run on the memory, wherein when the processor executes the screen projection data display processing program, the steps of any screen projection data display processing program method are realized.
A computer-readable storage medium, wherein a screen-shot data display processing program is stored thereon, which, when executed by a processor, implements the steps of any one of the screen-shot data display processing methods.
Has the advantages that: compared with the prior art, the method and the device have the advantages that according to the detection of the position and the size of the video display area in the screen of the mobile equipment and the detection of the composition of the video, the picture display area in the video playing window is independently extracted and amplified when the screen is projected, and the purpose that the video which is played in a windowed mode on the mobile equipment is directly projected into a full-screen video which is played in a full screen mode is achieved. The method and the device enable the user to watch the screen-projected video played in a full screen while browsing the comments, and not only project the display interface of the mobile device end as it is, but also provide convenience for the user to use.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a detailed implementation of a screen projection data display processing method according to an embodiment of the present invention.
Fig. 2 is a schematic flowchart of a process of analyzing screen data and extracting video playing window information according to an embodiment of the present invention.
Fig. 3 is a schematic flow chart of determining video window information and generating a full screen data stream according to an embodiment of the present invention.
Fig. 4 is a flowchart illustrating a full-screen display of a generated full-screen data stream according to an embodiment of the present invention.
Fig. 5 is a schematic block diagram of a projection data display processing apparatus according to an embodiment of the present invention.
Fig. 6 is a schematic diagram of an internal structure of a terminal device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that, if directional indications (such as up, down, left, right, front, and back … …) are involved in the embodiment of the present invention, the directional indications are only used to explain the relative positional relationship between the components, the movement situation, and the like in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indications are changed accordingly.
In addition, if there is a description of "first", "second", etc. in an embodiment of the present invention, the description of "first", "second", etc. is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
With the development of science and technology, people no longer meet simple clothing and household lines, but pay more and more attention to the spiritual richness of entertainment, social interaction and the like, so that people can go to places such as markets, amusement parks, movie theaters and the like for relaxation and play during holidays, but for people who like to watch movies, the cost performance of going to the movie theaters is not high frequently, the movies shown in the movie theaters generally only comprise the latest movies and the most classic movies, a plurality of movies and television shows which are wanted to be watched are not shown in the movie theaters, the home theaters are a good choice for the people at the moment, the most important family theaters can watch videos on large screens, various screen projection software can meet the requirements of most people at the moment, and the videos which are wanted to be watched can be projected on televisions through mobile devices such as mobile phones without purchasing movie members and the like. However, the current screen projection technology can only project the picture displayed on the screen of the mobile phone as it is, when a user wants to watch the video played in full screen, the windowed video needs to be manually enlarged to full screen, and after full screen, the mobile phone can only be put on one side to wait for the video playing to be finished, or when other videos need to be switched to watch, the mobile phone needs to manually exit the full screen mode, which is troublesome.
In order to solve the problems in the prior art, this embodiment provides a method for processing screen-casting data display, when a user uses a mobile phone to perform screen casting, a television receives a screen-transmitting data stream, detects whether a video playing area exists in a current mobile phone screen, and when the television detects that a video is playing on the screen of the mobile phone, acquires the position, size and video composition information of the video playing area, where the video composition includes a picture display portion and a black border portion, a black border inevitably appears when a vertical screen video is played in a horizontal screen window and a vertical screen window plays a horizontal screen video, and at this time, the black border needs to be cut off and the picture area in the video is maximized, the television displays the processed full-screen data stream to obtain a video in a playing window which is individually subjected to full-screen amplification, so as to improve the user experience of screen casting software during use, and is more beneficial to the operation of video switching compared with the existing screen casting technology, and operations such as reading comments and the like can be simultaneously performed when the video is played. Furthermore, the chat software can be opened in a split screen mode for chatting, the split screen technology is more and more mature along with the continuous progress of the mobile phone technology, and more things can be synchronously achieved when the video is watched through the screen projection technology by means of the technical scheme.
Real-time method
First embodiment
As shown in fig. 1, an embodiment of the present invention provides a screen projection data display processing method, which can be used in screen projection applications of a mobile phone and a television. In an embodiment of the present invention, the method includes the steps of:
and S100, receiving screen transmission data flow of screen projection.
In this embodiment, after the screen projection end is connected to the receiving end, the screen projection end sends a screen transmission data stream to the receiving end, where the screen transmission data stream is data obtained by packaging a picture and an audio content displayed on a current screen by the screen projection end, for example, a mobile phone, and is sent to the receiving end, for example, a large-screen device such as a television, in a data stream manner.
A mobile device, such as a mobile phone, that performs screen projection may be connected to a large screen, such as a television, in both wired and wireless modes. When the mobile phone is connected with the television through a wire, the mobile phone interface type is usually used for connecting with the HDMI connecting wire, the television is required to be switched to a corresponding HDMI interface channel to display the mobile phone information, and after the connection is completed, the mobile phone transmits the transmission screen data stream to the television through the connecting wire. When the mobile phone and the television are in wireless connection, the mobile phone and the television need to be connected to the same WIFI, and screen transmission data stream transmission is carried out through the WIFI.
Further, step S200, analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
in this embodiment, when the television receives the screen transmission data stream, whether a video playing window for playing a video exists in the currently received screen transmission data stream is analyzed, that is, whether a video playing window for playing a video exists on a current mobile phone screen, and if a video playing window exists, window information of the video playing window is further extracted.
Specifically, as shown in fig. 2, the step S200 includes:
step S201, carrying out real-time sampling analysis on data characteristics of the screen transmission data stream; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
step S202, if the current screen transmission data stream contains the data stream of the video playing window, the window information of the video playing window is obtained.
The method comprises the steps of carrying out real-time sampling analysis on data characteristics of a screen data stream; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
and judging whether the data stream contains the video playing window or not by identifying the playing progress bar in the data stream and the switching times of the pictures in the same area.
If the current screen transmission data stream contains the data stream of the video playing window, the step of acquiring the window information of the video playing window comprises:
and acquiring the size and position of the video playing window and video composition information. The video composition refers to an area of a played picture and a black border part of an unplayed picture in the video playing window, wherein the black border does not appear in all video playing windows, and usually appears when a vertical screen video is played in a horizontal screen playing window and a horizontal screen video is played in a vertical screen playing window.
For example, when the mobile phone end is using the today's headline APP in the vertical screen mode, when the user is browsing the home page portion of the today's headline APP, only text and pictures exist in the screen display range of the mobile phone, so the screen transmission data stream only includes text and picture information at this time, and the television end does not detect a playing progress bar and a certain area for continuously switching pictures, and at this time, the television end does not process the screen transmission data stream. When a user clicks a certain video in the home page part of the today's headline APP, the today's headline APP enters a video watching mode, the video watching mode mainly comprises a video playing window which is displayed at the upper half part of the mobile phone screen and a video playing window which is not played and displayed at the lower half part of the mobile phone screen, when the user wants to switch video watching, the user only needs to slide the mobile phone screen downwards to move the video playing window which is not played to the upper half part of the mobile phone screen for playing, and a new video playing window which is not played appears at the lower half part of the mobile phone screen. At this time, a preset condition that a playing progress bar and a certain area for continuously switching pictures exist in the mobile phone screen, and the frequency for switching the pictures is more than 1 second 10 times or 1 second 30 times is existed, that is, the television performs data sampling on the screen transmission data stream to detect that a video playing window exists at the mobile phone end, and obtains window information of the video playing window, wherein the window information includes the position and the size of the video playing window in the display screen of the mobile phone end, whether a black edge exists and the size and the position of the black edge, when the position and the size of the video window and the position and the size of the black edge are obtained, a coordinate system can be established according to the resolution of the mobile phone screen contained in the screen transmission data stream, and the position and the size of the video window and the black edge are calibrated through the coordinate system.
Further, step S300, determining the size and position of the video playing window and the video composition information in the extracted window information to obtain a picture display area, and performing secondary encoding on the picture display area to generate a full-screen data stream;
in this embodiment, the television end determines the position of the extracted video playing window and the position and size of the black edge, and performs secondary encoding on the picture display area to generate the full-screen data stream, so that the television end can achieve the effect when the full-screen data stream is played on the mobile phone end, the full-screen data stream is obtained by the television end performing processing such as extraction, black edge removal, amplification and the like on the video playing window area in the screen-transmitting data stream, and can be directly played to obtain the full-screen video data stream.
Specifically, as shown in fig. 3, the step S300 includes:
step S301, judging the size and position of a video playing window and video composition information in window information;
step S302, when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
step S303, when a black edge exists in the video composition, setting the size and the position of the window with the black edge removed as a picture display area;
and step S304, packaging the image display area video into a full-screen data stream. The picture display area is an area where a playing picture actually exists after black edges are removed.
For example, the television end determines and extracts the size and position of a video playing window being played in the today's top APP, and if the video in the video playing window has no black edge, the size and position of the video playing window is 1080 × 960 pixels, and the video playing window is tightly attached to the upper edge of the mobile phone screen and just occupies half of the 1080P resolution screen, the size and position of the video playing window is set as a picture display area, and the television end extracts and enlarges the video in the picture display area in the screen transmission data stream into a 1080P video format and packages the video into a full-screen data stream. And when the video playing window has a black edge and the black edge occupies half of the video window on the left and right sides of the video picture, the television end remeasures the position and the size of the video window information to obtain new video window information with the size of 540 x 960, the new video window information is tightly attached to the upper edge of the screen and centered, the size and the position of the new video window are set as a picture display area, and the television end extracts and amplifies the video in the picture display area in the screen transmission data stream into a 1080P video format and packs the video into full-screen data stream without the black edge.
Further, in step S400, the generated full-screen data stream is displayed in full screen.
In this embodiment, the television end plays the full-screen data stream obtained by packaging on a display screen.
Specifically, as shown in fig. 4, the step S400 includes:
and S401, adapting and displaying the full-screen data stream and the screen size.
For example, when the television terminal packages the picture display area in the screen transmission data stream into a 1080P format full-screen data stream and displays the full-screen data stream on a 1080P display screen, the data stream does not need to be adapted to a screen for direct playing, and when the 1080P format full-screen data stream is played on a 4K television, the 1080P format full-screen data stream needs to be correspondingly amplified and adapted to the 4K display screen for playing. On the contrary, when the image display area is packed into a full-screen data stream of 4K format and played in a 1080P display screen, the full-screen data stream of 4K format needs to be correspondingly reduced and played.
In the second embodiment, in order to improve the accuracy of the judgment of the screen projection receiving end on the video playing window, a judgment process may be added to distinguish two situations, namely frequent switching of pictures in a certain area and frequent switching of pictures in a video playing area, which are caused by sliding a screen. Whether the video playing area is determined according to the frequency of switching pictures, namely the frame rate, the existing mobile devices such as mobile phones and tablets have a plurality of screens with high refresh rates such as 120Hz and 144Hz, and due to the limitation of the APP server, most of the default refresh rates of videos still stay at the levels of 25 frames, 30 frames and 60 frames, so that when a shot similar to translation also appears in the playing video, a step of detecting the picture refresh rate is added, and whether the translation area is a video area or a non-video area can be distinguished.
In the third embodiment, in order to improve the flexibility of the user when using the technical scheme, a setting button for starting and closing the screen projection data display processing is set in the screen projection scheme, so that the user can switch the data stream of the screen projection at the moment according to the requirement. The method comprises the steps that when a user does not need to independently amplify a small-window video, the processing is closed, the normal screen projection state can be returned, screen transmission data streams are played, namely, the screen display content of the mobile equipment is projected to the existing screen projection technology of a screen projection receiving end without moving, when the user needs to use the mobile equipment while browsing a large-screen video, the screen transmission data streams are clicked to be started, the receiving end such as a television end is used for carrying out real-time sampling analysis and judging whether a video playing window exists in the screen transmission data streams, if the video playing window exists, the full-screen data streams obtained through the processing are played, and if the video playing window disappears is detected, the played content is changed into the screen transmission data streams to maintain the continuity of the screen projection function of the user.
Exemplary device
As shown in fig. 5, an embodiment of the present invention provides a projection data display processing apparatus, including: a receiving module 510, an analyzing and extracting module 520, a judging module 530 and a display control module 540. Specifically, the receiving module 510 is configured to receive a screen-transmitting data stream of a screen projection; the analysis and extraction module 520 is configured to analyze the screen transmission data stream and extract window information of a video playing window in the screen transmission data stream; the judging module 530 is configured to judge the size and position of the video playing window in the extracted window information and the video composition information, and perform secondary encoding on the picture display area to generate a full-screen data stream; the display control module 540 is configured to perform full-screen display on the generated full-screen data stream.
Based on the above embodiments, the present invention further provides a terminal device, and a schematic block diagram thereof may be as shown in fig. 6. The terminal equipment comprises a processor, a memory, a network interface and a display screen which are connected through a system bus. Wherein the processor of the terminal device is configured to provide computing and control capabilities. The memory of the terminal equipment comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the terminal device is used for connecting and communicating with an external terminal through a network. The computer program is executed by a processor to implement a projected data display process. The display screen of the terminal equipment can be a liquid crystal display screen or an electronic ink display screen.
It will be understood by those skilled in the art that the block diagram of fig. 6 is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation to the terminal device to which the solution of the present invention is applied, and a specific terminal device may include more or less components than those shown in the figure, or combine some components, or have a different arrangement of components.
In one embodiment, there is provided a terminal device, the terminal device comprising a memory, a processor and a terminal data processing program stored on and executable on the processor, the processor performing the steps of:
receiving a screen transmission data stream of screen projection;
analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
judging the size and position of a video playing window in the extracted window information and video composition information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream;
and displaying the generated full-screen data stream in a full screen mode.
The step of analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream comprises the following steps:
sampling and analyzing the data characteristics of the screen data stream in real time; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
and if the current screen transmission data stream contains the data stream of the video playing window, acquiring the window information of the video playing window.
The data characteristics of the screen data stream are sampled and analyzed in real time; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
sampling and analyzing the data characteristics of the screen data stream in real time; and judging whether the data stream of the video playing window is included by identifying the playing progress bar in the screen transmission data stream and the switching times of the pictures in the same area.
Wherein, the step of obtaining the window information of the video playing window comprises:
and acquiring the size and position of the video playing window and video composition information.
The step of judging the size, position and video composition information of the video playing window in the extracted window information, and performing secondary coding on the picture display area to generate a full-screen data stream comprises the following steps:
judging the size and position of a video playing window in the window information and video composition information;
when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
when a black edge exists in the video composition information, setting the size and the position of a window with the black edge removed as a picture display area;
and packaging the video of the picture display area into a full-screen data stream.
Wherein, the step of displaying the generated full-screen data stream in full screen includes:
and adapting and displaying the full-screen data stream and the screen size.
Wherein, after the step of displaying the generated full-screen data stream in full screen, the method further comprises:
setting a screen projection data display processing button;
when the small window video does not need to be amplified independently, receiving an operation instruction of a user through the screen projection data display processing button to close the screen projection data display processing function, and switching to screen transmission data stream playing;
when the mobile equipment is required to be used and the full-screen video is watched, the screen-casting data display processing function is started by receiving an operation instruction of a user through the screen-casting data display processing button, the screen-casting data display processing button is switched to the full-screen data stream to be played when a video playing window is detected to exist in the screen-transferring data stream, and the screen-transferring data stream is switched to the screen-transferring data stream to be played when the video playing window is detected to not exist in the screen-transferring data stream.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
In summary, the present invention discloses a method, an apparatus, a terminal device and a storage medium for displaying and processing screen projection data, wherein the method comprises: receiving a screen transmission data stream of screen projection; analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream; judging the size and position of a video playing window in the extracted window information and video composition information to obtain a picture display area, and carrying out secondary coding on the picture display area to generate a full-screen data stream; and displaying the generated full-screen data stream in a full screen mode. The invention can independently project videos played in a window mode in a mobile equipment terminal, such as a mobile phone, to large-screen equipment such as a television and the like and play the videos in a full screen mode. The method aims to solve the problem that the screen can only be projected on the mobile phone end screen data in the existing screen projection technology without change, and can meet the further requirement of a user on the screen projection function, so that the user can obtain more convenient and comprehensive screen projection video watching experience.
It is to be understood that the invention disclosed is not limited to the examples described above, but may be modified or varied by those skilled in the art, all falling within the scope of the invention as defined by the appended claims.
Claims (10)
1. A screen projection data display processing method is characterized by comprising the following steps:
receiving a screen transmission data stream of screen projection;
analyzing the screen transmission data stream, and extracting window information of a video playing window in the screen transmission data stream;
obtaining a picture display area by the size and position of a video playing window in the extracted window information and video composition information, and carrying out secondary coding on the picture display area to generate a full-screen data stream;
and displaying the generated full-screen data stream in a full screen mode.
2. The screen-projection data display processing method of claim 1, wherein the step of analyzing the screen-transmission data stream and extracting window information of a video playing window in the screen-transmission data stream comprises:
sampling and analyzing the data characteristics of the screen data stream in real time; judging whether the current screen transmission data stream contains the data stream of a video playing window or not through data sampling;
and if the current screen transmission data stream contains the data stream of the video playing window, acquiring the window information of the video playing window.
3. The screen projection data display processing method of claim 2, wherein the data characteristics of the screen projection data stream are sampled and analyzed in real time; the step of judging whether the current screen transmission data stream contains the data stream of the video playing window or not through data sampling comprises the following steps:
sampling and analyzing the data characteristics of the screen data stream in real time; and judging whether the data stream of the video playing window is included or not by identifying the playing progress bar in the screen transmission data stream and the switching times of the pictures in the same area.
4. The screen-projection data display processing method of claim 2, wherein the step of obtaining window information of a video playing window comprises:
and acquiring the size and position of the video playing window and video composition information.
5. The screen-projection data display processing method of claim 1, wherein the step of judging the size, position and video composition information of the video playing window in the extracted window information and performing secondary coding on the picture display area to generate a full-screen data stream comprises:
judging the size and position of a video playing window in the window information and video composition information;
when no black edge exists in the video composition information, setting the size and the position of a current window as a picture display area;
when a black edge exists in the video composition information, setting the size and the position of a window with the black edge removed as a picture display area;
and packaging the video of the picture display area into a full-screen data stream.
6. The screen-projection data display processing method of claim 1, wherein the step of displaying the generated full-screen data stream in full screen comprises:
and adapting and displaying the full-screen data stream and the screen size.
7. The screen-projection data display processing method of claim 1, wherein the step of displaying the generated full-screen data stream in full screen further comprises:
setting a screen projection data display processing button;
when the small window video does not need to be amplified independently, receiving an operation instruction of a user through the screen projection data display processing button to close the screen projection data display processing function, and switching to screen transmission data stream playing;
when the mobile equipment is required to be used and the full-screen video is watched, the screen-casting data display processing function is started by receiving an operation instruction of a user through the screen-casting data display processing button, the screen-casting data display processing button is switched to the full-screen data stream to be played when a video playing window is detected to exist in the screen-transferring data stream, and the screen-transferring data stream is switched to the screen-transferring data stream to be played when the video playing window is detected to not exist in the screen-transferring data stream.
8. A screen-projected data display processing apparatus, the apparatus comprising:
the receiving module is used for receiving screen transmission data flow of screen projection;
the analysis and extraction module is used for analyzing the screen transmission data stream and extracting window information of a video playing window in the screen transmission data stream;
the judging module is used for judging the size and position of a video playing window and video composition information in the extracted window information, and carrying out secondary coding on a picture display area to generate a full-screen data stream;
and the display control module is used for displaying the generated full-screen data stream in a full screen mode.
9. A terminal device, characterized in that the terminal device comprises a memory, a processor and a screen projection data display processing program stored on the memory and operable on the memory, and the processor implements the steps of the screen projection data display processing program method according to any one of claims 1 to 7 when executing the screen projection data display processing program.
10. A computer-readable storage medium, on which a screen projection data display processing program is stored, which, when executed by a processor, implements the steps of the screen projection data display processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110472387.0A CN113206964B (en) | 2021-04-29 | 2021-04-29 | Screen projection data display processing method and device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110472387.0A CN113206964B (en) | 2021-04-29 | 2021-04-29 | Screen projection data display processing method and device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113206964A true CN113206964A (en) | 2021-08-03 |
| CN113206964B CN113206964B (en) | 2022-07-26 |
Family
ID=77027800
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110472387.0A Active CN113206964B (en) | 2021-04-29 | 2021-04-29 | Screen projection data display processing method and device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113206964B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891167A (en) * | 2021-08-27 | 2022-01-04 | 荣耀终端有限公司 | Screen projection method and electronic equipment |
| CN114222188A (en) * | 2021-12-28 | 2022-03-22 | 深圳小湃科技有限公司 | Full-screen display method, device and equipment based on rotary screen and storage medium |
| CN114463359A (en) * | 2022-01-30 | 2022-05-10 | 深圳创维－Rgb电子有限公司 | Screen projection display method and device, electronic equipment and readable storage medium |
| CN114489550A (en) * | 2022-01-30 | 2022-05-13 | 深圳创维－Rgb电子有限公司 | Screen projection control method, screen projector and storage medium |
| WO2024045026A1 (en) * | 2022-08-31 | 2024-03-07 | 广州视源电子科技股份有限公司 | Display method, electronic device, display device, screen mirroring device and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107105184A (en) * | 2017-04-01 | 2017-08-29 | 深圳市蓝莓派科技有限公司 | A kind of same screen projective techniques of mobile terminal in portrait layout advertisement machine |
| WO2017161765A1 (en) * | 2016-03-21 | 2017-09-28 | 乐视控股（北京）有限公司 | Video playback method and device |
| CN110221798A (en) * | 2019-05-29 | 2019-09-10 | 华为技术有限公司 | A kind of throwing screen method, system and relevant apparatus |
| CN111625211A (en) * | 2019-12-03 | 2020-09-04 | 蘑菇车联信息科技有限公司 | Screen projection method and device, android device and display device |
| WO2020221039A1 (en) * | 2019-04-28 | 2020-11-05 | 华为技术有限公司 | Screen projection method, electronic device and screen projection system |
| CN112579030A (en) * | 2020-12-11 | 2021-03-30 | 联想(北京)有限公司 | Screen projection output control method and device and electronic equipment |
| CN112653923A (en) * | 2019-10-12 | 2021-04-13 | 中冶赛迪重庆信息技术有限公司 | Intelligent screen projection system and screen projection method |
-
2021
- 2021-04-29 CN CN202110472387.0A patent/CN113206964B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017161765A1 (en) * | 2016-03-21 | 2017-09-28 | 乐视控股（北京）有限公司 | Video playback method and device |
| CN107105184A (en) * | 2017-04-01 | 2017-08-29 | 深圳市蓝莓派科技有限公司 | A kind of same screen projective techniques of mobile terminal in portrait layout advertisement machine |
| WO2020221039A1 (en) * | 2019-04-28 | 2020-11-05 | 华为技术有限公司 | Screen projection method, electronic device and screen projection system |
| CN110221798A (en) * | 2019-05-29 | 2019-09-10 | 华为技术有限公司 | A kind of throwing screen method, system and relevant apparatus |
| CN112653923A (en) * | 2019-10-12 | 2021-04-13 | 中冶赛迪重庆信息技术有限公司 | Intelligent screen projection system and screen projection method |
| CN111625211A (en) * | 2019-12-03 | 2020-09-04 | 蘑菇车联信息科技有限公司 | Screen projection method and device, android device and display device |
| CN112579030A (en) * | 2020-12-11 | 2021-03-30 | 联想(北京)有限公司 | Screen projection output control method and device and electronic equipment |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891167A (en) * | 2021-08-27 | 2022-01-04 | 荣耀终端有限公司 | Screen projection method and electronic equipment |
| CN114222188A (en) * | 2021-12-28 | 2022-03-22 | 深圳小湃科技有限公司 | Full-screen display method, device and equipment based on rotary screen and storage medium |
| CN114463359A (en) * | 2022-01-30 | 2022-05-10 | 深圳创维－Rgb电子有限公司 | Screen projection display method and device, electronic equipment and readable storage medium |
| CN114489550A (en) * | 2022-01-30 | 2022-05-13 | 深圳创维－Rgb电子有限公司 | Screen projection control method, screen projector and storage medium |
| WO2024045026A1 (en) * | 2022-08-31 | 2024-03-07 | 广州视源电子科技股份有限公司 | Display method, electronic device, display device, screen mirroring device and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113206964B (en) | 2022-07-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113206964B (en) | Screen projection data display processing method and device, terminal equipment and storage medium | |
| US9723123B2 (en) | Multi-screen control method and device supporting multiple window applications | |
| US8255825B2 (en) | Content aware adaptive display | |
| CN110446110B (en) | Video playing method, video playing device and storage medium | |
| US10965904B2 (en) | Display method and display device, television and storage medium | |
| CN113268622A (en) | Picture browsing method and device, electronic equipment and storage medium | |
| US8467509B2 (en) | Video displaying apparatus, video displaying system and video displaying method | |
| WO2021136158A1 (en) | Video window picture displaying method and apparatus | |
| JP2008199370A (en) | Digital-broadcasting program display device, and digital-broadcasting program display program | |
| CN111246270B (en) | Method, device, equipment and storage medium for displaying bullet screen | |
| CN113766324B (en) | Video playing control method and device, computer equipment and storage medium | |
| WO2020244553A1 (en) | Subtitle border-crossing processing method and apparatus, and electronic device | |
| US20120301030A1 (en) | Image processing apparatus, image processing method and recording medium | |
| CN113905268A (en) | Black edge removing method for screen projection display of mobile terminal | |
| CN113282262B (en) | Control method and device for projection display picture, mobile terminal and storage medium | |
| CN112533048A (en) | Video playing method, device and equipment | |
| US9875521B2 (en) | Image output apparatus, image output method, and program | |
| CN113010135A (en) | Data processing method and device, display terminal and storage medium | |
| CN112738620A (en) | Media resource screen projection method, equipment and system | |
| CN113438550A (en) | Video playing method, video conference method, live broadcasting method and related devices | |
| CN111711857A (en) | Multi-channel video playing method, terminal and readable storage medium | |
| KR20150073573A (en) | Method and apparatus for displaying contents related in mirroring picture | |
| TW201737714A (en) | Server device, client device and dynamic image transmission method for virtual desktop infrastructure | |
| CN106604105B (en) | Calculate the method and device of HBBTV application image size | |
| CN113411532B (en) | Method, device, terminal and storage medium for recording content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |