CN112153459A - Method and device for screen projection display - Google Patents
Method and device for screen projection display Download PDFInfo
- Publication number
- CN112153459A CN112153459A CN202010903345.3A CN202010903345A CN112153459A CN 112153459 A CN112153459 A CN 112153459A CN 202010903345 A CN202010903345 A CN 202010903345A CN 112153459 A CN112153459 A CN 112153459A
- Authority
- CN
- China
- Prior art keywords
- screen
- sub
- terminal device
- pictures
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 230000004044 response Effects 0.000 claims abstract description 6
- 238000005192 partition Methods 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 8
- 230000002194 synthesizing effect Effects 0.000 claims description 5
- 239000000284 extract Substances 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 8
- 230000008569 process Effects 0.000 description 26
- 238000005266 casting Methods 0.000 description 11
- 239000011800 void material Substances 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000013515 script Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
- H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
Abstract
The invention provides a method and a device for screen projection display, wherein the method comprises the following steps: splitting a plurality of sub-pictures from a page resource corresponding to a picture displayed in a screen of the first terminal equipment in response to a screen projection instruction; and adjusting the layout of each sub-picture in the plurality of sub-pictures in the screen according to the screen information of the second terminal equipment, so that each sub-picture is displayed on the screen of the second terminal equipment according to the layout. The method and the device provided by the invention not only can effectively reduce or avoid the large black vacant area of the screen of the large-screen display device caused by the inconsistent screen display specifications during the screen projection display, but also can fully utilize the large-screen display resources of the large-screen display device, thereby fully exerting the large-screen display advantages of the large-screen display device, and improving the screen projection display effect on the large-screen display device and the viewing experience of a user.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to a method and an apparatus for screen projection display.
Background
With the popularization of screen projection technology, in particular, the way of projecting a screen to a television by using a mobile phone is getting more and more attention, however, the existing technology of projecting a screen to a television by using a mobile phone can only project the same picture as that displayed on the screen of a mobile phone to the screen of a television, and therefore, when the screen display specification (such as screen resolution and the like) of a mobile phone is inconsistent with the screen display specification of a television, a large black vacant area may appear on the screen of a television. This is more often the case on the screen of a tv with a rotary screen function, for example, when the mobile phone is in the vertical screen and the tv is in the horizontal screen, large black vacant areas (as shown in fig. 3 and 5) appear on the left and right sides of the screen of the tv; or, when the mobile phone is in the horizontal screen and the television is in the vertical screen, large black vacant areas (as shown in fig. 7) appear at the upper and lower ends of the screen of the television. In addition, the black void area generated by the inconsistent screen state is even larger than the display area of the screen projection picture, which not only affects the display effect of the screen projection picture on the screen of the television and the viewing experience of the user, but also fails to fully exert/utilize the advantages of the large-screen display of the television.
Therefore, a method and an apparatus for solving the above problems are desired.
Disclosure of Invention
The invention aims to provide a method and a device for screen projection display.
According to an aspect of the present invention, there is provided a method for screen projection display, the method comprising: splitting a plurality of sub-pictures from a page resource corresponding to a picture displayed in a screen of the first terminal equipment in response to a screen projection instruction; and adjusting the layout of each sub-picture in the plurality of sub-pictures in the screen according to the screen information of the second terminal equipment, so that each sub-picture is displayed on the screen of the second terminal equipment according to the layout.
Preferably, the method further comprises: synthesizing the plurality of sub-pictures into a new picture according to the adjusted layout; and projecting the new picture to a screen of the second terminal equipment for displaying.
Preferably, the splitting of the plurality of sub-pictures from the page resource corresponding to the picture displayed in the screen of the first terminal device may include: acquiring a document object model of the page resource based on a tree structure; and extracting a plurality of elements from the document object model as the plurality of sprites.
Preferably, the screen information of the second terminal device may include a screen resolution of the second terminal device and/or a screen status of the second terminal device, where the screen status of the second terminal device indicates whether the second terminal device is in a landscape screen or a portrait screen.
Preferably, the adjusting may comprise at least one of: adjusting the relative position of each of the plurality of sub-pictures in the screen; adjusting a length and/or a width of each of the plurality of sprites; and adjusting the ratio of the length to the width of each of the plurality of sprites.
Preferably, the adjusting of the layout of each of the plurality of sub-pictures in the screen according to the screen information of the second terminal device may include: dividing a screen of the second terminal device into a plurality of display partitions according to the screen information of the second terminal device; allocating a corresponding display partition for each of the plurality of sub-pictures to arrange the plurality of sub-pictures on the screen of the second terminal device; and filling each of the plurality of sub-pictures into a corresponding display partition to adjust the layout of each of the plurality of sub-pictures in the screen.
Preferably, the plurality of sub-pictures may be arranged on the screen of the second terminal device in a manner of occupying the entire screen.
According to another aspect of the present invention, there is provided an apparatus for a projection display, the apparatus comprising: the splitting unit is used for responding to the screen projection instruction and splitting a plurality of sub-pictures from the page resources corresponding to the pictures displayed in the screen of the first terminal equipment; and the adjusting unit is used for adjusting the layout of each sub-picture in the plurality of sub-pictures in the screen according to the screen information of the second terminal equipment so that each sub-picture is displayed on the screen of the second terminal equipment according to the layout.
Preferably, the apparatus further comprises: a synthesizing unit that synthesizes the plurality of sub-pictures into a new picture according to the adjusted layout; and the screen projection unit is used for projecting the new picture to the screen of the second terminal equipment for displaying.
Preferably, the splitting unit may include: the model acquisition unit is used for acquiring a document object model of the page resource based on a tree structure; and the picture splitting unit extracts a plurality of elements from the document object model as the plurality of sub-pictures.
Preferably, the screen information of the second terminal device may include a screen resolution of the second terminal device and/or a screen status of the second terminal device, where the screen status of the second terminal device indicates whether the second terminal device is in a landscape screen or a portrait screen.
Preferably, the adjusting may comprise at least one of: adjusting the relative position of each of the plurality of sub-pictures in the screen; adjusting a length and/or a width of each of the plurality of sprites; and adjusting the ratio of the length to the width of each of the plurality of sprites.
Preferably, the adjusting unit may include: the screen dividing unit is used for dividing the screen of the second terminal equipment into a plurality of display partitions according to the screen information of the second terminal equipment; an allocation and arrangement unit, which allocates a corresponding display partition for each of the plurality of sub-pictures to arrange the plurality of sub-pictures on the screen of the second terminal device; and a filling adjusting unit for filling each of the plurality of sub-pictures into a corresponding display partition to adjust the layout of each of the plurality of sub-pictures in the screen.
Preferably, the plurality of sub-pictures may be arranged on the screen of the second terminal device in a manner of occupying the entire screen.
According to another aspect of the invention, a computer-readable storage medium is provided, in which a computer program is stored which, when being executed by a processor, carries out the method for on-screen display as described above.
According to another aspect of the present invention, there is provided a computer apparatus comprising: a processor; a memory storing a computer program which, when executed by the processor, implements a method for on-screen display as described previously.
The method and the device for screen projection display provided by the invention not only can effectively reduce or avoid large black vacant areas on the screen of the screen projection caused by inconsistent screen display specifications during screen projection display, but also can fully utilize large-screen display resources of large-screen display equipment (such as, but not limited to, televisions and the like), thereby fully playing the advantages of large-screen display of the large-screen display equipment, and improving the display effect of screen projection on the large-screen display equipment and the viewing experience of a user.
Drawings
The objects and features of the present invention will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a diagram illustrating an exemplary system for projecting a screen display in accordance with an exemplary embodiment of the present invention;
FIG. 2 is an exemplary process illustrating a method for projecting a display according to an exemplary embodiment of the present invention;
fig. 3 illustrates a schematic view of a screen displayed in a screen of a first terminal device being projected to a screen of a second terminal device without using a method for screen projection display according to an exemplary embodiment of the present invention;
fig. 4 illustrates a schematic view of a screen displayed in a screen of a first terminal device being projected to a screen of a second terminal device using a method for screen projection display according to an exemplary embodiment of the present invention;
fig. 5 illustrates another schematic view of a screen displayed in a screen of a first terminal device being projected to a screen of a second terminal device without using a method for screen projection display according to an exemplary embodiment of the present invention;
fig. 6 illustrates another schematic view of a screen shot of a picture presented in a screen of a first terminal device to a screen of a second terminal device using a method for screen shot display according to an exemplary embodiment of the present invention;
fig. 7 illustrates still another schematic view of a screen displayed in a screen of a first terminal device being projected to a screen of a second terminal device without using a method for screen projection display according to an exemplary embodiment of the present invention;
fig. 8 shows still another schematic view of a screen displayed in a screen of a first terminal device being projected to a screen of a second terminal device using a method for screen projection display according to an exemplary embodiment of the present invention.
Detailed Description
In order to improve the projection display effect and the user viewing experience, an embodiment of the present invention provides a method for projection display, the method including: splitting a plurality of sub-pictures from a page resource corresponding to a picture displayed in a screen of the first terminal equipment in response to a screen projection instruction; and adjusting the layout of each sub-picture in the plurality of sub-pictures in the screen according to the screen information of the second terminal equipment, so that each sub-picture is displayed on the screen of the second terminal equipment according to the layout. According to the embodiment of the invention, the layout of the plurality of pictures is adjusted according to the screen information of the second terminal device, so that the picture layout displayed on the screen of the second terminal device is more reasonable, and the screen projection display effect and the watching experience of a user are further improved.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a block diagram illustrating an exemplary system 100 for screen projection display according to an exemplary embodiment of the present invention.
Referring to fig. 1, the system 100 may include a first terminal device 101 and a second terminal device 102, and the first terminal device 101 may be connected to the second terminal device 102 in a wired or wireless (such as WIFI wireless local area network) manner.
In the system 100, the first terminal device 101 may be a portable device (such as, but not limited to, a mobile phone, a tablet, a smart watch, a notebook computer, etc.) which a user can directly perform an input operation, and the second terminal device 102 may be a home appliance (a large screen display device such as a television, etc.) which a user does not normally perform an input operation directly but performs an input operation by means of a remote control device, etc.
The first terminal device 101 may load and run various client applications or APPs, and may be configured to use a screen-casting protocol (such as, but not limited to, DLNA protocol, airplay protocol, lelink protocol, etc.) to cast a screen to the second terminal device 102 in response to a screen-casting instruction (e.g., a user clicking a screen-casting button) to push a picture (a page resource such as a web page, video, game, etc.) presented on the screen of the first terminal device 101 to the screen of the second terminal device 102 for display. In the example disclosed herein, the first terminal device 101 may be further configured to adjust the page layout of the picture displayed on the screen of the first terminal device 101 before pushing the picture displayed on the screen of the first terminal device 101 to the second terminal device 102, so that the adjusted picture is better adapted to the screen of the second terminal device 102, so as to optimize the display effect of the screen-shot picture, thereby improving the user experience. The above-described screen projection display process will be described in detail below.
FIG. 2 is an exemplary process 200 illustrating a method for projecting a display according to an exemplary embodiment of the present invention.
Referring to fig. 2, in block S210, the process 200 may split a plurality of sub-screens from page resources (such as, but not limited to, various pages written using markup languages such as html, xml, and xaml, and various scripts written using programming languages such as JavaScript, VBScript, Perl, PHP, Python, Ruby) corresponding to the screens exposed in the screen of the first terminal device 102 in response to the screen-casting instruction.
In this example, the process 200 may obtain a tree-based Document Object Model (DOM) of the page resource and extract a plurality of elements (such as, but not limited to, interface elements such as videos, pictures, text, controls, etc.) from the document object model as the plurality of sprites. Each element is tagged in the document object model with various tags, and the tag corresponding to each element also records various attributes such as the type (such as, but not limited to, video, picture, text, control, etc.), length, width, relative position, and URL address of the element. For example, layer elements labeled with < frame > tags, video elements labeled with < video > tags, list elements labeled with < ListView > tags, and so on.
In block S220, the process 200 may adjust a layout of each of the plurality of sub-pictures in the screen according to the screen information of the second terminal device 102, so that each sub-picture is displayed on the screen of the second terminal device according to the layout.
Considering that different screens have different screen resolutions (for example, the screen resolution of a liquid crystal television can be 1366 × 768 pixels, the screen resolution of a full-high definition liquid crystal television can reach 1920 × 1080 pixels, and the screen resolution of an ultra-high definition 4k television can reach 3840 × 2160 pixels), the same picture can present different display effects after being projected to the screens of different terminal devices, that is, the same picture can present black vacant areas of different sizes after being projected to the screens of different terminal devices, because the matching degree between the ratio of the length to the width of the screen display area of the first terminal device 101 and the ratio of the length to the width of the screen display area of the second terminal device 102 is different. Thus, in this example, the screen information of the second terminal device 102 may include a screen resolution of the second terminal device 102, which may be used to determine a length to width ratio of the screen display area of the second terminal device 102, and thus a degree of matching between the length to width ratio of the screen display area of the first terminal device 101 and the length to width ratio of the screen display area of the second terminal device 102. For example, if the ratio of the length to the width of the screen display area of the first terminal device 101 is not consistent with or differs significantly from the ratio of the length to the width of the screen display area of the second terminal device 102, the process 200 may adjust the layout of each sprite in the screen of the second terminal device 102 according to the screen resolution of the second terminal device 102; if the length to width ratio of the screen display area of the first terminal device 101 is substantially the same as the length to width ratio of the screen display area of the second terminal device 102, the process 200 may stretch or leave unchanged the picture presented in the screen of the first terminal device 101 as appropriate while the length to width ratio remains unchanged.
Further, for a screen having a rotary screen function, it is considered that such a screen may also change the ratio of the length to the width of the screen display area of the terminal device after rotating from the landscape screen to the portrait screen or from the portrait screen to the landscape screen. Thus, in this example, the screen information of the second terminal device 102 may further include a screen status of the second terminal device 102, which may indicate whether the screen of said second terminal device 102 is in landscape or portrait. This may enable a better adaptation of the projected picture to the screen state of the second terminal device 102.
Although the above describes the example in which the layout of each sprite in the screen of the second terminal apparatus 102 can be adjusted according to the screen resolution of the second terminal apparatus 102 and/or the screen state of the second terminal apparatus 102, the present disclosure is not limited to the screen information of the second terminal apparatus 102 described in the above example.
With respect to adjustment of a picture, in one example, the process 200 may implement adjustment of each of a plurality of sub-pictures by at least one of the following operations such as, but not limited to: the method includes adjusting a relative position of each of the plurality of sprites in the screen, adjusting a length and/or a width of each of the plurality of sprites, and adjusting a ratio of the length to the width of each of the plurality of sprites. Specifically, the process 200 may adjust the picture presented on the screen of the first terminal apparatus 101 to the picture desired by the user by changing parameters related to the above-described adjustment operation, such as, but not limited to, the relative Position coordinates Position (x, y), the Length and/or the Width and the Ratio of Length to Width of each sub-picture, and the like. Preferably, the process 200 may arrange a plurality of sub-pictures on the screen of the second terminal device in a manner of occupying the whole screen through the above adjustment operation, so as to avoid a large black void area on the screen of the second terminal device 102 when the screen is projected for display because the ratio of the length to the width of the screen display area of the first terminal device 101 does not match the ratio of the length to the width of the screen display area of the second terminal device 102.
In addition to the above adjustment operation, in another example, the process 200 may further divide the screen of the second terminal device 102 into a plurality of display partitions according to the screen information of the second terminal device 102, allocate a corresponding display partition for each of the plurality of sub-pictures split in step 101 to arrange the plurality of sub-pictures on the screen of the second terminal device 102, and fill each of the plurality of sub-pictures into a corresponding display partition to adjust the layout of each of the plurality of sub-pictures in the screen.
As a possible implementation, the process 200 may divide the screen by adopting different dividing strategies according to the screen information of the second terminal device 102. In particular, for screens with smaller screen sizes and lower screen resolutions, the process 200 may divide such screens into a few sparse display partitions, as they are not suitable for being divided into more display partitions; for screens with larger screen sizes and higher screen resolutions, the process 200 may divide such screens into multiple dense display partitions, as it is appropriate to divide into more display partitions. Further, the process 200 may assign a corresponding display partition to each of the split sub-pictures according to a predetermined priority assignment strategy, for example, a sub-picture with a high priority is assigned to a display partition first, and a sub-picture with a low priority is assigned to a display partition later until no display partition is available. The priority level of each sub-picture may depend on the weight of each sub-picture, and the weight of each sub-picture may depend on the area ratio and/or other information of each sub-picture in the picture displayed in the screen of the first terminal apparatus 101.
It should be noted that, the blocks S210 and S220 may be executed on the first terminal device 101 or the second terminal device 102, which is not limited in the present invention.
When the process 200 is executed by the first terminal apparatus 101, as shown in fig. 2, in block S230, the process 200 may combine a plurality of sub-pictures into a new picture in the adjusted layout; then, in block S240, the process 200 may project a new screen into the screen of the second terminal apparatus 102 for display. As a possible implementation, the process 200 may construct a new page according to the adjusted layout, and then parse the new page to draw a new picture, where the new picture is not displayed on the screen of the second terminal device 102, but is pushed to the screen of the second terminal device 102 for presentation through the screen-casting protocol.
When the process 200 is executed by the second terminal device 102, the process 200 may directly build a new page according to the adjusted layout and present the new page on the screen of the second terminal device 102 for display.
Hereinafter, the above screen projection display processing of the present invention will be described in further detail with reference to fig. 4, 6, and 8.
Fig. 3 shows a schematic diagram in which a picture presented in a screen of the first terminal apparatus 101 is projected to a screen of the second terminal apparatus 102 without using the method for screen projection display according to an exemplary embodiment of the present invention.
As shown in fig. 3, in the case where the screen of the first terminal apparatus 101 is in the portrait screen and the screen of the second terminal apparatus 102 is in the landscape screen, two large black vacant areas appear on the left and right sides of the screen of the second terminal apparatus 102 because the screen display specification of the first terminal apparatus 101 does not match the screen display specification of the second terminal apparatus 102.
As a comparison of fig. 3, fig. 4 shows a schematic view of screen-casting a picture presented in a screen of a first terminal apparatus 101 to a screen of a second terminal apparatus 102 using a method for screen-casting display according to an exemplary embodiment of the present invention.
As shown in fig. 4, also in the case that the screen of the first terminal device 101 is in a vertical screen and the screen of the second terminal device 102 is in a horizontal screen, after receiving the screen-throwing instruction, the process 200 does not directly throw the screen displayed on the screen of the first terminal device 101 onto the screen of the second terminal device 102, but analyzes three elements from the page resources corresponding to the screen displayed in the screen of the first terminal device 101, which are respectively: a bullet screen 301, a video 302, and a list 303 (wherein the bullet screen 301 and the video 302 are displayed superimposed on the screen of the first terminal device 101, and the list 303 is not displayed on the screen of the first terminal device 101); these three elements are then combined as a sub-picture to a new picture according to the page layout shown in fig. 4 and projected to the screen of the second terminal apparatus 102 for display.
Compared to fig. 3, the two large black void areas shown in fig. 3 do not appear at the left and right ends of the screen of the second terminal device 102 shown in fig. 4, and more content than that shown on the screen of the first terminal device 101 is also shown on the screen of the second terminal device 102 shown in fig. 4.
Fig. 5 shows another schematic diagram in which a picture presented in a screen of the first terminal apparatus 101 is projected to a screen of the second terminal apparatus 102 without using the method for screen projection display according to an exemplary embodiment of the present invention.
As shown in fig. 5, also in the case where the screen of the first terminal apparatus 101 is in the portrait screen and the screen of the second terminal apparatus 102 is in the landscape screen, since the screen display specification of the first terminal apparatus 101 does not match the screen display specification of the second terminal apparatus 102, two large black void areas also appear on the left and right sides of the screen of the second terminal apparatus 102.
As a comparison of fig. 5, fig. 6 shows another schematic view of screen-casting a picture presented in a screen of the first terminal apparatus 101 to a screen of the second terminal apparatus 102 using the method for screen-casting display according to an exemplary embodiment of the present invention.
As shown in fig. 6, also in the case that the screen of the first terminal device 101 is in a vertical screen and the screen of the second terminal device 102 is in a horizontal screen, after receiving the screen-throwing instruction, the process 200 does not directly throw the screen displayed on the screen of the first terminal device 101 onto the screen of the second terminal device 102, but analyzes three elements from the page resources corresponding to the screen displayed in the screen of the first terminal device 101, which are respectively: a video 601, a brief introduction and comment 602, and a list 603 (which are displayed in a vertically arranged manner on the screen of the first terminal apparatus 101) superimposed with a bullet screen; these three elements are then combined as a sub-picture to a new picture according to the page layout shown in fig. 6 and projected to the screen of the second terminal apparatus 102 for display.
In contrast to fig. 5, the two large black void areas shown in fig. 7 do not appear at the left and right ends of the screen of the second terminal apparatus 102 shown in fig. 6.
Fig. 7 shows a schematic diagram in which a picture presented in a screen of a first terminal apparatus 101 is projected to a screen of a second terminal apparatus 102 without using a method for screen projection display according to an exemplary embodiment of the present invention.
As shown in fig. 7, in the case where the screen of the first terminal apparatus 101 is in the landscape screen and the screen of the second terminal apparatus 102 is in the portrait screen, two large black void areas appear at the upper and lower ends of the screen of the second terminal apparatus 102 because the screen display specification of the first terminal apparatus 101 does not match the screen display specification of the second terminal apparatus 102.
As a comparison of fig. 7, fig. 8 shows a schematic view of screen-casting a picture presented in a screen of a first terminal apparatus 101 to a screen of a second terminal apparatus 102 using a method for screen-casting display according to an exemplary embodiment of the present invention.
As shown in fig. 8, also in the case that the screen of the first terminal device 101 is in a horizontal screen and the screen of the second terminal device 102 is in a vertical screen, after receiving the screen-throwing instruction, the process 200 does not directly throw the screen displayed on the screen of the first terminal device 101 onto the screen of the second terminal device 102, but analyzes three elements from the page resources corresponding to the screen displayed in the screen of the first terminal device 101, which are respectively: a video 801 superimposed with a bullet screen, a brief introduction and comment 802, and a list 803 (in which only the video 801 superimposed with a bullet screen is displayed on the screen of the first terminal apparatus 101); these three elements are then combined as a sub-picture into a new picture according to the page layout shown in fig. 8 and projected to the screen of the second terminal apparatus 102 for display.
In comparison with fig. 7, two large black void areas shown in fig. 7 do not appear at the upper and lower ends of the screen of the second terminal apparatus 102 shown in fig. 8.
It can be seen that, the implementation process of the present invention not only can effectively reduce or avoid the occurrence of a large black vacant area on the screen of the projection screen due to the inconsistent screen display specifications during the projection screen display, but also can make full use of the large screen display resources of the large screen display device (such as, but not limited to, a television, etc.), thereby fully exerting the advantages of the large screen display device, and improving the display effect of the projection screen on the large screen display device and the viewing experience of the user.
There is also provided in accordance with an exemplary embodiment of the invention, apparatus for screen projection display, the apparatus including: the splitting unit is used for responding to the screen projection instruction and splitting a plurality of sub-pictures from the page resources corresponding to the pictures displayed in the screen of the first terminal equipment; and the adjusting unit is used for adjusting the layout of each sub-picture in the plurality of sub-pictures in the screen according to the screen information of the second terminal equipment so that each sub-picture is displayed on the screen of the second terminal equipment according to the layout.
The apparatus for projection display according to an exemplary embodiment of the present invention may further include: a synthesizing unit that synthesizes the plurality of sub-pictures into a new picture according to the adjusted layout; and the screen projection unit is used for projecting the new picture to the screen of the second terminal equipment for displaying.
The splitting unit may include: the model acquisition unit is used for acquiring a document object model of the page resource based on a tree structure; and the picture splitting unit extracts a plurality of elements from the document object model as the plurality of sub-pictures.
There is also provided, in accordance with an exemplary embodiment of the present invention, a computer-readable storage medium storing a computer program. The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to perform a method for screen projection display according to the present invention. The computer readable recording medium is any data storage device that can store data read by a computer system. Examples of the computer-readable recording medium include: read-only memory, random access memory, read-only optical disks, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the internet via wired or wireless transmission paths).
There is also provided, in accordance with an exemplary embodiment of the present invention, a computer apparatus. The computer device includes a processor and a memory. The memory is for storing a computer program. The computer program is executed by a processor such that the processor performs the method for on-screen display according to the invention.
While the present application has been shown and described with reference to preferred embodiments, it will be understood by those skilled in the art that various changes and modifications may be made to these embodiments without departing from the spirit and scope of the present application as defined by the following claims.
Claims (16)
1. A method for screen projection display, the method comprising:
splitting a plurality of sub-pictures from a page resource corresponding to a picture displayed in a screen of the first terminal equipment in response to a screen projection instruction;
and adjusting the layout of each sub-picture in the plurality of sub-pictures in the screen according to the screen information of the second terminal equipment, so that each sub-picture is displayed on the screen of the second terminal equipment according to the layout.
2. The method of claim 1, wherein the method further comprises:
synthesizing the plurality of sub-pictures into a new picture according to the adjusted layout;
and projecting the new picture to a screen of the second terminal equipment for displaying.
3. The method of claim 1, wherein splitting the plurality of sub-pictures from the page resource corresponding to the picture presented in the screen of the first terminal device comprises:
acquiring a document object model of the page resource based on a tree structure; and
extracting a plurality of elements from the document object model as the plurality of sprites.
4. The method of claim 1, wherein the screen information of the second terminal device comprises a screen resolution of the second terminal device and/or a screen status of the second terminal device, wherein the screen status of the second terminal device indicates whether the second terminal device is in a landscape screen or a portrait screen.
5. The method of claim 1, wherein the adjusting comprises at least one of:
adjusting the relative position of each of the plurality of sub-pictures in the screen;
adjusting a length and/or a width of each of the plurality of sprites; and
adjusting a ratio of a length to a width of each of the plurality of sprites.
6. The method of claim 1, wherein the adjusting of the layout of each of the plurality of sub-pictures in the screen according to the screen information of the second terminal device comprises:
dividing a screen of the second terminal device into a plurality of display partitions according to the screen information of the second terminal device;
allocating a corresponding display partition for each of the plurality of sub-pictures to arrange the plurality of sub-pictures on the screen of the second terminal device; and
and filling each of the plurality of sub-pictures into the corresponding display partition to adjust the layout of each of the plurality of sub-pictures in the screen.
7. The method according to any of claims 1 to 6, wherein the plurality of sub-pictures are arranged on the screen of the second terminal device in such a way that the entire screen is occupied.
8. An apparatus for a projection display, the apparatus comprising:
the splitting unit is used for responding to the screen projection instruction and splitting a plurality of sub-pictures from the page resources corresponding to the pictures displayed in the screen of the first terminal equipment;
and the adjusting unit is used for adjusting the layout of each sub-picture in the plurality of sub-pictures in the screen according to the screen information of the second terminal equipment so that each sub-picture is displayed on the screen of the second terminal equipment according to the layout.
9. The apparatus of claim 8, further comprising:
a synthesizing unit that synthesizes the plurality of sub-pictures into a new picture according to the adjusted layout;
and the screen projection unit is used for projecting the new picture to the screen of the second terminal equipment for displaying.
10. The apparatus of claim 8, wherein the splitting unit comprises:
the model acquisition unit is used for acquiring a document object model of the page resource based on a tree structure; and
and the picture splitting unit extracts a plurality of elements from the document object model as the plurality of sub-pictures.
11. The apparatus of claim 8, wherein the screen information of the second terminal device comprises a screen resolution of the second terminal device and/or a screen status of the second terminal device, wherein the screen status of the second terminal device indicates whether the second terminal device is in landscape or portrait.
12. The apparatus of claim 8, wherein the adjusting comprises at least one of:
adjusting the relative position of each of the plurality of sub-pictures in the screen;
adjusting a length and/or a width of each of the plurality of sprites; and
adjusting a ratio of a length to a width of each of the plurality of sprites.
13. The apparatus of claim 8, wherein the adjustment unit comprises:
the screen dividing unit is used for dividing the screen of the second terminal equipment into a plurality of display partitions according to the screen information of the second terminal equipment;
an allocation and arrangement unit, which allocates a corresponding display partition for each of the plurality of sub-pictures to arrange the plurality of sub-pictures on the screen of the second terminal device; and
and the filling adjusting unit is used for filling each of the plurality of sub-pictures into the corresponding display partition so as to adjust the layout of each of the plurality of sub-pictures in the screen.
14. The apparatus according to any of claims 8-13, wherein the plurality of sub-pictures are arranged on the screen of the second terminal device in a manner that the entire screen is occupied.
15. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out a method for screen projection display according to any one of claims 1 to 7.
16. A computer device, characterized in that the computer device comprises:
a processor;
memory storing a computer program which, when executed by the processor, implements a method for screen projection display as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010903345.3A CN112153459A (en) | 2020-09-01 | 2020-09-01 | Method and device for screen projection display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010903345.3A CN112153459A (en) | 2020-09-01 | 2020-09-01 | Method and device for screen projection display |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112153459A true CN112153459A (en) | 2020-12-29 |
Family
ID=73890472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010903345.3A Pending CN112153459A (en) | 2020-09-01 | 2020-09-01 | Method and device for screen projection display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112153459A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112667184A (en) * | 2021-01-28 | 2021-04-16 | 青岛海信传媒网络技术有限公司 | Display device |
| CN114579231A (en) * | 2022-02-15 | 2022-06-03 | 北京优酷科技有限公司 | Page display method and device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104407773A (en) * | 2014-11-18 | 2015-03-11 | 百度在线网络技术（北京）有限公司 | Page display method and device |
| CN108874341A (en) * | 2018-06-13 | 2018-11-23 | 深圳市东向同人科技有限公司 | Screen prjection method and terminal device |
| CN110381195A (en) * | 2019-06-05 | 2019-10-25 | 华为技术有限公司 | A kind of throwing screen display methods and electronic equipment |
| CN111367482A (en) * | 2020-02-25 | 2020-07-03 | 云南腾云信息产业有限公司 | Screen projection method and device for terminal |
| CN111399789A (en) * | 2020-02-20 | 2020-07-10 | 华为技术有限公司 | Interface layout method, device and system |
-
2020
- 2020-09-01 CN CN202010903345.3A patent/CN112153459A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104407773A (en) * | 2014-11-18 | 2015-03-11 | 百度在线网络技术（北京）有限公司 | Page display method and device |
| CN108874341A (en) * | 2018-06-13 | 2018-11-23 | 深圳市东向同人科技有限公司 | Screen prjection method and terminal device |
| CN110381195A (en) * | 2019-06-05 | 2019-10-25 | 华为技术有限公司 | A kind of throwing screen display methods and electronic equipment |
| CN111399789A (en) * | 2020-02-20 | 2020-07-10 | 华为技术有限公司 | Interface layout method, device and system |
| CN111367482A (en) * | 2020-02-25 | 2020-07-03 | 云南腾云信息产业有限公司 | Screen projection method and device for terminal |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112667184A (en) * | 2021-01-28 | 2021-04-16 | 青岛海信传媒网络技术有限公司 | Display device |
| CN114579231A (en) * | 2022-02-15 | 2022-06-03 | 北京优酷科技有限公司 | Page display method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220011926A1 (en) | Systems and methods for rendering user interface elements | |
| EP1914640B1 (en) | Multiple screen size render-engine | |
| CN106528025B (en) | Multi-screen image projection method, terminal, server and system | |
| EP3780637A1 (en) | Webpage video playback method and apparatus, electronic device and storage medium | |
| CN104813393B (en) | Displaying applications on a fixed orientation display | |
| US9538231B2 (en) | Systems and methods for rendering multiple applications on television screens | |
| CN110062284A (en) | Video broadcasting method, device and electronic equipment | |
| JP6081037B1 (en) | Image receiving and reproducing apparatus, image generating and transmitting apparatus, display system, image receiving and reproducing method, image generating and transmitting method, image receiving and reproducing program, and image generating and transmitting program | |
| CN112149025B (en) | Media resource display method and device, storage medium and electronic equipment | |
| CN112153459A (en) | Method and device for screen projection display | |
| CN114650434A (en) | Cloud service-based rendering method and related equipment thereof | |
| CN107864384B (en) | Method and device for redirecting internet video playing on cloud desktop | |
| CN111901660A (en) | Image display method, terminal, electronic equipment and storage medium | |
| US20220078505A1 (en) | User interface display method and device | |
| KR102152627B1 (en) | Method and apparatus for displaying contents related in mirroring picture | |
| CN109933735B (en) | Scheduling method, webpage rendering method, webpage display method and equipment thereof | |
| US20170142172A1 (en) | Video Player for Multiple Cameras, Playing System and Playing Method | |
| WO2018214768A1 (en) | Rendering method and device | |
| CN113949900B (en) | Live broadcast mapping processing method, system, equipment and storage medium | |
| CN113709541A (en) | WEB-based multi-terminal equipment interaction method, system and terminal equipment | |
| CN113497958A (en) | Display device and picture display method | |
| CN103957466B (en) | Method, server and the system of web page display are carried out based on set-top box | |
| CN115396717B (en) | Display device and display image quality adjusting method | |
| CN112287263B (en) | Webpage display method, device, system, terminal and computer readable storage medium | |
| KR101852493B1 (en) | Media play device and method for accelerating animation processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201229 |