CN115484485A - Screen projection method, equipment and system - Google Patents

Screen projection method, equipment and system Download PDF

Info

Publication number
CN115484485A
CN115484485A CN202211132476.1A CN202211132476A CN115484485A CN 115484485 A CN115484485 A CN 115484485A CN 202211132476 A CN202211132476 A CN 202211132476A CN 115484485 A CN115484485 A CN 115484485A
Authority
CN
China
Prior art keywords
screen projection
screen
parameters
matching
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211132476.1A
Other languages
Chinese (zh)
Inventor
王莹
孙宇
赵文芳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN202211132476.1A priority Critical patent/CN115484485A/en
Publication of CN115484485A publication Critical patent/CN115484485A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

The disclosure provides a screen projection method, equipment and system. The screen projection method is applied to screen projection equipment and comprises the following steps: acquiring screen projection parameters, wherein the screen projection parameters comprise screen projection receiving equipment parameters sent by screen projection receiving equipment; obtaining matching parameters through rule matching based on the acquired screen projection parameters; encoding source data based on the matching parameters; and transmitting screen projection data including the encoded source data to the screen projection receiving device. According to the method, the purposes of reducing time delay, reducing power consumption, improving heating and improving display effect can be achieved through the joint optimization and cooperative work of the screen projection equipment and the screen projection receiving equipment.

Description

Screen projection method, equipment and system
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a screen projection method, device, and system.
Background
With the popularization of screen projection technology, more and more users want to enjoy large screen experience through screen projection technology while watching videos and playing games through terminals (e.g., mobile phones). The current screen projection technology transmits screen projection resources to screen projection receiving equipment by using fixed parameters, the screen projection equipment and the screen projection receiving equipment perform coding and decoding processing on the resources without additional modification, and the hardware of the screen projection equipment and the hardware of the screen projection receiving equipment are different, so that the current screen projection technology has the problems of high time delay, high power consumption, easiness in heating, inapplicable resource display effect to large screens and the like for some applications with high refresh rate requirements, such as games and the like.
Disclosure of Invention
The present disclosure provides a screen projection method, device and system, which at least solve the problems of high delay, high power consumption, easy heating, and unsuitable resource display effect for large screens in screen projection technologies in the related art.
According to a first aspect of the present disclosure, there is provided a screen projection method applied to a screen projection device, including: acquiring screen projection parameters, wherein the screen projection parameters comprise screen projection receiving equipment parameters sent by screen projection receiving equipment; obtaining matching parameters through rule matching based on the acquired screen projection parameters; encoding source data based on the matching parameters; and sending screen projection data including the encoded source data to the screen projection receiving device.
Preferably, the acquiring of the screen projection parameters includes: acquiring source data parameters and screen projection equipment parameters; establishing a handshake connection with the screen projection receiving equipment; and receiving the screen projection receiving equipment parameters sent by the screen projection receiving equipment based on the establishment of the handshake connection.
Preferably, the source data parameters include source resolution, and the screen projection receiving device parameters include resolution gear information; the obtaining of matching parameters through rule matching based on the obtained screen projection parameters comprises: calculating the matching degree between each resolution gear in the resolution gear information and the source resolution; selecting a resolution matching gear from the resolution gear information based on the calculated matching degree.
Preferably, the encoding source data based on the matching parameters includes: encoding the source data based on the resolution matching gear; wherein the screen projection data comprises the resolution matching gear.
Preferably, the source data parameters include a target frame rate, and the screen projection device parameters include a supported refresh rate; the obtaining of matching parameters through rule matching based on the obtained screen projection parameters comprises: ordering the supported refresh rates; determining a matching refresh rate matching the target frame rate according to the sorted support refresh rate; and adjusting the refresh rate of the screen according to the matched refresh rate.
Preferably, the source data parameters include a target frame rate; the obtaining of matching parameters through rule matching based on the obtained screen projection parameters further comprises: setting the target frame rate as a matched frame rate; the encoding the source data based on the matching parameters includes: encoding the source data based on the matched frame rate; wherein the screen projection data comprises the matching frame rate.
Preferably, the screen projection equipment parameters comprise a first screen mode, and the screen projection receiving equipment parameters comprise a second screen mode; the obtaining of matching parameters through rule matching based on the obtained screen projection parameters comprises: determining consistency of a first screen mode and a second screen mode, wherein the first screen mode and the second screen mode comprise a horizontal screen mode and a vertical screen mode; and determining the second screen mode as a matching screen mode under the condition that the first screen mode is inconsistent with the second screen mode.
Preferably, the encoding the source data based on the matching parameters includes: encoding the source data based on the matching screen pattern.
According to a second aspect of the present disclosure, there is provided a screen projection method applied to a screen projection receiving device, including: sending the screen projection receiving equipment parameters to screen projection equipment; receiving screen projection data including the encoded source data transmitted by the screen projection device; decoding the received encoded source data to obtain decoded data; and displaying on a screen based on the decoded data.
Preferably, the sending the screen projection receiving device parameters to the screen projection device comprises: establishing handshake connection with the screen projection equipment; and sending the screen projection receiving equipment parameters to the screen projection equipment based on the establishment of the handshake connection.
Preferably, the screen projection data further comprises matching parameters; the method further comprises the following steps: and adjusting the parameters of the screen according to the matching parameters.
Preferably, the matching parameters comprise a resolution matching gear; the adjusting the parameters of the screen according to the matching parameters comprises the following steps: and adjusting the resolution of the screen according to the resolution matching gear.
Preferably, the matching parameters include a matching frame rate; the adjusting the parameters of the screen according to the matching parameters comprises: ordering the supported refresh rates; determining a matching refresh rate matched with the matching frame rate according to the sorted support refresh rate; and adjusting the refresh rate of the screen according to the matched refresh rate.
Preferably, the displaying on the screen based on the decoded data further comprises: performing display enhancement processing on the decoded data to obtain data after display enhancement; and displaying on a screen based on the display enhanced data.
Preferably, the display enhancement processing includes at least one of interpolation processing, super-division processing, and color processing.
Preferably, the frame interpolation process includes: performing frame interpolation based on a motion compensation algorithm to obtain data for supplementing the frame interpolation; the super-sorting process comprises the following steps: performing resolution enhancement by using a hyper-resolution model to obtain data with enhanced resolution; and the color processing includes: color processing is performed by a high dynamic range HDR algorithm to obtain color processed data.
According to a third aspect of the present disclosure, there is provided a screen projecting apparatus comprising: the screen projection system comprises a parameter acquisition module, a screen projection module and a screen projection module, wherein the parameter acquisition module is configured to acquire screen projection parameters, and the screen projection parameters comprise screen projection receiving equipment parameters sent by screen projection receiving equipment; the matching parameter obtaining module is configured to obtain matching parameters through rule matching based on the acquired screen projection parameters; an encoding module configured to encode source data based on the matching parameters; and a screen projection data transmitting module configured to transmit screen projection data including the encoded source data to the screen projection receiving apparatus.
Preferably, the parameter acquisition module is configured to: acquiring source data parameters and screen projection equipment parameters; establishing handshake connection with the screen projection receiving equipment; and receiving the screen projection receiving equipment parameters sent by the screen projection receiving equipment based on the establishment of the handshake connection.
Preferably, the source data parameters include source resolution, and the screen projection receiving device parameters include resolution gear information; the matching parameter derivation module is configured to: calculating the matching degree between each resolution gear in the resolution gear information and the source resolution; selecting a resolution matching gear from the resolution gear information based on the calculated matching degree.
Preferably, the encoding module is configured to: encoding the source data based on the resolution matching gear; wherein the screen projection data comprises the resolution matching gear.
Preferably, the source data parameters include a target frame rate, and the screen projection device parameters include a supported refresh rate; the matching parameter derivation module is configured to: ordering the supported refresh rates; determining a matching refresh rate matching the target frame rate according to the sorted supported refresh rates; and adjusting the refresh rate of the screen according to the matched refresh rate.
Preferably, the source data parameters include a target frame rate; the matching parameter derivation module is configured to: setting the target frame rate as a matched frame rate; the encoding module is configured to: encoding the source data based on the matched frame rate; wherein the screen projection data comprises the matching frame rate.
Preferably, the screen projection equipment parameters comprise a first screen mode, and the screen projection receiving equipment parameters comprise a second screen mode; the matching parameter derivation module is configured to: determining consistency of a first screen mode and a second screen mode, wherein the first screen mode and the second screen mode comprise a horizontal screen mode and a vertical screen mode; and determining the second screen mode as a matching screen mode under the condition that the first screen mode is not consistent with the second screen mode.
Preferably, the encoding module is configured to: encoding the source data based on the matching screen pattern.
According to a fourth aspect of the present disclosure, there is provided a screen projection receiving apparatus including: the parameter sending module is configured to send the screen projection receiving equipment parameters to the screen projection equipment; a screen projection data receiving module configured to receive screen projection data including the encoded source data transmitted by the screen projection device; a decoding module configured to decode the received encoded source data to obtain decoded data; a display module configured to display on a screen based on the decoded data.
Preferably, the parameter sending module is configured to: establishing handshake connection with the screen projection equipment; and sending the screen projection receiving equipment parameters to the screen projection equipment based on the establishment of the handshake connection.
Preferably, the screen projection data further comprises matching parameters; the screen projection receiving apparatus further includes: and the parameter adjusting module is configured to adjust the parameters of the screen according to the matching parameters.
Preferably, the matching parameters comprise a resolution matching gear; the parameter adjustment module is configured to: and adjusting the resolution of the screen according to the resolution matching gear.
Preferably, the matching parameters include a matching frame rate; the parameter adjustment module is configured to: ordering the supported refresh rates; determining a matching refresh rate matched with the matching frame rate according to the sorted supported refresh rate; and adjusting the refresh rate of the screen according to the matched refresh rate.
Preferably, the display module is further configured to: performing display enhancement processing on the decoded data to obtain data after display enhancement; and displaying on a screen based on the display enhanced data.
Preferably, the display enhancement processing includes at least one of interpolation processing, super-division processing, and color processing.
Preferably, the frame interpolation process includes: performing frame interpolation based on a motion compensation algorithm to obtain data for supplementing the frame interpolation; the super-sorting treatment comprises the following steps: performing resolution enhancement by using a hyper-resolution model to obtain data with enhanced resolution; and the color processing includes: color processing is performed by a high dynamic range HDR algorithm to obtain color processed data.
According to a fifth aspect of the present disclosure, there is provided a screen projection method, including: the method comprises the steps that screen projection parameters are obtained by screen projection equipment, wherein the screen projection parameters comprise screen projection receiving equipment parameters sent by screen projection receiving equipment; obtaining matching parameters through rule matching based on the acquired screen projection parameters; encoding source data based on the matching parameters; and sending screen projection data including the encoded source data to the screen projection receiving device; the screen projection receiving equipment sends the screen projection receiving equipment parameters to the screen projection equipment; receiving screen projection data including the encoded source data transmitted by the screen projection device; decoding the received encoded source data to obtain decoded data; and displaying on a screen based on the decoded data.
According to a sixth aspect of the present disclosure, a screen projection system is provided, which includes a screen projection device and a screen projection receiving device, wherein the screen projection device is configured to obtain screen projection parameters, and the screen projection parameters include screen projection receiving device parameters sent by the screen projection receiving device; obtaining matching parameters through rule matching based on the acquired screen projection parameters; encoding source data based on the matching parameters; and sending screen projection data including the encoded source data to the screen projection receiving device; the screen projection receiving equipment is configured to send screen projection receiving equipment parameters to the screen projection equipment; receiving screen projection data including the encoded source data transmitted by the screen projection device; decoding the received encoded source data to obtain decoded data; and displaying on a screen based on the decoded data.
According to a seventh aspect of the present disclosure, there is provided an electronic apparatus, the apparatus comprising: a processor; a memory storing a computer program which, when executed by the processor, implements the screen projecting method applied to the screen projecting device and the screen projecting method applied to the screen projecting receiving device as described above.
According to an eighth aspect of the present disclosure, there is provided a computer-readable storage medium, wherein a computer program is stored thereon, which when executed, implements the screen projecting method applied to the screen projecting device and the screen projecting method applied to the screen projecting receiving device as described above.
The technical scheme provided according to the embodiment of the disclosure at least brings the following beneficial effects: through throwing screen equipment and throwing the joint optimization and the collaborative work of screen receiving arrangement, reach the purpose that reduces the time delay, reduces the consumption, improve and generate heat and promote the display effect on the whole. Specifically, parameter matching is performed among screen projection resource (source data) parameters, screen projection equipment parameters and screen projection receiving equipment parameters, and the screen projection resources are coded by the matched parameters, so that time delay and power consumption are reduced, and the heating problem is improved. The display parameters of the screen projection equipment and the screen projection receiving equipment are adjusted through the matching parameters, so that the power consumption is further reduced, the heating problem is improved, and the screen projection performance is improved. The display enhancement processing is carried out on the screen projection receiving equipment side, the processing pressure of the screen projection equipment side is relieved, hardware resources of the screen projection receiving equipment (particularly large-screen display equipment) are fully utilized, the display effect is improved, the display picture is clearer and smoother, and the user experience is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 illustrates an example architecture of a screen projection system according to an example embodiment.
Fig. 2 shows a flowchart of a screen projection method applied to a screen projection apparatus according to an exemplary embodiment.
Fig. 3 illustrates a schematic diagram of target frame rate acquisition of source data according to an exemplary embodiment.
Fig. 4 shows a resolution matching diagram according to an exemplary embodiment.
FIG. 5 illustrates a landscape-portrait screen matching schematic according to an exemplary embodiment.
Fig. 6 illustrates a flowchart of a screen projection method applied to a screen projection receiving apparatus according to an exemplary embodiment.
FIG. 7 illustrates a display enhancement flow diagram according to an exemplary embodiment.
Fig. 8 shows a schematic flow diagram of a method of screen projection according to an exemplary embodiment.
Fig. 9 illustrates a screen projection device adaptation module according to an exemplary embodiment.
Fig. 10 illustrates a screen projection receiving device smart display enhancement module according to an exemplary embodiment.
Fig. 11 shows a schematic view of a terminal-to-television projection according to an exemplary embodiment.
FIG. 12 shows a screen shot diagram of a landscape-portrait screen fit scenario in accordance with an example embodiment.
FIG. 13 illustrates a screen shot schematic of a multi-person conference scene, according to an example embodiment.
FIG. 14 shows a screen shot schematic of a multiplayer online game scene, according to an example embodiment.
Fig. 15 shows a block diagram of a screen projection apparatus according to an exemplary embodiment.
Fig. 16 shows a block diagram of a screen projection receiving apparatus according to an exemplary embodiment.
FIG. 17 illustrates a screen projection system according to an exemplary embodiment.
Fig. 18 shows a block diagram of an electronic device according to an exemplary embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In this case, the expression "at least one of the items" in the present disclosure means a case where three types of parallel expressions "any one of the items", "a combination of any plural ones of the items", and "the entirety of the items" are included. For example, "include at least one of a and B" includes the following three cases in parallel: (1) comprises A; (2) comprises B; and (3) comprises A and B. For another example, "at least one of the first step and the second step is performed", which means that the following three cases are juxtaposed: (1) executing the step one; (2) executing the step two; and (3) executing the step one and the step two.
In the current screen projection technology, fixed parameters are used for transmitting screen projection resources to screen projection receiving equipment, the screen projection equipment and the screen projection equipment perform coding and decoding processing on the resources without additional modification, and more applications use modes such as high frames, so that the picture refreshing is fast, the coding and decoding requirements and the transmission requirements are high, and the problems of high delay, high power consumption, easiness in heating and large transmission quantity between the screen projection equipment and the screen projection receiving equipment are caused. Meanwhile, parameters among screen projection resources, screen projection equipment and screen projection receiving equipment are not matched, so that screen projection performance is low, and screen projection display effect is poor. In addition, because the processing pressure of the screen projection resources is on the screen projection equipment side, the problems of high power consumption and easy heating of the screen projection equipment side are further caused, and because the hardware resources of the screen projection receiving equipment, especially the large-screen projection receiving equipment, cannot be fully applied, the display effect of the screen projection resources on a large screen is hardly satisfactory, and a user cannot obtain the due visual experience of the large screen.
In order to solve the above problems, the present disclosure provides a screen projection method, device, and system, which achieve the purposes of reducing delay, reducing power consumption, improving heat generation, and improving display effect by jointly optimizing and cooperatively working a screen projection device and a screen projection receiving device. Specifically, parameter matching is performed among screen projection resource (source data) parameters, screen projection equipment parameters and screen projection receiving equipment parameters, and the screen projection resources are coded by the matched parameters, so that time delay and power consumption are reduced, and the heating problem is improved. The display parameters of the screen projection equipment and the screen projection receiving equipment are adjusted through the matching parameters, so that the power consumption is further reduced, the heating problem is improved, and the screen projection performance is improved. The display enhancement processing is carried out on the screen projection receiving equipment side, the processing pressure of the screen projection equipment side is relieved, hardware resources of the screen projection receiving equipment (particularly large-screen display equipment) are fully utilized, the display effect is improved, the display picture is clearer and smoother, and the user experience is improved. Hereinafter, a screen projection method, apparatus and system according to the present disclosure are described in detail with reference to fig. 1 to 18.
Fig. 1 illustrates an example architecture of a screen projection system according to an example embodiment.
Referring to fig. 1, the screen projection system 100 may include a screen projection device 110 and a screen projection reception device 120, and the screen projection device 110 may be connected to the screen projection reception device 120 in a wired or wireless (such as WIFI wireless local area network) manner.
In the system 100, the screen projecting device 110 may be a portable device (such as, but not limited to, a mobile phone, a tablet, a smart watch, a notebook computer, etc.) which a user can directly perform an input operation, and the screen projecting receiving device 120 may be a display device (such as, a large-screen display device like a television, etc.) which a user does not normally perform an input operation directly but performs an input operation by means of, but not limited to, a remote control device, etc.
The screen projecting device 110 may load and run various client applications or APPs, and may be configured to project a screen to the screen projecting reception device 120 using a screen projecting protocol (such as, but not limited to, DLNA protocol, airplay protocol, lelink protocol, etc.) in response to a screen projecting instruction (e.g., a user clicking a screen projecting button) to transmit a picture (page resources such as a web page, video, game, etc.) displayed on the screen of the screen projecting device 110 to the screen of the screen projecting reception device 120 for display.
Fig. 2 shows a flowchart of a screen projection method applied to a screen projection apparatus according to an exemplary embodiment.
Referring to fig. 2, in step S210, screen projection parameters are acquired, where the screen projection parameters include screen projection receiving device parameters sent by a screen projection receiving device. According to an exemplary embodiment of the present disclosure, the screen projection device may acquire the source data parameters and the screen projection device parameters, establish a handshake connection with the screen projection receiving device, and receive the screen projection receiving device parameters sent by the screen projection receiving device based on the establishment of the handshake connection.
In the embodiment of the disclosure, the screen projection device may initiate a screen projection request to the screen projection receiving device, and after initiating the screen projection request, the screen projection device may first obtain the source data parameters and the screen projection device parameters. The screen-casting device screen-casting request may be initiated, for example, in response to a screen-casting instruction (e.g., a user clicking a screen-casting button). Here, the source data (i.e., the screen projection resource or the application resource) may include, but is not limited to, video, games, images, web pages, and the like, and the source data parameters may include, but is not limited to, resolution (source resolution), frame rate (target frame rate), and the like. The screen projection device parameters may include, but are not limited to, resolution gear information, current resolution, default resolution, supported refresh rate, current refresh rate, and landscape and portrait screen modes (first screen mode), among others. FIG. 3 illustrates a schematic diagram of target frame rate acquisition of source data according to an example embodiment. Referring to fig. 3, frame rates of source data may be classified into two types, a fixed frame rate and a dynamic frame rate, and the source data having the dynamic frame rate may be, for example, an application resource whose frame rate configuration can be dynamically modified. If the frame rate is fixed, the screen projection device can acquire the current frame rate of the source data as the target frame rate. If the frame rate is a dynamic frame rate, if the integrated SDK exists, the target frame rate can be obtained through an interface of the SDK, and if the integrated SDK does not exist, the target frame rate can be predicted. The predicted target frame rate may be, for example, a target frame rate predicted by monitoring frame rate change information each time a touch event is received through a google scoring algorithm, and the method for predicting the target frame rate is not limited thereto, and the disclosure does not limit this.
After the screen projection receiving device receives the screen projection request, the screen projection device can establish handshaking connection with the screen projection receiving device. In the process of establishing the handshaking connection, the screen projection equipment can receive screen projection receiving equipment parameters sent by the screen projection receiving equipment. The screen projection receiving device parameters may include, but are not limited to, resolution gear information, default resolution, supported refresh rate, and landscape screen mode (second screen mode), among others.
Returning to fig. 2, in step S220, based on the acquired screen projection parameters, matching parameters are obtained through rule matching. In the embodiment of the present disclosure, after the screen projection device obtains the screen projection parameters, the matching parameters may be obtained through rule matching, and the rule matching may include: resolution rule matching, refresh rate and frame rate rule matching, and horizontal and vertical screen mode rule matching. The screen projection device may perform at least one of the above rule matching.
The following describes the specific contents of resolution rule matching, refresh rate and frame rate rule matching, and horizontal and vertical screen mode rule matching in sequence:
1. resolution rule matching
According to an exemplary embodiment of the present disclosure, the source data parameter includes a source resolution, and the screen projection receiving device parameter includes resolution gear information. The screen projection equipment can calculate the matching degree between each resolution gear in the resolution gear information and the source resolution, and selects a resolution matching gear in the resolution gear information based on the calculated matching degree. In the embodiment of the present disclosure, the screen projection parameters acquired by the screen projection device may include a source resolution (source data parameters) and resolution gear information (screen projection receiving device parameters), and a resolution matching gear is obtained through resolution rule matching based on the source resolution and the resolution gear information of the screen projection receiving device, where the resolution gear information is a plurality of resolutions supported by the screen projection receiving device, for example, 540p, 720p, 1080p, and the like. Here, when the source data is displayed on the screen projection device, if the screen projection device employs a resolution that is fully adapted to the source resolution, then the current resolution of the screen projection device is the source resolution.
Fig. 4 shows a resolution rule matching diagram according to an exemplary embodiment. Referring to fig. 4, the source resolution that has been acquired is represented as (x, y), and the resolution range information of the projection receiving apparatus may include, for example, (x) x 1 ,y 1 )，(x 2 ,y 2 )…，(x n ,y n ) And selecting a proper resolution gear from the resolution gear information of the screen projection receiving equipment through resolution rule matching.
The resolution rule matching algorithm is as follows: (1) And calculating the matching degree SR between each resolution gear in the resolution gear information and the source resolution.
1) If the resolution step information and the source resolution are different in the number of pixels in both the x-direction and the y-direction, the matching degree SR is the product of the absolute value of the difference between the numbers of pixels in the x-direction and the absolute value of the difference between the numbers of pixels in the y-direction. I.e., if x ≠ x n And y ≠ y n ，SR＝|x n -x||y n -y|。
2) If the resolution step information and the source resolution differ only by one in the number of pixels in the x direction and the y direction, the matching degree SR is the product of the absolute value of the difference between the two in the direction in which the number of pixels differs and the number of pixels in the direction in which the number of pixels is the same. I.e., if x ≠ x n And y = y n ，SR＝|x n -x |. Y; if x = x n And y ≠ y n ，SR＝x*|y n -y|。
3) If the resolution step information is the same as the source resolution in the number of pixels in both the x-direction and the y-direction, the matching degree SR is 0, i.e. if x = x n And y = y n ，SR＝0。
(2) And selecting the resolution gear with the minimum calculated matching degree SR from the resolution gear information as a resolution matching gear.
2. Refresh rate and frame rate rule matching
According to an exemplary embodiment of the present disclosure, the source data parameters include a target frame rate, and the screen projection device parameters include a supported refresh rate. The screen projection equipment can sequence the supported refresh rates, determine the matched refresh rate matched with the target frame rate according to the sequenced supported refresh rates, and adjust the refresh rate of the screen according to the matched refresh rate.
In the embodiment of the present disclosure, the screen projection parameters acquired by the screen projection device may include a target frame rate (source data parameter) and a supported refresh rate (screen projection device parameter), and after the target frame rate of the source data is acquired by the method described in fig. 3, a matching refresh rate may be obtained through refresh rate rule matching based on the target frame rate and the supported refresh rate, where the supported refresh rate is a refresh rate supported by hardware of the screen projection device.
The refresh rate rule matches as follows: and sequencing and storing the supported refresh rates, and searching a matched refresh rate RR matched with the target frame rate from the sequenced supported refresh rates. For example, a total of s refresh rates are supported, ordered from small to large as RR n1 ,RR n2 …RR ns Here, the sorting manner may be a big-to-small sorting.
1) And if the value of the target frame rate is between the two adjacent support refresh rates after the sorting, determining the larger support refresh rate in the two adjacent support refresh rates as the matching refresh rate. I.e., if RR np <Target frame rate<RR nq Determining RR nq Is RR, wherein, RR np And RR nq The two next adjacent supported refresh rates after the ordering.
2) If all supported refresh rates are greater than the target frame rate, then the minimum supported refresh rate is determined to be the matching refresh rate, i.e., if the RR is n1 ,RR n2 …RR ns >Target frame rate, then RR is determined n1 Is RR.
3) If all supported refresh rates are less than the target frame rate, then the maximum supported refresh rate is determined to be the matching refresh rate, i.e., if the target frame rate>RR n1 ,RR n2 …RR ns Then RR is determined ns Is RR.
3) If the target frame rate is equal to one of the ordered supported refresh rates, then the supported refresh rate is determined to be the matching refresh rate, i.e., if the RR is np = target frame rate, then RR is determined np Is RR, wherein, RR np Is one of the ordered supported refresh rates.
After the matching refresh rate of the screen projection equipment is determined, the refresh rate of the screen projection equipment can be adjusted according to the matching refresh rate. By adjusting the refresh rate of the screen projection equipment, the target frame rate of the source data can be better matched, and high power consumption and easy heating of the screen projection equipment side caused by an excessively high refresh rate are avoided.
According to an example embodiment of the present disclosure, the source data parameter includes a target frame rate, and the screen projection device may set the target frame rate to a matching frame rate.
In the embodiment of the present disclosure, the screen projection parameters acquired by the screen projection device may include a target frame rate (source data parameter), and a matching frame rate may be obtained through frame rate rule matching based on the acquired target frame rate. Here, the frame rate rule matching may be to match the frame rate at the time of encoding so that the frame rate at the time of encoding is equal to the target frame rate, and then obtaining the matching frame rate through the frame rate rule matching may be to set the target frame rate as the matching frame rate, or may be to set the target frame rate as the matching frame rate.
3. Horizontal and vertical screen pattern rule matching
According to an exemplary embodiment of the present disclosure, the screen projection device parameters include a first screen mode, and the screen projection reception device parameters include a second screen mode; the screen projection device can determine consistency of a first screen mode and a second screen mode, wherein the first screen mode and the second screen mode comprise a horizontal screen mode and a vertical screen mode; and determining the second screen mode as a matching screen mode under the condition that the first screen mode is inconsistent with the second screen mode.
In the embodiment of the disclosure, the screen projection parameters acquired by the screen projection device may include a horizontal and vertical screen mode (a first screen mode) of the screen projection device and a horizontal and vertical screen mode (a second screen mode) of the screen projection receiving device, and the matched screen mode may be obtained through regular matching of the horizontal and vertical screen modes based on the acquired horizontal and vertical screen mode of the screen projection device and the horizontal and vertical screen mode of the screen projection receiving device. Specifically, the screen projection device may determine whether the horizontal and vertical screen modes of the screen projection device and the screen projection receiving device are consistent, and in the case of consistency, the current screen mode is maintained, and in the case of inconsistency, the screen projection device may enter a presentation mode (presentation mode), for example, and determine that the horizontal and vertical screen modes of the screen projection receiving device are the matching screen mode. Different User Interfaces (UIs) can be displayed on the screen projection device and the screen projection receiving device through the display mode, and after the matched screen mode is confirmed, the corresponding mode UI can be adapted, namely the UI in the matched screen mode is displayed on the screen projection receiving device. In addition, a screen projecting UI module can be arranged in the screen projecting equipment, and when the horizontal and vertical screen modes of the screen projecting equipment and the screen projecting receiving equipment are inconsistent, the screen projecting UI module can provide horizontal and vertical screen menu switching to better adapt to the display and touch control of the screen projecting equipment and the screen projecting equipment in the screen projecting mode. FIG. 5 illustrates a landscape-portrait screen matching schematic according to an exemplary embodiment. Referring to fig. 5, after the screen projection request is initiated, the screen projection receiving device displays the corresponding resource on the screen projection receiving device only according to the horizontal and vertical screen modes of the screen projection device. If the screen projection receiving equipment is in a horizontal screen mode and the screen projection equipment is in a vertical screen mode, the screen projection receiving equipment can continue to display the vertical screen effect (at present) after the screen is projected. After the matched screen mode (horizontal screen mode) is determined according to the horizontal and vertical screen mode rules (after updating), the screen projection equipment side encodes the source data according to the matched screen mode and sends the encoded source data to the screen projection receiving equipment so as to project the screen to the screen projection receiving equipment according to the horizontal screen mode.
Returning to fig. 2, in step S230, the source data is encoded based on the matching parameters.
According to an exemplary embodiment of the present disclosure, a screen projection apparatus may encode source data based on a resolution matching gear. In the embodiment of the present disclosure, after a resolution matching gear is obtained by resolution rule matching, the screen projection device encodes source data using the resolution matching gear (resolution). The screen projection equipment adopts the resolution matching gear to code the source data, so that the source resolution of the source data can be better matched, the extra power consumption and the heat generation caused by coding the resolution of a higher gear are avoided, and the delay increase caused by the transmission data volume increased by the resolution of the higher gear is reduced.
According to an example embodiment of the present disclosure, a screen projection device may encode source data based on a matching frame rate. In an embodiment of the present disclosure, after obtaining a matching frame rate through frame rate rule matching, the screen projection device encodes source data using the matching frame rate. The screen projection equipment adopts the matching frame rate to encode the source data, can better match the target frame rate (frame rate) of the source data, avoids extra power consumption and heating caused by encoding with a higher frame rate, and also reduces delay increase caused by increasing the transmission data volume by selecting a higher frame rate.
According to an exemplary embodiment of the present disclosure, a screen projection device may encode source data based on a matching screen pattern. In the embodiment of the disclosure, after the matched screen mode is obtained through the rule matching of the horizontal and vertical screen modes, the screen projection device encodes the source data by adopting the matched screen mode and sends the encoded source data to the screen projection receiving device, so that a picture adapting to the horizontal and vertical screen modes of the screen projection receiving device can be displayed on the screen projection receiving device, and the visual experience of a user is improved.
In step S240, the screen projection data including the encoded source data is transmitted to the screen projection receiving apparatus. In the embodiment of the present disclosure, after encoding the source data, the screen projecting device further transmits the screen projecting data including the encoded source data to the screen projecting receiving device. Further, the screen projection data may also include matching parameters.
According to an example embodiment of the present disclosure, the screen projection data may include a resolution matching gear. In the embodiment of the disclosure, after the resolution matching gear is obtained through resolution rule matching, the screen projection device may further send the resolution matching gear (or the encoded resolution matching gear) to the screen projection receiving device as screen projection data, so that the screen projection receiving device adjusts the resolution of its screen according to the resolution matching gear.
According to example embodiments of the present disclosure, the screen projection data may include a matching frame rate. In the embodiment of the disclosure, after the matching frame rate is obtained through the frame rate rule matching, the screen projection device may further send the matching frame rate (or the encoded matching frame rate) to the screen projection receiving device as screen projection data, so that the screen projection receiving device determines the matching refresh rate of the screen projection receiving device side according to the matching frame rate, thereby adjusting the refresh rate of the screen projection receiving device.
As described above, according to the screen projection method applied to the screen projection device of the exemplary embodiment, parameter matching is performed among the screen projection resource (source data) parameters, the screen projection device parameters, and the screen projection receiving device parameters, and the screen projection resources are encoded by the matched parameters, thereby reducing delay and power consumption and improving the problem of heat generation. The display parameters of the screen projection equipment are adjusted through the matching parameters, so that the power consumption is further reduced, the heating problem is improved, and the screen projection performance is improved.
Fig. 6 illustrates a flowchart of a screen projection method applied to a screen projection receiving apparatus according to an exemplary embodiment.
Referring to fig. 6, in step S610, the screen projection receiving apparatus parameters are transmitted to the screen projection apparatus. According to an exemplary embodiment of the present disclosure, the screen projection receiving device may establish a handshake connection with the screen projection device, and transmit screen projection receiving device parameters to the screen projection device based on the establishment of the handshake connection.
In the embodiment of the disclosure, the screen projecting device sends a screen projecting request to the screen projecting receiving device, and after the screen projecting receiving device receives the screen projecting request, the screen projecting device can establish handshake connection with the screen projecting receiving device. In the handshake connection establishment process, the screen projection receiving device may send the screen projection receiving device parameters to the screen projection device. The screen projection receiving device parameters may include, but are not limited to, resolution gear information, default resolution, supported refresh rate, and landscape screen mode (second screen mode), among others.
In step S620, screen projection data including the encoded source data transmitted by the screen projection device is received. In the embodiment of the disclosure, after the screen projection receiving device sends the screen projection receiving device parameters to the screen projection device, the screen projection device may obtain matching parameters through rule matching based on the acquired screen projection parameters including the screen projection receiving device parameters, and then send the screen projection data including the coded source data to the screen projection receiving device after encoding the source data based on the matching parameters. Accordingly, the screen projection receiving device can receive screen projection data including the encoded source data transmitted by the screen projection device.
According to an exemplary embodiment of the present disclosure, the screen projection data further includes matching parameters, and the screen projection method further includes a step S650 (not shown) of adjusting parameters of the screen according to the matching parameters in the step S650. In an embodiment of the present disclosure, the screen projecting device may transmit screen projecting data including the matching parameters to the screen projecting receiving device, and accordingly, the screen projecting receiving device may receive the screen projecting data including the matching parameters.
According to the exemplary embodiment of the present disclosure, the matching parameter includes a resolution matching gear, and the screen projection receiving apparatus may adjust the resolution of the screen according to the resolution matching gear. In the embodiment of the present disclosure, the matching parameter may be a resolution matching gear obtained by the screen projection device through resolution rule matching, and after the screen projection receiving device receives screen projection data including the resolution matching gear (or the encoded resolution matching gear), the screen projection receiving device may adjust the resolution of the screen according to the resolution matching gear. By adjusting the resolution ratio of the screen projection receiving equipment, the source resolution ratio of the source data can be better matched, and the high power consumption and the easy heating of the screen projection receiving equipment caused by the overhigh resolution ratio or the reduction of the display effect of the screen projection receiving equipment caused by the overlow resolution ratio are avoided.
According to the exemplary embodiment of the disclosure, the matching parameters include a matching frame rate, the screen projection receiving device can sort the supported refresh rates, the matching refresh rate matched with the matching frame rate is determined according to the sorted supported refresh rates, and the refresh rate of the screen is adjusted according to the matching refresh rate. In the embodiment of the present disclosure, the matching parameter may be a matching frame rate obtained by the screen projection device through frame rate rule matching, and after the screen projection receiving device receives the screen projection data including the matching frame rate (or the encoded matching frame rate), the screen projection receiving device may obtain the matching refresh rate of the screen projection receiving device through refresh rate rule matching based on the matching frame rate and a supported refresh rate (screen projection receiving device parameter), where the supported refresh rate is a refresh rate supported by hardware of the screen projection receiving device.
The refresh rate rule matching here adopts the same rule matching as the refresh rate rule matching at the screen projection device side, and only the target frame rate in the refresh rate rule matching and the supported refresh rate of the screen projection device need to be respectively changed into the matching frame rate and the supported refresh rate of the screen projection receiving device, which is not described in detail in this disclosure.
And after the screen projection receiving equipment obtains the matched refresh rate, adjusting the refresh rate of the screen according to the matched refresh rate. By adjusting the refresh rate of the screen projection receiving equipment, the target frame rate of the source data can be better matched, and the high power consumption and the easy heating of the screen projection receiving equipment caused by the overhigh refresh rate or the reduction of the display effect of the screen projection receiving equipment caused by the overlow refresh rate are avoided.
In step S630, the received encoded source data is decoded to obtain decoded data. According to the embodiment of the present disclosure, the decoding process here is the inverse process of the encoding process of the screen projection device described above, and may correspond to the encoding process. Accordingly, the screen projection receiving device may decode the encoded source data based on the matching parameters in the screen projection data to obtain decoded data. Specifically, the screen projection receiving device may decode the encoded source data based on a resolution matching gear, and the screen projection receiving device may decode the encoded source data based on a matching frame rate. In addition, the screen projection receiving device may decode the encoded source data based on a landscape mode (screen projection receiving device parameters) of the screen projection receiving device.
In step S640, display is performed on the screen based on the decoded data.
According to an exemplary embodiment of the present disclosure, the screen projection receiving device may perform display enhancement processing on the decoded data to obtain display enhanced data, and display on the screen based on the display enhanced data. The display enhancement processing includes at least one of interpolation processing, super-resolution processing, and color processing.
In an embodiment of the present disclosure, the screen-projection receiving apparatus may adjust the parameters of the screen according to the received matching parameters included in the screen-projection data. Specifically, the screen projection receiving device may adjust the resolution of the screen according to the received resolution matching gear. If the received resolution matching stage is low, for example, the resolution stage information of the projection receiving apparatus includes 540p, 720p, 1080p, 2K, 4K, etc., and the resolution matching stage is 720p. Or the screen projection receiving equipment can also receive the matched frame rate, determine the matched refresh rate matched with the matched frame rate, and adjust the refresh rate of the screen according to the matched refresh rate. If the matching frame rate is also low for the projection receiving device, for example, only 60fps, and the supportable data frame rate of the projection receiving device includes 120fps, corresponding to a refresh rate of 120Hz. Or the resolution matching gear and the matching frame rate received by the screen projection receiving equipment are both low. Under the above circumstances, hardware resources of the screen projection receiving device are not fully utilized, and the screen projection effect is difficult to satisfy.
In an embodiment of the present disclosure, a screen projection receiving device, particularly a large screen projection receiving device, may perform display enhancement processing on decoded data to obtain display enhanced data and display the display enhanced data on a screen. The display enhancement processing includes at least one of interpolation processing, super-resolution processing, and color processing. For example, if the matching frame rate is low (the decoded data frame rate is low), frame interpolation may be performed to increase the frame rate of the data. For another example, if the resolution matching step is low, then the super-resolution processing may be performed to improve the resolution. For another example, if the picture color effect is not good, then color processing can be performed to improve the image performance. Of course, any combination of the three processes, for example, frame interpolation processing + super-resolution processing, or super-resolution processing + color processing, may be performed to fully utilize the hardware performance of the projection receiving device, and improve the user experience.
According to an exemplary embodiment of the present disclosure, the frame interpolation process may include: performing frame interpolation based on a motion compensation algorithm to obtain data for supplementing the frame interpolation; the super-sorting process may include: performing resolution enhancement by using a hyper-resolution model to obtain data with enhanced resolution; the color processing may include: color processing is performed by a high dynamic range HDR algorithm to obtain color processed data.
FIG. 7 illustrates a display enhancement flow diagram according to an exemplary embodiment.
Referring to fig. 7, after decoding the received encoded source data to obtain decoded data, the screen projection receiving device may input the decoded data into the display enhancement module for display enhancement processing. The display enhancement module comprises three sub-modules, namely a frame insertion sub-module, a super-resolution sub-module and a color processing sub-module (HDR), wherein the frame insertion sub-module and the super-resolution sub-module can process based on the NPU chip capability of the screen projection receiving equipment. Specifically, the frame interpolation sub-module may perform frame interpolation processing based on a motion compensation (MEMC) algorithm to obtain data of the supplementary frame, wherein the motion compensation algorithm may also be implemented by deep learning. In fig. 7, the interpolation frame data is added to the original frame data through the interactive processing of the interpolation frame sub-module and the NPU chip. The super-resolution module can use a super-resolution model such as FSSR to carry out resolution improvement and supplement image details so as to obtain data with improved resolution. In FIG. 7, the data is processed for 4K/UHD data via the interaction of the supramolecular module and the NPU chip, for example, HD/FHD data processing. And the color processing module performs color processing through a High Dynamic Range (HDR) algorithm to obtain data after color processing, so that the display effect is further improved.
In the embodiment of the present disclosure, the decoded data does not have to be processed by three modules, but may be processed by at least one of the three modules as needed, which is illustrated in fig. 7 by taking the processing by three modules as an example, and the positions of the interpolation sub-module and the supramolecular module in the drawing may be exchanged, but the color processing sub-module needs to be after the interpolation sub-module and the supramolecular module, that is, color processing is generally performed on the data after the supplemental interpolation and/or resolution enhancement.
As described above, according to the screen projection method applied to the screen projection receiving device in the exemplary embodiment, on one hand, the display parameters of the screen projection receiving device can be adjusted by matching the parameters, so that the power consumption is further reduced, the heating problem is improved, and the screen projection performance is improved. On the other hand, in the current screen projection technology, the screen projection resource processing pressure is at the screen projection equipment, the screen projection method performs display enhancement processing on the screen projection receiving equipment, the processing pressure on the screen projection equipment side is relieved, hardware resources of the screen projection receiving equipment (especially large-screen display equipment) are fully utilized, the display effect is improved, the display picture is clearer and smoother, and the user experience is improved.
FIG. 8 shows a schematic flow diagram of a screen projection method according to an exemplary embodiment.
Referring to fig. 8, in step S810, a screen-casting device initiates a screen-casting request to a screen-casting receiving device. After the screen projection equipment initiates a screen projection request, the screen projection equipment acquires screen projection equipment parameters and source data parameters. In step S820, the screen projecting device and the screen projecting receiving device establish a handshake connection, and in the handshake connection process, the screen projecting receiving device sends the screen projecting receiving device parameters to the screen projecting device, and accordingly, the screen projecting device receives the screen projecting receiving device parameters sent by the screen projecting receiving device. In step S830, the screen projection device performs rule automatic matching. Here, the screen projection device obtains matching parameters through rule matching based on screen projection parameters including screen projection device parameters, source data parameters, and screen projection reception device parameters. The rule matching here includes: resolution rule matching, refresh rate and frame rate rule matching, and horizontal and vertical screen mode rule matching. The resolution rule matching can obtain a resolution matching gear, the refresh rate and the frame rate rule matching can obtain a matching refresh rate and/or a matching frame rate, and the horizontal and vertical screen mode rule matching can obtain a matching screen mode.
Fig. 9 illustrates a screen projection device adaptation module according to an exemplary embodiment. The screen projection device may include a screen projection device adaptation module to implement the above steps S810-S830. Referring to fig. 9, the screen projection apparatus adaptation module 900 includes a parameter acquisition sub-module 910, a screen projection handshake sub-module 920, and an automatic matching sub-module 930. The parameter obtaining sub-module 910 obtains source data parameters including information of resolution, frame rate, and the like of the current application through system services (services) such as a surfefinger and the like of the screen projection device, and can also obtain parameters of the screen projection device including support of a refresh rate, a horizontal screen mode, a vertical screen mode, and the like. The screen-projecting handshaking submodule is mainly used for interactively handshaking the screen-projecting equipment and the screen-projecting receiving equipment to acquire parameters of the screen-projecting receiving equipment, including resolution ratio gear information, transverse and vertical screen modes and the like. And the automatic matching sub-module 930 performs rule matching, where the rule matching includes: resolution rule matching, refresh rate and frame rate rule matching, and horizontal and vertical screen mode rule matching.
Returning to fig. 8, in step S840, the screen projection device encodes the source data, where the screen projection device may encode the source data based on the matching parameters (adjust the encoding parameters of the source data), and the matching parameters include a resolution matching step, a matching frame rate, and a matching screen mode. Then, the screen projection device transmits screen projection data including the encoded source data to the screen projection receiving device. Accordingly, the screen projection receiving device receives screen projection data including the encoded source data. In step S850, the screen projection receiving apparatus decodes the encoded source data to obtain decoded data. In step S860, the screen projection receiving apparatus performs display enhancement processing on the decoded data, and displays on the screen based on the display-enhanced data.
Fig. 10 illustrates a screen projection receiving device smart display enhancement module according to an exemplary embodiment. The screen projection receiving device comprises a screen projection receiving device intelligent display enhancement module to realize the step S860. Referring to fig. 10, the screen projection receiving device intelligent display enhancement module 1000 includes three sub-modules, which are an insertion frame sub-module 1010, a supramolecular module 1020, and an HDR sub-module 1030. The frame interpolation submodule 1010 performs real-time frame interpolation based on deep learning through an NPU chip of the screen projection receiving device to improve the frame rate of data, so that the screen projection picture is smoother and transition is more natural. The super-resolution sub-module 1020 performs image processing on the data resource by using a super-resolution model such as FSSR through the NPU chip of the screen projection receiving device, supplements image details, and improves the quality of a screen projection picture. The HDR module 1030 performs image color processing on the data resource through an HDR algorithm of the screen projection receiving device, so as to improve image performance and make a picture clearer and more real.
Fig. 11 shows a schematic screen projection of a terminal to a television according to an exemplary embodiment.
Referring to fig. 11, the screen projection device is a mobile terminal (e.g., a mobile phone), and the screen projection receiving device is a Television (TV). Taking the screen-casting resource as the game resource, after the user mobile terminal opens the game (for example, the royal glory), it initiates the screen-casting request and establishes handshake connection with the TV. The screen projection parameters acquired by the mobile terminal may include: game resource resolution 720p, frame rate (target frame rate) 60fps; displayed as 720p on the mobile terminal and displayed as a landscape screen; the resolution gear information on the TV includes 540p, 720p, 1080p, 2K, and 4K, the supported refresh rate includes 60Hz, 90Hz, and 120Hz, and is displayed on a landscape screen. According to the screen projection parameters (including game resource parameters, mobile terminal parameters and TV parameters), the resolution matching gear which is automatically matched is 720p, the matching refresh rate is 60Hz, the matching frame rate is 60fps, and the matching screen mode is a horizontal screen mode.
The TV side receives and decodes the screen projection data, and can improve the frame rate (the matching frame rate is 60 fps) to 120fps by using frame interpolation processing based on an NPU chip of the TV, improve the resolution from 720p to 2K/4K by using super-resolution processing, and enhance the image quality by using an HDR algorithm.
FIG. 12 shows a screen shot diagram of a landscape-portrait screen fit scenario in accordance with an example embodiment.
Referring to fig. 12, the screen projection device is a mobile terminal (e.g., a mobile phone), and the screen projection receiving device is a Television (TV). At the moment, the mobile terminal is in a vertical screen mode, the TV is in a horizontal screen mode, when the horizontal screen mode and the vertical screen mode of the TV are not consistent, the horizontal screen mode of the TV is used as a matched screen mode, a corresponding UI effect (horizontal screen mode) is displayed on the TV, and user experience is improved.
FIG. 13 illustrates a screen shot schematic of a multi-person conference scene, according to an example embodiment.
Referring to fig. 13, taking a multi-person conference as an example, all devices in the meta universe may enter the same virtual environment through networking, while the multi-person conference may be conducted in a specific UI by receiving source data and displaying it. E.g., resources on terminal devices in the conference, are projected onto the conference UI. Since the terminal device can obtain the matching parameters through rule matching and encode the source data based on the matching parameters, the source data can be adjusted (e.g., adjustment of encoding parameters) according to the target device (conference UI).
FIG. 14 illustrates a screen shot schematic of a multiplayer online game scene, according to an example embodiment.
Referring to fig. 14, taking a multiplayer online game as an example, interaction is required to be performed on a plurality of source data in a virtual world, intelligent adaptive matching based on rule matching can be performed on different source data, and appropriate parameters are selected according to screen projection resources (source data) and screen projection receiving device parameters and finally displayed in the virtual world.
Fig. 15 shows a block diagram of a screen projection apparatus according to an exemplary embodiment.
Referring to fig. 15, the screen projection device 1500 includes a parameter obtaining module 1510, a matching parameter obtaining module 1520, a coding module 1530, and a screen projection data transmitting module 1540, where the parameter obtaining module 1510 may obtain a screen projection parameter, where the screen projection parameter includes a screen projection receiving device parameter transmitted by the screen projection receiving device, the matching parameter obtaining module 1520 may obtain a matching parameter through rule matching based on the obtained screen projection parameter, the coding module 1530 may code source data based on the matching parameter, and the screen projection data transmitting module 1540 may transmit screen projection data including the coded source data to the screen projection receiving device.
According to an example embodiment of the present disclosure, the parameter obtaining module 1510 may obtain source data parameters and screen-projecting device parameters, establish a handshake connection with the screen-projecting receiving device, and receive the screen-projecting receiving device parameters sent by the screen-projecting receiving device based on the establishment of the handshake connection.
According to an exemplary embodiment of the present disclosure, the source data parameter includes a source resolution, and the screen projection receiving device parameter includes resolution gear information. The matching parameter obtaining module 1520 may calculate a matching degree between each resolution stage in the resolution stage information and the source resolution, and select a resolution matching stage in the resolution stage information based on the calculated matching degree.
According to an exemplary embodiment of the present disclosure, the encoding module 1530 may encode the source data based on a resolution matching gear, wherein the screen projection data includes the resolution matching gear.
According to an exemplary embodiment of the disclosure, the source data parameters include a target frame rate, the screen projection device parameters include a supported refresh rate, the matching parameter obtaining module 1520 may sort the supported refresh rates, determine a matching refresh rate matching the target frame rate according to the sorted supported refresh rates, and adjust the refresh rate of the screen according to the matching refresh rate.
According to an exemplary embodiment of the present disclosure, the source data parameters include a target frame rate; the matching parameter obtaining module 1520 may set the target frame rate to the matching frame rate, and the encoding module 1530 may encode the source data based on the matching frame rate, where the screen projection data includes the matching frame rate.
According to an exemplary embodiment of the present disclosure, the projection device parameters include a first screen mode, the projection receiving device parameters include a second screen mode, and the matching parameter obtaining module 1520 may determine consistency of the first screen mode and the second screen mode, where the first screen mode and the second screen mode include a landscape screen mode and a portrait screen mode, and in case that the first screen mode is inconsistent with the second screen mode, determine the second screen mode as the matching screen mode.
The encoding module 1530 may encode the source data based on the matching screen pattern according to an exemplary embodiment of the present disclosure.
As described above, according to the screen projection device of the exemplary embodiment, parameter matching is performed among the screen projection resource (source data) parameters, the screen projection device parameters, and the screen projection receiving device parameters, and the screen projection resources are encoded by the matched parameters, so that delay and power consumption are reduced, and the problem of heat generation is improved. The display parameters of the screen projection equipment are adjusted through the matching parameters, so that the power consumption is further reduced, the heating problem is improved, and the screen projection performance is improved.
Fig. 16 shows a block diagram of a screen projection receiving apparatus according to an exemplary embodiment.
Referring to fig. 16, the screen projection receiving apparatus includes: a parameter sending module 1610, a screen projection data receiving module 1620, a decoding module 1630 and a display module 1640. The parameter sending module 1610 may send the parameters of the screen projection receiving device to the screen projection device, the screen projection data receiving module 1620 may receive the screen projection data including the encoded source data sent by the screen projection device, the decoding module 1630 may decode the received encoded source data to obtain decoded data, and the display module 1640 may display the decoded data on the screen.
According to an example embodiment of the present disclosure, the parameter sending module 1610 may establish a handshake connection with the screen projecting device, and send the screen projecting receiving device parameters to the screen projecting device based on the establishment of the handshake connection.
According to an exemplary embodiment of the present disclosure, the screen projection data further includes matching parameters, and the screen projection receiving apparatus may further include: the parameter adjustment module 1650 (not shown) may adjust the parameters of the screen according to the matching parameters.
According to an exemplary embodiment of the present disclosure, the matching parameters include a resolution matching gear, and the parameter adjusting module 1650 may adjust the resolution of the screen according to the resolution matching gear.
According to an exemplary embodiment of the present disclosure, the matching parameters include a matching frame rate, the parameter adjusting module 1650 may rank the supported refresh rates, determine a matching refresh rate matching the matching frame rate according to the ranked supported refresh rates, and adjust the refresh rate of the screen according to the matching refresh rate.
According to an example embodiment of the disclosure, the display module 1640 may perform display enhancement processing on the decoded data to obtain display enhanced data, the display being displayed on a screen based on the display enhanced data.
According to an exemplary embodiment of the present disclosure, the display enhancement process includes at least one of an interpolation process, a super-resolution process, and a color process.
According to an exemplary embodiment of the present disclosure, the frame interpolation process includes: performing frame interpolation based on a motion compensation algorithm to obtain data for supplementing the frame interpolation; the super-sorting treatment comprises the following steps: performing resolution enhancement by using a hyper-resolution model to obtain data with enhanced resolution; and the color processing includes: color processing is performed by a high dynamic range HDR algorithm to obtain color processed data.
As described above, according to the screen projection receiving device of the exemplary embodiment, on one hand, the display parameters of the screen projection receiving device can be adjusted through the matching parameters, so that the power consumption is further reduced, the heating problem is improved, and the screen projection performance is improved. On the other hand, in the current screen projection technology, the screen projection resource processing pressure is at the screen projection equipment, the screen projection method performs display enhancement processing on the screen projection receiving equipment, the processing pressure on the screen projection equipment side is relieved, hardware resources of the screen projection receiving equipment (especially large-screen display equipment) are fully utilized, the display effect is improved, the display picture is clearer and smoother, and the user experience is improved.
FIG. 17 illustrates a screen projection system according to an exemplary embodiment.
Referring to fig. 17, the screen projection system 1700 includes a screen projection device 1710 and a screen projection reception device 1720. The screen-projecting device 1710 may acquire screen-projecting parameters, where the screen-projecting parameters include screen-projecting receiving device parameters sent by the screen-projecting receiving device, match parameters are obtained through rule matching based on the acquired screen-projecting parameters, source data is encoded based on the match parameters, and screen-projecting data including the encoded source data is sent to the screen-projecting receiving device. The screen projection receiving device can send the screen projection receiving device parameters to the screen projection device, receive screen projection data including encoded source data sent by the screen projection device, decode the received encoded source data to obtain decoded data, and display the decoded data on a screen. Any relevant details involved in the operations performed by the screen projection device 1710 and the screen projection receiving device 1720 can be found in the relevant description regarding fig. 2 and 6 and are not repeated here. The screen projecting device 1710 in the screen projecting system in fig. 17 may further include a parameter obtaining module, a matching parameter obtaining module, an encoding module, and a screen projecting data sending module, and the screen projecting receiving device 1720 may further include a parameter sending module, a screen projecting data receiving module, a decoding module, a display module, and a parameter adjusting module. Any relevant details related to the specific operations of the corresponding modules included in the screen projecting device 1710 and the screen projecting receiving device 1720 can be referred to the description related to fig. 15 and 16, and are not described herein again.
Fig. 18 shows a block diagram of an electronic device according to an example embodiment. The electronic device 1800 may be a screen projection device or a screen projection receiving device of an embodiment of the present disclosure. Referring to fig. 18, the electronic device 1800 may include at least one memory 1810 having stored therein a set of computer-executable instructions that, when executed by the at least one processor, perform a method of screen projection according to an embodiment of the present disclosure and at least one processor 1820.
The electronic device need not be a single electronic device, but can be any collection of devices or circuits that can execute the above instructions (or sets of instructions) either individually or in combination. The electronic device may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission).
In an electronic device, a processor may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a programmable logic device, a special-purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processors may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.
The processor may execute instructions or code stored in the memory, which may also store data. The instructions and data may also be transmitted or received over a network via a network interface device, which may employ any known transmission protocol.
The memory may be integral to the processor, e.g., RAM or flash memory disposed within an integrated circuit microprocessor or the like. Further, the memory may comprise a stand-alone device, such as an external disk drive, storage array, or other storage device usable by any database system. The memory and the processor may be operatively coupled or may communicate with each other, such as through an I/O port, a network connection, etc., so that the processor can read files stored in the memory.
In addition, the electronic device may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device may be connected to each other via a bus and/or a network.
According to an embodiment of the present disclosure, there may also be provided a computer-readable storage medium, wherein a computer program is stored thereon, which when executed, implements a screen projection method according to the present disclosure. Examples of computer-readable storage media herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD + RW, DVD-ROM, DVD-R, DVD + R, DVD-RW, DVD + RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, blu-ray or optical disk memory, hard Disk Drives (HDDs), solid-state hard disks (SSDs), card-type memory (such as a multimedia card, a Secure Digital (SD) card, or an extreme digital (XD) card), magnetic tape, floppy disk, magneto-optical data storage, hard disk, solid-state disk, and any other device configured to store and to enable a computer program and any associated data file, data processing structure and to be executed by a computer. The computer program in the computer-readable storage medium described above can be run in an environment deployed in a computer apparatus, such as a terminal, client, host, proxy device, server, etc., and further, in one example, the computer program and any associated data, data files, and data structures are distributed across a networked computer system such that the computer program and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.
According to the screen projection method, the screen projection equipment and the screen projection system, generally speaking, the purposes of reducing time delay, reducing power consumption, improving heating and improving display effect are achieved through the joint optimization and cooperative work of the screen projection equipment and the screen projection receiving equipment. Specifically, parameter matching is performed among screen projection resource (source data) parameters, screen projection equipment parameters and screen projection receiving equipment parameters, and the screen projection resources are coded by the matched parameters, so that time delay and power consumption are reduced, and the heating problem is improved. The display parameters of the screen projection equipment and the screen projection receiving equipment are adjusted through the matching parameters, so that the power consumption is further reduced, the heating problem is improved, and the screen projection performance is improved. The display enhancement processing is carried out on the screen projection receiving equipment side, the processing pressure of the screen projection equipment side is relieved, hardware resources of the screen projection receiving equipment (especially large-screen display equipment) are fully utilized, the display effect is improved, the display pictures are clearer and smoother, and the user experience is improved.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice in the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (24)

1. A screen projection method is applied to screen projection equipment and comprises the following steps:
acquiring screen projection parameters, wherein the screen projection parameters comprise screen projection receiving equipment parameters sent by screen projection receiving equipment;
based on the acquired screen projection parameters, obtaining matching parameters through rule matching;
encoding source data based on the matching parameters; and
and sending screen projection data comprising the encoded source data to the screen projection receiving equipment.
2. The method of claim 1, wherein the obtaining screen projection parameters comprises:
acquiring source data parameters and screen projection equipment parameters;
establishing handshake connection with the screen projection receiving equipment;
and receiving the screen projection receiving equipment parameters sent by the screen projection receiving equipment based on the establishment of the handshake connection.
3. The method of claim 2, wherein the source data parameters include a source resolution, the screen projection receiving device parameters include resolution gear information;
the obtaining of matching parameters through rule matching based on the obtained screen projection parameters comprises:
calculating the matching degree between each resolution gear in the resolution gear information and the source resolution;
selecting a resolution matching gear from the resolution gear information based on the calculated matching degree.
4. The method of claim 3, wherein said encoding source data based on the matching parameters comprises: encoding the source data based on the resolution matching gear;
wherein the screen projection data comprises the resolution matching gear.
5. The method of claim 2, wherein the source data parameters include a target frame rate, the screen projection device parameters include a supported refresh rate;
the obtaining of matching parameters through rule matching based on the obtained screen projection parameters comprises: ordering the supported refresh rates; determining a matching refresh rate matching the target frame rate according to the sorted support refresh rate; and adjusting the refresh rate of the screen according to the matched refresh rate.
6. The method of claim 2, wherein the source data parameters comprise a target frame rate;
the obtaining of matching parameters through rule matching based on the obtained screen projection parameters further comprises: setting the target frame rate as a matched frame rate;
the encoding the source data based on the matching parameters includes: encoding the source data based on the matched frame rate;
wherein the screen projection data comprises the matching frame rate.
7. The method of claim 2, wherein the screen-casting device parameters comprise a first screen mode, and the screen-casting receiving device parameters comprise a second screen mode;
the obtaining of matching parameters through rule matching based on the obtained screen projection parameters comprises:
determining consistency of a first screen mode and a second screen mode, wherein the first screen mode and the second screen mode comprise a horizontal screen mode and a vertical screen mode;
and determining the second screen mode as a matching screen mode under the condition that the first screen mode is not consistent with the second screen mode.
8. The method of claim 7, the encoding the source data based on the match parameters, comprising:
encoding the source data based on the matching screen pattern.
9. A screen projection method is applied to screen projection receiving equipment and comprises the following steps:
sending the screen projection receiving equipment parameters to screen projection equipment;
receiving screen projection data including the encoded source data transmitted by the screen projection device;
decoding the received encoded source data to obtain decoded data;
and displaying on a screen based on the decoded data.
10. The method of claim 9, wherein the sending screen projection receiving device parameters to a screen projection device comprises:
establishing handshake connection with the screen projection equipment;
and sending the screen projection receiving equipment parameters to the screen projection equipment based on the establishment of the handshake connection.
11. The method of claim 10, wherein the screen projection data further comprises matching parameters;
the method further comprises the following steps: and adjusting the parameters of the screen according to the matching parameters.
12. The method of claim 11, wherein the matching parameters include a resolution matching gear;
the adjusting the parameters of the screen according to the matching parameters comprises: and adjusting the resolution of the screen according to the resolution matching gear.
13. The method of claim 11, wherein the matching parameters comprise a matching frame rate;
the adjusting the parameters of the screen according to the matching parameters comprises the following steps: ordering the supported refresh rates; determining a matching refresh rate matched with the matching frame rate according to the sorted supported refresh rate; and adjusting the refresh rate of the screen according to the matched refresh rate.
14. The method of claim 9, wherein the displaying on the screen based on the decoded data, further comprises:
performing display enhancement processing on the decoded data to obtain data after display enhancement;
and displaying on a screen based on the display enhanced data.
15. The method of claim 14, wherein the display enhancement processing comprises at least one of framing, super-binning, and color processing.
16. A screen projection apparatus comprising:
the screen projection system comprises a parameter acquisition module, a screen projection module and a screen projection module, wherein the parameter acquisition module is configured to acquire screen projection parameters, and the screen projection parameters comprise screen projection receiving equipment parameters sent by screen projection receiving equipment;
the matching parameter obtaining module is configured to obtain matching parameters through rule matching based on the acquired screen projection parameters;
an encoding module configured to encode source data based on the matching parameters; and
and the screen projection data sending module is configured to send the screen projection data comprising the encoded source data to the screen projection receiving equipment.
17. The device of claim 16, wherein the parameter acquisition module is configured to:
acquiring source data parameters and screen projection equipment parameters;
establishing handshake connection with the screen projection receiving equipment;
and receiving the screen projection receiving equipment parameters sent by the screen projection receiving equipment based on the establishment of the handshake connection.
18. A screen-projection receiving device comprising:
the parameter sending module is configured to send the screen projection receiving equipment parameters to the screen projection equipment;
a screen projection data receiving module configured to receive screen projection data including the encoded source data transmitted by the screen projection device;
a decoding module configured to decode the received encoded source data to obtain decoded data;
a display module configured to display on a screen based on the decoded data.
19. The device of claim 18, wherein the parameter transmission module is configured to:
establishing a handshake connection with the screen projection equipment;
and sending the screen projection receiving equipment parameters to the screen projection equipment based on the establishment of the handshake connection.
20. The device of claim 18, wherein the display module is further configured to:
performing display enhancement processing on the decoded data to obtain data after display enhancement;
and displaying on a screen based on the display enhanced data.
21. A screen projection method, comprising:
screen projection parameters are obtained by screen projection equipment, wherein the screen projection parameters comprise screen projection receiving equipment parameters sent by screen projection receiving equipment; obtaining matching parameters through rule matching based on the acquired screen projection parameters; encoding source data based on the matching parameters; and sending screen projection data including the encoded source data to the screen projection receiving device;
the screen projection receiving equipment sends the screen projection receiving equipment parameters to the screen projection equipment; receiving screen projection data including the encoded source data transmitted by the screen projection device; decoding the received encoded source data to obtain decoded data; and displaying on a screen based on the decoded data.
22. A screen projection system comprises a screen projection device and a screen projection receiving device, wherein,
the screen projection equipment is configured to acquire screen projection parameters, wherein the screen projection parameters comprise screen projection receiving equipment parameters sent by the screen projection receiving equipment; obtaining matching parameters through rule matching based on the acquired screen projection parameters; encoding source data based on the matching parameters; and sending screen projection data including the encoded source data to the screen projection receiving device;
the screen projection receiving device is configured to send screen projection receiving device parameters to the screen projection device; receiving screen projection data including the encoded source data transmitted by the screen projection device; decoding the received encoded source data to obtain decoded data; and displaying on a screen based on the decoded data.
23. An electronic device, the device comprising:
a processor;
memory storing a computer program which, when executed by a processor, implements the method of any one of claims 1 to 15.
24. A computer-readable storage medium, in which a computer program is stored which, when executed, implements the method of any of claims 1 to 15.
CN202211132476.1A 2022-09-06 2022-09-06 Screen projection method, equipment and system Pending CN115484485A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211132476.1A CN115484485A (en) 2022-09-06 2022-09-06 Screen projection method, equipment and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211132476.1A CN115484485A (en) 2022-09-06 2022-09-06 Screen projection method, equipment and system

Publications (1)

Publication Number Publication Date
CN115484485A true CN115484485A (en) 2022-12-16

Family

ID=84423707

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211132476.1A Pending CN115484485A (en) 2022-09-06 2022-09-06 Screen projection method, equipment and system

Country Status (1)

Country Link
CN (1) CN115484485A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107093418A (en) * 2017-06-20 2017-08-25 努比亚技术有限公司 A kind of screen display method, computer equipment and storage medium
CN110012333A (en) * 2017-12-19 2019-07-12 交互数字Ce专利控股公司 Video frame in video flowing is transmitted to the method and related device of display
CN111182303A (en) * 2019-10-08 2020-05-19 腾讯科技（深圳）有限公司 Encoding method and device for shared screen, computer readable medium and electronic equipment
CN111708503A (en) * 2020-06-05 2020-09-25 努比亚技术有限公司 Screen projection control method and device and computer readable storage medium
CN113296664A (en) * 2021-05-18 2021-08-24 Oppo广东移动通信有限公司 Screen resolution adjusting method and device, terminal equipment and storage medium
CN113407142A (en) * 2021-07-13 2021-09-17 海信视像科技股份有限公司 Display device and screen projection method
CN114979755A (en) * 2022-05-20 2022-08-30 Oppo广东移动通信有限公司 Screen projection method and device, terminal equipment and computer readable storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107093418A (en) * 2017-06-20 2017-08-25 努比亚技术有限公司 A kind of screen display method, computer equipment and storage medium
CN110012333A (en) * 2017-12-19 2019-07-12 交互数字Ce专利控股公司 Video frame in video flowing is transmitted to the method and related device of display
CN111182303A (en) * 2019-10-08 2020-05-19 腾讯科技（深圳）有限公司 Encoding method and device for shared screen, computer readable medium and electronic equipment
CN111708503A (en) * 2020-06-05 2020-09-25 努比亚技术有限公司 Screen projection control method and device and computer readable storage medium
CN113296664A (en) * 2021-05-18 2021-08-24 Oppo广东移动通信有限公司 Screen resolution adjusting method and device, terminal equipment and storage medium
CN113407142A (en) * 2021-07-13 2021-09-17 海信视像科技股份有限公司 Display device and screen projection method
CN114979755A (en) * 2022-05-20 2022-08-30 Oppo广东移动通信有限公司 Screen projection method and device, terminal equipment and computer readable storage medium

Similar Documents

Publication Publication Date Title
CN112235626B (en) Video rendering method and device, electronic equipment and storage medium
EP3926947B1 (en) Dynamic video resolution and quality for improved video conferencing
CN113015021B (en) Cloud game implementation method, device, medium and electronic equipment
WO2022087920A1 (en) Video playing method and apparatus, and terminal and storage medium
KR101905182B1 (en) Self-Adaptive Display Method and Device for Image of Mobile Terminal, and Computer Storage Medium
JP5548671B2 (en) Image processing system, image providing server, information processing apparatus, and image processing method
US9723123B2 (en) Multi-screen control method and device supporting multiple window applications
CN111681167A (en) Image quality adjusting method and device, storage medium and electronic equipment
CN112087633B (en) Video decoding method, device and storage medium
CN111417441A (en) Method and system for rendering and encoding content of an online interactive gaming session
CN109155873A (en) That improves virtual reality media content spreads defeated method, apparatus and computer program
US11694316B2 (en) Method and apparatus for determining experience quality of VR multimedia
CN107409237B (en) Method, medium and system for dynamically adjusting cloud game data stream
KR20160031403A (en) A multiscreen control method and device supporting multiple window applications
CN113301355B (en) Video transmission, live broadcast and playing method, equipment and storage medium
KR101535809B1 (en) Method for providing Cloud Streaming Service, system and apparatus therefor
US10002644B1 (en) Restructuring video streams to support random access playback
CN104010204B (en) Image information processing method and device
CN116567346A (en) Video processing method, device, storage medium and computer equipment
WO2021093882A1 (en) Video meeting method, meeting terminal, server, and storage medium
CN115484485A (en) Screen projection method, equipment and system
KR20160015136A (en) System for cloud streaming service, method of cloud streaming service using still image compression technique and apparatus for the same
JP6623905B2 (en) Server device, information processing method and program
CN114339344B (en) Intelligent device and video recording method
WO2023193524A1 (en) Live streaming video processing method and apparatus, electronic device, computer-readable storage medium, and computer program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination