WO2026002247A1 - 用于屏幕内容获取的方法、装置、设备和存储介质 - Google Patents
用于屏幕内容获取的方法、装置、设备和存储介质Info
- Publication number
- WO2026002247A1 WO2026002247A1 PCT/CN2025/104781 CN2025104781W WO2026002247A1 WO 2026002247 A1 WO2026002247 A1 WO 2026002247A1 CN 2025104781 W CN2025104781 W CN 2025104781W WO 2026002247 A1 WO2026002247 A1 WO 2026002247A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- resolution
- terminal device
- adjustment mode
- screen content
- predetermined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Definitions
- the exemplary embodiments disclosed herein relate generally to the field of computers, and more particularly to methods, apparatuses, electronic devices, and computer-readable storage media for obtaining screen content.
- the resolution of the screen content captured by the terminal device is usually based on the video resolution of a standard monitor (e.g., 16:9).
- the display resolution of some terminal devices e.g., mobile phones, tablets
- image distortion, "black borders," or cropping of the image may occur.
- a method for acquiring screen content comprising: in response to determining that a terminal device acquires screen content of the terminal device at a first resolution under a predetermined resolution, determining a target adjustment mode corresponding to the predetermined resolution from a plurality of adjustment modes, wherein the first resolution corresponds to the predetermined resolution; adjusting the first resolution to a second resolution based on the display resolution of the terminal device using the target adjustment mode; and controlling the terminal device to acquire screen content at the second resolution under the predetermined resolution.
- an apparatus for acquiring screen content comprising: a determining module configured to, in response to determining that a terminal device acquires screen content of the terminal device at a first resolution under a predetermined resolution, determine a target adjustment mode corresponding to the predetermined resolution from a plurality of adjustment modes, wherein the first resolution corresponds to the predetermined resolution; an adjusting module configured to adjust the first resolution to a second resolution based on the display resolution of the terminal device using the target adjustment mode; and a control module configured to control the terminal device to acquire screen content at the second resolution under the predetermined resolution.
- an electronic device in a third aspect of this disclosure, includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the electronic device to perform the method of the first aspect.
- a computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.
- a computer-executable instruction product comprising computer-executable instructions that, when executed by a processor, implement the method of the first aspect.
- Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented
- Figure 2 shows a flowchart of a screen content acquisition process according to some embodiments of the present disclosure
- Figure 3 shows a block diagram of an apparatus for screen content acquisition according to some embodiments of the present disclosure.
- Figure 4 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure.
- a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information.
- This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.
- sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format.
- the pop-up window can also include a selection control allowing the user to choose "agree” or “disagree” to provide personal information to the electronic device.
- performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.
- a resolution of 1080p corresponds to a resolution of 1920 ⁇ 1080
- a resolution of 720p corresponds to a resolution of 1280 ⁇ 720.
- Screen recording and live streaming capture the screen content of terminal devices.
- the display resolution of some terminal devices does not match the video resolution based on standard monitors.
- mobile phones have a "strip" display resolution, meaning the ratio of width resolution to height resolution exceeds 2:1; the ratio of width resolution to height resolution in tablet displays is approximately 4:3.
- the video resolution based on the standard display is used to capture the screen content of the above terminal device, the following two situations will occur: (1) The captured source image completely fills the 16:9 display area, which will cause the image to be distorted; (2) In the 16:9 display area, the captured screen content fills one side first, and the other side is scaled proportionally according to the size of the device screen, which will cause large black borders or cropping to appear on the top, bottom or left and right sides of the display area.
- a server device or terminal device determines that the terminal device will acquire its screen content at a first resolution corresponding to a predetermined resolution. Based on the terminal device's display resolution, the first resolution is adjusted to a second resolution; and the terminal device is controlled to acquire screen content at the second resolution at the predetermined resolution. Utilizing the terminal device's display resolution, the first resolution corresponding to the predetermined resolution is adjusted to a second resolution suitable for or matching the terminal device's display resolution, and the terminal device is controlled to acquire screen content at the second resolution at the predetermined resolution. Therefore, when recording the terminal device's screen content, the content resolution can be adaptively adjusted, thereby avoiding image distortion or black borders or cropping in the display area.
- Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented.
- environment 100 may include server 110 and terminal device 120.
- environment 100 may include only terminal device 120.
- terminal device 120 When environment 100 includes server 110 and terminal device 120, terminal device 120 is deployed with applications supporting screen recording and live streaming, applications supporting terminal device performance testing, and applications supporting quality scoring of captured screen content.
- server 110 is deployed with applications supporting terminal device performance testing and applications supporting quality scoring of captured screen content
- terminal device 120 is deployed with applications supporting screen recording and live streaming.
- terminal device 120 When environment 100 only includes terminal device 120, terminal device 120 is equipped with applications that support screen recording and live streaming, applications that support testing the performance of terminal devices, and applications that support quality scoring of the captured screen content.
- terminal device 120 can be any type of computing-capable electronic device, including terminal electronic devices or server electronic devices.
- Terminal electronic devices can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) electronic devices, personal navigation electronic devices, personal digital assistants (PDAs), audio/video players, digital cameras/camcorders, positioning electronic devices, television receivers, radio receivers, e-book electronic devices, gaming electronic devices, or any combination of the foregoing, including accessories and peripherals of these electronic devices or any combination thereof.
- Server electronic devices may include, for example, computing systems/servers, such as mainframes, edge computing nodes, electronic devices in cloud environments, etc.
- Server 110 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms.
- Server 110 may include, for example, computing systems/servers such as mainframes, edge computing nodes, computing devices in cloud environments, etc.
- a communication connection can be established between server 110 and terminal device 120.
- This communication connection can be established via wired or wireless means.
- the communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect.
- server 110 and terminal device 120 can achieve signaling interaction through the communication connection between them.
- FIG. 2 shows a flowchart of a screen content acquisition process 200 according to some embodiments of the present disclosure.
- the screen content acquisition process 200 can be implemented in a server or a terminal device.
- the following description will use the example of a server executing the screen content acquisition process for a terminal device.
- the screen content acquisition scheme provided by the present disclosure will then be described in detail with reference to Figure 1. It should be understood that a similar process can also be executed locally by the terminal device 120.
- server 110 responds to determining that terminal device 120 acquires the screen content of terminal device 120 at a first resolution with a predetermined resolution, and determines the target adjustment mode corresponding to the predetermined resolution from multiple adjustment modes, wherein the first resolution corresponds to the predetermined resolution.
- acquiring the screen content of the terminal device 120 can be done in scenarios requiring screen recording and live streaming, such as game live streaming or live streaming other content displayed on the screen of the terminal device 120.
- the terminal device 120 can upload the acquired screen content to the server 110 in real time, and the server 110 can then transmit it to other terminal devices for playback.
- the user before the screen recording/live stream begins, can manually set the resolution, or network speed test software can be used to test the network speed of the terminal device 120, and the resolution can be recommended to the user based on the test results. For example, a lower resolution can be selected when the network conditions are poor; a higher resolution can be selected when the network conditions are good.
- the resolution selected by the user or the resolution recommended by the network speed test software is the predetermined resolution.
- the predetermined resolution may include multiple levels, such as 1080p, 720p, 540p, and resolutions below 540p. As mentioned above, different resolutions correspond to different levels of resolution. After determining the resolution of the terminal device 120 during screen recording and live streaming, the resolution corresponding to that resolution can be determined.
- the adjustment mode here refers to the method of adjusting the resolution.
- corresponding adjustment modes can be pre-configured for different resolutions to adjust the resolution corresponding to different resolutions. That is, different adjustment methods can be used to determine how to adjust the resolution of the captured screen content under different resolutions.
- the screen content of the electronic device 110 includes images displayed on the screen of the electronic device during screen recording, such as images of a running application.
- the display of screen content can be user-authorized, and the user can select the content to be displayed.
- server 110 adjusts the first resolution to the second resolution based on the display resolution of terminal device 120 using a target adjustment mode.
- server 110 may be configured with multiple adjustment modes, or server 110 may invoke multiple adjustment modes from an external source.
- the adjustment mode may include a first resolution adjustment mode, a second resolution adjustment mode, and a third resolution adjustment mode.
- standard resolution video resolution based on a standard display
- target resolution The resolution of the screen content of the acquisition terminal device 120
- the three resolution adjustment modes will be described in detail below.
- First resolution adjustment mode First, align the width resolution of the target resolution with the width resolution of the standard resolution. Then, determine the height resolution of the target resolution based on the ratio of the width resolution to the height resolution of the terminal device's display resolution and the width resolution of the target resolution.
- the first resolution adjustment mode can be implemented as follows:
- esolution_lrage max ⁇ W target ,H target ⁇ ;
- resolution_short resolution_lrage/(max ⁇ W screen , H screen ⁇ /min ⁇ W screen , H screen ⁇ );
- W target is the width resolution of the standard resolution
- H target is the height resolution of the standard resolution
- W screen is the width resolution of the display resolution
- H screen is the height resolution of the display resolution
- resolution_lrage is the width resolution of the target resolution
- resolution_short is the height resolution of the target resolution
- mod is the modulo function.
- the second resolution adjustment mode First, align the height resolution of the target resolution with the height resolution of the standard resolution. Then, multiply the height resolution of the target resolution by the ratio of the width resolution to the height resolution of the terminal device's display resolution to determine the width resolution of the target resolution. Finally, perform a 16-alignment correction on the width resolution of the target resolution.
- the second resolution adjustment mode can be implemented as follows:
- resolution_short_temp min ⁇ W target ,H target ⁇ ;
- resolution_large_temp resolution_short_temp ⁇ (max ⁇ W screen , H screen ⁇ /min ⁇ W screen , H screen ⁇ );
- resolution_large (resolution_large_temp+16-1)/16 ⁇ 16;
- resolution_short resolution_lrage/(max ⁇ W screen , H screen ⁇ /min ⁇ W screen , H screen ⁇ );
- W target is the width resolution of the standard resolution
- H target is the height resolution of the standard resolution
- W screen is the width resolution of the display resolution
- H screen is the height resolution of the display resolution
- resolution_lrage is the width resolution of the target resolution
- resolution_short is the height resolution of the target resolution
- resolution_short_temp is an intermediate variable
- resolution_large_temp is an intermediate variable
- mod is the modulo function
- the third resolution adjustment mode First, determine the greatest common divisor of the width and height resolutions of the terminal device's display resolution, and then determine the width and height resolutions of the target resolution based on integer multiples of this greatest common divisor.
- the third resolution adjustment mode can be implemented as follows:
- f(n) (n ⁇ W screen /screen_gcd ⁇ 16) ⁇ (n ⁇ H screen /screen_gcd ⁇ 16);
- W capture min_scale ⁇ W screen /screen_gcd ⁇ 16;
- H capture min_scale ⁇ H screen /screen_gcd ⁇ 16;
- W target is the width resolution of the standard resolution
- H target is the height resolution of the standard resolution
- W screen is the width resolution of the display resolution
- H screen is the height resolution of the display resolution
- W capture is the width resolution of the target resolution
- H capture is the height resolution of the target resolution
- screen_gcd is the greatest common divisor of the width and height resolutions of the display resolution
- gcd ⁇ identifies the function that takes the greatest common divisor
- min_scale is the minimum value of n for f(n).
- server 110 may use the above-described target adjustment mode to adjust the first resolution to obtain a second resolution.
- server 110 can use a first resolution adjustment mode to adjust the first resolution to a second resolution.
- a first resolution adjustment mode to adjust the first resolution to a second resolution.
- using the second resolution obtained from the first resolution adjustment mode can save the terminal device's acquisition and encoding resources, optimize power consumption, and thus improve the smoothness of screen content acquisition.
- server 110 can use a second resolution adjustment mode to adjust the first resolution to the second resolution.
- 720p resolution compared to using the standard resolution to acquire the terminal device's screen content, using the second resolution adjustment mode to acquire the terminal device's screen content at the second resolution can avoid black borders or cropping when capturing the terminal device's screen content, thus improving image quality.
- server 110 can use a third resolution adjustment mode to adjust the first resolution to the second resolution.
- the resolution is 540p or lower, compared to using the standard resolution to acquire the terminal device's screen content, using the second resolution obtained through the third resolution adjustment mode to acquire the terminal device's screen content results in a significant improvement in both power consumption and image quality.
- the first resolution mentioned above is the standard resolution mentioned earlier, and the second resolution is the target resolution mentioned earlier.
- server 110 may determine the target adjustment mode corresponding to a predetermined sharpness from multiple adjustment modes based on the performance score of terminal device 120.
- server 110 can determine multiple performance scores of terminal device 120 during the acquisition of screen content at multiple third resolutions at a predetermined resolution, and determine a target adjustment mode for adjusting the first resolution to a second resolution at the predetermined resolution based at least on the multiple performance scores.
- the multiple third resolutions are obtained by adjusting the first resolution using different adjustment modes, and therefore the multiple third resolutions may be different.
- each third resolution can be obtained by adjusting the first resolution according to different adjustment modes.
- terminal device 120 can be controlled to acquire screen content at each third resolution for a period of time, and the performance scores of the client device at each third resolution can be observed. Based on the observed performance scores, the target adjustment mode to be used for the predetermined resolution can be determined from the multiple adjustment modes.
- each of the multiple performance scores of the terminal device 120 may be determined by the performance scores of multiple components in the terminal device 120, which are related to the data processing of acquiring screen content during screen recording and live streaming. It should be understood that a performance score of the terminal device 120 corresponds to an adjustment mode, that is, the performance score of the terminal device 120 when the screen content of the terminal device 120 is acquired at the third resolution after adjusting the first resolution to the third resolution by the adjustment mode.
- the performance score of terminal device 120 can be determined based on the performance scores of at least one component within terminal device 120. At least one component is related to the data processing of acquiring screen content during screen recording and live streaming. Examples include the CPU, GPU, memory, etc., of terminal device 120.
- the performance score of at least one component can be determined based on the component parameter-component performance score relationship curve.
- the performance parameters of relevant components in the terminal device 120 can be detected and obtained from the component parameter-component performance score relationship curve using interpolation.
- the performance score of at least one component in terminal device 120 is first obtained, and then the weighted average, weighted sum, or other calculation result of the performance scores of at least one component is determined as the performance score of terminal device 120.
- the performance score of terminal device 120 can be determined, for example, in the following ways:
- weight values corresponding to at least one of the above components can be set as needed, and this disclosure does not impose any restrictions on this.
- a corresponding performance score can be obtained when capturing the screen content of the terminal device 120 at each third resolution.
- the adjustment mode corresponding to a higher performance score of the terminal device 120 can be determined as the target adjustment mode for adjusting the first resolution to the second resolution at a predetermined resolution.
- the quality score of the screen content of the terminal device 120 can be used to determine which resolution algorithm to use to adjust the first resolution to the second resolution.
- the quality scores of multiple screen contents acquired by the terminal device 120 at multiple third resolutions under a predetermined resolution can be determined separately. Based on these multiple quality scores, an adjustment mode for adjusting the first resolution to a second resolution under the predetermined resolution can be determined.
- the multiple third resolutions are obtained by adjusting the first resolution using multiple adjustment modes.
- the terminal device 120 can be controlled to acquire screen contents at various resolutions obtained according to different adjustment modes over a period of time, while simultaneously observing the performance score of the client device and the quality score of the screen contents at each resolution.
- a quality score for screen content corresponds to an adjustment mode, that is, after adjusting the first resolution to the third resolution by the adjustment mode, the quality score of the screen content of the terminal device 120 obtained at the third resolution is determined.
- the adjustment mode corresponding to a higher quality score of the terminal device 120 can be determined as the target adjustment mode for adjusting the first resolution to the second resolution at a predetermined resolution.
- the resolution algorithm i.e., the target adjustment mode for adjusting the first resolution to the second resolution can be determined by comprehensively considering the performance score of the terminal device 120 and the quality score of the screen content of the terminal device 120.
- the weighted average, weighted sum, or other calculation result of the performance score of at least one component of the terminal device 120 and the quality score of the screen content can be used as the comprehensive score of the terminal device 120.
- the adjustment mode corresponding to the higher comprehensive score of the terminal device 120 can be determined as the target adjustment mode for adjusting the first resolution to the second resolution at a predetermined clarity.
- server 110 controls terminal device 120 to acquire the screen content of terminal device 120 at a second resolution with a predetermined resolution.
- the second resolution can be determined to be more suitable for the terminal device 120. Therefore, in the subsequent acquisition of screen content, the terminal device 120 will acquire the screen content at the second resolution, for example, for screen recording and live streaming.
- server 110 when server 110 determines a second resolution for terminal device 120, server 110 can send the second resolution to terminal device 120 for use by terminal device 120. In some embodiments, if process 200 is implemented at terminal device 120, terminal device 120 itself will determine the adjusted second resolution and can use the second resolution to acquire screen content.
- the first resolution corresponding to a predetermined clarity can be adjusted to a second resolution suitable for or matching the display resolution of the terminal device using the display resolution of the terminal device. This allows for adaptive adjustment of the content resolution when recording the screen content of the terminal device, thereby avoiding image distortion or black borders or cropping in the display area.
- FIG. 3 shows a block diagram of an apparatus 300 for screen content acquisition according to some embodiments of the present disclosure.
- the apparatus 300 may be implemented as or included in a server 110 or a terminal device 120.
- the various modules/components in the apparatus 300 may be implemented by hardware, software, firmware, or any combination thereof.
- the device 300 includes a determining module 310 configured to, in response to determining that a terminal device acquires screen content of the terminal device at a first resolution under a predetermined resolution, determine a target adjustment mode corresponding to the predetermined resolution from a plurality of adjustment modes, wherein the first resolution corresponds to the predetermined resolution.
- the device 300 also includes an adjusting module 320 configured to adjust the first resolution to a second resolution based on the display resolution of the terminal device using the target adjustment mode.
- the device 300 further includes a control module 330 configured to control the terminal device to acquire screen content at the second resolution under the predetermined resolution.
- the adjustment module 330 is further configured to: determine the width resolution in the first resolution as the width resolution of the second resolution in response to the target adjustment mode being a first target adjustment mode; and determine the height resolution of the second resolution based on the height resolution of the first resolution and the display resolution.
- the adjustment module 330 is further configured to: in response to the target adjustment mode being a second target adjustment mode, determine the height resolution of the second resolution based on the display resolution and a predetermined integer multiple of the height resolution of the first resolution; and determine the width resolution of the second resolution based on the display resolution and the height resolution of the second resolution.
- the adjustment module 330 is further configured to: determine the greatest common divisor of the width resolution and the height resolution of the display resolution in response to the target adjustment mode being a third target adjustment mode; and determine the second resolution based on the greatest common divisor, the first resolution, and the display resolution.
- the determining module 310 is further configured to: determine multiple performance scores of the terminal device during the acquisition of screen content at multiple third resolutions under the predetermined resolution, the multiple third resolutions being obtained by adjusting the first resolution using multiple adjustment modes; and determine a target adjustment mode for adjusting the first resolution to the second resolution under the predetermined resolution, based at least on the multiple performance scores.
- the determining module 310 is further configured to: determine multiple quality scores of the screen content obtained by the terminal device at multiple third resolutions under the predetermined resolution, the multiple third resolutions being obtained by adjusting the first resolution using multiple modes; and further determine a target adjustment mode for adjusting the first resolution to the second resolution under the predetermined resolution based on the multiple quality scores.
- Figure 4 shows a block diagram illustrating a terminal device in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device shown in Figure 4 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device shown in Figure 4 can be used to implement the server 110 or terminal device 120 of Figure 1.
- electronic device 400 is in the form of a general-purpose electronic device.
- Components of electronic device 400 may include, but are not limited to, one or more processors or processing units 410, memory 420, storage electronics 430, one or more communication units 440, one or more input electronics 450, and one or more output electronics 460.
- Processing unit 410 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 420. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 400.
- Electronic device 400 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 400, including but not limited to volatile and non-volatile media, removable and non-removable media.
- Memory 420 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof.
- Storage electronic device number 30 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and/or data and can be accessed within electronic device 400.
- Electronic device 400 may further include additional removable/non-removable, volatile/non-volatile storage media.
- disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided.
- each drive may be connected to a bus (not shown) via one or more data media interfaces.
- Memory 420 may include computer program product 425 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.
- Communication unit 440 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 400 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 400 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.
- PCs network personal computers
- Input electronic device 450 can be one or more input electronic devices, such as a mouse, keyboard, trackball, etc.
- Output electronic device 460 can be one or more output electronic devices, such as a monitor, speaker, printer, etc.
- Electronic device 400 can also communicate with one or more external electronic devices (not shown) via communication unit 440 as needed. These external electronic devices, such as storage electronic devices, display electronic devices, etc., can communicate with one or more electronic devices that enable user interaction with electronic device 400, or with any electronic device (e.g., network card, modem, etc.) that enables electronic device 400 to communicate with one or more other electronic devices. Such communication can be performed via input/output (I/O) interface (not shown).
- I/O input/output
- a computer-readable storage medium that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above.
- a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.
- These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions/actions specified in one or more blocks of the flowchart and/or block diagram.
- These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and/or other electronic equipment to operate in a particular manner.
- the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions/actions specified in one or more blocks of the flowchart and/or block diagram.
- Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other electronic device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other electronic device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other electronic device to perform the functions/actions specified in one or more boxes of a flowchart and/or block diagram.
- each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function.
- the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved.
- each block in the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
根据本公开的实施例,提供了用于屏幕内容获取的方法、装置、电子设备和存储介质。该方法包括:响应于确定终端设备在预定清晰度下以第一分辨率获取终端设备的屏幕内容,从多个调整模式中确定预定清晰度对应的目标调整模式,第一分辨率对应于预定清晰度;基于终端设备的显示分辨率,利用目标调整模式来调整第一分辨率至第二分辨率;以及控制终端设备在预定清晰度下以第二分辨率获取屏幕内容。
Description
本申请要求2024年06月28日递交的、标题为“用于屏幕内容获取的方法、装置、设备和存储介质”、申请号为202410870303.2的中国发明专利申请的优先权,该申请的全部内容通过引用结合在本申请中。
本公开的示例实施例总体涉及计算机领域,特别地涉及用于屏幕内容获取的方法、装置、电子设备和计算机可读存储介质。
在录屏直播场景下,采集终端设备的屏幕内容的分辨率通常是基于标准显示器的视频分辨率(例如,16:9)。然而,某些终端设备(例如,手机、平板电脑)的显示分辨率和基于标准显示器的视频分辨率不匹配,在采用基于标准显示器的视频分辨率采集这些终端设备的屏幕内容时,会出现画面失真,或者出现“黑边区域”或画面被裁剪。
在本公开的第一方面,提供了一种用于屏幕内容获取的方法,包括:响应于确定终端设备在预定清晰度下以第一分辨率获取所述终端设备的屏幕内容,从多个调整模式中确定所述预定清晰度对应的目标调整模式,所述第一分辨率对应于所述预定清晰度;基于所述终端设备的显示分辨率,利用所述目标调整模式来调整所述第一分辨率至第二分辨率;以及控制所述终端设备在所述预定清晰度下以所述第二分辨率获取屏幕内容。
在本公开的第二方面,提供了一种用于屏幕内容获取的装置,包括:确定模块,被配置为响应于确定终端设备在预定清晰度下以第一分辨率获取所述终端设备的屏幕内容,从多个调整模式中确定所述预定清晰度对应的目标调整模式,所述第一分辨率对应于所述预定清晰度;调整模块,被配置为基于所述终端设备的显示分辨率,利用所述目标调整模式来调整所述第一分辨率至第二分辨率;以及控制模块,被配置为控制所述终端设备在所述预定清晰度下以所述第二分辨率获取屏幕内容。
在本公开的第三方面,提供了一种电子设备。该电子设备包括至少一个处理器;以及至少一个存储器,至少一个存储器被耦合到至少一个处理器并且存储用于由至少一个处理器执行的指令。指令在由至少一个处理器执行时使电子设备执行第一方面的方法。
在本公开的第四方面,提供了一种计算机可读存储介质。该计算机可读存储介质上存储有计算机可执行指令,计算机可执行指令可由处理器执行以实现第一方面的方法。
在本公开的第五方面,提供了一种计算机可执行指令产品,包括计算机可执行指令,其中所述计算机可执行指令在被处理器执行时实现第一方面的方法。
应当理解,本内容部分中所描述的内容并非旨在限定本公开的实施例的关键特征或重要特征,也不用于限制本公开的范围。本公开的其它特征将通过以下的描述而变得容易理解。
结合附图并参考以下详细说明,本公开各实施例的上述和其他特征、优点及方面将变得更加明显。在附图中,相同或相似的附图标记表示相同或相似的元素,其中:
图1示出了本公开的实施例能够在其中实现的示例环境的示意图;
图2示出了根据本公开的一些实施例的屏幕内容获取的过程的流程图;
图3示出了根据本公开的一些实施例的用于屏幕内容获取的装置的框图;以及
图4示出了能够实施本公开的多个实施例的电子设备的框图。
可以理解的是,在使用本公开各实施例公开的技术方案之前,均应当依据相关法律法规通过恰当的方式对本公开所涉及个人信息的类型、使用范围、使用场景等告知用户并获取用户的授权。
例如,在响应于接收到用户的主动请求时,向用户发送提示信息,以明确地提示用户,其请求执行的操作将需要获取和使用到用户的个人信息。从而,使得用户可以根据提示信息来自主地选择是否向执行本公开技术方案的操作的电子设备、应用程序、服务器或存储介质等软件或硬件提供个人信息。
作为一种可选的但非限定性的实现方式,响应于接收到用户的主动请求,向用户发送提示信息的方式例如可以是弹窗的方式,弹窗中可以以文字的方式呈现提示信息。此外,弹窗中还可以承载供用户选择“同意”或者“不同意”向电子设备提供个人信息的选择控件。
可以理解的是,上述通知和获取用户授权过程仅是示意性的,不对本公开的实现方式构成限定,其它满足相关法律法规的方式也可应用于本公开的实现方式中。
可以理解的是,本技术方案所涉及的数据(包括但不限于数据本身、数据的获取或使用)应当遵循相应法律法规及相关规定的要求。
下面将参照附图更详细地描述本公开的实施例。虽然附图中示出了本公开的某些实施例,然而应当理解的是,本公开可以通过各种形式来实现,而且不应该被解释为限于这里阐述的实施例,相反,提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是,本公开的附图及实施例仅用于示例性作用,并非用于限制本公开的保护范围。
需要注意的是,本文中所提供的任何节/子节的标题并不是限制性的。本文通篇描述了各种实施例,并且任何类型的实施例都可以包括在任何节/子节下。此外,在任一节/子节中描述的实施例可以以任何方式与同一节/子节和/或不同节/子节中描述的任何其他实施例相结合。
在本文中,除非明确说明,“响应于A”执行一个步骤并不意味着在“A”之后立即执行该步骤,而是可以包括一个或多个中间步骤。
在本公开的实施例的描述中,术语“包括”及其类似用语应当理解为开放性包含,即“包括但不限于”。术语“基于”应当理解为“至少部分地基于”。术语“一个实施例”或“该实施例”应当理解为“至少一个实施例”。术语“一些实施例”应当理解为“至少一些实施例”。下文还可能包括其他明确的和隐含的定义。下文还可能包括其他明确的和隐含的定义。
如前文所简要提及的,在录屏直播场景下,在开播时主播会手动选择或则通过测速推荐来决定开播的清晰度。不同的清晰度对应有不同的基于标准显示器的视频分辨率,例如,清晰度为1080p,对应的分辨率为1920×1080;清晰度为720p,对应的分辨率为1280×720。
录屏直播采集的是终端设备的屏幕内容,某些终端设备的显示分辨率和基于标准显示器的视频分辨率不匹配。例如,手机的显示分辨率为“长条”,即宽度分辨率和高度分辨率的比例超过2:1;平板电脑的显示分辨率中宽度分辨率和高度分辨的比例大概为4:3。
如果采用基于标准显示器的视频分辨率来采集上述终端设备的屏幕内容,会出现下述两种情况:(1)将采集到的源画面完全填满16:9的显示区域,此种方式会导致画面失真;(2)在16:9的显示区域中,先将采集到的屏幕内容填满一边,另一边按照设备屏幕的大小等比缩放,此种方式会导致显示区域上下或左右出现大面积黑边或者裁剪。
本公开的实施例提出了一种用于屏幕内容获取的方案。根据本公开的各种实施例,服务端设备或终端设备确定该终端设备在预定清晰度下以第一分辨率获取终端设备的屏幕内容,第一分辨率对应于所述预定清晰度。基于终端设备的显示分辨率,调整第一分辨率至第二分辨率;以及控制终端设备在预定清晰度下以第二分辨率获取屏幕内容。利用终端设备的显示分辨率,调整预定清晰度对应的第一分辨率至适合或者匹配终端设备的显示分辨率的第二分辨率,并控制终端设备在预定清晰度下以第二分辨率获取屏幕内容。由此,可以在对终端设备的屏幕内容进行录制的情况下可以适应性调整内容的分辨率,从而避免了画面失真,或者显示区域出现黑边或裁剪。
图1示出了本公开的实施例能够在其中实现的示例环境100的示意图。如图1所示,在一些实施例中,环境100可以包括服务器110和终端设备120。在另一些实施例中,环境100可以仅包括终端设备120。
在环境100中包括服务器110和终端设备120时,终端设备120中部署有支持录屏直播的应用、支持检测终端设备性能的应用以及支持对采集到的屏幕内容进行质量评分的应用。或者,服务器110中部署有支持检测终端设备性能的应用以及支持对采集到的屏幕内容进行质量评分的应用,终端设备120中部署有支持录屏直播的应用。
在环境100仅包括终端设备120时,终端设备120中部署有支持录屏直播的应用、支持检测终端设备性能的应用以及支持对采集到的屏幕内容进行质量评分的应用。
在环境100中,终端设备120可以是任意类型的具有计算能力的电子设备,包括终端电子设备或服务端电子设备。终端电子设备可以是任意类型的移动终端、固定终端或便携式终端,包括移动手机、台式计算机、膝上型计算机、笔记本计算机、上网本计算机、平板计算机、媒体计算机、多媒体平板、个人通信系统(PCS)电子设备、个人导航电子设备、个人数字助理(PDA)、音频/视频播放器、数码相机/摄像机、定位电子设备、电视接收器、无线电广播接收器、电子书电子设备、游戏电子设备或者前述各项的任意组合,包括这些电子设备的配件和外设或者其任意组合。服务端电子设备例如可以包括计算系统/服务器,诸如大型机、边缘计算节点、云环境中的电子设备,等等。
服务器110可以是独立的物理服务器,也可以是多个物理服务器构成的服务器集群或者分布式系统,还可以是提供云服务、云数据库、云计算、云函数、云存储、网络服务、云通信、中间件服务、域名服务、安全服务、内容分发网络、以及大数据和人工智能平台等基础云计算服务的云服务器。服务器110例如可以包括计算系统/服务器,诸如大型机、边缘计算节点、云环境中的计算设备,等等。
服务器110与终端设备120之间可以建立有通信连接。通信连接可以通过有线方式或无线方式建立。通信连接可以包括但不限于蓝牙连接、移动网络连接、通用串行总线(Universal Serial Bus,USB)连接、无线保真(Wireless Fidelity,WiFi)连接等,本公开的实施例在此方面不受限制。在本公开的实施例中,服务器110与终端设备120可以通过二者之间的通信连接实现信令交互。
应当理解,仅出于示例性的目的描述环境100的结构和功能,而不暗示对于本公开的范围的任何限制。
图2示出了根据本公开的一些实施例的用于屏幕内容获取的过程200的流程图。在图2中,用于屏幕内容获取的过程200可以被实现在服务器或终端设备中。为了方便讨论,下文中将以服务器执行对终端设备的屏幕内容获取过程为例进行说明。接下来结合图1对本公开提供的用于屏幕内容获取的方案进行详细介绍。应当理解,类似的过程也可以由终端设备120本地执行。
在框210,服务器110响应于确定终端设备120在预定清晰度下以第一分辨率获取终端设备120的屏幕内容,从多个调整模式中确定预定清晰度对应的目标调整模式,第一分辨率对应于预定清晰度。
在一些实施例中,获取终端设备120的屏幕内容可以是在需要实现录屏直播的场景,例如游戏直播或者以终端设备120的屏幕所显示的其他内容进行直播。在录屏直播的场景中,终端设备120可以将获取到的屏幕内容实时地上传服务器110并由服务器110传输给其他终端设备进行播放。
在一些实施例中,录屏直播开始之前,可以由用户手动设置清晰度,或者也可以通过网络测速软件对终端设备120进行网络测速,根据测速结果来向用户推荐清晰度。例如,在网络条件较差的情况下可以选择较低的清晰度;在网络条件较好的情况下,可以选择较高的清晰度。用户选择的清晰度或者网络测速软件推荐的清晰度即为预定清晰度。
在一些实施例中,预定清晰度可以包括多个档位,例如1080p、720p、540p及540p以下的清晰度。如前文所述,不同的清晰度对应有不同的分辨率。在确定终端设备120进行录屏直播时的清晰度后,可以确定该清晰度对应的分辨率。
这里的调整模式指的是对分辨率的调整方式。在一些实施例中,针对终端设备110的屏幕内容的录制过程中,对于不同清晰度可以预先配置对应的调整模式,以用于调整与不同清晰度对应的分辨率。也就是说,在不同清晰度下,可以采用不同的调整方式来确定如何调整采集到的屏幕内容的分辨率。
在一些实施例中,电子设备110的屏幕内容包括在录屏期间电子设备的屏幕上所呈现的画面,例如是正在运行的应用的画面。对于屏幕内容的呈现可以是用户授权的,并且可以由用户选定所要呈现的画面内容。
在框220,服务器110基于终端设备120的显示分辨率,利用目标调整模式来调整第一分辨率至第二分辨率。
在一些实施例中,服务器110中可以配置有多个调整模式,或者服务器110可以从外部调用多个调整模式。
在一些实施例中,调整模式可以包括第一分辨率调整模式、第二分辨率调整模式以及第三分辨率调整模式。为方便描述下文中将“基于标准显示器的视频分辨率”称为“标准分辨率”。将采集终端设备120的屏幕内容的分辨率称为“目标分辨率”。下面对三种分辨调整模式分别进行详细介绍。
第一分辨率调整模式:首先将目标分辨率的宽度分辨率和标准分辨率的宽度分辨率对齐,随后基于终端设备的显示分辨率的宽度分辨率和高度分辨率的比例和目标分辨率的宽度分辨率来确定目标分辨率的高度分辨率。
示例地,第一分辨率调整模式可以采用如下方式实现:
esolution_lrage=max{Wtarget,Htarget};
resolution_short=resolution_lrage/(max{Wscreen,Hscreen}/min{Wscreen,Hscreen});
resolution_short mod 2=0;
其中,Wtarget为标准分辨率的宽度分辨率,Htarget为标准分辨率的高度分辨率,Wscreen为显示分辨率的宽度分辨率,Hscreen为显示分辨率的高度分辨率,resolution_lrage为目标分辨率的宽度分辨率,resolution_short为目标分辨率的高度分辨率,mod为求余函数。
第二种分辨率调整模式:首先将目标分辨率的高度分辨率和标准分辨率的高度分辨率对齐,随后再将目标分辨率的高度分辨率乘以终端设备的显示分辨率的宽度分辨率和高度分辨率的比例来确定目标分辨率的宽度分辨率,随后在对目标分辨率的宽度分辨率进行16对齐修正。
示例地,第二分辨率调整模式可以采用如下方式实现:
resolution_short_temp=min{Wtarget,Htarget};
resolution_large_temp=resolution_short_temp×(max{Wscreen,Hscreen}/min{Wscreen,Hscreen});
resolution_large=(resolution_large_temp+16-1)/16×16;
resolution_short=resolution_lrage/(max{Wscreen,Hscreen}/min{Wscreen,Hscreen});
resolution_short mod 2=0;
其中,Wtarget为标准分辨率的宽度分辨率,Htarget为标准分辨率的高度分辨率,Wscreen为显示分辨率的宽度分辨率,Hscreen为显示分辨率的高度分辨率,resolution_lrage为目标分辨率的宽度分辨率,resolution_short为目标分辨率的高度分辨率,resolution_short_temp为中间变量,resolution_large_temp为中间变量,mod为求余函数。
第三种分辨率调整模式:首先确定终端设备的显示分辨率的宽度分辨率和高度分辨率的最大公约数,基于该最大公约数的整数倍分别确定目标分辨率的宽度分辨率和高度分辨率。
示例地,第三分辨率调整模式可以采用如下方式实现:
screen_gcd=gcd{Wscreen,Hscreen};
f(n)=(n×Wscreen/screen_gcd×16)×(n×Hscreen/screen_gcd×16);
Wcapture=min_scale×Wscreen/screen_gcd×16;
Hcapture=min_scale×Hscreen/screen_gcd×16;
其中,Wtarget为标准分辨率的宽度分辨率,Htarget为标准分辨率的高度分辨率,Wscreen为显示分辨率的宽度分辨率,Hscreen为显示分辨率的高度分辨率,Wcapture为目标分辨率的宽度分辨率,Hcapture为目标分辨率的高度分辨率,screen_gcd为显示分辨率的宽度分辨率和高度分辨率的最大公约数,gcd{}标识取最大公约数的函数,min_scale为f(n)取值最小是n的取值。
在一些实施例中,服务器110可以采用上述目标调整模式对第一分辨率进行调整,得到第二分辨率。
例如,预定清晰度为1080p时,服务器110可以采用第一分辨率调整模式,将第一分辨率调整至第二分辨率。在清晰度为1080p时,相比于采用标准分辨率获取终端设备的屏幕内容,采用第一分辨率调整模式调整得到的第二分辨率来获取终端设备的屏幕内容,可以节省终端设备的采集资源和编码资源,还能够优化终端设备的功耗,从而提高获取屏幕内容的流畅性。
例如,预定清晰度为720p时,服务器110可以采用第二分辨率调整模式,将第一分辨率调整至第二分辨率。在清晰度为720p时,相比于采用标准分辨率获取终端设备的屏幕内容,采用第二分辨率调整模式调整得到的第二分辨率来获取终端设备的屏幕内容,可以避免采集终端设备的屏幕内容时画质出现黑边区域或画面被裁剪,以提高画面质量。
例如,预定清晰度为540p及以下清晰度时,服务器110可以采用第三分辨率调整模式,将第一分辨率调整至第二分辨率。在清晰度为540p及以下清晰度时,相比于采用标准分辨率获取终端设备的屏幕内容,采用第三分辨率调整模式调整得到的第二分辨率来获取终端设备的屏幕内容,在终端设备功耗和画质上均有较大的提升。
需要说明的是,上述第一分辨率为前文中所提到的标准分辨率,第二分辨率为前文中所提到的目标分辨率。
前文详细讨论了不同调整模式,并且还提到针对不同清晰度确定更适合的调整模式。下文将详细讨论如何确定每个清晰度对应的目标调整模式。
在一些实施例中,服务器110可以基于终端设备120的性能得分来从多个调整模式中确定预定清晰度对应的目标调整模式。
具体地,服务器110可以分别确定终端设备120在预定清晰度下以多个第三分辨率获取屏幕内容期间的多个性能得分,至少基于多个性能得分确定在预定清晰度下将第一分辨率调整至第二分辨率的目标调整模式。多个第三分辨率是利用不同的多个调整模式分别对第一分辨率进行调整后得到的,因此多个第三分辨率可能是不同的。根据该方案,可以按照不同调整模式对第一分辨率进行调整得到各个第三分辨率。然而,可以在一段时间内控制终端设备120按照各个第三分辨率进行屏幕内容采集,并观察客户端设备在各个第三分辨率下的性能得分。基于观察到的性能得分,可以从多个调整模式中确定针对预定清晰度所要使用的目标调整模式。
在一些实施例中,终端设备120的多个性能得分中每个性能得分可以由终端设备120中的多个组件的性能得分来确定,多个组件与录屏直播时获取屏幕内容的数据处理相关。应当理解,终端设备120的一个性能得分对应于一种调整模式,即由该种调整模式将第一分辨率调整至第三分辨率后,以第三分辨率获取终端设备120的屏幕内容时终端设备120的性能得分。
终端设备120的性能得分可以是基于终端设备120中至少一个组件各自的性能得分来确定。至少一个组件是与录屏直播中获取屏幕内容的数据处理相关的组件。例如,终端设备120的CPU、GPU、内存,等等。
在一些实施例中,至少一个组件各自的性能得分可以基于组件参数-组件性能得分关系曲线确定。例如,可以检测终端设备120中相关组件的性能参数,并采用插值法,由组件参数-组件性能得分关系曲线得到。
在确定终端设备120的性能得分,首先获得终端设备120中至少一个组件的性能得分,然后确定至少一个组件的性能得分的加权平均值、加权和、或者其他运算结果作为终端设备120的性能得分。
示例地,以表1中所示的组件为例:
表1
终端设备120的性能得分例如可以通过以下方式来确定:
应当理解,上述至少一个组件对应的权重值,可以根据需要来进行设置,本公开对此不进行限制。
由于多个第三分辨率是经不同调整模式调整后得到的,以每种第三分辨率采集终端设备120的屏幕内容时,可以得到对应的性能得分。在一些实施例中,可以将终端设备120的性能得分较高的情况下对应的调整模式确定为在预定清晰度下将第一分辨率调整至第二分辨率的目标调整模式。
在一些实施例中,可以通过采集得到的终端设备120的屏幕内容的质量得分来确定采用哪种分辨率算法将第一分辨调整至第二分辨率。
具体地,可以分别确定终端设备120在预定清晰度下以多个第三分辨率获取屏幕内容期间的多个屏幕内容的质量得分,基于多个质量得分确定在预定清晰度下将第一分辨率调整至第二分辨率的调整模式。多个第三分辨率是利用多个调整模式分别对第一分辨率进行调整后得到的。例如可以在一段时间内控制终端设备120按照不同调整模式得到的各个分辨率进行屏幕内容采集,并同时观察客户端设备在各个分辨率下的性能得分和屏幕内容的质量得分。
应当理解,屏幕内容的一个质量得分对应于一种调整模式,即由该种调整模式将第一分辨率调整至第三分辨率后,确定以第三分辨率获取到的终端设备120的屏幕内容的质量得分。
由于多个第三分辨率是经不同调整模式调整后得到的,以每种第三分辨率采集终端设备120的屏幕内容时,可以得到对应的质量得分。在一些实施例中,可以将终端设备120的质量得分较高的情况下对应的调整模式确定为在预定清晰度下将第一分辨率调整至第二分辨率的目标调整模式。
在一些实施例中,可以通过综合考虑终端设备120的性能得分和采集得到的终端设备120的屏幕内容的质量得分来确定采用哪种分辨率算法(即,目标调整模式)将第一分辨调整至第二分辨率。在一些实施例中,可以将终端设备120的至少一个组件的性能得分和屏幕内容的质量得分的加权平均值、加权和、或者其他运算结果作为终端设备120的综合得分。在一些实施例中,可以将终端设备120的综合得分较高的情况下对应的调整模式确定为在预定清晰度下将第一分辨率调整至第二分辨率的目标调整模式。
在框230,服务器110控制终端设备120在预定清晰度下以第二分辨率获取终端设备120的屏幕内容。
在完成分辨率调整后,第二分辨率可以被确定为更适合于终端设备120。因此,在后续屏幕内容的获取过程中,终端设备120将以第二分辨率获取屏幕内容,例如用于录屏直播。
在一些实施例中,在服务器110为终端设备120确定第二分辨率的情况下,服务器110可以将第二分辨率发送给终端设备120,以由终端设备120使用。在一些实施例中,如果过程200被实现在终端设备120处,终端设备120本身将确定调整后得到的第二分辨率,并可以使用第二分辨率来获取屏幕内容。
根据本公开的实施例,可以利用终端设备的显示分辨率,调整预定清晰度对应的第一分辨率至适合或者匹配终端设备的显示分辨率的第二分辨率,以在对终端设备的屏幕内容进行录制的情况下可以适应性调整内容的分辨率,以避免画面失真,或者显示区域出现黑边或裁剪等情况。
图3示出了根据本公开的一些实施例的用于屏幕内容获取的装置300的框图。装置300可以被实现为或者被包括在服务器110或终端设备120中。装置300中的各个模块/组件可以由硬件、软件、固件或者它们的任意组合来实现。
如图所示,装置300包括确定模块310,被配置为响应于确定终端设备在预定清晰度下以第一分辨率获取所述终端设备的屏幕内容,从多个调整模式中确定所述预定清晰度对应的目标调整模式,所述第一分辨率对应于所述预定清晰度。装置300还包括调整模块320,被配置为基于所述终端设备的显示分辨率,利用所述目标调整模式来调整所述第一分辨率至第二分辨率。装置300还包括控制模块330,被配置为控制所述终端设备在所述预定清晰度下以所述第二分辨率获取屏幕内容。
在一些实施例中,调整模块330还被配置为:响应于所述目标调整模式是第一目标调整模式,将所述第一分辨率中的宽度分辨率确定为所述第二分辨率的宽度分辨率;以及基于所述第一分辨率的高度分辨率和所述显示分辨率,确定所述第二分辨率的高度分辨率。
在一些实施例中,调整模块330还被配置为:响应于所述目标调整模式是第二目标调整模式,基于所述显示分辨率和所述第一分辨率的高度分辨率的预定整数倍,确定所述第二分辨率的高度分辨率;以及基于所述显示分辨率和所述第二分辨率的高度分辨率,确定所述第二分辨率的宽度分辨率。
在一些实施例中,调整模块330还被配置为:响应于所述目标调整模式是第三目标调整模式,确定所述显示分辨率的宽度分辨率和高度分辨率的最大公约数;以及基于所述最大公约数、所述第一分辨率以及所述显示分辨率,确定所述第二分辨率。
在一些实施例中,确定模块310还被配置为:分别确定所述终端设备在所述预定清晰度下以多个第三分辨率获取所述屏幕内容期间的多个性能得分,所述多个第三分辨率是利用多个调整模式对所述第一分辨率进行调整后得到的;以及至少基于所述多个性能得分,确定在所述预定清晰度下将所述第一分辨率调整至所述第二分辨率的目标调整模式。
在一些实施例中,确定模块310还被配置为:分别确定所述终端设备在所述预定清晰度下以多个第三分辨率获取到的所述屏幕内容的多个质量得分,所述多个第三分辨率是利用多个模式对所述第一分辨率进行调整后得到的;以及还基于所述多个质量得分,确定在所述预定清晰度下将所述第一分辨率调整至所述第二分辨率的目标调整模式。
图4示出了示出了其中可以实施本公开的一个或多个实施例的终端设备的框图。应当理解,图4所示出的电子设备仅仅是示例性的,而不应当构成对本文所描述的实施例的功能和范围的任何限制。图4所示出的电子设备可以用于实现图1的服务器110或终端设备120。
如图4所示,电子设备400是通用电子设备的形式。电子设备400的组件可以包括但不限于一个或多个处理器或处理单元410、存储器420、存储电子设备430、一个或多个通信单元440、一个或多个输入电子设备450以及一个或多个输出电子设备460。处理单元410可以是实际或虚拟处理器并且能够根据存储器420中存储的程序来执行各种处理。在多处理器系统中,多个处理单元并行执行计算机可执行指令,以提高电子设备400的并行处理能力。
电子设备400通常包括多个计算机存储介质。这样的介质可以是电子设备400可访问的任何可以获取的介质,包括但不限于易失性和非易失性介质、可拆卸和不可拆卸介质。存储器420可以是易失性存储器(例如寄存器、高速缓存、随机访问存储器(RAM))、非易失性存储器(例如,只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、闪存)或它们的某种组合。存储电子设备devicenumber30可以是可拆卸或不可拆卸的介质,并且可以包括机器可读介质,诸如闪存驱动、磁盘或者任何其他介质,其可以能够用于存储信息和/或数据并且可以在电子设备400内被访问。
电子设备400可以进一步包括另外的可拆卸/不可拆卸、易失性/非易失性存储介质。尽管未在图4中示出,可以提供用于从可拆卸、非易失性磁盘(例如“软盘”)进行读取或写入的磁盘驱动和用于从可拆卸、非易失性光盘进行读取或写入的光盘驱动。在这些情况中,每个驱动可以由一个或多个数据介质接口被连接至总线(未示出)。存储器420可以包括计算机程序产品425,其具有一个或多个程序模块,这些程序模块被配置为执行本公开的各种实施例的各种方法或动作。
通信单元440实现通过通信介质与其他电子设备进行通信。附加地,电子设备400的组件的功能可以以单个计算集群或多个计算机器来实现,这些计算机器能够通过通信连接进行通信。因此,电子设备400可以使用与一个或多个其他服务器、网络个人计算机(PC)或者另一个网络节点的逻辑连接来在联网环境中进行操作。
输入电子设备450可以是一个或多个输入电子设备,例如鼠标、键盘、追踪球等。输出电子设备460可以是一个或多个输出电子设备,例如显示器、扬声器、打印机等。电子设备400还可以根据需要通过通信单元440与一个或多个外部电子设备(未示出)进行通信,外部电子设备诸如存储电子设备、显示电子设备等,与一个或多个使得用户与电子设备400交互的电子设备进行通信,或者与使得电子设备400与一个或多个其他电子设备通信的任何电子设备(例如,网卡、调制解调器等)进行通信。这样的通信可以经由输入/输出(I/O)接口(未示出)来执行。
根据本公开的示例性实现方式,提供了一种计算机可读存储介质,其上存储有计算机可执行指令,其中计算机可执行指令被处理器执行以实现上文描述的方法。根据本公开的示例性实现方式,还提供了一种计算机程序产品,计算机程序产品被有形地存储在非瞬态计算机可读介质上并且包括计算机可执行指令,而计算机可执行指令被处理器执行以实现上文描述的方法。
这里参照根据本公开实现的方法、装置、电子设备和计算机程序产品的流程图和/或框图描述了本公开的各个方面。应当理解,流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合,都可以由计算机可读程序指令实现。
这些计算机可读程序指令可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理单元,从而生产出一种机器,使得这些指令在通过计算机或其他可编程数据处理装置的处理单元执行时,产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中,这些指令使得计算机、可编程数据处理装置和/或其他电子设备以特定方式工作,从而,存储有指令的计算机可读介质则包括一个制造品,其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。
可以把计算机可读程序指令加载到计算机、其他可编程数据处理装置、或其他电子设备上,使得在计算机、其他可编程数据处理装置或其他电子设备上执行一系列操作步骤,以产生计算机实现的过程,从而使得在计算机、其他可编程数据处理装置、或其他电子设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。
附图中的流程图和框图显示了根据本公开的多个实现的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分,模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。
以上已经描述了本公开的各实现,上述说明是示例性的,并非穷尽性的,并且也不限于所公开的各实现。在不偏离所说明的各实现的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择,旨在最好地解释各实现的原理、实际应用或对市场中的技术的改进,或者使本技术领域的其他普通技术人员能理解本文公开的各个实现方式。
Claims (10)
- 一种用于屏幕内容获取的方法,包括:响应于确定终端设备在预定清晰度下以第一分辨率获取所述终端设备的屏幕内容,从多个调整模式中确定所述预定清晰度对应的目标调整模式,所述第一分辨率对应于所述预定清晰度;基于所述终端设备的显示分辨率,利用所述目标调整模式来调整所述第一分辨率至第二分辨率;以及控制所述终端设备在所述预定清晰度下以所述第二分辨率获取屏幕内容。
- 根据权利要求1所述的方法,其中利用所述目标调整模式来调整所述第一分辨率至第二分辨率包括:响应于所述目标调整模式是第一目标调整模式,将所述第一分辨率中的宽度分辨率确定为所述第二分辨率的宽度分辨率;以及基于所述第一分辨率的高度分辨率和所述显示分辨率,确定所述第二分辨率的高度分辨率。
- 根据权利要求1所述的方法,其中利用所述目标调整模式来调整所述第一分辨率至第二分辨率包括:响应于所述目标调整模式是第二目标调整模式,基于所述显示分辨率和所述第一分辨率的高度分辨率的预定整数倍,确定所述第二分辨率的高度分辨率;以及基于所述显示分辨率和所述第二分辨率的高度分辨率,确定所述第二分辨率的宽度分辨率。
- 根据权利要求1所述的方法,其中利用所述目标调整模式来调整所述第一分辨率至第二分辨率包括:响应于所述目标调整模式是第三目标调整模式,确定所述显示分辨率的宽度分辨率和高度分辨率的最大公约数;以及基于所述最大公约数、所述第一分辨率以及所述显示分辨率,确定所述第二分辨率。
- 根据权利要求1所述的方法,其中确定所述目标调整模式包括:分别确定所述终端设备在所述预定清晰度下以多个第三分辨率获取所述屏幕内容期间的多个性能得分,所述多个第三分辨率是利用多个调整模式对所述第一分辨率进行调整后得到的;以及至少基于所述多个性能得分,确定在所述预定清晰度下将所述第一分辨率调整至所述第二分辨率的所述目标调整模式。
- 根据权利要求1所述的方法,其中确定所述目标调整模式包括:分别确定所述终端设备在所述预定清晰度下以多个第三分辨率获取到的所述屏幕内容的多个质量得分,所述多个第三分辨率是利用多个模式对所述第一分辨率进行调整后得到的;以及还基于所述多个质量得分,确定在所述预定清晰度下将所述第一分辨率调整至所述第二分辨率的所述目标调整模式。
- 一种用于屏幕内容获取的装置,包括:确定模块,被配置为响应于确定终端设备在预定清晰度下以第一分辨率获取所述终端设备的屏幕内容,从多个调整模式中确定所述预定清晰度对应的目标调整模式,所述第一分辨率对应于所述预定清晰度;调整模块,被配置为基于所述终端设备的显示分辨率,利用所述目标调整模式来调整所述第一分辨率至第二分辨率;以及控制模块,被配置为控制所述终端设备在所述预定清晰度下以所述第二分辨率获取屏幕内容。
- 一种电子设备,包括:至少一个处理器;以及至少一个存储器,所述至少一个存储器被耦合到所述至少一个处理器并且存储用于由所述至少一个处理器执行的指令,所述指令在由所述至少一个处理器执行时使所述电子设备执行根据权利要求1至6中任一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机可执行指令,所述计算机可执行指令可由处理器执行以实现根据权利要求1至6中任一项所述的方法。
- 一种计算机可执行指令产品,包括计算机可执行指令,其中所述计算机可执行指令在被处理器执行时实现根据权利要求1至6中任一项所述的方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410870303.2 | 2024-06-28 | ||
| CN202410870303.2A CN121239899A (zh) | 2024-06-28 | 2024-06-28 | 用于屏幕内容获取的方法、装置、设备和存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2026002247A1 true WO2026002247A1 (zh) | 2026-01-02 |
Family
ID=98145998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2025/104781 Pending WO2026002247A1 (zh) | 2024-06-28 | 2025-06-27 | 用于屏幕内容获取的方法、装置、设备和存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN121239899A (zh) |
| WO (1) | WO2026002247A1 (zh) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101282440A (zh) * | 2007-04-05 | 2008-10-08 | 上海乐金广电电子有限公司 | 广播录像机中录像画质的调节方法 |
| US20160249099A1 (en) * | 2012-12-05 | 2016-08-25 | At&T Intellectual Property I, Lp | Digital video recorder that enables recording at a selected resolution |
| CN107454457A (zh) * | 2017-06-28 | 2017-12-08 | 武汉斗鱼网络科技有限公司 | 切换录屏直播分辨率的方法及装置 |
| CN113296664A (zh) * | 2021-05-18 | 2021-08-24 | Oppo广东移动通信有限公司 | 屏幕分辨率调整方法、装置、终端设备及存储介质 |
| CN115617288A (zh) * | 2021-07-16 | 2023-01-17 | 广州视源电子科技股份有限公司 | 录屏方法、装置、存储介质及电子设备 |
-
2024
- 2024-06-28 CN CN202410870303.2A patent/CN121239899A/zh active Pending
-
2025
- 2025-06-27 WO PCT/CN2025/104781 patent/WO2026002247A1/zh active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101282440A (zh) * | 2007-04-05 | 2008-10-08 | 上海乐金广电电子有限公司 | 广播录像机中录像画质的调节方法 |
| US20160249099A1 (en) * | 2012-12-05 | 2016-08-25 | At&T Intellectual Property I, Lp | Digital video recorder that enables recording at a selected resolution |
| CN107454457A (zh) * | 2017-06-28 | 2017-12-08 | 武汉斗鱼网络科技有限公司 | 切换录屏直播分辨率的方法及装置 |
| CN113296664A (zh) * | 2021-05-18 | 2021-08-24 | Oppo广东移动通信有限公司 | 屏幕分辨率调整方法、装置、终端设备及存储介质 |
| CN115617288A (zh) * | 2021-07-16 | 2023-01-17 | 广州视源电子科技股份有限公司 | 录屏方法、装置、存储介质及电子设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN121239899A (zh) | 2025-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8610938B2 (en) | Remote print preview generation | |
| US20250175681A1 (en) | Method, apparatus, device, and storage medium for generating media content | |
| WO2025162414A1 (zh) | 媒体编辑的方法、装置、设备和存储介质 | |
| WO2025082221A1 (zh) | 界面交互的方法、装置、设备和存储介质 | |
| US10210630B2 (en) | Picture compression method and apparatus, and mobile terminal | |
| CN110858388B (zh) | 一种增强视频画质的方法和装置 | |
| WO2026026818A1 (zh) | 生成虚拟资源的方法、装置、设备和存储介质 | |
| CN108780348B (zh) | 图像传输装置、图像传输系统、和控制图像传输装置的方法 | |
| WO2025040129A9 (zh) | 界面交互的方法、装置、设备和存储介质 | |
| WO2026002247A1 (zh) | 用于屏幕内容获取的方法、装置、设备和存储介质 | |
| US20200211234A1 (en) | Display apparatus and image processing method thereof | |
| WO2026007991A1 (zh) | 界面交互方法、装置、设备和存储介质 | |
| US20250386077A1 (en) | Method, apparatus, device and storage medium for live streaming | |
| CN110312148B (zh) | 一种自适应的视频数据传输方法、装置及介质 | |
| WO2025139909A1 (zh) | 直播交互的方法、装置、设备和存储介质 | |
| EP4625138A1 (en) | Screen mirroring method, electronic device, and computer-readable medium | |
| TWI868478B (zh) | 增強幀序列質量的方法以及系統 | |
| WO2021011804A1 (en) | Video frame pulldown based on frame analysis | |
| WO2024169650A1 (zh) | 投屏帧率获取方法、装置、计算机设备以及存储介质 | |
| WO2026026734A1 (zh) | 用于视频推送的方法、装置、设备和存储介质 | |
| CN117666990A (zh) | 一种画面的投屏显示方法、装置、电子设备及存储介质 | |
| WO2026002123A1 (zh) | 录屏处理方法、装置、电子设备、存储介质和程序产品 | |
| CN115588414B (zh) | 基于背光调节的动态对比度控制方法及设备 | |
| US20260032293A1 (en) | Method, apparatus, device and storage medium for live stream playback generation | |
| CN114911550B (zh) | 云应用界面处理系统、方法、装置及设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 25826318 Country of ref document: EP Kind code of ref document: A1 |