WO2024061087A1 - 一种桌面图像动态采集方法、设备及计算机可读存储介质 - Google Patents
一种桌面图像动态采集方法、设备及计算机可读存储介质 Download PDFInfo
- Publication number
- WO2024061087A1 WO2024061087A1 PCT/CN2023/118683 CN2023118683W WO2024061087A1 WO 2024061087 A1 WO2024061087 A1 WO 2024061087A1 CN 2023118683 W CN2023118683 W CN 2023118683W WO 2024061087 A1 WO2024061087 A1 WO 2024061087A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- desktop
- resolution
- image
- output
- image encoder
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 238000010276 construction Methods 0.000 claims abstract description 15
- 238000012544 monitoring process Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 abstract description 27
- 230000003044 adaptive effect Effects 0.000 abstract description 11
- 238000005516 engineering process Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 2
- 230000000877 morphologic effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Definitions
- the present invention relates to the field of image processing technology, and in particular to a desktop image dynamic acquisition method, equipment and computer-readable storage medium.
- the cloud display solution relies on image collection and transmission at the image source. During this process, if the resolution of the desktop image at the image source changes, it will have a certain impact on subsequent image data. For example, when the resolution of desktop images is reduced, if the transmitted image data is still encoded and transmitted at a larger resolution, it will lead to a certain degree of waste of image transmission bandwidth and excessive occupation of image decoding resources.
- the present invention proposes a desktop image dynamic collection method.
- the collected image frames are encoded through the constructed, reconstructed, or existing encoding algorithm corresponding to the image encoder to obtain output desktop image data.
- the invention also proposes a desktop image dynamic collection device, which device includes a memory, a processor and a computer program stored in the memory and executable on the processor.
- the computer program is executed by the processor.
- the present invention also proposes a computer-readable storage medium.
- the computer-readable storage medium stores a desktop image dynamic collection program.
- the desktop image dynamic collection program is executed by the processor, the desktop image dynamic collection process as described in any of the above items is realized. Steps of the collection method.
- the desktop image dynamic acquisition method, equipment and computer-readable storage medium of the present invention by obtaining the resolution relationship between the current desktop resolution and the current output resolution and the instance status of the current image encoder; according to the resolution
- the relationship and the instance state perform the construction or reconstruction of the image encoder, and/or perform the texture scaling of the desktop resolution, and obtain the captured image frame consistent with the output resolution; through the constructed, or already Reconstruct or use the existing encoding algorithm corresponding to the image encoder to encode the collected image frames to obtain output desktop image data.
- the present invention implements an adaptive dynamic collection scheme for desktop images, enabling cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources.
- Figure 1 is a flow chart of the first embodiment of the desktop image dynamic collection method of the present invention
- Figure 2 is a flow chart of the second embodiment of the desktop image dynamic collection method of the present invention.
- Figure 3 is a flow chart of the third embodiment of the desktop image dynamic collection method of the present invention.
- Figure 4 is a flow chart of the fourth embodiment of the desktop image dynamic collection method of the present invention.
- Figure 5 is a flow chart of the fifth embodiment of the desktop image dynamic collection method of the present invention.
- Figure 6 is a flow chart of the sixth embodiment of the desktop image dynamic collection method of the present invention.
- Figure 7 is a flow chart of the seventh embodiment of the desktop image dynamic collection method of the present invention.
- Figure 8 is a flow chart of the eighth embodiment of the desktop image dynamic collection method of the present invention.
- Figure 1 is a flow chart of a first embodiment of a desktop image dynamic acquisition method of the present invention.
- a method for dynamic collection of desktop images which method includes:
- the resolution relationship between the current desktop resolution and the current output resolution and the current instance status of the image encoder are obtained.
- the resolution relationship includes two types. One is, the current desktop resolution The rate is the same as the current output resolution. Second, the current desktop resolution is different from the current output resolution.
- the instance status of the current image encoder also includes two types. First, the instance status of the current image encoder is Instanced state, secondly, the instance state of the current image encoder is uninstantiated state; then, the construction or reconstruction of the image encoder is performed according to the resolution relationship and the instance state, and/or the execution of the The texture scaling of the desktop resolution is used to obtain the captured image frame consistent with the output resolution.
- the above resolution relationship will first be judged. When the resolution relationship is different, whether the encoder is The subsequent processing of the instantiation will also be different. For example, when the above resolution relationship is that the two resolutions are consistent, if it is further detected that the encoder has been instantiated, the texture scaling of the current image frame will be directly performed through the instantiated encoder, and For example, when the above resolution relationship is that the two resolutions are inconsistent, if it is further detected that the encoder has not been instantiated, the current image frame cannot be directly texture scaled through the instantiated encoder.
- This embodiment will first build the encoder, Then the texture of the current image frame is scaled through the constructed encoder to make the resolutions of the two consistent; finally, the corresponding encoding algorithm of the constructed, reconstructed, or existing image encoder is used to Collect image frames and encode them to obtain output desktop image data. It can be seen that when this embodiment is applied to real-time video stream network transmission, it can not only dynamically match the screen resolution as the input resolution, but also modify the encoded output image resolution in real time as needed.
- This embodiment obtains the resolution relationship between the current desktop resolution and the current output resolution and the instance state of the current image encoder; constructs or reconstructs the image encoder according to the resolution relationship and the instance state, and/or performs texture scaling of the desktop resolution to obtain a captured image frame consistent with the output resolution; encodes the captured image frame using the corresponding encoding algorithm of the constructed, reconstructed, or existing image encoder to obtain output desktop image data.
- An adaptive desktop image dynamic acquisition solution is implemented, so that cloud applications can dynamically acquire and process desktop images, greatly improving the transmission bandwidth and decoding resource utilization efficiency of desktop image transmission.
- Figure 2 is a flow chart of the second embodiment of the desktop image dynamic acquisition method of the present invention. Based on the above embodiment, the resolution relationship between the current desktop resolution and the current output resolution and the instance status of the current image encoder are obtained. ,include:
- the resolution detection frequency of this embodiment is set according to the type of the current desktop application. For example, a higher resolution detection frequency is set for an application display state with higher real-time performance or higher dynamic range.
- the screen monitoring conditions of this embodiment are set according to the content of the current desktop application.
- the content of the application is a monitoring screen
- the change of the monitoring scene is set as the condition of this embodiment. .
- the desktop collector when the resolution monitoring frequency and/or the image monitoring conditions are met, the desktop collector is initialized, and the current desktop image frame is obtained through the collector.
- the configuration parameters of the current output image are directly read, or the current output image frame is obtained through another collector.
- This embodiment presets the resolution monitoring frequency of the desktop and/or the screen monitoring conditions of the desktop; when the resolution monitoring frequency and/or the screen monitoring conditions are met, the current desktop screen frame and the current output image are collected frame.
- An adaptive dynamic collection scheme for desktop images is implemented, allowing cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources.
- Figure 3 is a flow chart of the third embodiment of the desktop image dynamic collection method of the present invention. Based on the above embodiment, the resolution relationship between the current desktop resolution and the current output resolution and the instance status of the current image encoder are obtained. ,Also includes:
- the second instance state of the image encoder is obtained.
- the resolution relationship is that the resolutions are inconsistent and the desktop resolution is greater than the output resolution
- the current desktop application content is obtained.
- the ratio of the ratios is at the above ratio threshold, the resolution relationship is regarded as the same resolution to perform subsequent processing steps.
- the desktop resolution is obtained according to the desktop picture frame, and the output resolution is obtained according to the output image frame; when the resolution relationship is that the resolutions are consistent, the third value of the image encoder is obtained.
- An instance state when the resolution relationship is that the resolutions are inconsistent, the second instance state of the image encoder is obtained.
- Figure 4 is a flow chart of the fourth embodiment of the desktop image dynamic acquisition method of the present invention. Based on the above embodiment, the construction or reconstruction of the image encoder is performed according to the resolution relationship and the instance state, and/ Or perform texture scaling of the desktop resolution to obtain a captured image frame consistent with the output resolution, including:
- the above desktop image data can be encoded and output directly by constructing the image encoder.
- This embodiment detects whether there is an existing image encoder when the first instance state is not instantiated; when the existing image encoder is not detected, constructs the image encoder according to the output resolution. Described image encoder.
- An adaptive dynamic collection scheme for desktop images is implemented, allowing cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources.
- Figure 5 is a flow chart of the fifth embodiment of the desktop image dynamic acquisition method of the present invention. Based on the above embodiment, the construction or reconstruction of the image encoder is performed according to the resolution relationship and the instance state, and/ Or perform texture scaling of the desktop resolution to obtain a captured image frame consistent with the output resolution, which also includes:
- this embodiment since what is detected is the first instance state, at this time, the above-mentioned resolution relationship is consistent. Therefore, this embodiment can directly call the image encoder that has been instantiated to encode the above-mentioned desktop image. Data is encoded and output.
- the output resolution is lowered according to the proportion threshold, thereby reducing bandwidth occupation and resource consumption.
- the desktop resolution can be executed according to the image encoder that has been instantiated.
- the texture is scaled to obtain the captured image frame consistent with the output resolution.
- the image encoder that has been instantiated when the first instance state is instantiated, the image encoder that has been instantiated is called; the texture scaling of the desktop resolution is performed according to the image encoder that has been instantiated, so as to obtain the same result as the image encoder that has been instantiated. Output the collected image frames with consistent resolution.
- An adaptive dynamic collection scheme for desktop images is implemented, allowing cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources.
- Figure 6 is a flow chart of the sixth embodiment of the desktop image dynamic acquisition method of the present invention. Based on the above embodiment, the construction or reconstruction of the image encoder is performed according to the resolution relationship and the instance state, and/ Or perform texture scaling of the desktop resolution to obtain a captured image frame consistent with the output resolution, which also includes:
- the desktop resolution when the desktop resolution is higher than the output resolution, the desktop resolution is lowered according to the above ratio threshold, thereby reducing bandwidth occupation and resource consumption while ensuring content visibility.
- the image encoder is constructed according to the appropriately lowered output resolution.
- This embodiment detects whether there is an existing image encoder when the second instance status is not instantiated; when the existing image encoder is not detected, constructs the image encoder according to the output resolution. Described image encoder.
- An adaptive dynamic collection scheme for desktop images is implemented, allowing cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources.
- Figure 7 is a flow chart of the seventh embodiment of the desktop image dynamic acquisition method of the present invention. Based on the above embodiment, the construction or reconstruction of the image encoder is performed according to the resolution relationship and the instance state, and/ Or perform texture scaling of the desktop resolution to obtain a captured image frame consistent with the output resolution, which also includes:
- S28 Perform texture scaling of the desktop resolution according to the reconstructed image encoder to obtain a captured image frame consistent with the output resolution.
- this embodiment when the second instance state is instantiated, it is determined that the original image encoder is no longer suitable for the existing output resolution. Therefore, this embodiment will use all existing output resolutions.
- the output resolution is used to reconstruct the instantiated image encoder to obtain the reconstructed image encoder.
- This embodiment obtains the reconstructed image encoder by reconstructing the instantiated image encoder according to the existing output resolution when the second instance state is instantiated; according to the reconstructed
- the image encoder performs texture scaling of the desktop resolution to obtain acquired image frames consistent with the output resolution.
- An adaptive dynamic collection scheme for desktop images is implemented, allowing cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources.
- FIG. 8 is a flow chart of the eighth embodiment of the desktop image dynamic acquisition method of the present invention. Based on the above embodiment, the acquisition is performed through the corresponding encoding algorithm of the image encoder that has been constructed, reconstructed, or existing. The image frames are encoded to obtain the output desktop image data, including:
- the desktop screen is re-executed. frame and the acquisition operation of the output image frame, and begins to perform the above-mentioned instance state judgment and texture scaling operation in a loop to adaptively meet dynamic image acquisition requirements.
- This embodiment monitors the configuration parameters of the output resolution during the output process of the desktop image data; when the configuration parameters change, the acquisition operation of the desktop image frame and the output image frame is re-executed. , to update the output desktop image data.
- An adaptive dynamic collection scheme for desktop images is implemented, allowing cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources.
- the present invention also proposes a desktop image dynamic acquisition device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor.
- a desktop image dynamic acquisition device which includes a memory, a processor, and a computer program stored in the memory and executable on the processor.
- the present invention also proposes a computer-readable storage medium.
- the computer-readable storage medium stores a desktop image dynamic collection program.
- the desktop image dynamic collection program is executed by the processor, any one of the above is implemented.
- the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better. implementation.
- the technical solution of the present invention can be embodied in the form of a software product in essence or that contributes to the existing technology.
- the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD), including several instructions to cause a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in various embodiments of the present invention.
- the desktop image dynamic acquisition method, equipment and computer-readable storage medium of the present invention by obtaining the resolution relationship between the current desktop resolution and the current output resolution and the instance status of the current image encoder; according to the resolution
- the relationship and the instance state perform the construction or reconstruction of the image encoder, and/or perform the texture scaling of the desktop resolution, and obtain the captured image frame consistent with the output resolution; through the constructed, or already Reconstruct or use the existing encoding algorithm corresponding to the image encoder to encode the collected image frames to obtain output desktop image data.
- the present invention implements an adaptive dynamic collection scheme for desktop images, enabling cloud applications to dynamically collect and process desktop images, which greatly improves the transmission bandwidth of desktop image transmission and the utilization efficiency of decoding resources. Therefore, it has industrial practicality.
Abstract
本发明公开了一种桌面图像动态采集方法、设备及计算机可读存储介质，其中，该方法包括：获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态(S1)；根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧(S2)；通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据(S3)。本发明实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
Description
本发明涉及图像处理技术领域，尤其涉及一种桌面图像动态采集方法、设备及计算机可读存储介质。
现有技术中，随着云端技术的不断发展，越来越多的软件开始以云端的方式呈现。其中，云端显示方案依赖于图像源端的图像采集和传输，在此过程中，若图像源端的桌面图像的分辨率发生改变，则会对后续的图像数据造成一定的影响。例如，当桌面图像的分辨率减小时，若传输的图像数据仍以较大的分辨率进行编码和传输，则会导致一定程度的图像传输带宽浪费和图像解码资源过度占用的问题。
因此，如何动态地对桌面图像的采集、处理和传输进行适应性地调整，以提高传输带宽和解码资源的利用效率，成为目前亟待解决的技术问题。
为了解决现有技术中图像传输带宽浪费和图像解码资源过度占用的技术缺陷，本发明提出了一种桌面图像动态采集方法。
本发明为解决上述技术问题所采用的方法包括：
获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态；
根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧；
通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据。
本发明还提出了一种桌面图像动态采集设备，该设备包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如上任一项所述的桌面图像动态采集方法的步骤。
本发明还提出了一种计算机可读存储介质，该计算机可读存储介质上存储有桌面图像动态采集程序，桌面图像动态采集程序被处理器执行时实现如上述任一项所述的桌面图像动态采集方法的步骤。
实施本发明的桌面图像动态采集方法、设备及计算机可读存储介质，通过获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态；根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧；通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据。本发明实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
下面将结合附图及实施例对本发明作进一步说明，附图中：
图1是本发明桌面图像动态采集方法第一实施例的流程图；
图2是本发明桌面图像动态采集方法第二实施例的流程图；
图3是本发明桌面图像动态采集方法第三实施例的流程图；
图4是本发明桌面图像动态采集方法第四实施例的流程图；
图5是本发明桌面图像动态采集方法第五实施例的流程图；
图6是本发明桌面图像动态采集方法第六实施例的流程图；
图7是本发明桌面图像动态采集方法第七实施例的流程图；
图8是本发明桌面图像动态采集方法第八实施例的流程图。
应当理解，此处所描述的具体实施例仅用以解释本发明，并不用于限定本发明。
在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明，其本身没有特定的意义。因此，“模块”、“部件”或“单元”可以混合地使用。
实施例一
图1是本发明桌面图像动态采集方法第一实施例的流程图。一种桌面图像动态采集方法，该方法包括：
S1、获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态；
S2、根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧；
S3、通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据。
在本实施例中，首先，获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态，其中，分辨率关系包括两种，一是，当前的桌面分辨率与当前的输出分辨率相同，二是，当前的桌面分辨率与当前的输出分辨率不同，当前的图像编码器的实例状态同样包括两种，一是，当前的图像编码器的实例状态为已实例状态，二是，当前的图像编码器的实例状态为未实例状态；然后，根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，其中，无论编码器是否已实例，均会首先判断上述分辨率关系，在分辨率关系不同时，针对编码器是否已实例的后续处理也将不同，例如，在上述分辨率关系为两分辨率一致时，若进一步检测到编码器已实例，则直接通过已实例的编码器对当前的图像帧进行纹理缩放，又例如，在上述分辨率关系为两分辨率不一致时，若进一步检测到编码器未实例，则无法直接通过已实例的编码器对当前的图像帧进行纹理缩放，本实施例将首先构建编码器，然后通过构建的编码器对当前的图像帧进行纹理缩放，以使两者的分辨率一致；最后，通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据。可以看出，本实施例应用在实时视频流网络传输上时，既能动态地匹配屏幕分辨率作为输入分辨率，也能根据需要实时修改编码后输出的图像分辨率。
本实施例通过获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态；根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧；通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例二
图2是本发明桌面图像动态采集方法第二实施例的流程图，基于上述实施例，所述获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态，包括：
S11、预设桌面的分辨率监测频率和/或桌面的画面监测条件；
S12、在满足所述分辨率监测频率和/或所述画面监测条件时，采集当前的桌面画面帧和当前的输出图像帧。
可选地，在本实施例中，根据当前的桌面应用的类型设定本实施例的分辨率检测频率，例如，针对实时性较高的或者动态范围较高的应用显示状态时，设定较高的分辨率检测频率。
可选地，在本实施例中，根据当前的桌面应用的内容设定本实施例的画面监测条件，例如，针对应用的内容为监控画面时，设定监控场景的变更作为本实施例的条件。
可选地，在本实施例中，在满足所述分辨率监测频率和/或所述画面监测条件时，初始化桌面采集器，通过该采集器获取当前的桌面画面帧，可选地，直接读取当前的输出图像的配置参数，或者，通过另一采集器获取当前的输出图像帧。
本实施例通过预设桌面的分辨率监测频率和/或桌面的画面监测条件；在满足所述分辨率监测频率和/或所述画面监测条件时，采集当前的桌面画面帧和当前的输出图像帧。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例三
图3是本发明桌面图像动态采集方法第三实施例的流程图，基于上述实施例，所述获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态，还包括：
S13、根据所述桌面画面帧得到所述桌面分辨率，根据所述输出图像帧得到所述输出分辨率；
S14、在所述分辨率关系为分辨率一致时，获取所述图像编码器的第一实例状态，在所述分辨率关系为分辨率不一致时，获取所述图像编码器的第二实例状态。
可选地，在本实施例中，在所述分辨率关系为分辨率不一致，且桌面分辨率小于输出分辨率时，获取所述图像编码器的第二实例状态。
可选地，在本实施例中，在所述分辨率关系为分辨率不一致，且桌面分辨率大于输出分辨率时，获取当前的桌面应用内容。解析上述桌面应用内容的形态特征，在确定该形态特征的内容以预设比例降低分辨率时仍具有识别基础时，按该预设比例设定分辨率的比例阈值，在桌面分辨率与输出分辨率的比值处于上述比例阈值时，将所述分辨率关系作为分辨率一致，以执行后续处理步骤。
本实施例通过根据所述桌面画面帧得到所述桌面分辨率，根据所述输出图像帧得到所述输出分辨率；在所述分辨率关系为分辨率一致时，获取所述图像编码器的第一实例状态，在所述分辨率关系为分辨率不一致时，获取所述图像编码器的第二实例状态。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例四
图4是本发明桌面图像动态采集方法第四实施例的流程图，基于上述实施例，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，包括：
S21、在所述第一实例状态为未实例时，检测是否存在现有的所述图像编码器；
S22、在未检测到现有的所述图像编码器时，按所述输出分辨率构建所述图像编码器。
可选地，在本实施例中，在按所述输出分辨率构建所述图像编码器之后，可直接通过构建所述图像编码器对上述桌面图像数据进行编码和输出。
本实施例通过在所述第一实例状态为未实例时，检测是否存在现有的所述图像编码器；在未检测到现有的所述图像编码器时，按所述输出分辨率构建所述图像编码器。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例五
图5是本发明桌面图像动态采集方法第五实施例的流程图，基于上述实施例，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，还包括：
S23、在所述第一实例状态为已实例时，调用已实例的所述图像编码器；
S24、按已实例的所述图像编码器执行所述桌面分辨率的纹理缩放，以得到与所述输出分辨率一致的采集图像帧。
可选地，在本实施例中，由于检测的是第一实例状态，此时，上述分辨率关系是一致的，因此，本实施例可直接调用已实例的所述图像编码器对上述桌面图像数据进行编码和输出。
可选地，在本实施例中，按上述比例阈值对上述输出分辨率进行调低，从而降低带宽占用和资源消耗，此时，可按已实例的所述图像编码器执行所述桌面分辨率的纹理缩放，以得到与所述输出分辨率一致的采集图像帧。
本实施例通过在所述第一实例状态为已实例时，调用已实例的所述图像编码器；按已实例的所述图像编码器执行所述桌面分辨率的纹理缩放，以得到与所述输出分辨率一致的采集图像帧。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例六
图6是本发明桌面图像动态采集方法第六实施例的流程图，基于上述实施例，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，还包括：
S25、在所述第二实例状态为未实例时，检测是否存在现有的所述图像编码器；
S26、在未检测到现有的所述图像编码器时，按所述输出分辨率构建所述图像编码器。
可选地，在本实施例中，在桌面分辨率高于输出分辨率时，按上述比例阈值对上述桌面分辨率进行调低，从而在保障内容可视性的前提下降低带宽占用和资源消耗，此时，按适当调低的所述输出分辨率构建所述图像编码器。
本实施例通过在所述第二实例状态为未实例时，检测是否存在现有的所述图像编码器；在未检测到现有的所述图像编码器时，按所述输出分辨率构建所述图像编码器。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例七
图7是本发明桌面图像动态采集方法第七实施例的流程图，基于上述实施例，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，还包括：
S27、在所述第二实例状态为已实例时，按现有的所述输出分辨率重构已实例的所述图像编码器，得到重构的所述图像编码器；
S28、按重构的所述图像编码器执行所述桌面分辨率的纹理缩放，以得到与所述输出分辨率一致的采集图像帧。
可选地，在本实施例中，在所述第二实例状态为已实例时，确定原始的图像编码器已不再适用现有的输出分辨率，因此，本实施例将按现有的所述输出分辨率重构已实例的所述图像编码器，得到重构的所述图像编码器。
本实施例通过在所述第二实例状态为已实例时，按现有的所述输出分辨率重构已实例的所述图像编码器，得到重构的所述图像编码器；按重构的所述图像编码器执行所述桌面分辨率的纹理缩放，以得到与所述输出分辨率一致的采集图像帧。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例八
图8是本发明桌面图像动态采集方法第八实施例的流程图，基于上述实施例，所述通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据，包括：
S31、在所述桌面图像数据的输出过程中，监测所述输出分辨率的配置参数；
S32、在所述配置参数发生变更时，重新执行所述桌面画面帧和所述输出图像帧的采集操作，以更新输出的所述桌面图像数据。
可选地，在本实施例中，在所述配置参数发生变更时，确定输出分辨率也发生变化，也即，上述分辨率关系也可能发生相应的变化，此时，重新执行所述桌面画面帧和所述输出图像帧的采集操作，并开始循环执行上述的实例状态判断和纹理缩放操作，以适应性地满足动态的图像采集需求。
本实施例通过在所述桌面图像数据的输出过程中，监测所述输出分辨率的配置参数；在所述配置参数发生变更时，重新执行所述桌面画面帧和所述输出图像帧的采集操作，以更新输出的所述桌面图像数据。实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。
实施例九
基于上述实施例，本发明还提出了一种桌面图像动态采集设备，该设备包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如上任一项所述的桌面图像动态采集方法的步骤。
需要说明的是，上述设备实施例与方法实施例属于同一构思，其具体实现过程详细见方法实施例，且方法实施例中的技术特征在设备实施例中均对应适用，这里不再赘述。
实施例十
基于上述实施例，本发明还提出了一种计算机可读存储介质，该计算机可读存储介质上存储有桌面图像动态采集程序，桌面图像动态采集程序被处理器执行时实现如上述任一项所述的桌面图像动态采集方法的步骤。
需要说明的是，上述介质实施例与方法实施例属于同一构思，其具体实现过程详细见方法实施例，且方法实施例中的技术特征在介质实施例中均对应适用，这里不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质（如ROM/RAM、磁碟、光盘）中，包括若干指令用以使得一台终端（可以是手机，计算机，服务器，空调器，或者网络设备等）执行本发明各个实施例所述的方法。
上面结合附图对本发明的实施例进行了描述，但是本发明并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本发明的启示下，在不脱离本发明宗旨和权利要求所保护的范围情况下，还可做出很多形式，这些均属于本发明的保护之内。
实施本发明的桌面图像动态采集方法、设备及计算机可读存储介质，通过获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态；根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧；通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据。本发明实现了一种自适应的桌面图像动态采集方案，使得云端应用可动态地对桌面图像进行采集和处理，极大程度地提高了桌面图像传输的传输带宽和解码资源的利用效率。因此，具有工业实用性。
Claims (10)
- 一种桌面图像动态采集方法，所述方法包括：获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态；根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧；通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据。
- 根据权利要求1所述的桌面图像动态采集方法，其中，所述获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态，包括：预设桌面的分辨率监测频率和/或桌面的画面监测条件；在满足所述分辨率监测频率和/或所述画面监测条件时，采集当前的桌面画面帧和当前的输出图像帧。
- 根据权利要求2所述的桌面图像动态采集方法，其中，所述获取当前的桌面分辨率与当前的输出分辨率的分辨率关系以及当前的图像编码器的实例状态，还包括：根据所述桌面画面帧得到所述桌面分辨率，根据所述输出图像帧得到所述输出分辨率；在所述分辨率关系为分辨率一致时，获取所述图像编码器的第一实例状态，在所述分辨率关系为分辨率不一致时，获取所述图像编码器的第二实例状态。
- 根据权利要求3所述的桌面图像动态采集方法，其中，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，包括：在所述第一实例状态为未实例时，检测是否存在现有的所述图像编码器；在未检测到现有的所述图像编码器时，按所述输出分辨率构建所述图像编码器。
- 根据权利要求4所述的桌面图像动态采集方法，其中，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，还包括：在所述第一实例状态为已实例时，调用已实例的所述图像编码器；按已实例的所述图像编码器执行所述桌面分辨率的纹理缩放，以得到与所述输出分辨率一致的采集图像帧。
- 根据权利要求5所述的桌面图像动态采集方法，其中，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，还包括：在所述第二实例状态为未实例时，检测是否存在现有的所述图像编码器；在未检测到现有的所述图像编码器时，按所述输出分辨率构建所述图像编码器。
- 根据权利要求6所述的桌面图像动态采集方法，其中，所述根据所述分辨率关系以及所述实例状态执行所述图像编码器的构建或重构、和/或执行所述桌面分辨率的纹理缩放，得到与所述输出分辨率一致的采集图像帧，还包括：在所述第二实例状态为已实例时，按现有的所述输出分辨率重构已实例的所述图像编码器，得到重构的所述图像编码器；按重构的所述图像编码器执行所述桌面分辨率的纹理缩放，以得到与所述输出分辨率一致的采集图像帧。
- 根据权利要求7所述的桌面图像动态采集方法，其中，所述通过已构建、或已重构、或现有的所述图像编码器对应编码算法对所述采集图像帧进行编码，得到输出的桌面图像数据，包括：在所述桌面图像数据的输出过程中，监测所述输出分辨率的配置参数；在所述配置参数发生变更时，重新执行所述桌面画面帧和所述输出图像帧的采集操作，以更新输出的所述桌面图像数据。
- 一种桌面图像动态采集设备，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如权利要求1至8中任一项所述的桌面图像动态采集方法的步骤。
- 一种计算机可读存储介质，所述计算机可读存储介质上存储有桌面图像动态采集程序，所述桌面图像动态采集程序被处理器执行时实现如权利要求1至8中任一项所述的桌面图像动态采集方法的步骤。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211147146.X | 2022-09-19 | ||
| CN202211147146.XA CN115567711A (zh) | 2022-09-19 | 2022-09-19 | 一种桌面图像动态采集方法、设备及计算机可读存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024061087A1 true WO2024061087A1 (zh) | 2024-03-28 |
Family
ID=84740381
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/118683 WO2024061087A1 (zh) | 2022-09-19 | 2023-09-14 | 一种桌面图像动态采集方法、设备及计算机可读存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115567711A (zh) |
| WO (1) | WO2024061087A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115567711A (zh) * | 2022-09-19 | 2023-01-03 | 亿航智能设备（广州）有限公司 | 一种桌面图像动态采集方法、设备及计算机可读存储介质 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150201193A1 (en) * | 2012-01-10 | 2015-07-16 | Google Inc. | Encoding and decoding techniques for remote screen sharing of media content using video source and display parameters |
| CN111182303A (zh) * | 2019-10-08 | 2020-05-19 | 腾讯科技（深圳）有限公司 | 共享屏幕的编码方法、装置、计算机可读介质及电子设备 |
| CN111741298A (zh) * | 2020-08-26 | 2020-10-02 | 腾讯科技（深圳）有限公司 | 视频编码方法、装置、电子设备及可读存储介质 |
| CN113284472A (zh) * | 2021-05-13 | 2021-08-20 | 深圳乐播科技有限公司 | 投屏分辨率转换方法、装置、设备及存储介质 |
| CN115567711A (zh) * | 2022-09-19 | 2023-01-03 | 亿航智能设备（广州）有限公司 | 一种桌面图像动态采集方法、设备及计算机可读存储介质 |
-
2022
- 2022-09-19 CN CN202211147146.XA patent/CN115567711A/zh active Pending
-
2023
- 2023-09-14 WO PCT/CN2023/118683 patent/WO2024061087A1/zh unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150201193A1 (en) * | 2012-01-10 | 2015-07-16 | Google Inc. | Encoding and decoding techniques for remote screen sharing of media content using video source and display parameters |
| CN111182303A (zh) * | 2019-10-08 | 2020-05-19 | 腾讯科技（深圳）有限公司 | 共享屏幕的编码方法、装置、计算机可读介质及电子设备 |
| CN111741298A (zh) * | 2020-08-26 | 2020-10-02 | 腾讯科技（深圳）有限公司 | 视频编码方法、装置、电子设备及可读存储介质 |
| CN113284472A (zh) * | 2021-05-13 | 2021-08-20 | 深圳乐播科技有限公司 | 投屏分辨率转换方法、装置、设备及存储介质 |
| CN115567711A (zh) * | 2022-09-19 | 2023-01-03 | 亿航智能设备（广州）有限公司 | 一种桌面图像动态采集方法、设备及计算机可读存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115567711A (zh) | 2023-01-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110430441B (zh) | 一种云手机视频采集方法、系统、装置及存储介质 | |
| WO2024061087A1 (zh) | 一种桌面图像动态采集方法、设备及计算机可读存储介质 | |
| CN111399964A (zh) | 一种基于视频串流技术的云桌面平台 | |
| WO2021169408A1 (zh) | 图像处理方法、装置、电子设备及存储介质 | |
| CN105469381B (zh) | 一种信息处理方法及终端 | |
| CN105338323A (zh) | 一种视频监控方法及装置 | |
| WO2022111631A1 (zh) | 视频传输方法、服务器、终端和视频传输系统 | |
| WO2020038127A1 (zh) | 解码方法、装置、电子设备以及存储介质 | |
| US20140169473A1 (en) | Texture sensitive temporal filter based on motion estimation | |
| US20050169537A1 (en) | System and method for image background removal in mobile multi-media communications | |
| CN112764853A (zh) | 一种投屏方法、设备及系统 | |
| WO2021047177A1 (zh) | 数据编码方法及装置 | |
| WO2022057362A1 (zh) | 图像处理方法及装置、云真机系统、存储介质和电子设备 | |
| CN112565603B (zh) | 图像处理方法、装置及电子设备 | |
| CN111836092A (zh) | 一种虚拟桌面的数据处理方法、装置及相关组件 | |
| TW201811057A (zh) | 影像訊框處理方法 | |
| WO2016202285A1 (zh) | 一种即时视频的传输方法和电子设备 | |
| WO2023124461A1 (zh) | 面向机器视觉任务的视频编解码方法、装置、设备及介质 | |
| CN114584831B (zh) | 提高视频清晰度的视频优化处理方法、装置、设备和存储介质 | |
| CN112445624B (zh) | 一种面向任务的gpu资源优化配置方法及装置 | |
| JP2010186369A (ja) | 画像転送装置、方法及びプログラム | |
| JP6216046B2 (ja) | コーデックの自動適応化 | |
| CN113658073A (zh) | 图像去噪处理方法、装置、存储介质与电子设备 | |
| JP2019186917A (ja) | ビデオ最適化処理システム及び方法 | |
| US10356424B2 (en) | Image processing device, recording medium, and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23867376 Country of ref document: EP Kind code of ref document: A1 |