CN116880937A - Desktop screen capturing data processing method, device, equipment and medium for interactive classroom - Google Patents
Desktop screen capturing data processing method, device, equipment and medium for interactive classroom Download PDFInfo
- Publication number
- CN116880937A CN116880937A CN202310089336.9A CN202310089336A CN116880937A CN 116880937 A CN116880937 A CN 116880937A CN 202310089336 A CN202310089336 A CN 202310089336A CN 116880937 A CN116880937 A CN 116880937A
- Authority
- CN
- China
- Prior art keywords
- screen capturing
- screen
- current frame
- cpu
- gpu
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 42
- 238000003672 processing method Methods 0.000 title claims abstract description 18
- 238000000034 method Methods 0.000 claims abstract description 67
- 238000012545 processing Methods 0.000 claims abstract description 60
- 238000013507 mapping Methods 0.000 claims abstract description 56
- 238000009877 rendering Methods 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 25
- 230000008859 change Effects 0.000 claims description 13
- 230000006870 function Effects 0.000 description 11
- 239000000306 component Substances 0.000 description 7
- 230000006854 communication Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000013506 data mapping Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000007175 bidirectional communication Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 239000008358 core component Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 210000003041 ligament Anatomy 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5044—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering hardware capabilities
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Digital Computer Display Output (AREA)
Abstract
The application discloses a desktop screen capturing data processing method, device, equipment and medium for an interactive classroom, and belongs to the technical field of computers. The method comprises the following steps: initializing desktop screen capturing to acquire a first frame screen capturing image with successful screen capturing; mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding; identifying whether the screen capturing of the desktop of the current frame is successful; if the screen capturing of the current frame fails, the screen capturing data is read from the cache of the CPU for the GPU to encode the current frame. According to the technical scheme, the problems that the data processing time is long and the memory is occupied more due to multiple mapping of the screen capturing data can be avoided, and the stability of the screen capturing frame rate and the efficiency of screen capturing data processing are improved.
Description
Technical Field
The application belongs to the technical field of computers, and particularly relates to a desktop screen capturing data processing method, device, equipment and medium for an interactive classroom.
Background
With the development of live-broadcast class, more and more educational systems begin to conduct course teaching and class interaction in a live-broadcast mode. In the live process of classroom, the teaching pictures of the teacher end are mainly transmitted to the student end through the mode of desktop image screen capturing, and in order to improve the interactive experience sense of classroom of the student end, people put forward higher requirements on desktop screen capturing data processing of the teacher end.
In the prior art, a main mode of desktop screen capturing data processing of a teacher end is to continuously capture a screen on a desktop of teaching equipment of the teacher through a preset time interval at the teacher end, determine whether to perform screen capturing image rendering according to whether an auxiliary screen exists at the teacher end, map screen capturing data from a GPU to a CPU, enable the CPU to perform data encoding and storage on the screen capturing data, and then send the encoded screen capturing data to a student end. However, when the desktop screen capture data of the teacher end is processed by the prior art, the problems of unstable screen capture frame rate, more mapping times of the screen capture data and lower processing efficiency of the screen capture data exist.
Disclosure of Invention
The application aims to provide a desktop screen capture data processing method, device, equipment and medium for an interactive classroom, which can solve the problems of unstable screen capture frame rate, more mapping times of screen capture data and lower processing efficiency of the screen capture data.
In a first aspect, an embodiment of the present application provides a desktop screen capture data processing method for an interactive classroom, where the method includes:
initializing desktop screen capturing to acquire a first frame screen capturing image with successful screen capturing;
mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding;
identifying whether the screen capturing of the desktop of the current frame is successful;
if the screen capturing of the current frame fails, the screen capturing data is read from the cache of the CPU for the GPU to encode the current frame.
Further, after identifying whether the current frame desktop screen capture is successful, the method further includes:
if the screen capturing of the current frame is successful, the mapping from the video memory of the GPU to the CPU of the previous frame of screen capturing image is closed, the mapping from the video memory of the GPU to the CPU of the current frame of screen capturing image is built, and the current frame of screen capturing image is copied into the cache of the CPU;
and reading screen capturing data from the cache of the CPU for the GPU to encode the current frame.
Further, after identifying that the screen capture of the current frame is successful, the method further comprises:
identifying whether local rendering of the screen capturing image of the current frame is needed;
And if local rendering is needed, locally rendering the screen capturing image of the current frame in the GPU in a preset mode.
Further, before establishing the mapping of the current frame screen capture image from the video memory of the GPU to the CPU, the method further comprises:
identifying whether the current frame screen capturing image needs to be subjected to scaling processing or not;
and if the scaling processing is needed, scaling the current frame screen capturing image to a target size, and then executing the operation of establishing the mapping of the current frame screen capturing image from the video memory of the GPU to the CPU.
Further, the scaling process is performed in the GPU;
after the scaling process, the current frame screen capture image is converted to the target data format.
Further, after reading the screen capture data from the cache of the CPU for the GPU to perform current frame encoding, the method further includes:
identifying whether screen capturing is stopped;
if yes, releasing the video memory of the GPU occupied by the screen capturing data and the cache of the CPU, and ending the desktop screen capturing data processing flow.
Further, identifying whether the current frame desktop screen capture is successful includes:
if the input or output change data is detected through the device driver, determining that the screen capturing is successful;
if no input or output change data is detected by the device driver, determining that the screen capture fails.
In a second aspect, an embodiment of the present application provides a desktop screen capture data processing device for an interactive classroom, where the device includes:
the screen capturing initialization module is used for initializing the desktop screen capturing so as to acquire a first frame screen capturing image with successful screen capturing;
the screen capturing image mapping module is used for mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding;
the screen capturing identification module is used for identifying whether the screen capturing of the desktop of the current frame is successful;
and the screen capture data encoding module is used for reading the screen capture data from the cache of the CPU for the GPU to encode the current frame if the screen capture of the current frame fails.
Further, the screen capturing data encoding module is further configured to:
if the screen capturing of the current frame is successful, the mapping from the video memory of the GPU to the CPU of the previous frame of screen capturing image is closed, the mapping from the video memory of the GPU to the CPU of the current frame of screen capturing image is built, and the current frame of screen capturing image is copied into the cache of the CPU;
and reading screen capturing data from the cache of the CPU for the GPU to encode the current frame.
Further, the screen capturing data encoding module further includes:
The local rendering identification unit is used for identifying whether local rendering is needed for the screen capturing image of the current frame or not;
and the screen capturing image rendering unit is used for locally rendering the screen capturing image of the current frame in the GPU in a preset mode if local rendering is needed.
Further, the screen capturing data encoding module further includes:
the zooming identification unit is used for identifying whether zooming processing is needed to be carried out on the screen capturing image of the current frame or not;
and the screen capturing image scaling unit is used for scaling the screen capturing image of the current frame to the target size if the scaling processing is needed, and then executing the operation of establishing the mapping of the screen capturing image of the current frame from the video memory of the GPU to the CPU.
Further, the scaling processing of the screen capturing image scaling unit is performed in the GPU;
the screen capturing image scaling unit is further used for converting the screen capturing image of the current frame into a target data format after scaling processing.
Further, the screen capturing data encoding module is further configured to:
identifying whether screen capturing is stopped;
if yes, releasing the video memory of the GPU occupied by the screen capturing data and the cache of the CPU, and ending the desktop screen capturing data processing flow.
Further, the screen capturing identification module is specifically configured to:
If the input or output change data is detected through the device driver, determining that the screen capturing is successful;
if no input or output change data is detected by the device driver, determining that the screen capture fails.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction implementing the steps of the method according to the first aspect when executed by the processor.
In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor perform the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.
In the embodiment of the application, the desktop screen capturing is initialized to acquire a first frame screen capturing image with successful screen capturing; mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding; identifying whether the screen capturing of the desktop of the current frame is successful; if the screen capturing of the current frame fails, the screen capturing data is read from the cache of the CPU for the GPU to encode the current frame. According to the desktop screen capturing data processing method of the interactive classroom, the problems that the screen capturing frame rate is unstable, the number of times of screen capturing data mapping is large, and the processing efficiency of the screen capturing data is low can be solved.
Drawings
Fig. 1 is a flowchart of a desktop screenshot data processing method in an interactive classroom according to an embodiment of the present application;
fig. 2 is a flow chart of a desktop screenshot data processing method in an interactive classroom according to a second embodiment of the present application;
fig. 3 is a schematic structural diagram of a desktop screen capturing data processing device for an interactive classroom according to a third embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the following detailed description of specific embodiments of the present application is given with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the matters related to the present application are shown in the accompanying drawings. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The technical solutions of the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which are obtained by a person skilled in the art based on the embodiments of the present application, fall within the scope of protection of the present application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type, and are not limited to the number of objects, such as the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
The method, the device, the equipment and the medium for processing desktop screen capturing data of the interactive classroom provided by the embodiment of the application are described in detail through specific embodiments and application scenes thereof by combining the attached drawings.
Example 1
Fig. 1 is a flowchart of a desktop screenshot data processing method in an interactive classroom according to an embodiment of the present application. As shown in fig. 1, the method specifically comprises the following steps:
s101, initializing desktop screen capturing to acquire a first frame screen capturing image with successful screen capturing;
firstly, the usage scenario of the scheme may be a scenario in which desktop screenshot data needs to be processed in an interactive classroom, and specifically, may be a scenario in which DXGI (DirectX Graphics Infrastructure, graphics device infrastructure) screenshot data of an interactive classroom live broadcast device end is processed. In this scenario, in combination with the use environment of the current device end, the interactive classroom live broadcast device end needs to install a graphics card driver and the operating system is windows8 or above. The desktop image of the live equipment is captured in a DXGI mode, the captured data is mapped and cached in a CPU (Central Processing Unit ) for a GPU (Graphics Processing Unit, graphics processor) to encode the captured data of the current frame, and the efficiency of processing the captured data can be improved.
Based on the above usage scenario, it can be understood that the execution subject of the present application may be software or a system platform installed at the live device end of the interactive classroom, which can perform screen capturing on a desktop image of the device and have a function of sending and receiving screen capturing data, and the present application is not limited in any way.
In the scheme, the DXGI can be a screen capturing method and a screen recording method for tasks such as desktop live broadcasting, desktop recording and the like. Specifically, the main process of screen capturing with DXGI may be to create D3DDevice; obtaining paths through a series of interfaces to obtain an IDXGIOutputDuplication interface; calling an AcquireNextFrame to acquire current desktop data, and storing the current desktop data in an IDXGIResource; mapping data from the GPU into memory; and copying the needed data into the buffer. Because DXGI provides desktop images through GPU, CPU occupancy rate is very low, and the method has the characteristics of high performance, high speed and the like. The DXGI runs in the interactive classroom equipment system of Windows8 and above.
In the scheme, initializing the desktop screen capturing can be the operation of capturing the desktop initial image and collecting the screen capturing data when the interactive classroom equipment starts to operate in a DXGI mode. Specifically, the desktop initial image may be a first frame image on a screen of the device when the teacher end device starts to run. The first frame image may be an image displayed on a device screen of a teacher end according to an advanced setting of the end, for example: screen layout, course PPT, classroom writing, course documentation, etc., are not overly limited herein. If the desktop screen capturing initialization operation is successful, namely the screen capturing operation is completed on the desktop initial image when the interactive classroom equipment starts to operate, storing the screen capturing image, and further obtaining a first frame of screen capturing image with successful screen capturing; if the initialization operation is unsuccessful, the screen capturing operation cannot be completed, the screen capturing operation can be re-performed or the system screen capturing operation can be stopped, and operations such as screen capturing and error reporting can be performed on the system. The screen capture image may be stored and transmitted in the form of screen capture data, etc.
S102, mapping the first frame screen capturing image from a video memory of the GPU to a CPU, copying the first frame screen capturing image into a cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding;
in this scheme, the GPU is a microprocessor that performs image and graphics related operations on personal computers, workstations, game consoles, and some mobile devices (e.g., tablet computers, smartphones, etc.). The GPU reduces the dependency of the graphics card on the CPU and performs part of the original CPU, and especially, the core technology adopted by the GPU in 3D graphics processing includes hardware T & L (geometric transformation and lighting processing), cubic environment texture mapping and vertex blending, texture compression and concave-convex mapping, and dual texture four-pixel 256-bit rendering engine, and the hardware T & L technology can be said to be a flag of the GPU. A raster display system is independent of a graphics processor, which is an important element of the graphics system architecture and is a ligament connecting a computer and a display terminal. The system not only stores the graphics, but also can complete most graphics functions, thus greatly reducing the load of the CPU and improving the display capacity and the display speed.
The graphics processor is composed of the following devices: the method comprises the steps of displaying the core of a main chip display card, commonly called GPU, and mainly performing construction and rendering on video information input by a system; the display buffer memory is used for storing graphic information to be displayed and storing intermediate data of graphic operation; the size and speed of the display cache directly influence the performance of the main chip; the RAMD/A converter converts binary digital signals into analog signals compatible with the display.
In the scheme, the CPU is used as the operation and control core of the computer system, is the final execution unit for information processing and program running, and is one of the main devices of the electronic computer, and is a core accessory in the computer. The CPU is a core component in the computer for reading instructions, decoding the instructions and executing the instructions, and mainly comprises two parts, namely a controller and an arithmetic unit, a cache memory and a bus for realizing the data and control of the connection between the cache memory and the controller, and the CPU mainly has the functions of processing the instructions, executing the operations, controlling the time and processing the data. In the computer architecture, a CPU is a core hardware unit that performs control allocation and general-purpose operations on all hardware resources (such as a memory and an input/output unit) of a computer. The CPU is the operation and control core of the computer. The operation of all software layers in the computer system will ultimately be mapped by the instruction set into the operation of the CPU. The operating principle of the CPU can be divided into four phases: fetch (Fetch), decode (Decode), execute (Execute), and write back (Writeback). The CPU fetches instructions from memory or cache, places them into instruction registers, decodes the instructions, and executes the instructions. Generally, the configuration of a CPU can be roughly divided into an arithmetic logic unit, a register unit, a control unit, and the like. The arithmetic logic unit is capable of performing mainly related logical operations such as: the shift operation and the logic operation can be executed, and the fixed point or floating point arithmetic operation, the address operation, the conversion and other commands can be executed, so that the multifunctional arithmetic unit is multifunctional. The register unit is used for temporarily storing instructions, data and addresses. The control part is mainly used for analyzing the instruction and can send out corresponding control signals.
In this solution, the video memory of the GPU is also called a frame buffer, and is used for storing the rendering data processed by the video card chip or to be extracted, where in this solution may be the screen capturing data used for storing the screen capturing image of the first frame. The CPU cache can be a temporary memory between the CPU and the memory, the capacity of the temporary memory is smaller than that of the memory, but the exchange speed of the temporary memory is much faster than that of the memory, the data in the CPU cache is a small part of the memory, but the small part is to be accessed by the CPU in a short time, when the CPU calls a large amount of data, the CPU cache can be avoided from being directly called from the CPU cache, so that the reading speed is increased, and in the scheme, the CPU cache can store screen capture data to be read. The screen capture data may be image data of the first frame screen capture image, for example: data such as pixel values, gray values, and image sizes can be obtained by calling an encoding program through the DXGI. Mapping the first frame screen capturing image from the video memory of the GPU to the CPU may be by storing a video memory address of the first frame screen capturing image in the GPU and an address of the CPU to establish a mapping relationship table, and the CPU may read the first frame screen capturing image in the GPU according to the mapping relationship table. And copying the screen capture data of the first frame screen capture image mapped into the CPU address into the CPU buffer memory through a corresponding interface, and reading the screen capture data from the CPU buffer memory through encoding for the GPU to perform initial frame encoding. The initial frame may be the first frame screen shot image.
S103, identifying whether the screen capturing of the desktop of the current frame is successful;
in the scheme, whether the screen capturing is successful can be identified as whether the desktop image of the current frame is subjected to the desktop screen capturing operation by using the DXGI, if the desktop image of the current frame is identical to the screen capturing image of the desktop screen capturing of the previous frame, the desktop screen capturing operation of the current frame is not performed, namely the screen capturing fails; if the desktop image of the current frame is not identical to the screen capturing image of the desktop screen capturing of the previous frame, the desktop screen capturing operation of the current frame is carried out, namely the screen capturing is successful. Specifically, whether the desktop image of the current frame is identical to the screen capture image of the desktop screen capture of the previous frame or not may be obtained by image recognition, whether the image data is identical to the image data is compared, and whether the desktop screen capture of the previous frame is performed or not is determined. The desktop screen capturing operation of the current frame may be an operation of capturing a desktop image of the current frame after initializing the desktop screen capturing and acquiring a first frame of screen capturing image of which the screen capturing is successful.
S104, if the screen capturing of the current frame fails, the screen capturing data are read from the cache of the CPU for the GPU to encode the current frame.
In the scheme, if the screen capturing of the current frame fails, that is, the image data of the desktop image of the current frame is identical to the image data of the last frame, the screen capturing operation is not performed on the desktop image of the current frame any more, and the screen capturing data of the last frame can be directly used as the screen capturing data of the current frame. Because the screen capturing data of the desktop screen capturing of each frame with successful screen capturing can be stored in the GPU and can be mapped from the video memory of the GPU and copied into the cache of the CPU, the screen capturing data of the last frame can be read from the cache of the CPU for the GPU to carry out current frame encoding. Specifically, if the screen capturing of the desktop image of the current frame is successful, storing the screen capturing data of the current frame in a video memory address of the GPU, and establishing a new mapping relation between the GPU and the CPU, wherein the mapping relation can be used for providing authority for the CPU to access and read the video memory address of the GPU of the current screen capturing data; if the desktop image of the current frame fails to be captured, a new mapping relation is not established any more, and the CPU directly reads the captured data of the previous frame by using the mapping relation of the previous frame. And after the CPU reads the screen capturing data of the last frame in the GPU video memory, copying the screen capturing data into a buffer memory, and providing codes for reading the screen capturing data in the buffer memory for the GPU to encode the current frame.
Based on the above embodiment, optionally, after identifying whether the current frame desktop screen capture is successful, the method further includes:
if the screen capturing of the current frame is successful, the mapping from the video memory of the GPU to the CPU of the previous frame of screen capturing image is closed, the mapping from the video memory of the GPU to the CPU of the current frame of screen capturing image is built, and the current frame of screen capturing image is copied into the cache of the CPU;
and reading screen capturing data from the cache of the CPU for the GPU to encode the current frame.
In the scheme, if the screen capturing of the current frame is successful, that is, the image data of the desktop image of the current frame is not identical to the screen capturing data of the desktop screen capturing of the previous frame, the screen capturing operation is performed on the desktop image of the current frame, the screen capturing data are obtained, the mapping from the video memory of the GPU to the CPU of the previous frame of the screen capturing image is closed, and a new mapping relation from the video memory of the GPU to the CPU of the current frame of the screen capturing image is established, wherein the mapping relation can be used for providing access rights of the CPU to the video memory address of the GPU for reading the current screen capturing data. And copying the screen capture data into a cache of the CPU after the CPU reads the current screen capture data, and reading the screen capture data in the cache of the CPU through encoding to enable the GPU to encode the current frame.
In the scheme, if the screen capturing of the current frame is successful, the mapping from the video memory of the GPU to the CPU of the last frame of screen capturing image is closed, the mapping from the video memory of the GPU to the CPU of the current frame of screen capturing image is built, the current frame of screen capturing image is copied to the cache of the CPU, screen capturing data are read from the cache of the CPU for the GPU to carry out current frame encoding, and the screen capturing efficiency and the reliability of the desktop screen capturing data mapping can be improved
Based on the above embodiment, optionally, after identifying that the screen capture of the current frame is successful, the method further includes:
identifying whether local rendering of the screen capturing image of the current frame is needed;
and if local rendering is needed, locally rendering the screen capturing image of the current frame in the GPU in a preset mode.
In the scheme, after the current frame screen capturing is successfully identified, whether the current frame screen capturing image needs to be locally rendered is identified, specifically, whether the auxiliary screen is installed on equipment at the teacher end in the interactive classroom equipment system is judged by identifying whether the auxiliary screen is installed on the equipment at the teacher end, if the auxiliary screen is installed on the teacher end, the current frame screen capturing image needs to be locally rendered, and if the auxiliary screen is not installed, the current frame screen capturing image does not need to be rendered. The local rendering may be an operation process of generating an image from a model, and in particular, may be an operation process for displaying a screen shot image of a current frame on a secondary screen at the teacher side. If local rendering is needed, locally rendering the screen capturing image of the current frame in the GPU in a preset mode, wherein the preset mode can be a D3D11 texture rendering mode.
In the scheme, whether the current frame screen capturing image needs to be locally rendered is identified, if so, the current frame screen capturing image is locally rendered in the GPU in a preset mode, the local rendering can be performed according to requirements, the problems of delay and blocking of the screen capturing image received by a student end caused by overlong screen capturing data processing duration are avoided, and the desktop screen capturing data processing efficiency is improved.
Based on the above embodiment, optionally, before establishing the mapping of the current frame screen capture image from the video memory of the GPU to the CPU, the method further includes:
identifying whether the current frame screen capturing image needs to be subjected to scaling processing or not;
and if the scaling processing is needed, scaling the current frame screen capturing image to a target size, and then executing the operation of establishing the mapping of the current frame screen capturing image from the video memory of the GPU to the CPU.
In this scheme, identifying whether the current frame of the screen capturing image needs to be scaled may be identifying whether the screen capturing data resolution of the current frame of the screen capturing image meets a preset resolution condition, where the preset resolution condition may be that the screen capturing data resolution of the screen capturing image is not greater than 1920×1080. If the conditions are met, the mapping relation between the video memory of the GPU and the CPU of the current frame screen capturing image can be directly established; if the condition is not met, scaling the size of the screen capturing data resolution of the current frame screen capturing image, and then executing the operation of establishing the mapping from the video memory of the GPU to the CPU of the current frame screen capturing image, wherein the scaling process can be to reduce the screen capturing data resolution of the current frame screen capturing image to a target size, and the target size can be 1920×1080 resolution.
In the scheme, whether the current frame screen capturing image needs to be scaled is identified, if the current frame screen capturing image needs to be scaled, the current frame screen capturing image is scaled to the target size, and then the operation of establishing the mapping from the video memory of the GPU to the CPU of the current frame screen capturing image is executed, so that the problem of unstable frame rate caused by smaller equipment respectively rate and poor equipment performance of an interactive classroom system can be avoided, the encoding consumption from the whole desktop screen capturing to the rendering is reduced, and the processing efficiency of desktop screen capturing data is improved.
Based on the above embodiments, optionally, the scaling process is performed in the GPU;
after the scaling process, the current frame screen capture image is converted to the target data format.
In this scheme, the scaling process is performed in the GPU, and after the scaling process is performed, the current frame screen capture image is converted into the target data format. Here, the target data format may be a data format that occupies less data space to store the same image than a normal image data format (e.g., RGB format). For example, the target data format may be the NV12 data format. The NV12 data format is a data storage mode of YUV, and the YUV divides the expression of the image into two parts, namely brightness (brightness) and chromaticity. The chroma is divided into 2 sub-dimensions, namely hue and saturation, the brightness is generally expressed by Y, the hue is expressed by U, the saturation is expressed by V, and the information is stored by 1 byte, so YUV and RGB are all expressed by 3 bytes, and are converted through a fixed linear mapping, in order to reduce the image size, the YUV adopts a mode that the number of Y is kept unchanged, and simultaneously reduces the number of U and V, for example, a plurality of pixels share one U or V, and different common modes bring different coding modes, such as: YUV is 4:4:4; YUV is 4:2:2; YUV 4:2:0, etc. The data storage modes of YUV are generally divided into two types, one type is that YUV three components are alternately stored, and the other type is that YUV is stored in a piece manner, and the former type is simply understood as information storage in pixels; the latter is understood to be stored in components, e.g. Y for all pixels stored together. The NV12 data format may be two planes, storing Y and UV components, respectively. Wherein the UV components share a plane and are staggered in the order U, V, each four Y components sharing a set of U, V components.
In the scheme, the scaling processing is performed in the GPU, so that the calculation efficiency of the scaling data can be improved, the processing efficiency of the DXGI screen capture data is improved, after the scaling processing is performed, the screen capture image of the current frame is converted into the target data format, the data volume of the DXGI screen capture data can be reduced, and the processing efficiency of the DXGI screen capture data in the GPU is improved.
According to the technical scheme provided by the embodiment, the desktop screen capturing is initialized so as to obtain a first frame screen capturing image with successful screen capturing; mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding; identifying whether the screen capturing of the desktop of the current frame is successful; if the screen capturing of the current frame fails, the screen capturing data is read from the cache of the CPU for the GPU to encode the current frame. According to the desktop screen capturing data processing method of the interactive classroom, the problems that the screen capturing frame rate is unstable, the number of times of screen capturing data mapping is large, and the processing efficiency of the screen capturing data is low can be solved.
Example two
Fig. 2 is a flow chart of a desktop screenshot data processing method in an interactive classroom according to a second embodiment of the present application. As shown in fig. 2, the method specifically comprises the following steps:
s201, initializing desktop screen capturing to acquire a first frame screen capturing image with successful screen capturing;
s202, mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding;
s203, identifying whether the screen capturing of the desktop of the current frame is successful;
based on the above embodiment, optionally, identifying whether the current frame desktop screen capture is successful includes:
if the input or output change data is detected through the device driver, determining that the screen capturing is successful;
if no input or output change data is detected by the device driver, determining that the screen capture fails.
In this scheme, the device driver may be a software code running on the live device side of the interactive classroom, and its main function is to complete the data transfer function between the computer system and the hardware device, for example: the device driver can complete data transmission between computer system data of the interactive classroom live broadcast device end and hardware such as a mouse, a keyboard, a display and the like. The device driver is a medium between the operating system and the hardware of the interactive classroom live broadcast device end, and can realize the bidirectional communication of the operating system and the hardware information, namely, the function of the hardware device is communicated to the operating system, and the standard instruction of the operating system is also communicated to the hardware device, so that the seamless connection of the operating system and the hardware device is realized. Because the device driver contains information about the hardware device, the function of the hardware can be told to the computer system, and meanwhile, the instruction received by the system device can be transmitted to the hardware, so that whether the screen capture of the desktop screen capture of the current frame is successful or not can be detected and identified through the device driver of the live device end of the interactive classroom. Specifically, the device driver may compare the system data of the operating system of the live broadcast device end of the interactive classroom, the input data of the hardware device or the device data, and the like with the data stored in the CPU, and determine whether the data is consistent with the data stored in the CPU, if not, it indicates that there is a change of the input and output data, that is, the screen capturing of the current frame desktop is successful, and if not, it indicates that there is no change of the input and output data, that is, the screen capturing of the current frame desktop is failed.
In the scheme, whether the screen capturing is successful is judged by whether the input or output data of the device driving detection system is changed, and if the device driving detects the changed data, the screen capturing is determined to be successful; if the change of the input or output data is not detected, the screen capturing failure is determined, excessive mapping processing and longer processing time of the screen capturing data can be avoided, and the processing efficiency of the desktop screen capturing data is improved.
S204, if the screen capturing of the current frame fails, the screen capturing data are read from the cache of the CPU for the GPU to encode the current frame.
Based on the above embodiment, optionally, after reading the screen capture data from the cache of the CPU for the GPU to perform current frame encoding, the method further includes:
identifying whether screen capturing is stopped;
if yes, releasing the video memory of the GPU occupied by the screen capturing data and the cache of the CPU, and ending the desktop screen capturing data processing flow.
In the scheme, whether to stop screen capturing can be identified as to whether to stop screen recording operation on the current teacher end, the identification mode can be to judge whether to close a course file, a classroom blackboard writing, a teacher end auxiliary screen and the like on the current teacher end through image identification, or whether to stop screen capturing can be identified according to whether to send out a recording stopping or recording suspending instruction by the teacher end equipment, and excessive limitation is not made here. If the identification result is that screen capturing is stopped, screen capturing data stored in the video memory of the GPU and the cache of the CPU are cleared through encoding, the video memory of the GPU and the cache of the CPU are released, and the desktop screen capturing data processing flow is ended.
In the scheme, after the screen capturing data is read from the cache of the CPU for the GPU to carry out current frame coding, whether screen capturing is stopped is identified, if yes, the video memory of the GPU occupied by the screen capturing data and the cache of the CPU are released, the desktop screen capturing data processing flow is ended, and the memory and the system resources of the system equipment can be timely released.
According to the technical scheme provided by the embodiment of the application, whether the image content of the current frame DXGI screen shot is the same as the image content of the previous frame DXGI screen shot is identified; if the screen capturing is the same, the screen capturing fails; if the screen shots are different, the screen shots are successful; identifying whether screen capturing is stopped; if yes, releasing the video memory of the GPU and the cache of the CPU occupied by the screen capturing data, ending the desktop screen capturing data processing flow, avoiding excessive mapping processing and longer processing time of the screen capturing data, releasing the system equipment memory and system resources in time, and improving the processing efficiency of the desktop screen capturing data.
Example III
Fig. 3 is a schematic structural diagram of a desktop screen capturing data processing device for an interactive classroom according to a third embodiment of the present application. As shown in fig. 3, the method specifically includes the following steps:
the screen capturing initialization module 301 is configured to initialize a desktop screen capturing to obtain a first frame screen capturing image that the screen capturing is successful;
The screen capturing image mapping module 302 is configured to map the first frame of screen capturing image from the video memory of the GPU to the CPU, copy the first frame of screen capturing image to the cache of the CPU, and read the screen capturing data from the cache of the CPU for the GPU to perform initial frame encoding;
the screen capturing identification module 303 is configured to identify whether the screen capturing of the desktop of the current frame is successful;
and the screen capturing data encoding module 304 is configured to, if the screen capturing of the current frame fails, read the screen capturing data from the cache of the CPU for the GPU to encode the current frame.
Further, the screen capturing data encoding module is further configured to:
if the screen capturing of the current frame is successful, the mapping from the video memory of the GPU to the CPU of the previous frame of screen capturing image is closed, the mapping from the video memory of the GPU to the CPU of the current frame of screen capturing image is built, and the current frame of screen capturing image is copied into the cache of the CPU;
and reading screen capturing data from the cache of the CPU for the GPU to encode the current frame.
Further, the screen capturing data encoding module further includes:
the local rendering identification unit is used for identifying whether local rendering is needed for the screen capturing image of the current frame or not;
and the screen capturing image rendering unit is used for locally rendering the screen capturing image of the current frame in the GPU in a preset mode if local rendering is needed.
Further, the screen capturing data encoding module further includes:
the zooming identification unit is used for identifying whether zooming processing is needed to be carried out on the screen capturing image of the current frame or not;
and the screen capturing image scaling unit is used for scaling the screen capturing image of the current frame to the target size if the scaling processing is needed, and then executing the operation of establishing the mapping of the screen capturing image of the current frame from the video memory of the GPU to the CPU.
Further, the scaling processing of the screen capturing image scaling unit is performed in the GPU;
the screen capturing image scaling unit is further used for converting the screen capturing image of the current frame into a target data format after scaling processing.
Further, the screen capturing data encoding module is further configured to:
identifying whether screen capturing is stopped;
if yes, releasing the video memory of the GPU occupied by the screen capturing data and the cache of the CPU, and ending the desktop screen capturing data processing flow.
Further, the screen capturing identification module is specifically configured to:
if the input or output change data is detected through the device driver, determining that the screen capturing is successful;
if no input or output change data is detected by the device driver, determining that the screen capture fails.
According to the technical scheme provided by the embodiment, the screen capturing initialization module is used for initializing the desktop screen capturing so as to acquire a first frame of screen capturing image with successful screen capturing; the screen capturing image mapping module is used for mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding; the screen capturing identification module is used for identifying whether the screen capturing of the desktop of the current frame is successful; and the screen capture data encoding module is used for reading the screen capture data from the cache of the CPU for the GPU to encode the current frame if the screen capture of the current frame fails. According to the desktop screen capturing data processing device of the interactive classroom, the problems that the screen capturing frame rate is unstable, the number of times of screen capturing data mapping is large, and the processing efficiency of the screen capturing data is low can be solved.
The desktop screen capturing data processing device of the interactive classroom in the embodiment of the application can be a device, and can also be a component, an integrated circuit or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a cell phone, tablet computer, notebook computer, palm computer, vehicle mounted electronic device, wearable device, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook or personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device may be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and embodiments of the present application are not limited in particular.
The desktop screen capturing data processing device of the interactive classroom in the embodiment of the application can be a device with an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, and the embodiment of the present application is not limited specifically.
The desktop screen capturing data processing device for the interactive classroom provided by the embodiment of the application can realize each process realized by the method embodiments of fig. 1 to 2, and in order to avoid repetition, the description is omitted here.
Example IV
As shown in fig. 4, the embodiment of the present application further provides an electronic device 400, which includes a processor 401, a memory 402, and a program or an instruction stored in the memory 402 and capable of running on the processor 401, where the program or the instruction implements each process of the desktop screen capture data processing method embodiment of the interactive classroom when executed by the processor 401, and the process can achieve the same technical effect, so that repetition is avoided and no further description is given here.
The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.
Example five
The embodiment of the application also provides a readable storage medium, wherein the readable storage medium stores a program or an instruction, and the program or the instruction realizes each process of the desktop screen capture data processing method embodiment of the interactive classroom when being executed by a processor, and can achieve the same technical effect, so that repetition is avoided and redundant description is omitted.
Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.
Example six
The embodiment of the application further provides a chip, the chip comprises a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions, the processes of the desktop screen capture data processing method embodiment of the interactive classroom can be realized, the same technical effects can be achieved, and the repetition is avoided, and the description is omitted here.
It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.
The foregoing description is only of the preferred embodiments of the application and the technical principles employed. The present application is not limited to the specific embodiments described herein, but is capable of numerous modifications, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, while the application has been described in connection with the above embodiments, the application is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit of the application, the scope of which is set forth in the following claims.
Claims (10)
1. The desktop screen capturing data processing method for the interactive classroom is characterized by comprising the following steps of:
initializing desktop screen capturing to acquire a first frame screen capturing image with successful screen capturing;
mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding;
identifying whether the screen capturing of the desktop of the current frame is successful;
if the screen capturing of the current frame fails, the screen capturing data is read from the cache of the CPU for the GPU to encode the current frame.
2. The method of claim 1, wherein after identifying whether the current frame desktop screen capture was successful, the method further comprises:
If the screen capturing of the current frame is successful, the mapping from the video memory of the GPU to the CPU of the previous frame of screen capturing image is closed, the mapping from the video memory of the GPU to the CPU of the current frame of screen capturing image is built, and the current frame of screen capturing image is copied into the cache of the CPU;
and reading screen capturing data from the cache of the CPU for the GPU to encode the current frame.
3. The method of claim 2, wherein after identifying that the current frame screen capture was successful, the method further comprises:
identifying whether local rendering of the screen capturing image of the current frame is needed;
and if local rendering is needed, locally rendering the screen capturing image of the current frame in the GPU in a preset mode.
4. The method of claim 2, wherein prior to establishing the mapping of the current frame screen shot image from the memory of the GPU to the CPU, the method further comprises:
identifying whether the current frame screen capturing image needs to be subjected to scaling processing or not;
and if the scaling processing is needed, scaling the current frame screen capturing image to a target size, and then executing the operation of establishing the mapping of the current frame screen capturing image from the video memory of the GPU to the CPU.
5. The method of claim 4, wherein the scaling process is performed in a GPU;
After the scaling process, the current frame screen capture image is converted to the target data format.
6. The method of claim 1 or 2, wherein after reading the screen capture data from the CPU's cache for the GPU to perform current frame encoding, the method further comprises:
identifying whether screen capturing is stopped;
if yes, releasing the video memory of the GPU occupied by the screen capturing data and the cache of the CPU, and ending the desktop screen capturing data processing flow.
7. The method of claim 1, wherein identifying whether the current frame desktop screen capture was successful comprises:
if the input or output change data is detected through the device driver, determining that the screen capturing is successful;
if no input or output change data is detected by the device driver, determining that the screen capture fails.
8. A desktop screen capture data processing device for an interactive classroom, the device comprising:
the screen capturing initialization module is used for initializing the desktop screen capturing so as to acquire a first frame screen capturing image with successful screen capturing;
the screen capturing image mapping module is used for mapping the first frame screen capturing image from the video memory of the GPU to the CPU, copying the first frame screen capturing image into the cache of the CPU, and reading screen capturing data from the cache of the CPU for the GPU to perform initial frame coding;
The screen capturing identification module is used for identifying whether the screen capturing of the desktop of the current frame is successful;
and the screen capture data encoding module is used for reading the screen capture data from the cache of the CPU for the GPU to encode the current frame if the screen capture of the current frame fails.
9. An electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, the program or instruction when executed by the processor implementing the steps of the desktop screen capture data processing method of an interactive classroom of any one of claims 1-7.
10. A readable storage medium, wherein a program or instructions is stored on the readable storage medium, which when executed by a processor, implements the steps of the interactive classroom desktop screen capture data processing method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310089336.9A CN116880937A (en) | 2023-02-06 | 2023-02-06 | Desktop screen capturing data processing method, device, equipment and medium for interactive classroom |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310089336.9A CN116880937A (en) | 2023-02-06 | 2023-02-06 | Desktop screen capturing data processing method, device, equipment and medium for interactive classroom |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116880937A true CN116880937A (en) | 2023-10-13 |
Family
ID=88255578
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310089336.9A Pending CN116880937A (en) | 2023-02-06 | 2023-02-06 | Desktop screen capturing data processing method, device, equipment and medium for interactive classroom |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116880937A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117435112A (en) * | 2023-12-20 | 2024-01-23 | 摩尔线程智能科技(成都)有限责任公司 | Data processing method, system and device, electronic equipment and storage medium |
-
2023
- 2023-02-06 CN CN202310089336.9A patent/CN116880937A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117435112A (en) * | 2023-12-20 | 2024-01-23 | 摩尔线程智能科技(成都)有限责任公司 | Data processing method, system and device, electronic equipment and storage medium |
| CN117435112B (en) * | 2023-12-20 | 2024-04-05 | 摩尔线程智能科技(成都)有限责任公司 | Data processing method, system and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109600666B (en) | Video playing method, device, medium and electronic equipment in game scene | |
| CN1985278B (en) | Legacy processing for pixel shader hardware | |
| CN107729095B (en) | Image processing method, virtualization platform and computer-readable storage medium | |
| CN101438319A (en) | Advanced anti-aliasing with multiple graphics processing units | |
| US20070268289A1 (en) | Graphics system with dynamic reposition of depth engine | |
| EP3972253A1 (en) | Image rendering and encoding method, and related apparatus | |
| WO2016133730A1 (en) | Systems and methods for reducing memory bandwidth using low quality tiles | |
| CN107886466B (en) | Image processing unit system of graphic processor | |
| CN116880937A (en) | Desktop screen capturing data processing method, device, equipment and medium for interactive classroom | |
| US20120218292A1 (en) | System and method for multistage optimized jpeg output | |
| CN110782387B (en) | Image processing method and device, image processor and electronic equipment | |
| CN109089120B (en) | Analysis-aided encoding | |
| CN112184538B (en) | Image acceleration method, related device, equipment and storage medium | |
| CN112991143A (en) | Method and device for assembling graphics primitives and computer storage medium | |
| CN104008565A (en) | System and method for playing Flash bitmap animation by using cocos2d-x and HE engines | |
| CN113625923A (en) | Mouse processing method and device based on remote cloud desktop, storage medium and equipment | |
| CN116909511A (en) | Method, device and storage medium for improving double-buffer display efficiency of GPU (graphics processing Unit) | |
| CN114222185B (en) | Video playing method, terminal equipment and storage medium | |
| CN112581575B (en) | Texture system is done to outer video | |
| CN113052748B (en) | Graphics processor and video decoding display method | |
| CN111054072B (en) | Method, device, equipment and storage medium for role model tailing | |
| CN116348904A (en) | Optimizing GPU kernels with SIMO methods for downscaling with GPU caches | |
| US20060170708A1 (en) | Circuits for processing encoded image data using reduced external memory access and methods of operating the same | |
| CN111179386A (en) | Animation generation method, device, equipment and storage medium | |
| CN117435532B (en) | Copying method, device and storage medium based on video hardware acceleration interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |