WO2024119812A1 - Image processing method, system and apparatus, image compression apparatus, and storage medium - Google Patents

Image processing method, system and apparatus, image compression apparatus, and storage medium Download PDF

Info

Publication number
WO2024119812A1
WO2024119812A1 PCT/CN2023/105771 CN2023105771W WO2024119812A1 WO 2024119812 A1 WO2024119812 A1 WO 2024119812A1 CN 2023105771 W CN2023105771 W CN 2023105771W WO 2024119812 A1 WO2024119812 A1 WO 2024119812A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
discarded
pixel
pixel point
compression engine
Prior art date
Application number
PCT/CN2023/105771
Other languages
French (fr)
Chinese (zh)
Inventor
周玉龙
张洪宾
刘同强
刘刚
张贞雷
王贤坤
Original Assignee
山东云海国创云计算装备产业创新中心有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 山东云海国创云计算装备产业创新中心有限公司 filed Critical 山东云海国创云计算装备产业创新中心有限公司
Publication of WO2024119812A1 publication Critical patent/WO2024119812A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel

Definitions

  • the embodiments of the present application relate to the field of image processing, and in particular, to an image processing method, system, device, image compression device and non-volatile readable storage medium.
  • BMC Baseboard Manager Controller
  • CPU central processing unit
  • memory hard disk, fan, frame, etc.
  • temperature and voltage a component that when an abnormal situation is detected, it can be reported to the host computer in time, so that the staff can deal with the remote server in time.
  • the BMC when remotely managing a remote server, the BMC is required to transmit the monitoring screen of the remote server to the local device for display.
  • the BMC transmits the screen it first compresses each frame of the screen, and then transmits the compressed image to the local device through the network. Since the image is transmitted frame by frame, and the data volume of a frame is large, it will not only occupy the storage bandwidth for a long time, but also cause the loss of a frame of the image due to the limitation of the storage bandwidth, which will cause the local display to be not smooth enough.
  • each pixel data is compressed, which reduces the performance requirements for the compression engine. Since the pixel data is transmitted instead of frame by frame, the storage bandwidth occupancy is reduced and the smoothness of the compressed image is improved.
  • an image processing method including:
  • the acquired current pixel data is sent to the compression engine so that the compression engine can
  • the current pixel data is compressed and sent to the system memory
  • the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module;
  • each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine.
  • the pixel point data includes position data and color data in a frame of image.
  • the current pixel point data is the end pixel point data of a frame of an image
  • the compression engine after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in an idle state, obtaining each discarded pixel point data from the discarded pixel point processing module and sending it to the compression engine includes:
  • the current pixel point data is the end pixel point data of the frame of an image
  • each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine.
  • sequentially acquiring the data of each pixel point in each frame of the image from the continuous images includes:
  • the color data of each pixel point is sequentially acquired according to the position of each pixel point of each continuous frame image, and the position data of the pixel point is determined based on the position of each pixel point in a frame image;
  • the pixel data is determined based on the color data and the position data.
  • the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module, including:
  • the position data of the current pixel data is recorded as the last discarded pixel position data, and the current pixel data is set as the discarded pixel data and sent to the discarded pixel processing module.
  • obtaining each discarded pixel data from the discarded pixel processing module and sending it to the compression engine includes:
  • each discarded pixel data is obtained in sequence according to the order of its position data until the discarded pixel data with the position data being the last discarded pixel position data is obtained and sent to the compression engine in the idle state.
  • it also includes:
  • Each frame of image is restored based on the position data in each pixel point data after decompression.
  • restoring each frame of image based on the position data in each pixel point data after decompression includes:
  • the position of each pixel point in a frame of image is determined according to the position data in each pixel point data after decompression, so as to restore each frame of image.
  • sequentially acquiring the data of each pixel point in each frame of the image from the continuous images includes:
  • the pixel data of each frame image is obtained in sequence from the continuous images and stored in the FIFO memory in sequence.
  • the acquired current pixel point data is sent to the compression engine, so that the compression engine compresses the current pixel point data and then sends it to the system memory, including:
  • the compression engine When the compression engine is in an idle state, the current pixel data is obtained from the FIFO memory and sent to the compression engine, so that the compression engine compresses the current pixel data and then sends it to the system memory.
  • the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module, including:
  • the current pixel data is obtained from the FIFO memory and is set as discarded pixel data and sent to the discarded pixel processing module.
  • the current pixel point data is the end pixel point data of a frame of an image
  • the compression engine after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in an idle state, obtaining each discarded pixel point data from the discarded pixel point processing module and sending it to the compression engine includes:
  • the current pixel point data is the pixel point data at the end of a frame of an image
  • the compression engine when the compression engine is in a busy state, the next frame of pixel point data in the next frame of the image where the current pixel point data is located is obtained from the FIFO memory and set as the next frame of discarded pixel point data to be sent to the discarded pixel point processing module;
  • each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine;
  • next frame of pixel point data in the next frame of the image where the current pixel point data is located is obtained from the FIFO memory and sent to the compression engine, so that the compression engine compresses the next frame of pixel point data and sends it to the system memory.
  • the compression engine compresses the next frame of pixel point data and sends it to the system memory, it also includes:
  • next frame of pixel data is the end pixel data of a frame of image
  • the compression engine when the compression engine is in an idle state, the pixel data of each frame is obtained from the discarded pixel processing module.
  • the next frame discards pixel data and sends it to the compression engine.
  • an image processing system including:
  • a first acquisition unit is configured to sequentially acquire pixel data in each frame of an image from continuous images
  • a first sending unit is configured to send the acquired current pixel point data to the compression engine when the compression engine is in an idle state, so that the compression engine compresses the current pixel point data and then sends it to the system memory;
  • the second sending unit is configured to set the current pixel data as discarded pixel data and send it to the discarded pixel processing module when the compression engine is in a busy state;
  • the second acquisition unit is configured to, when the current pixel data is the end pixel data of a frame of an image, after sending the current pixel data to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, obtain each discarded pixel data from the discarded pixel processing module and send it to the compression engine.
  • an image processing device including:
  • a memory arranged to store a computer program
  • the processor is configured to implement the steps of the above-mentioned image processing method when executing the computer program.
  • an embodiment of the present application provides an image compression device, including the above image processing device, and further including:
  • a compression engine connected to the processor is configured to compress pixel data and then send it to the system memory;
  • the discarded pixel processing module connected to the processor is configured to cache each discarded pixel data.
  • the pixel discarding processing module includes:
  • a discard control module connected to the processor is configured to receive discarded pixel data and discarded pixel data of the next frame and send them to the pixel discard recording module, or obtain discarded pixel data and discarded pixel data of the next frame through the pixel discard recording module and send them to the processor;
  • the frame tail information appending module connected to the discarding control module is configured to sort each discarded pixel point data according to the position data, and sort each next frame discarded pixel point data according to the position data, so that the discarding control module sends each discarded pixel point data in sequence or each next frame discarded pixel point data in sequence to the processor;
  • a pixel discarding recording module connected to the discarding control module is configured to store the discarded pixel point data and the discarded pixel point data of the next frame in the discarding memory, or send the discarded pixel point data in the discarding memory and the discarded pixel point data of the next frame to the discarding control module;
  • the discarding memory connected to the pixel discarding recording module is configured to store discarded pixel point data and discarded pixel point data of the next frame.
  • the discard memory includes a first discard memory and a second discard memory
  • the first discarding memory is configured to store discarded pixel data
  • the second discarding memory is configured to store discarded pixel data of the next frame.
  • it also includes:
  • the FIFO memory connected to the processor is configured to cache the data of each pixel point in each frame of the image.
  • an embodiment of the present application provides a non-volatile readable storage medium, on which a computer program is stored.
  • the computer program is executed by a processor, the steps of the image processing method as described above are implemented.
  • the embodiments of the present application provide a method, system, device, image compression device and non-volatile readable storage medium for image processing, which relate to the field of image processing.
  • each pixel point data obtained from a continuous image is sent to the compression engine to compress the current pixel point data and then send it to the system memory;
  • the compression engine is in a busy state, the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module; if the current pixel point data is the end pixel point data of a frame image, and the compression engine is in an idle state, each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine for compression.
  • each pixel point data reduces the performance requirements for the compression engine. Since the transmission is performed according to the transmission pixel point data, there is no need to transmit by frame, which also reduces the occupancy of the storage bandwidth and improves the smoothness of the compressed picture.
  • FIG1 is a schematic diagram of a flow chart of an image processing method provided in an embodiment of the present application.
  • FIG2 is a schematic diagram of the structure of an image processing system provided in an embodiment of the present application.
  • FIG3 is a schematic diagram of the structure of an image processing device provided in an embodiment of the present application.
  • FIG4 is a schematic diagram of the structure of an image compression device provided in an embodiment of the present application.
  • FIG5 is a schematic diagram of the structure of a non-volatile readable storage medium provided in an embodiment of the present application.
  • the core of the embodiments of the present application is to provide a picture processing method, system, device, image compression device and non-volatile readable storage medium, which compresses the data of each pixel point, reducing the performance requirements of the compression engine. Transmitting pixel data does not need to be transmitted frame by frame, which reduces the storage bandwidth usage and improves the smoothness of the compressed image.
  • FIG. 1 is a flow chart of an image processing method provided by an embodiment of the present application, the method comprising:
  • each frame of the image is compressed and transmitted to the system memory for storage after compression, so that the local device can obtain the compressed image from the system memory and display it.
  • the compression engine 41 compresses the image
  • the efficiency of the compression engine 41 in compressing a frame of the image is low.
  • the monitoring image of the remote server is generated continuously. If the compression engine 41 is busy, the continuously generated images cannot be compressed in time and can only be discarded. After the image is discarded, the picture finally displayed by the local device is not smooth, but it is sufficient to show the status of the remote server. Therefore, frame loss is allowed in the related art.
  • the image displayed by the local device is not smooth, it may cause the user to miss important information.
  • the image is not compressed frame by frame in the embodiment of the present application, but each pixel data in each frame image is obtained in sequence from the continuous image, that is, the pixel data is compressed in the embodiment of the present application. Since the data amount of one pixel data is smaller than the data amount of one frame image, the performance of the compression engine 41 can be reduced, and when the compressed pixel data is stored in the system memory, since the data amount of the pixel data is small, the storage bandwidth occupancy is also small, which is convenient for the system memory to execute other algorithm tasks.
  • the compression engine 41 Since images are continuously generated, when the compression engine 41 compresses pixel data, due to the large amount of data, the compression engine 41 may be in a busy state. At this time, the compression engine 41 cannot compress subsequent pixel data. Therefore, in this embodiment, the current pixel data will be sent to the compression engine 41 for compression only when the compression engine 41 is in an idle state.
  • the compression engine 41 When the compression engine 41 is in a busy state, the compression engine 41 cannot compress the current pixel. In the related technology, since the compression engine 41 compresses a frame of image, if the compression engine 41 is in a busy state, the subsequent images will be discarded directly until the compression engine 41 is idle, and the subsequent images will not be compressed. However, this will cause the compressed image to be discontinuous due to frame loss, and the image played by the local device will also be discontinuous.
  • each pixel point data in a frame of image is compressed separately, not only the performance requirements for the compression engine 41 are reduced, if the compression engine 41 is currently in a busy state, only the current pixel point data is set to discarded pixel point data and sent to the discarded pixel point data, instead of discarding the entire frame of image.
  • each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine 41.
  • each pixel in the frame of the image where the current pixel data is located is compressed by the compression engine 41 or sent to the discarded pixel processing module.
  • the compression engine 41 is idle, and then each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41 for compression. Based on this, although the pixel data in a frame of the image are compressed in disorder, the pixel data are not discarded, and the image finally displayed by the local device is a complete and continuous image.
  • a frame of image includes the first to tenth pixels.
  • a frame of image usually includes 1024*728 pixel data, but for ease of description, a frame of image including ten pixels is taken as an example.
  • the current pixel data is the pixel data of the first pixel, that is, the first pixel data
  • the compression engine 41 if the compression engine 41 is in an idle state, the first pixel data can be sent to the compression engine 41 for compression, and if the compression engine 41 is in a busy state, such as compressing the pixel data of the previous frame of image, the first pixel data is set as discarded pixel data and sent to the discarded pixel processing module; no matter whether the first pixel data is sent to the compression engine 41 or the discarded pixel processing module, when the second pixel data is the current pixel data, it is still necessary to judge again whether the compression engine 41 is in an idle state.
  • the second pixel point data can be sent to the compression engine 41 for compression. If the compression engine 41 is in a busy state, the second pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module. This is repeated until the current pixel point data is the tenth pixel point data. After the tenth pixel point data is sent to the compression engine 41 or the discarded pixel point processing module, each discarded pixel point data in the discarded pixel point processing module is sent to the compression engine 41 for compression when the compression engine 41 is in an idle state.
  • the first, fifth and seventh pixel point data are all set as discarded pixel point data
  • the first, fifth and seventh pixel point data are obtained from the discarded pixel point processing module.
  • the discarded pixel data corresponding to the data is sent to the compression engine 41 when the compression engine 41 is in an idle state.
  • the system memory stores ten pixel data in a frame of image, which can ensure the integrity of a frame of image.
  • each pixel point data obtained from the continuous image is sent to the compression engine 41, so as to compress the current pixel point data and then send it to the system memory;
  • the compression engine 41 when the compression engine 41 is in a busy state, the current pixel point data is set as the discarded pixel point data and sent to the discarded pixel point processing module; if the current pixel point data is the end pixel point data of a frame image, and the compression engine 41 is in an idle state, each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine 41 for compression.
  • compressing each pixel point data reduces the performance requirements of the compression engine 41. Since the transmission is performed according to the transmission pixel point data, it is not necessary to transmit by frame, which also reduces the occupancy of the storage bandwidth and improves the smoothness of the compressed picture.
  • the pixel point data includes position data and color data in a frame of image
  • each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41, including:
  • the current pixel point data is the end pixel point data of the frame of an image
  • each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41.
  • each pixel point data in a frame of image includes position data and color data, that is, the position of a pixel point data in a frame of image and the color of the position. Based on this, different or same colors at different positions constitute a frame of image.
  • whether it is the end pixel data of a frame can be determined by the position data in each pixel data, or the order of the current pixel data can be determined according to the number of pixels in a frame image and the position data of the current pixel data to determine whether the current pixel data is the end pixel data of a frame image.
  • the current pixel data is the end pixel data of the frame, it can be determined that all pixel data in a frame of image have been sent to the compression engine 41 for compression or sent to the discarded pixel processing module.
  • the discarded pixel data are extracted from the discarded pixel processing module.
  • the pixel data of a frame of image in the system memory are not stored in the order of their positions in the frame of image, since the pixel data includes the position data of the pixel, the local device can extract the pixel data from the system memory.
  • the color data of each position in the frame of image can be determined according to the position data in the data of each pixel point, so as to restore the image before compression.
  • sequentially acquiring pixel data in each frame of the image from the continuous images includes:
  • the pixel data is determined based on the color data and the position data.
  • the position data of each pixel in a frame of images and the color of each position in a frame of images are determined, thereby determining the color data of each position, and the pixel data can be determined based on the position data and the color data.
  • the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module, including:
  • the position data of the current pixel data is recorded as the last discarded pixel position data, and the current pixel data is set as the discarded pixel data and sent to the discarded pixel processing module.
  • the position data of the current pixel data is recorded as the last discarded pixel position data.
  • the position data of the first pixel data is recorded as the last discarded pixel position data, and the first pixel data is set as discarded pixel data and sent to the discarded pixel processing module.
  • the second pixel data is compressed normally, and when the third pixel data is the current pixel data and the compression engine 41 is in a busy state, the position data of the third pixel data is recorded as the last discarded pixel position data, and the third pixel data is set as discarded pixel data and sent to the discarded pixel processing module, that is, the first pixel data and the third pixel data are both discarded pixel data, but only the position data of the third pixel is updated to the last discarded pixel position data, that is, in a frame of image, the position data of the last pixel data set as discarded pixel data is the last discarded pixel position data.
  • the last position data in a frame of image is set as pixel data of discarded pixel position data, so that all discarded pixel data can be obtained in the discarded pixel processing module without omission.
  • the discarded pixel data are obtained from the discarded pixel processing module and the discarded pixel data are processed.
  • Sent to compression engine 41 including:
  • each discarded pixel point data is obtained in sequence according to the order of the position data of each discarded pixel point data until the discarded pixel point data whose position data is the last discarded pixel point position data is obtained and sent to the compression engine 41 in the idle state.
  • each discarded pixel data can be obtained in sequence according to the order of the position data of each discarded pixel data. For example, in a frame of image, only the first, third and seventh pixel data are discarded pixel data, and the position data of the seventh pixel data is the last discarded pixel position data.
  • the compression engine 41 is idle, the discarded pixel data corresponding to the first pixel data is first obtained for compression, and then the discarded pixel data corresponding to the third pixel data is obtained for compression.
  • the position data of the seventh pixel data is determined to be the last discarded pixel position data. After the seventh pixel data is compressed, it can be determined that the pixel data in the frame of image where the current pixel data is located no longer exists in the discarded pixel processing module. The compression and storage of one frame of image is completed, and the compression of the pixel data of the next frame of image can be performed.
  • sequentially acquiring pixel data in each frame of the image from the continuous images includes:
  • the pixel data of each frame image is obtained in sequence from the continuous image and stored in the FIFO (First In First Out) memory 47 in sequence;
  • the compression engine 41 When the compression engine 41 is in an idle state, the acquired current pixel point data is sent to the compression engine 41, so that the compression engine 41 compresses the current pixel point data and then sends it to the system memory, including:
  • the compression engine 41 When the compression engine 41 is in an idle state, the current pixel data is obtained from the FIFO memory 47 and sent to the compression engine 41, so that the compression engine 41 compresses the current pixel data and sends it to the system memory;
  • the current pixel data is set as discarded pixel data and sent to the discarded pixel processing module, including:
  • the current pixel data is obtained from the FIFO memory 47 and is set as discarded pixel data to be sent to the discarded pixel processing module.
  • the pixel data in each frame of the image is also uninterrupted.
  • the pixel data in each continuous frame image are stored in the FIFO memory 47 in sequence.
  • the pixel data is sent to the compression engine 41 or the pixel discarding processing module, the pixel data is obtained from the FIFO memory 47 as the current pixel data.
  • the next pixel data obtained from the FIFO memory 47 is the current pixel data.
  • FIFO memory 47 Based on this, by caching pixel data through FIFO memory 47, the probability of pixel data being discarded can be avoided when there is a lot of pixel data.
  • the storage upper limit of FIFO memory 47 can be set by the user according to the pixel data of a frame of image.
  • each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine 41, including:
  • the current pixel data is the end pixel data of a frame of an image
  • the compression engine 41 when the compression engine 41 is in a busy state, the next frame of pixel data in the next frame of the image where the current pixel data is located is obtained from the FIFO memory 47 and set as the next frame of discarded pixel data to be sent to the discarded pixel processing module;
  • each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41;
  • next frame of pixel data in the next frame of the image where the current pixel data is located is obtained from the FIFO memory 47 and sent to the compression engine 41, so that the compression engine 41 compresses the next frame of pixel data and sends it to the system memory.
  • the current pixel point data is the frame end pixel point data
  • the position data of the current pixel point data is recorded as the last discarded pixel point position data, and is set as the discarded pixel point data to be sent to the discarded pixel point processing module.
  • the next frame pixel point data in the next frame image of the frame image where the current pixel point data is located is also obtained.
  • the frame image where the current pixel point data is located is the first frame image, and the frame end pixel point sequence in the first frame image has been sent to the compression engine 41 or the discarded pixel point processing module.
  • the compression engine 41 When the second frame image is obtained, After the first pixel point data of the image is taken as the current pixel point data, the compression engine 41 is still in a busy state, and the first pixel point data of the second frame image is set as the discarded pixel point data of the next frame and sent to the discarded pixel point processing module, and so on, until the compression engine 41 is in an idle state, the discarded pixel point data in the first frame image is first obtained from the discarded pixel point processing module and sent to the compression engine 41 for compression.
  • the next frame of discarded pixel point data in the discarded pixel point data is not obtained first for compression, but the next frame of pixel point data in the next frame image is continuously obtained from the FIFO memory 47. to compress.
  • each continuous frame image can be compressed separately, and the integrity of each frame image is guaranteed.
  • the compression engine 41 compresses the next frame of pixel point data and sends it to the system memory, it also includes:
  • next frame pixel data is the frame end pixel data of a frame image
  • the compression engine 41 or the discarded pixel processing module when the compression engine 41 is in an idle state, each next frame discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41.
  • the discarded pixel data of each next frame is obtained from the discarded pixel processing module and sent to the compression engine 41 for compression.
  • all pixel data in the first frame image are compressed, and only the first pixel data, the second pixel data and the third pixel data in the second frame image are set as the discarded pixel data of the next frame and sent to the discarded pixel processing module. Then, after the compression of the frame tail pixel data in the second frame image is completed, when the compression engine 41 is in an idle state, each next frame of discarded pixel data is obtained from the discarded pixel processing module for compression to achieve compression of each pixel data in the second frame image.
  • the embodiment of the present application can not only ensure that all pixels in a frame of image are compressed without omission, but also compress the pixel data of multiple consecutive frames of images by frame to ensure the continuity and integrity of the image.
  • the system memory in the embodiment of the present application is DDR (or called DDR SRAM (Dual Rate Synchronous Dynamic Random Access Memory)), and when the compression engine 41 sends the compressed pixel data to the system memory, the DDR controller is required to perform transit processing therein. Therefore, each system memory that stores a compressed pixel data needs to occupy the DDR controller, that is, occupy the storage bandwidth. However, since the amount of data of a pixel data is much smaller than the amount of data of a frame of image, the storage bandwidth is occupied for a shorter time in the embodiment of the present application.
  • the image acquisition module can acquire pixel data
  • the frame rate control module can determine whether the current pixel data should be sent to the compression engine 41 or the pixel processing module should be discarded.
  • it also includes:
  • Each frame of image is restored based on the position data in each pixel point data after decompression.
  • each frame image is restored based on the position data of each pixel point data after decompression.
  • each frame image is restored based on the position data of each pixel point data after decompression.
  • the position of each pixel point in a frame of image is determined according to the position data in each pixel point data after decompression, so as to restore each frame of image.
  • the local device After the pixel data in each frame image are compressed and stored in the DDR, when the local device obtains the image from the DDR, it can obtain the compressed pixel data of each frame image in the DDR from the image acquisition processor 32 through the network module, decompress the pixel data, and restore each frame image according to the position data of each pixel data to display a continuous and clear image.
  • FIG. 2 is a schematic diagram of the structure of an image processing system provided in an embodiment of the present application, the system comprising:
  • the first acquisition unit 21 is configured to sequentially acquire pixel data in each frame of the image from the continuous images;
  • the first sending unit 22 is configured to send the acquired current pixel data to the compression engine 41 when the compression engine 41 is in an idle state, so that the compression engine 41 compresses the current pixel data and then sends it to the system memory;
  • the second sending unit 23 is configured to set the current pixel data as discarded pixel data and send it to the discarded pixel processing module when the compression engine 41 is in a busy state;
  • the second acquisition unit 24 is configured to, when the current pixel data is the end pixel data of a frame of an image, after sending the current pixel data to the compression engine 41 or the discarded pixel processing module, when the compression engine 41 is in an idle state, obtain each discarded pixel data from the discarded pixel processing module and send it to the compression engine 41.
  • FIG. 3 is a schematic diagram of the structure of an image processing device provided in an embodiment of the present application, the device comprising:
  • the processor 32 is configured to implement the steps of the above-mentioned image processing method when executing the computer program.
  • FIG. 4 is a schematic diagram of the structure of an image compression device provided in an embodiment of the present application.
  • the device includes the image processing device as described above, and further includes:
  • a compression engine 41 connected to the processor 32 is configured to compress pixel data and then send it to the system memory;
  • the discarded pixel processing module connected to the processor 32 is configured to cache each discarded pixel data.
  • the compression engine 41 in this embodiment is configured to compress the pixel data in each frame image and send the compressed pixel data to the system memory. However, when the system memory is occupied, the compression engine 41 cannot send the compressed pixel data to the system memory. At this time, the compression engine 41 is busy, and subsequent pixel data can only be sent to the discarded pixel processing module as discarded pixel data.
  • the discarded pixel processing module is configured to cache each discarded pixel data.
  • the main function includes receiving each discarded pixel data, or sending each pixel data to the processor 32 when the processor 32 obtains the discarded pixel data.
  • the pixel discarding processing module includes:
  • the discard control module 42 connected to the processor 32 is configured to receive the discarded pixel data and the discarded pixel data of the next frame and send them to the pixel discard recording module 44, or obtain the discarded pixel data and the discarded pixel data of the next frame through the pixel discard recording module 44 and send them to the processor 32;
  • the frame tail information appending module 43 connected to the discarding control module 42 is configured to sort each discarded pixel point data according to the position data, and sort each next frame discarded pixel point data according to the position data, so that the discarding control module 42 sends each discarded pixel point data in sequence or each next frame discarded pixel point data in sequence to the processor 32;
  • the pixel discarding recording module 44 connected to the discarding control module 42 is configured to store the discarded pixel data and the discarded pixel data of the next frame in the discarding memory, or send the discarded pixel data in the discarding memory and the discarded pixel data of the next frame to the discarding control module 42;
  • the discarding memory connected to the pixel discarding recording module 44 is configured to store discarded pixel point data and discarded pixel point data of the next frame.
  • the discarded pixel processing module in this embodiment includes a discard control module 42, a frame tail information appending module 43, a pixel discard recording module 44 and a discard memory.
  • the discard control module 42 mainly receives discarded pixel data or the next frame of discarded pixel data according to the request of the processor 32 to send the discarded pixel data to the discarded pixel processing module, or sends each discarded pixel data or the next frame of discarded pixel data to the processor 32 according to the request of the processor 32 to obtain the discarded pixel data from the discarded pixel processing module.
  • the frame tail appending module can enable the processor 32 to receive each discarded pixel data and each next frame of discarded pixel data in order of position by sorting each discarded pixel data and each next frame of discarded pixel data respectively, so as to reduce the disorder of the pixel data and reduce the workload of the processor 32.
  • the pixel discarding recording module 44 in this embodiment mainly stores the discarded pixel data and the discarded pixel data of the next frame in the discarding memory, or sends the discarded pixel data in the discarding memory and the discarded pixel data of the next frame to the discarding control module 42.
  • the discard control module 42, the frame end information appending module 43, and the pixel discard recording module 44 in the embodiment of the present application can be, but are not limited to, implemented through gate circuits or hardware links.
  • the discard memory includes a first discard memory 45 and a second discard memory 46;
  • the first discarding memory 45 is configured to store discarded pixel data
  • the second discarding memory 46 is configured to store discarded pixel data of the next frame.
  • the frame tail pixel data of the first frame image is set as the discarded pixel data and sent to the discarded pixel processing module
  • the frame head pixel data of the second frame image is set as the next frame discarded pixel data and sent to the discarded pixel processing module.
  • two discarding memories are set to respectively store the discarded pixel data in different images, so as to ensure that different images are complete and accurate after the pixel data are compressed.
  • it also includes:
  • the FIFO memory 47 connected to the processor 32 is configured to cache the data of each pixel point in each frame image.
  • a FIFO memory 47 is also provided to cache the data of each pixel point in each consecutive frame image, so as to reduce the data cache pressure of the processor 32 and improve the performance of the processor 32.
  • Figure 5 is a schematic diagram of the structure of a non-volatile readable storage medium provided in an embodiment of the present application.
  • the non-volatile readable storage medium shown in Figure 5 stores a computer program, which implements the steps of the above-mentioned image processing method when executed by the processor 32.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Embodiments of the present application relate to the field of image processing. Disclosed are an image processing method, system and apparatus, an image compression apparatus, and a nonvolatile readable storage medium. The method comprises: when a compression engine is in an idle state, sending, to the compression engine, pixel point data acquired from continuous images so as to compress current pixel point data and then send the compressed pixel point data to a system memory; when the compression engine is in a busy state, setting the current pixel point data as discarded pixel point data and sending same to a discarded pixel point processing module; and when the current pixel point data is frame trailer pixel point data of an image frame and the compression engine is in an idle state, acquiring each discarded pixel point data from the discarded pixel point processing module and sending the discarded pixel point data to the compression engine for compression. Compressing each pixel point data reduces performance requirements for the compression engine. Because transmission is carried out by pixel point data but not by frames, the storage bandwidth occupied is reduced, thereby improving the smoothness of compressed images.

Description

图片处理方法、系统、装置、图像压缩装置及存储介质Image processing method, system, device, image compression device and storage medium
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本申请要求于2022年12月6日提交中国专利局,申请号为202211554111.8,申请名称为“图片处理方法、系统、装置、图像压缩装置及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application filed with the China Patent Office on December 6, 2022, with application number 202211554111.8, and application name “Image processing method, system, device, image compression device and storage medium”, all contents of which are incorporated by reference in this application.
技术领域Technical Field
本申请实施例涉及图片处理领域,特别是涉及一种图片处理方法、系统、装置、图像压缩装置及非易失性可读存储介质。The embodiments of the present application relate to the field of image processing, and in particular, to an image processing method, system, device, image compression device and non-volatile readable storage medium.
背景技术Background technique
BMC(Baseboard Manager Controller,基板管理控制器)在对远程服务器进行监控时,主要用于对远程服务器的各个部件(CPU(central processing unit,中央处理器)、内存、硬盘、风扇和机框等)的温度、电压等健康状态进行检测,以便在检测到异常情况时及时上报上位机,使工作人员及时对远程服务器进行处理。When monitoring a remote server, BMC (Baseboard Manager Controller) is mainly used to detect the health status of the remote server's various components (CPU (central processing unit), memory, hard disk, fan, frame, etc.), such as temperature and voltage, so that when an abnormal situation is detected, it can be reported to the host computer in time, so that the staff can deal with the remote server in time.
但是,当对远程服务器进行远程管理时,需要BMC将远程服务器的监视画面传至本地设备进行显示,相关技术中BMC在传输画面时,是先将每一帧画面进行图像压缩,再通过网络将压缩后的图像传输至本地设备,由于图像传输时是按帧传输,由于一帧图像的数据量较大,不仅会长时间占用存储带宽,还会因存储带宽的限制,导致某一帧图像的丢失,进而导致本地显示的画面不够流畅。However, when remotely managing a remote server, the BMC is required to transmit the monitoring screen of the remote server to the local device for display. In the related technology, when the BMC transmits the screen, it first compresses each frame of the screen, and then transmits the compressed image to the local device through the network. Since the image is transmitted frame by frame, and the data volume of a frame is large, it will not only occupy the storage bandwidth for a long time, but also cause the loss of a frame of the image due to the limitation of the storage bandwidth, which will cause the local display to be not smooth enough.
发明内容Summary of the invention
本申请实施例的目的是提供一种图片处理方法、系统、装置、图像压缩装置及非易失性可读存储介质,一方面对每个像素点数据进行压缩,降低了对压缩引擎的性能要求,由于按传输像素点数据进行传输,无需按帧传输,还降低了对存储带宽的占用,还提高了压缩后画面的流畅度。The purpose of the embodiments of the present application is to provide an image processing method, system, device, image compression device and non-volatile readable storage medium. On the one hand, each pixel data is compressed, which reduces the performance requirements for the compression engine. Since the pixel data is transmitted instead of frame by frame, the storage bandwidth occupancy is reduced and the smoothness of the compressed image is improved.
为解决上述技术问题,本申请实施例提供了一种图像处理方法,包括:In order to solve the above technical problems, the embodiment of the present application provides an image processing method, including:
从连续的图像中依次获取各帧图像中的各个像素点数据;Sequentially obtain pixel data in each frame of the image from the continuous images;
在压缩引擎为空闲状态时,将获取的当前像素点数据发送至压缩引擎,以使压缩引擎对 当前像素点数据进行压缩后发送至系统存储器;When the compression engine is in an idle state, the acquired current pixel data is sent to the compression engine so that the compression engine can The current pixel data is compressed and sent to the system memory;
在压缩引擎为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块;When the compression engine is in a busy state, the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module;
当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎。When the current pixel data is the end pixel data of a frame of an image, after the current pixel data is sent to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine.
可选地,像素点数据包括在一帧图像中的位置数据和色彩数据。Optionally, the pixel point data includes position data and color data in a frame of image.
可选地,当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎,包括:Optionally, when the current pixel point data is the end pixel point data of a frame of an image, after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in an idle state, obtaining each discarded pixel point data from the discarded pixel point processing module and sending it to the compression engine includes:
基于当前像素点数据的位置数据判断当前像素点数据是否位于一帧图像的帧尾;Determining whether the current pixel point data is located at the end of a frame of an image based on the position data of the current pixel point data;
在当前像素点数据位于一帧图像的帧尾的情况下,则当前像素点数据为一帧图像的帧尾像素点数据;When the current pixel point data is located at the end of a frame of an image, the current pixel point data is the end pixel point data of the frame of an image;
在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎。After the current pixel data is sent to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine.
可选地,从连续的图像中依次获取各帧图像中的各个像素点数据,包括:Optionally, sequentially acquiring the data of each pixel point in each frame of the image from the continuous images includes:
按照连续的各帧图像的各个像素点的位置依次获取各个像素点的色彩数据,并基于各个像素点在一帧图像中的位置确定像素点的位置数据;The color data of each pixel point is sequentially acquired according to the position of each pixel point of each continuous frame image, and the position data of the pixel point is determined based on the position of each pixel point in a frame image;
基于色彩数据和位置数据确定像素点数据。The pixel data is determined based on the color data and the position data.
可选地,在压缩引擎为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块,包括:Optionally, when the compression engine is in a busy state, the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module, including:
在压缩引擎为忙碌状态时,记录当前像素点数据的位置数据为最末丢弃像素点位置数据,并将当前像素点数据设定为丢弃像素点数据发送至丢弃像素点处理模块。When the compression engine is in a busy state, the position data of the current pixel data is recorded as the last discarded pixel position data, and the current pixel data is set as the discarded pixel data and sent to the discarded pixel processing module.
可选地,在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎,包括:Optionally, after sending the current pixel data to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, obtaining each discarded pixel data from the discarded pixel processing module and sending it to the compression engine includes:
在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,按照各个丢弃像素点数据的位置数据的顺序依次获取各个丢弃像素点数据,直至位置数据为最末丢弃像素点位置数据的丢弃像素点数据并发送至空闲状态的压缩引擎。After the current pixel data is sent to the compression engine or the discarded pixel processing module, each discarded pixel data is obtained in sequence according to the order of its position data until the discarded pixel data with the position data being the last discarded pixel position data is obtained and sent to the compression engine in the idle state.
可选地,还包括:Optionally, it also includes:
从系统存储器中获取各个压缩后的像素点数据并进行解压处理; Obtaining each compressed pixel data from the system memory and performing decompression processing;
基于解压处理后的各个像素点数据中的位置数据还原各帧图像。Each frame of image is restored based on the position data in each pixel point data after decompression.
可选地,基于解压处理后的各个像素点数据中的位置数据还原各帧图像,包括:Optionally, restoring each frame of image based on the position data in each pixel point data after decompression includes:
按照解压处理后的各个像素点数据中的位置数据确定各个像素点在一帧图像中的位置,以还原各帧图像。The position of each pixel point in a frame of image is determined according to the position data in each pixel point data after decompression, so as to restore each frame of image.
可选地,从连续的图像中依次获取各帧图像中的各个像素点数据,包括:Optionally, sequentially acquiring the data of each pixel point in each frame of the image from the continuous images includes:
将连续的图像中依次获取各帧图像中的各个像素点数据依次存储至FIFO存储器中。The pixel data of each frame image is obtained in sequence from the continuous images and stored in the FIFO memory in sequence.
可选地,在压缩引擎为空闲状态时,将获取的当前像素点数据发送至压缩引擎,以使压缩引擎对当前像素点数据进行压缩后发送至系统存储器,包括:Optionally, when the compression engine is in an idle state, the acquired current pixel point data is sent to the compression engine, so that the compression engine compresses the current pixel point data and then sends it to the system memory, including:
在压缩引擎为空闲状态时,从FIFO存储器中获取当前像素点数据并发送至压缩引擎,以使压缩引擎对当前像素点数据进行压缩后发送至系统存储器。When the compression engine is in an idle state, the current pixel data is obtained from the FIFO memory and sent to the compression engine, so that the compression engine compresses the current pixel data and then sends it to the system memory.
可选地,在压缩引擎为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块,包括:Optionally, when the compression engine is in a busy state, the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module, including:
在压缩引擎为忙碌状态时,从FIFO存储器中获取当前像素点数据并设定为丢弃像素点数据发送至丢弃像素点处理模块。When the compression engine is in a busy state, the current pixel data is obtained from the FIFO memory and is set as discarded pixel data and sent to the discarded pixel processing module.
可选地,当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎,包括:Optionally, when the current pixel point data is the end pixel point data of a frame of an image, after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in an idle state, obtaining each discarded pixel point data from the discarded pixel point processing module and sending it to the compression engine includes:
当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为忙碌状态时,从FIFO存储器中获取当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并设定为下一帧丢弃像素点数据发送至丢弃像素点处理模块;When the current pixel point data is the pixel point data at the end of a frame of an image, after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in a busy state, the next frame of pixel point data in the next frame of the image where the current pixel point data is located is obtained from the FIFO memory and set as the next frame of discarded pixel point data to be sent to the discarded pixel point processing module;
压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎;When the compression engine is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine;
从FIFO存储器中获取当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并发送至压缩引擎,以使压缩引擎对下一帧像素点数据进行压缩后发送至系统存储器。The next frame of pixel point data in the next frame of the image where the current pixel point data is located is obtained from the FIFO memory and sent to the compression engine, so that the compression engine compresses the next frame of pixel point data and sends it to the system memory.
可选地,从FIFO存储器中获取当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并发送至压缩引擎,以使压缩引擎对下一帧像素点数据进行压缩后发送至系统存储器之后,还包括:Optionally, after obtaining the next frame of pixel point data in the next frame of the image where the current pixel point data is located from the FIFO memory and sending it to the compression engine, so that the compression engine compresses the next frame of pixel point data and sends it to the system memory, it also includes:
当下一帧像素点数据为一帧图像的帧尾像素点数据时,在将下一帧像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各 个下一帧丢弃像素点数据并发送至压缩引擎。When the next frame of pixel data is the end pixel data of a frame of image, after sending the next frame of pixel data to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, the pixel data of each frame is obtained from the discarded pixel processing module. The next frame discards pixel data and sends it to the compression engine.
为解决上述技术问题,本申请实施例提供了一种图像处理系统,包括:In order to solve the above technical problems, the embodiment of the present application provides an image processing system, including:
第一获取单元,被设置为从连续的图像中依次获取各帧图像中的各个像素点数据;A first acquisition unit is configured to sequentially acquire pixel data in each frame of an image from continuous images;
第一发送单元,被设置为在压缩引擎为空闲状态时,将获取的当前像素点数据发送至压缩引擎,以使压缩引擎对当前像素点数据进行压缩后发送至系统存储器;A first sending unit is configured to send the acquired current pixel point data to the compression engine when the compression engine is in an idle state, so that the compression engine compresses the current pixel point data and then sends it to the system memory;
第二发送单元,被设置为在压缩引擎为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块;The second sending unit is configured to set the current pixel data as discarded pixel data and send it to the discarded pixel processing module when the compression engine is in a busy state;
第二获取单元,被设置为当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎或丢弃像素点处理模块后,压缩引擎为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎。The second acquisition unit is configured to, when the current pixel data is the end pixel data of a frame of an image, after sending the current pixel data to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, obtain each discarded pixel data from the discarded pixel processing module and send it to the compression engine.
为解决上述技术问题,本申请实施例提供了一种图像处理装置,包括:In order to solve the above technical problems, the embodiment of the present application provides an image processing device, including:
存储器,被设置为存储计算机程序;a memory arranged to store a computer program;
处理器,被设置为执行计算机程序时实现如上述图像处理方法的步骤。The processor is configured to implement the steps of the above-mentioned image processing method when executing the computer program.
为解决上述技术问题,本申请实施例提供了一种图像压缩装置,包括如上述的图像处理装置,还包括:In order to solve the above technical problems, an embodiment of the present application provides an image compression device, including the above image processing device, and further including:
与处理器连接的压缩引擎,被设置为对像素点数据进行压缩后发送至系统存储器;A compression engine connected to the processor is configured to compress pixel data and then send it to the system memory;
与处理器连接的丢弃像素点处理模块,被设置为缓存各个丢弃像素点数据。The discarded pixel processing module connected to the processor is configured to cache each discarded pixel data.
可选地,丢弃像素点处理模块包括:Optionally, the pixel discarding processing module includes:
与处理器连接的丢弃控制模块,被设置为接收丢弃像素点数据和下一帧丢弃像素点数据并发送至像素丢弃记录模块,或通过像素丢弃记录模块获取丢弃像素点数据和下一帧丢弃像素点数据并发送至处理器;A discard control module connected to the processor is configured to receive discarded pixel data and discarded pixel data of the next frame and send them to the pixel discard recording module, or obtain discarded pixel data and discarded pixel data of the next frame through the pixel discard recording module and send them to the processor;
与丢弃控制模块连接的帧尾信息追加模块,被设置为对各个丢弃像素点数据按照位置数据进行排序,以及对各个下一帧丢弃像素点数据按照位置数据进行排序,以使丢弃控制模块将各个丢弃像素点数据按照顺序或将各个下一帧丢弃像素点数据按照顺序发送至处理器;The frame tail information appending module connected to the discarding control module is configured to sort each discarded pixel point data according to the position data, and sort each next frame discarded pixel point data according to the position data, so that the discarding control module sends each discarded pixel point data in sequence or each next frame discarded pixel point data in sequence to the processor;
与丢弃控制模块连接的像素丢弃记录模块,被设置为将丢弃像素点数据和下一帧丢弃像素点数据存储至丢弃存储器中,或将丢弃存储器中的丢弃像素点数据和下一帧丢弃像素点数据发送至丢弃控制模块;A pixel discarding recording module connected to the discarding control module is configured to store the discarded pixel point data and the discarded pixel point data of the next frame in the discarding memory, or send the discarded pixel point data in the discarding memory and the discarded pixel point data of the next frame to the discarding control module;
与像素丢弃记录模块连接的丢弃存储器,被设置为存储丢弃像素点数据和下一帧丢弃像素点数据。The discarding memory connected to the pixel discarding recording module is configured to store discarded pixel point data and discarded pixel point data of the next frame.
可选地,丢弃存储器包括第一丢弃存储器和第二丢弃存储器; Optionally, the discard memory includes a first discard memory and a second discard memory;
第一丢弃存储器被设置为存储丢弃像素点数据;The first discarding memory is configured to store discarded pixel data;
第二丢弃存储器被设置为存储下一帧丢弃像素点数据。The second discarding memory is configured to store discarded pixel data of the next frame.
可选地,还包括:Optionally, it also includes:
与处理器连接的FIFO存储器,被设置为缓存各帧图像中的各个像素点数据。The FIFO memory connected to the processor is configured to cache the data of each pixel point in each frame of the image.
为解决上述技术问题,本申请实施例提供了一种非易失性可读存储介质,非易失性可读存储介质上存储有计算机程序,计算机程序被处理器执行时实现如上述的图像处理方法的步骤。In order to solve the above technical problems, an embodiment of the present application provides a non-volatile readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the image processing method as described above are implemented.
本申请实施例提供了一种图片处理方法、系统、装置、图像压缩装置及非易失性可读存储介质,涉及图片处理领域。在压缩引擎为空闲状态时,将从连续的图像中获取的各个像素点数据发送至压缩引擎,以对当前像素点数据进行压缩后发送至系统存储器;而在压缩引擎为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块;若当前像素点数据为一帧图像的帧尾像素点数据时,且压缩引擎为空闲状态时,从丢弃像素点处理模块中再获取各个丢弃像素点数据并发送至压缩引擎进行压缩。一方面对每个像素点数据进行压缩,降低了对压缩引擎的性能要求,由于按传输像素点数据进行传输,无需按帧传输,还降低了对存储带宽的占用,还提高了压缩后画面的流畅度。The embodiments of the present application provide a method, system, device, image compression device and non-volatile readable storage medium for image processing, which relate to the field of image processing. When the compression engine is in an idle state, each pixel point data obtained from a continuous image is sent to the compression engine to compress the current pixel point data and then send it to the system memory; when the compression engine is in a busy state, the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module; if the current pixel point data is the end pixel point data of a frame image, and the compression engine is in an idle state, each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine for compression. On the one hand, compressing each pixel point data reduces the performance requirements for the compression engine. Since the transmission is performed according to the transmission pixel point data, there is no need to transmit by frame, which also reduces the occupancy of the storage bandwidth and improves the smoothness of the compressed picture.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本申请实施例中的技术方案,下面将对相关技术和实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the relevant technologies and the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
图1为本申请实施例提供的一种图像处理方法的流程示意图;FIG1 is a schematic diagram of a flow chart of an image processing method provided in an embodiment of the present application;
图2为本申请实施例提供的一种图像处理系统的结构示意图;FIG2 is a schematic diagram of the structure of an image processing system provided in an embodiment of the present application;
图3为本申请实施例提供的一种图像处理装置的结构示意图;FIG3 is a schematic diagram of the structure of an image processing device provided in an embodiment of the present application;
图4为本申请实施例提供的一种图像压缩装置的结构示意图;FIG4 is a schematic diagram of the structure of an image compression device provided in an embodiment of the present application;
图5为本申请实施例提供的非易失性可读存储介质的结构示意图。FIG5 is a schematic diagram of the structure of a non-volatile readable storage medium provided in an embodiment of the present application.
具体实施方式Detailed ways
本申请实施例的核心是提供一种图片处理方法、系统、装置、图像压缩装置及非易失性可读存储介质,一方面对每个像素点数据进行压缩,降低了对压缩引擎的性能要求,由于按 传输像素点数据进行传输,无需按帧传输,还降低了对存储带宽的占用,还提高了压缩后画面的流畅度。The core of the embodiments of the present application is to provide a picture processing method, system, device, image compression device and non-volatile readable storage medium, which compresses the data of each pixel point, reducing the performance requirements of the compression engine. Transmitting pixel data does not need to be transmitted frame by frame, which reduces the storage bandwidth usage and improves the smoothness of the compressed image.
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请实施例保护的范围。In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.
请参照图1,图1为本申请实施例提供的一种图像处理方法的流程示意图,该方法包括:Please refer to FIG. 1 , which is a flow chart of an image processing method provided by an embodiment of the present application, the method comprising:
S11:从连续的图像中依次获取各帧图像中的各个像素点数据;S11: sequentially acquiring pixel data in each frame of the image from the continuous images;
相关技术中在对远程服务器的图像进行压缩时,是将每帧图像进行压缩,压缩后传输至系统存储器进行存储,以便本地设备从系统存储器中获取压缩后的图像并进行显示,但是压缩引擎41在对图像进行压缩时,由于压缩引擎41性能的限制,压缩引擎41对一帧图像进行压缩的效率较低,但是远程服务器的监控图像是连续生成的,若压缩引擎41为忙碌状态,连续生成的图像无法及时进行压缩,只能进行丢弃,将图像丢弃后,本地设备最终显示的画面虽不流畅,但是足以显示远程服务器的状态,因此,相关技术中允许丢帧。In the related art, when compressing an image of a remote server, each frame of the image is compressed and transmitted to the system memory for storage after compression, so that the local device can obtain the compressed image from the system memory and display it. However, when the compression engine 41 compresses the image, due to the performance limitation of the compression engine 41, the efficiency of the compression engine 41 in compressing a frame of the image is low. However, the monitoring image of the remote server is generated continuously. If the compression engine 41 is busy, the continuously generated images cannot be compressed in time and can only be discarded. After the image is discarded, the picture finally displayed by the local device is not smooth, but it is sufficient to show the status of the remote server. Therefore, frame loss is allowed in the related art.
但是,考虑到本地设备显示的画面不流畅时,可能会导致用户错过重要信息,为了提高画面流畅度,并且降低对压缩引擎41的性能的要求,本申请实施例中并非将图像按帧进行压缩,而是从连续的图像中,依次获取各帧图像中的各个像素点数据,也即本申请实施例中是对像素点数据进行压缩,由于一个像素点数据的数据量是小于一帧图像的数据量的,因此,压缩引擎41的性能可以降低,且将压缩后的像素点数据存储至系统存储器中时,由于像素点数据的数据量较小,对存储带宽的占用也较小,便于系统存储器执行其他的算法工作。However, considering that the image displayed by the local device is not smooth, it may cause the user to miss important information. In order to improve the smoothness of the image and reduce the performance requirements of the compression engine 41, the image is not compressed frame by frame in the embodiment of the present application, but each pixel data in each frame image is obtained in sequence from the continuous image, that is, the pixel data is compressed in the embodiment of the present application. Since the data amount of one pixel data is smaller than the data amount of one frame image, the performance of the compression engine 41 can be reduced, and when the compressed pixel data is stored in the system memory, since the data amount of the pixel data is small, the storage bandwidth occupancy is also small, which is convenient for the system memory to execute other algorithm tasks.
S12:在压缩引擎41为空闲状态时,将获取的当前像素点数据发送至压缩引擎41,以使压缩引擎41对当前像素点数据进行压缩后发送至系统存储器;S12: When the compression engine 41 is in an idle state, the acquired current pixel point data is sent to the compression engine 41, so that the compression engine 41 compresses the current pixel point data and then sends it to the system memory;
由于图像是源源不断生成的,压缩引擎41在压缩像素点数据时,由于数据量较多,压缩引擎41可能处于忙碌状态,此时压缩引擎41无法对后续的像素点数据进行压缩,因此,本实施例中只有当压缩引擎41为空闲状态时才会将当前像素点数据发送至压缩引擎41进行压缩。Since images are continuously generated, when the compression engine 41 compresses pixel data, due to the large amount of data, the compression engine 41 may be in a busy state. At this time, the compression engine 41 cannot compress subsequent pixel data. Therefore, in this embodiment, the current pixel data will be sent to the compression engine 41 for compression only when the compression engine 41 is in an idle state.
S13:在压缩引擎41为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块; S13: when the compression engine 41 is in a busy state, the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module;
而当压缩引擎41为忙碌状态时,压缩引擎41无法对当前像素点进行压缩,相关技术中由于压缩引擎41是对一帧图像进行压缩,若压缩引擎41处于忙碌状态,会直接将后续的图像丢弃,直至压缩引擎41空闲后才会对后续的图像进行压缩,但这会因为丢帧导致压缩后的图像不连续,本地设备播放的图像也不连续。When the compression engine 41 is in a busy state, the compression engine 41 cannot compress the current pixel. In the related technology, since the compression engine 41 compresses a frame of image, if the compression engine 41 is in a busy state, the subsequent images will be discarded directly until the compression engine 41 is idle, and the subsequent images will not be compressed. However, this will cause the compressed image to be discontinuous due to frame loss, and the image played by the local device will also be discontinuous.
而本申请实施例中由于是对一帧图像中的各个像素点数据分别进行压缩,不仅降低了对压缩引擎41的性能要求若压缩引擎41当前处于忙碌状态,只将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点数据,并非将一整帧图像都丢弃。In the embodiment of the present application, since each pixel point data in a frame of image is compressed separately, not only the performance requirements for the compression engine 41 are reduced, if the compression engine 41 is currently in a busy state, only the current pixel point data is set to discarded pixel point data and sent to the discarded pixel point data, instead of discarding the entire frame of image.
S14:当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎41。S14: When the current pixel point data is the end pixel point data of a frame of an image, after the current pixel point data is sent to the compression engine 41 or the discarded pixel point processing module, when the compression engine 41 is in an idle state, each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine 41.
若当前像素点数据为一帧图像的帧尾像素点数据,则当前像素点数据所在一帧图像中的各个像素点被压缩引擎41压缩或者被发送至丢弃像素点处理模块,在将当前像素点数据发送至压缩引擎41或者被发送至丢弃像素点处理模块之后,为了保证一帧图像的完整度,待压缩引擎41为空闲状态,再从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎41进行压缩,基于此,虽然一帧图像中的各个像素点数据为乱序压缩,但是各个像素点数据均未被丢弃,本地设备最终显示的图像为完整且连续的图像。If the current pixel data is the end pixel data of a frame of an image, then each pixel in the frame of the image where the current pixel data is located is compressed by the compression engine 41 or sent to the discarded pixel processing module. After the current pixel data is sent to the compression engine 41 or sent to the discarded pixel processing module, in order to ensure the integrity of a frame of the image, the compression engine 41 is idle, and then each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41 for compression. Based on this, although the pixel data in a frame of the image are compressed in disorder, the pixel data are not discarded, and the image finally displayed by the local device is a complete and continuous image.
例如,一帧图像中包括第一至第十个像素点,当然,实际情况下一帧图像中通常包括1024*728个像素点数据,但是为了便于描述,此处以一帧图像包括十个像素点为例。在当前像素点数据为第一个像素点的像素点数据,也即第一个像素点数据时,若压缩引擎41处于空闲状态,则可将第一个像素点数据发送至压缩引擎41进行压缩,而若压缩引擎41正处于忙碌状态,如正在压缩上一帧图像的像素点数据,则将第一个像素点数据设定为丢弃像素点数据发送至丢弃像素点处理模块;无论第一个像素点数据被发送至压缩引擎41或丢弃像素点处理模块,当第二个像素点数据为当前像素点数据时,仍需再次判断压缩引擎41为空闲状态或忙碌状态,若压缩引擎41为空闲状态,则可将第二个像素点数据发送至压缩引擎41进行压缩,若压缩引擎41为忙碌状态,则将第二个像素点数据设定为丢弃像素点数据发送至丢弃像素点处理模块,以此类推,直到当前像素点数据为第十个像素点数据,在将第十个像素点数据发送至压缩引擎41或者丢弃像素点处理模块之后,将丢弃像素点处理模块中的各个丢弃像素点数据在压缩引擎41为空闲状态时发送至压缩引擎41进行压缩。可选地,若第一个、第五个和第七个像素点数据均被设定为丢弃像素点数据,则在将第十个像素点数据发送至压缩引擎41之后,从丢弃像素点处理模块中获取第一个、第五个和第七个像素点 数据对应的丢弃像素点数据在压缩引擎41为空闲状态时发送至压缩引擎41,基于此,系统存储器中存储了一帧图像中的十个像素点数据,能够保证一帧图像的完整度。For example, a frame of image includes the first to tenth pixels. Of course, in actual situations, a frame of image usually includes 1024*728 pixel data, but for ease of description, a frame of image including ten pixels is taken as an example. When the current pixel data is the pixel data of the first pixel, that is, the first pixel data, if the compression engine 41 is in an idle state, the first pixel data can be sent to the compression engine 41 for compression, and if the compression engine 41 is in a busy state, such as compressing the pixel data of the previous frame of image, the first pixel data is set as discarded pixel data and sent to the discarded pixel processing module; no matter whether the first pixel data is sent to the compression engine 41 or the discarded pixel processing module, when the second pixel data is the current pixel data, it is still necessary to judge again whether the compression engine 41 is in an idle state. 1 is an idle state or a busy state. If the compression engine 41 is in an idle state, the second pixel point data can be sent to the compression engine 41 for compression. If the compression engine 41 is in a busy state, the second pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module. This is repeated until the current pixel point data is the tenth pixel point data. After the tenth pixel point data is sent to the compression engine 41 or the discarded pixel point processing module, each discarded pixel point data in the discarded pixel point processing module is sent to the compression engine 41 for compression when the compression engine 41 is in an idle state. Optionally, if the first, fifth and seventh pixel point data are all set as discarded pixel point data, after the tenth pixel point data is sent to the compression engine 41, the first, fifth and seventh pixel point data are obtained from the discarded pixel point processing module. The discarded pixel data corresponding to the data is sent to the compression engine 41 when the compression engine 41 is in an idle state. Based on this, the system memory stores ten pixel data in a frame of image, which can ensure the integrity of a frame of image.
综上,在压缩引擎41为空闲状态时,将从连续的图像中获取的各个像素点数据发送至压缩引擎41,以对当前像素点数据进行压缩后发送至系统存储器;而在压缩引擎41为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块;若当前像素点数据为一帧图像的帧尾像素点数据时,且压缩引擎41为空闲状态时,从丢弃像素点处理模块中再获取各个丢弃像素点数据并发送至压缩引擎41进行压缩。一方面对每个像素点数据进行压缩,降低了对压缩引擎41的性能要求,由于按传输像素点数据进行传输,无需按帧传输,还降低了对存储带宽的占用,还提高了压缩后画面的流畅度。In summary, when the compression engine 41 is in an idle state, each pixel point data obtained from the continuous image is sent to the compression engine 41, so as to compress the current pixel point data and then send it to the system memory; when the compression engine 41 is in a busy state, the current pixel point data is set as the discarded pixel point data and sent to the discarded pixel point processing module; if the current pixel point data is the end pixel point data of a frame image, and the compression engine 41 is in an idle state, each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine 41 for compression. On the one hand, compressing each pixel point data reduces the performance requirements of the compression engine 41. Since the transmission is performed according to the transmission pixel point data, it is not necessary to transmit by frame, which also reduces the occupancy of the storage bandwidth and improves the smoothness of the compressed picture.
在上述实施例的基础上:Based on the above embodiments:
作为一种可选的实施例,像素点数据包括在一帧图像中的位置数据和色彩数据;As an optional embodiment, the pixel point data includes position data and color data in a frame of image;
当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎41,包括:When the current pixel data is the end pixel data of a frame of an image, after sending the current pixel data to the compression engine 41 or the discarded pixel processing module, when the compression engine 41 is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41, including:
基于当前像素点数据的位置数据判断当前像素点数据是否位于一帧图像的帧尾;Determining whether the current pixel point data is located at the end of a frame of an image based on the position data of the current pixel point data;
在当前像素点数据位于一帧图像的帧尾的情况下,则当前像素点数据为一帧图像的帧尾像素点数据;When the current pixel point data is located at the end of a frame of an image, the current pixel point data is the end pixel point data of the frame of an image;
在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎41。After the current pixel data is sent to the compression engine 41 or the discarded pixel processing module, when the compression engine 41 is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41.
本申请实施例中一帧图像中的各个像素点数据均包括位置数据和色彩数据,也即一个像素点数据在一帧图像中的位置以及该位置的颜色,基于此,不同位置的不同或相同的颜色构成一帧图像。In the embodiment of the present application, each pixel point data in a frame of image includes position data and color data, that is, the position of a pixel point data in a frame of image and the color of the position. Based on this, different or same colors at different positions constitute a frame of image.
基于此,可以通过各个像素点数据中的位置数据确定是否为帧尾像素点数据,或者根据一帧图像中的像素点个数,并根据当前像素点数据的位置数据确定当前像素点数据的顺序,以确定当前像素点数据是否为一帧图像的帧尾像素点数据。Based on this, whether it is the end pixel data of a frame can be determined by the position data in each pixel data, or the order of the current pixel data can be determined according to the number of pixels in a frame image and the position data of the current pixel data to determine whether the current pixel data is the end pixel data of a frame image.
在当前像素点数据为帧尾像素点数据时,可以确定一帧图像中的各个像素点数据均已被发送至压缩引擎41进行压缩或者被发送至丢弃像素点处理模块,为了保证一帧图像的完整性,在将帧尾像素点数据进行压缩或者丢弃后,再从丢弃像素点处理模块将丢弃的各个像素点数据提取回来,虽然系统存储器中一帧图像的各个像素点数据不是按照在一帧图像中的位置顺序存储的,但是由于像素点数据中包括了像素点的位置数据,本地设备在从系统存储器 中获取了压缩的一帧图像中的各个像素点数据后,可根据各个像素点数据中的位置数据确定一帧图像中各个位置的色彩数据,从而还原压缩前的图像。When the current pixel data is the end pixel data of the frame, it can be determined that all pixel data in a frame of image have been sent to the compression engine 41 for compression or sent to the discarded pixel processing module. In order to ensure the integrity of a frame of image, after the end pixel data of the frame is compressed or discarded, the discarded pixel data are extracted from the discarded pixel processing module. Although the pixel data of a frame of image in the system memory are not stored in the order of their positions in the frame of image, since the pixel data includes the position data of the pixel, the local device can extract the pixel data from the system memory. After obtaining the data of each pixel point in a compressed frame of image, the color data of each position in the frame of image can be determined according to the position data in the data of each pixel point, so as to restore the image before compression.
作为一种可选的实施例,从连续的图像中依次获取各帧图像中的各个像素点数据,包括:As an optional embodiment, sequentially acquiring pixel data in each frame of the image from the continuous images includes:
按照连续的各帧图像的各个像素点的位置依次获取各个像素点的色彩数据,并基于各个像素点在一帧图像中的位置确定像素点的位置数据;Acquire color data of each pixel point in sequence according to the position of each pixel point in each consecutive frame image, and determine the position data of the pixel point based on the position of each pixel point in a frame image;
基于色彩数据和位置数据确定像素点数据。The pixel data is determined based on the color data and the position data.
本实施例中,在从连续的图像中获取各帧图像的各个像素点数据时,由于一帧图像中各个位置的像素点都有自身的颜色,而一帧图像由不同位置的像素点的颜色构成,因此,在生成像素点数据时,确定一帧图像中各个像素点的位置数据,以及一帧图像中各个位置的颜色,从而确定各个位置的色彩数据,根据位置数据和色彩数据便可确定像素点数据。In this embodiment, when obtaining the pixel data of each frame of images from a continuous image, since the pixels at each position in a frame of images have their own colors, and a frame of images is composed of the colors of pixels at different positions, when generating pixel data, the position data of each pixel in a frame of images and the color of each position in a frame of images are determined, thereby determining the color data of each position, and the pixel data can be determined based on the position data and the color data.
作为一种可选的实施例,在压缩引擎41为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块,包括:As an optional embodiment, when the compression engine 41 is in a busy state, the current pixel point data is set as discarded pixel point data and sent to the discarded pixel point processing module, including:
在压缩引擎41为忙碌状态时,记录当前像素点数据的位置数据为最末丢弃像素点位置数据,并将当前像素点数据设定为丢弃像素点数据发送至丢弃像素点处理模块。When the compression engine 41 is in a busy state, the position data of the current pixel data is recorded as the last discarded pixel position data, and the current pixel data is set as the discarded pixel data and sent to the discarded pixel processing module.
本实施例中,每次将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块时,将当前像素点数据的位置数据记录为最末丢弃像素点位置数据,如当第一个像素点数据为当前像素点数据,但压缩引擎41为忙碌状态时,将第一个像素点数据的位置数据记录为最末丢弃像素点位置数据,并将第一个像素点数据设定为丢弃像素点数据发送至丢弃像素点处理模块,但是,若第一个像素点数据的位置数据被设定为最末丢弃像素点位置数据之后,第二个像素点数据正常压缩,而第三个像素点数据为当前像素点数据时压缩引擎41又处于忙碌状态,则第三个像素点数据的位置数据被记录为最末丢弃像素点位置数据,并将第三个像素点数据设定为丢弃像素点数据发送至丢弃像素点处理模块,也即第一个像素点数据和第三个像素点数据均为丢弃像素点数据,但是只有第三个像素点的位置数据被更新为最末丢弃像素点位置数据,也即一帧图像中,最后一个被设定为丢弃像素点数据的像素点数据的位置数据为最末丢弃像素点位置数据。In this embodiment, each time the current pixel data is set as discarded pixel data and sent to the discarded pixel processing module, the position data of the current pixel data is recorded as the last discarded pixel position data. For example, when the first pixel data is the current pixel data, but the compression engine 41 is in a busy state, the position data of the first pixel data is recorded as the last discarded pixel position data, and the first pixel data is set as discarded pixel data and sent to the discarded pixel processing module. However, if after the position data of the first pixel data is set as the last discarded pixel position data, the second pixel data is compressed normally, and when the third pixel data is the current pixel data and the compression engine 41 is in a busy state, the position data of the third pixel data is recorded as the last discarded pixel position data, and the third pixel data is set as discarded pixel data and sent to the discarded pixel processing module, that is, the first pixel data and the third pixel data are both discarded pixel data, but only the position data of the third pixel is updated to the last discarded pixel position data, that is, in a frame of image, the position data of the last pixel data set as discarded pixel data is the last discarded pixel position data.
基于此,可以确定一帧图像中最后一个位置数据被设定为丢弃像素点位置数据的像素点数据,以便在丢弃像素点处理模块中获取所有的丢弃像素点数据,不造成遗漏。Based on this, it can be determined that the last position data in a frame of image is set as pixel data of discarded pixel position data, so that all discarded pixel data can be obtained in the discarded pixel processing module without omission.
作为一种可选的实施例,在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发 送至压缩引擎41,包括:As an optional embodiment, after sending the current pixel data to the compression engine 41 or the discarded pixel processing module, when the compression engine 41 is in an idle state, the discarded pixel data are obtained from the discarded pixel processing module and the discarded pixel data are processed. Sent to compression engine 41, including:
在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,按照各个丢弃像素点数据的位置数据的顺序依次获取各个丢弃像素点数据,直至获取到位置数据为最末丢弃像素点位置数据的丢弃像素点数据并发送至空闲状态的压缩引擎41。After the current pixel point data is sent to the compression engine 41 or the discarded pixel point processing module, each discarded pixel point data is obtained in sequence according to the order of the position data of each discarded pixel point data until the discarded pixel point data whose position data is the last discarded pixel point position data is obtained and sent to the compression engine 41 in the idle state.
由于设置了最末丢弃像素点位置数据,在从丢弃像素点处理模块中获取丢弃像素点数据时,可按照各个丢弃像素点数据的位置数据的顺序,依次获取各个丢弃像素点数据,如一帧图像中只有第一个、第三个以及第七个像素点数据为丢弃像素点数据,而第七个像素点数据的位置数据为最末丢弃像素点位置数据,在将第十个像素点数据压缩完成后,当压缩引擎41空闲时,先获取第一个像素点数据对应的丢弃像素点数据进行压缩,再获取第三个像素点数据对应的丢弃像素点数据进行压缩,在获取第七个像素点数据对应的丢弃像素点数据时,确定第七个像素点数据的位置数据为最末丢弃像素点位置数据,在将第七个像素点数据进行压缩后,可以确定丢弃像素点处理模块中已不存在当前像素点数据所在一帧图像中的像素点数据,一帧图像压缩存储完成,可进行下一帧图像的像素点数据的压缩。Since the last discarded pixel position data is set, when the discarded pixel data is obtained from the discarded pixel processing module, each discarded pixel data can be obtained in sequence according to the order of the position data of each discarded pixel data. For example, in a frame of image, only the first, third and seventh pixel data are discarded pixel data, and the position data of the seventh pixel data is the last discarded pixel position data. After the compression of the tenth pixel data is completed, when the compression engine 41 is idle, the discarded pixel data corresponding to the first pixel data is first obtained for compression, and then the discarded pixel data corresponding to the third pixel data is obtained for compression. When the discarded pixel data corresponding to the seventh pixel data is obtained, the position data of the seventh pixel data is determined to be the last discarded pixel position data. After the seventh pixel data is compressed, it can be determined that the pixel data in the frame of image where the current pixel data is located no longer exists in the discarded pixel processing module. The compression and storage of one frame of image is completed, and the compression of the pixel data of the next frame of image can be performed.
基于此,通过设置最末丢弃像素点位置数据,可以确定丢弃像素点处理模块中是否还有一帧图像中的丢弃像素点数据,从而避免在不确定丢弃像素点处理模块中是否还有丢弃像素点数据时导致压缩效率的降低。Based on this, by setting the last discarded pixel position data, it can be determined whether there is any discarded pixel data in a frame of image in the discarded pixel processing module, thereby avoiding a decrease in compression efficiency when it is uncertain whether there is any discarded pixel data in the discarded pixel processing module.
作为一种可选的实施例,从连续的图像中依次获取各帧图像中的各个像素点数据,包括:As an optional embodiment, sequentially acquiring pixel data in each frame of the image from the continuous images includes:
将连续的图像中依次获取各帧图像中的各个像素点数据依次存储至FIFO(First In First Out,先进先出)存储器47中;The pixel data of each frame image is obtained in sequence from the continuous image and stored in the FIFO (First In First Out) memory 47 in sequence;
在压缩引擎41为空闲状态时,将获取的当前像素点数据发送至压缩引擎41,以使压缩引擎41对当前像素点数据进行压缩后发送至系统存储器,包括:When the compression engine 41 is in an idle state, the acquired current pixel point data is sent to the compression engine 41, so that the compression engine 41 compresses the current pixel point data and then sends it to the system memory, including:
在压缩引擎41为空闲状态时,从FIFO存储器47中获取当前像素点数据并发送至压缩引擎41,以使压缩引擎41对当前像素点数据进行压缩后发送至系统存储器;When the compression engine 41 is in an idle state, the current pixel data is obtained from the FIFO memory 47 and sent to the compression engine 41, so that the compression engine 41 compresses the current pixel data and sends it to the system memory;
在压缩引擎41为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块,包括:When the compression engine 41 is in a busy state, the current pixel data is set as discarded pixel data and sent to the discarded pixel processing module, including:
在压缩引擎41为忙碌状态时,从FIFO存储器47中获取当前像素点数据并设定为丢弃像素点数据发送至丢弃像素点处理模块。When the compression engine 41 is in a busy state, the current pixel data is obtained from the FIFO memory 47 and is set as discarded pixel data to be sent to the discarded pixel processing module.
本实施例中,考虑到在对远程服务器进行监控时,监控图像为按照时间顺序生成且源源不断的,因此,各帧图像中的像素点数据也是不间断的,为了对各个像素点数据进行缓存, 将连续的各帧图像中的各个像素点数据依次存储至FIFO存储器47,在将像素点数据发送至压缩引擎41或者丢弃像素点处理模块中时,从FIFO存储器47中获取像素点数据作为当前像素点数据,待当前像素点数据发送至压缩引擎41或者丢弃像素点处理模块中后,从FIFO存储器47中获取的下一个像素点数据即为当前像素点数据。In this embodiment, considering that when monitoring a remote server, the monitoring images are generated in a time sequence and continuously, therefore, the pixel data in each frame of the image is also uninterrupted. In order to cache the pixel data, The pixel data in each continuous frame image are stored in the FIFO memory 47 in sequence. When the pixel data is sent to the compression engine 41 or the pixel discarding processing module, the pixel data is obtained from the FIFO memory 47 as the current pixel data. After the current pixel data is sent to the compression engine 41 or the pixel discarding processing module, the next pixel data obtained from the FIFO memory 47 is the current pixel data.
基于此,通过FIFO存储器47对像素点数据进行缓存,能够避免像素点数据较多时,像素点数据被丢弃的概率,当然,FIFO存储器47的存储上限可由用户根据一帧图像的像素点数据自行设定。Based on this, by caching pixel data through FIFO memory 47, the probability of pixel data being discarded can be avoided when there is a lot of pixel data. Of course, the storage upper limit of FIFO memory 47 can be set by the user according to the pixel data of a frame of image.
作为一种可选的实施例,当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎41,包括:As an optional embodiment, when the current pixel point data is the end pixel point data of a frame of an image, after sending the current pixel point data to the compression engine 41 or the discarded pixel point processing module, when the compression engine 41 is in an idle state, each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine 41, including:
当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为忙碌状态时,从FIFO存储器47中获取当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并设定为下一帧丢弃像素点数据发送至丢弃像素点处理模块;When the current pixel data is the end pixel data of a frame of an image, after sending the current pixel data to the compression engine 41 or the discarded pixel processing module, when the compression engine 41 is in a busy state, the next frame of pixel data in the next frame of the image where the current pixel data is located is obtained from the FIFO memory 47 and set as the next frame of discarded pixel data to be sent to the discarded pixel processing module;
压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎41;When the compression engine 41 is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41;
从FIFO存储器47中获取当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并发送至压缩引擎41,以使压缩引擎41对下一帧像素点数据进行压缩后发送至系统存储器。The next frame of pixel data in the next frame of the image where the current pixel data is located is obtained from the FIFO memory 47 and sent to the compression engine 41, so that the compression engine 41 compresses the next frame of pixel data and sends it to the system memory.
本实施例中,考虑到各帧图像均为连续的,若当前像素点数据为帧尾像素点数据,且当前像素点数据被发送至丢弃像素点处理模块之后,当前像素点数据的位置数据被记录为最末丢弃像素点位置数据,并被设定为丢弃像素点数据发送至丢弃像素点处理模块,但是,之后当前像素点数据所在一帧图像的下一帧图像中的下一帧像素点数据也被获取到,例如当前像素点数据所在一帧图像为第一帧图像,第一帧图像中的帧尾像素点顺序已被发送至压缩引擎41或丢弃像素点处理模块,在获取第二帧图像的第一个像素点数据作为当前像素点数据后压缩引擎41仍为忙碌状态,将第二帧图像的第一个像素点数据设定为下一帧丢弃像素点数据发送至丢弃像素点处理模块,以此类推,直至压缩引擎41为空闲状态,则先从丢弃像素点处理模块中获取第一帧图像中的丢弃像素点数据发送至压缩引擎41进行压缩,但是,第一帧图像中的各个像素点数据均压缩完成后,并非先获取丢弃像素点数据中的下一帧丢弃像素点数据进行压缩,而是继续从FIFO存储器47中获取下一帧图像中的下一帧像素点数据 进行压缩。In this embodiment, considering that each frame image is continuous, if the current pixel point data is the frame end pixel point data, and after the current pixel point data is sent to the discarded pixel point processing module, the position data of the current pixel point data is recorded as the last discarded pixel point position data, and is set as the discarded pixel point data to be sent to the discarded pixel point processing module. However, thereafter, the next frame pixel point data in the next frame image of the frame image where the current pixel point data is located is also obtained. For example, the frame image where the current pixel point data is located is the first frame image, and the frame end pixel point sequence in the first frame image has been sent to the compression engine 41 or the discarded pixel point processing module. When the second frame image is obtained, After the first pixel point data of the image is taken as the current pixel point data, the compression engine 41 is still in a busy state, and the first pixel point data of the second frame image is set as the discarded pixel point data of the next frame and sent to the discarded pixel point processing module, and so on, until the compression engine 41 is in an idle state, the discarded pixel point data in the first frame image is first obtained from the discarded pixel point processing module and sent to the compression engine 41 for compression. However, after the compression of each pixel point data in the first frame image is completed, the next frame of discarded pixel point data in the discarded pixel point data is not obtained first for compression, but the next frame of pixel point data in the next frame image is continuously obtained from the FIFO memory 47. to compress.
基于此,可以将连续的各帧图像分别进行压缩,且保证每一帧图像的完整度。Based on this, each continuous frame image can be compressed separately, and the integrity of each frame image is guaranteed.
作为一种可选的实施例,从FIFO存储器47中获取当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并发送至压缩引擎41,以使压缩引擎41对下一帧像素点数据进行压缩后发送至系统存储器之后,还包括:As an optional embodiment, after obtaining the next frame of pixel point data in the next frame of the image where the current pixel point data is located from the FIFO memory 47 and sending it to the compression engine 41, so that the compression engine 41 compresses the next frame of pixel point data and sends it to the system memory, it also includes:
当下一帧像素点数据为一帧图像的帧尾像素点数据时,在将下一帧像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个下一帧丢弃像素点数据并发送至压缩引擎41。When the next frame pixel data is the frame end pixel data of a frame image, after the next frame pixel data is sent to the compression engine 41 or the discarded pixel processing module, when the compression engine 41 is in an idle state, each next frame discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine 41.
本实施例中,在将下一帧图像的帧尾像素点数据发送至压缩引擎41或者丢弃像素点数据之后,若压缩引擎41为空闲状态,再从丢弃像素点处理模块中获取各个下一帧丢弃像素点数据并发送至压缩引擎41进行压缩。In this embodiment, after the frame tail pixel data of the next frame image is sent to the compression engine 41 or the pixel data is discarded, if the compression engine 41 is in an idle state, the discarded pixel data of each next frame is obtained from the discarded pixel processing module and sent to the compression engine 41 for compression.
可选地,例如第一帧图像中的各个像素点数据均压缩完成,第二帧图像中只有第一个像素点数据、第二个像素点数据和第三个像素点数据被设为下一帧丢弃像素点数据发送至丢弃像素点处理模块,那么在将下第二帧图像中的帧尾像素点数据压缩完成后,压缩引擎41空闲状态时,再从丢弃像素点处理模块中获取各个下一帧丢弃像素点数据进行压缩,以实现对第二帧图像中各个像素点数据的压缩。Optionally, for example, all pixel data in the first frame image are compressed, and only the first pixel data, the second pixel data and the third pixel data in the second frame image are set as the discarded pixel data of the next frame and sent to the discarded pixel processing module. Then, after the compression of the frame tail pixel data in the second frame image is completed, when the compression engine 41 is in an idle state, each next frame of discarded pixel data is obtained from the discarded pixel processing module for compression to achieve compression of each pixel data in the second frame image.
基于此,本申请实施例中不仅能保证一帧图像中的各个像素点不遗漏地全部被压缩完成,还能够将连续多帧图像的像素点数据按帧压缩,以保证图像的连续完整性。Based on this, the embodiment of the present application can not only ensure that all pixels in a frame of image are compressed without omission, but also compress the pixel data of multiple consecutive frames of images by frame to ensure the continuity and integrity of the image.
还需要说明的是,本申请实施例中的系统存储器为DDR(或称为,DDR SRAM(Dual Rate Synchronous Dynamic Random Access Memory,双倍速率同步动态随机存储器)),而压缩引擎41在将压缩后的像素点数据发送至系统存储器中时,需要DDR控制器在其中进行中转处理,因此,每存储一个压缩后的像素点数据系统存储器便需要占用DDR控制器,也即占用存储带宽,但是由于一个像素点数据的数据量远小于一帧图像的数据量,因此,本申请实施例中对存储带宽的占用时间更短。It should also be noted that the system memory in the embodiment of the present application is DDR (or called DDR SRAM (Dual Rate Synchronous Dynamic Random Access Memory)), and when the compression engine 41 sends the compressed pixel data to the system memory, the DDR controller is required to perform transit processing therein. Therefore, each system memory that stores a compressed pixel data needs to occupy the DDR controller, that is, occupy the storage bandwidth. However, since the amount of data of a pixel data is much smaller than the amount of data of a frame of image, the storage bandwidth is occupied for a shorter time in the embodiment of the present application.
此外,本申请实施例中在获取像素点数据时可以由图像获取模块进行获取,在确定当前像素点数据应发送至压缩引擎41或丢弃像素点处理模块时,可由帧率控制模块进行。In addition, in the embodiment of the present application, the image acquisition module can acquire pixel data, and the frame rate control module can determine whether the current pixel data should be sent to the compression engine 41 or the pixel processing module should be discarded.
作为一种可选的实施例,还包括:As an optional embodiment, it also includes:
从系统存储器中获取各个压缩后的像素点数据并进行解压处理;Obtaining each compressed pixel data from the system memory and performing decompression processing;
基于解压处理后的各个像素点数据中的位置数据还原各帧图像。Each frame of image is restored based on the position data in each pixel point data after decompression.
作为一种可选的实施例,基于解压处理后的各个像素点数据中的位置数据还原各帧图 像,包括:As an optional embodiment, each frame image is restored based on the position data of each pixel point data after decompression. Like, including:
按照解压处理后的各个像素点数据中的位置数据确定各个像素点在一帧图像中的位置,以还原各帧图像。The position of each pixel point in a frame of image is determined according to the position data in each pixel point data after decompression, so as to restore each frame of image.
而在将各帧图像中的像素点数据均进行压缩存储至DDR中后,本地设备在从DDR中获取图像时,可以通过网络模块从利用图像获取处理器32获取DDR中的各帧图像的压缩后的像素点数据,并对像素点数据进行解压,按照各个像素点数据的位置数据对各帧图像进行恢复,以显示连续且清晰的图像。After the pixel data in each frame image are compressed and stored in the DDR, when the local device obtains the image from the DDR, it can obtain the compressed pixel data of each frame image in the DDR from the image acquisition processor 32 through the network module, decompress the pixel data, and restore each frame image according to the position data of each pixel data to display a continuous and clear image.
请参照图2,图2为本申请实施例提供的一种图像处理系统的结构示意图,该系统包括:Please refer to FIG. 2 , which is a schematic diagram of the structure of an image processing system provided in an embodiment of the present application, the system comprising:
第一获取单元21,被设置为从连续的图像中依次获取各帧图像中的各个像素点数据;The first acquisition unit 21 is configured to sequentially acquire pixel data in each frame of the image from the continuous images;
第一发送单元22,被设置为在压缩引擎41为空闲状态时,将获取的当前像素点数据发送至压缩引擎41,以使压缩引擎41对当前像素点数据进行压缩后发送至系统存储器;The first sending unit 22 is configured to send the acquired current pixel data to the compression engine 41 when the compression engine 41 is in an idle state, so that the compression engine 41 compresses the current pixel data and then sends it to the system memory;
第二发送单元23,被设置为在压缩引擎41为忙碌状态时,将当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块;The second sending unit 23 is configured to set the current pixel data as discarded pixel data and send it to the discarded pixel processing module when the compression engine 41 is in a busy state;
第二获取单元24,被设置为当当前像素点数据为一帧图像的帧尾像素点数据时,在将当前像素点数据发送至压缩引擎41或丢弃像素点处理模块后,压缩引擎41为空闲状态时,从丢弃像素点处理模块中获取各个丢弃像素点数据并发送至压缩引擎41。The second acquisition unit 24 is configured to, when the current pixel data is the end pixel data of a frame of an image, after sending the current pixel data to the compression engine 41 or the discarded pixel processing module, when the compression engine 41 is in an idle state, obtain each discarded pixel data from the discarded pixel processing module and send it to the compression engine 41.
对于本申请实施例提供的一种图像处理系统的详细介绍请参照上述方法实施例,本申请实施例在此不再赘述。For a detailed introduction to an image processing system provided in an embodiment of the present application, please refer to the above method embodiment, and the embodiment of the present application will not be described in detail here.
请参照图3,图3为本申请实施例提供的一种图像处理装置的结构示意图,该装置包括:Please refer to FIG. 3 , which is a schematic diagram of the structure of an image processing device provided in an embodiment of the present application, the device comprising:
存储器31,被设置为存储计算机程序;A memory 31, configured to store computer programs;
处理器32,被设置为执行计算机程序时实现如上述图像处理方法的步骤。The processor 32 is configured to implement the steps of the above-mentioned image processing method when executing the computer program.
对于本申请实施例提供的一种图像处理装置的详细介绍请参照上述方法实施例,本申请实施例在此不再赘述。For a detailed introduction to an image processing device provided in an embodiment of the present application, please refer to the above method embodiment, and the embodiment of the present application will not be described in detail here.
请参照图4,图4为本申请实施例提供的一种图像压缩装置的结构示意图,该装置包括如上述的图像处理装置,还包括:Please refer to FIG. 4 , which is a schematic diagram of the structure of an image compression device provided in an embodiment of the present application. The device includes the image processing device as described above, and further includes:
与处理器32连接的压缩引擎41,被设置为对像素点数据进行压缩后发送至系统存储器;A compression engine 41 connected to the processor 32 is configured to compress pixel data and then send it to the system memory;
与处理器32连接的丢弃像素点处理模块,被设置为缓存各个丢弃像素点数据。 The discarded pixel processing module connected to the processor 32 is configured to cache each discarded pixel data.
本实施例中的压缩引擎41被设置为对各帧图像中的像素点数据进行压缩,并将压缩后的像素点数据发送至系统存储器,但是当系统存储器被占用时,压缩引擎41无法将压缩后的像素点数据发送至系统存储器,此时压缩引擎41为忙碌状态,后续的像素点数据只得被作为丢弃像素点数据发送至丢弃像素点处理模块。The compression engine 41 in this embodiment is configured to compress the pixel data in each frame image and send the compressed pixel data to the system memory. However, when the system memory is occupied, the compression engine 41 cannot send the compressed pixel data to the system memory. At this time, the compression engine 41 is busy, and subsequent pixel data can only be sent to the discarded pixel processing module as discarded pixel data.
而丢弃像素点处理模块被设置为缓存各个丢弃像素点数据,可选地,主要功能包括接收各个丢弃像素点数据,或者在处理器32获取丢弃像素点数据时将各个像素点数据发送至处理器32。The discarded pixel processing module is configured to cache each discarded pixel data. Optionally, the main function includes receiving each discarded pixel data, or sending each pixel data to the processor 32 when the processor 32 obtains the discarded pixel data.
此外,对于本申请实施例提供的一种图像压缩装置的详细介绍请参照上述方法实施例,本申请实施例在此不再赘述。In addition, for a detailed introduction to an image compression device provided in an embodiment of the present application, please refer to the above method embodiment, and the embodiment of the present application will not be repeated here.
作为一种可选的实施例,丢弃像素点处理模块包括:As an optional embodiment, the pixel discarding processing module includes:
与处理器32连接的丢弃控制模块42,被设置为接收丢弃像素点数据和下一帧丢弃像素点数据并发送至像素丢弃记录模块44,或通过像素丢弃记录模块44获取丢弃像素点数据和下一帧丢弃像素点数据并发送至处理器32;The discard control module 42 connected to the processor 32 is configured to receive the discarded pixel data and the discarded pixel data of the next frame and send them to the pixel discard recording module 44, or obtain the discarded pixel data and the discarded pixel data of the next frame through the pixel discard recording module 44 and send them to the processor 32;
与丢弃控制模块42连接的帧尾信息追加模块43,被设置为对各个丢弃像素点数据按照位置数据进行排序,以及对各个下一帧丢弃像素点数据按照位置数据进行排序,以使丢弃控制模块42将各个丢弃像素点数据按照顺序或将各个下一帧丢弃像素点数据按照顺序发送至处理器32;The frame tail information appending module 43 connected to the discarding control module 42 is configured to sort each discarded pixel point data according to the position data, and sort each next frame discarded pixel point data according to the position data, so that the discarding control module 42 sends each discarded pixel point data in sequence or each next frame discarded pixel point data in sequence to the processor 32;
与丢弃控制模块42连接的像素丢弃记录模块44,被设置为将丢弃像素点数据和下一帧丢弃像素点数据存储至丢弃存储器中,或将丢弃存储器中的丢弃像素点数据和下一帧丢弃像素点数据发送至丢弃控制模块42;The pixel discarding recording module 44 connected to the discarding control module 42 is configured to store the discarded pixel data and the discarded pixel data of the next frame in the discarding memory, or send the discarded pixel data in the discarding memory and the discarded pixel data of the next frame to the discarding control module 42;
与像素丢弃记录模块44连接的丢弃存储器,被设置为存储丢弃像素点数据和下一帧丢弃像素点数据。The discarding memory connected to the pixel discarding recording module 44 is configured to store discarded pixel point data and discarded pixel point data of the next frame.
本实施例中的丢弃像素点处理模块包括丢弃控制模块42、帧尾信息追加模块43、像素丢弃记录模块44和丢弃存储器,丢弃控制模块42主要根据处理器32的将丢弃像素点数据发送至丢弃像素点处理模块的请求接收丢弃像素点数据或下一帧丢弃像素点数据,或者根据处理器32的从丢弃像素点处理模块中获取丢弃像素点数据的请求将各个丢弃像素点数据或下一帧丢弃像素点数据发送至处理器32,而帧尾追加模块通过对各个丢弃像素点数据以及各个下一帧丢弃像素点数据分别进行排序,能够使处理器32按照位置顺序接收各个丢弃像素点数据获各个下一帧丢弃像素点数据,以减小像素点数据的乱序程度,减轻处理器32的工作量。 The discarded pixel processing module in this embodiment includes a discard control module 42, a frame tail information appending module 43, a pixel discard recording module 44 and a discard memory. The discard control module 42 mainly receives discarded pixel data or the next frame of discarded pixel data according to the request of the processor 32 to send the discarded pixel data to the discarded pixel processing module, or sends each discarded pixel data or the next frame of discarded pixel data to the processor 32 according to the request of the processor 32 to obtain the discarded pixel data from the discarded pixel processing module. The frame tail appending module can enable the processor 32 to receive each discarded pixel data and each next frame of discarded pixel data in order of position by sorting each discarded pixel data and each next frame of discarded pixel data respectively, so as to reduce the disorder of the pixel data and reduce the workload of the processor 32.
而本实施例中的像素丢弃记录模块44,主要将弃像素点数据和下一帧丢弃像素点数据存储至丢弃存储器中,或将丢弃存储器中的丢弃像素点数据和下一帧丢弃像素点数据发送至丢弃控制模块42。The pixel discarding recording module 44 in this embodiment mainly stores the discarded pixel data and the discarded pixel data of the next frame in the discarding memory, or sends the discarded pixel data in the discarding memory and the discarded pixel data of the next frame to the discarding control module 42.
需要说明的是,本申请实施例中的丢弃控制模块42、帧尾信息追加模块43、像素丢弃记录模块44可以但不限定为通过门电路或者硬件链路实现。It should be noted that the discard control module 42, the frame end information appending module 43, and the pixel discard recording module 44 in the embodiment of the present application can be, but are not limited to, implemented through gate circuits or hardware links.
作为一种可选的实施例,丢弃存储器包括第一丢弃存储器45和第二丢弃存储器46;As an optional embodiment, the discard memory includes a first discard memory 45 and a second discard memory 46;
第一丢弃存储器45被设置为存储丢弃像素点数据;The first discarding memory 45 is configured to store discarded pixel data;
第二丢弃存储器46被设置为存储下一帧丢弃像素点数据。The second discarding memory 46 is configured to store discarded pixel data of the next frame.
本实施例中考虑到在两帧图像的像素点数据的交界处,如第一帧图像的帧尾像素点数据被设定为丢弃像素点数据发送至丢弃像素点处理模块,第二帧图像的帧头像素点数据被设定为下一帧丢弃像素点数据发送至丢弃像素点处理模块,为了区分两帧图像中的丢弃像素点数据,设置了两个丢弃存储器,分别存储不同图像中的丢弃像素点数据,以保证不同的图像在像素点数据压缩后均为完整且准确的。In this embodiment, it is taken into consideration that at the junction of the pixel data of two frames of images, for example, the frame tail pixel data of the first frame image is set as the discarded pixel data and sent to the discarded pixel processing module, and the frame head pixel data of the second frame image is set as the next frame discarded pixel data and sent to the discarded pixel processing module. In order to distinguish the discarded pixel data in the two frames of images, two discarding memories are set to respectively store the discarded pixel data in different images, so as to ensure that different images are complete and accurate after the pixel data are compressed.
作为一种可选的实施例,还包括:As an optional embodiment, it also includes:
与处理器32连接的FIFO存储器47,被设置为缓存各帧图像中的各个像素点数据。The FIFO memory 47 connected to the processor 32 is configured to cache the data of each pixel point in each frame image.
本实施例中还设置了FIFO存储器47,为了缓存连续的各帧图像中的各个像素点数据,以减小处理器32的数据缓存压力,提高处理器32的性能。In this embodiment, a FIFO memory 47 is also provided to cache the data of each pixel point in each consecutive frame image, so as to reduce the data cache pressure of the processor 32 and improve the performance of the processor 32.
请参照图5,图5为本申请实施例提供的非易失性可读存储介质的结构示意图。图5所示的非易失性可读存储介质上存储有计算机程序,计算机程序被处理器32执行时实现如上述的图像处理方法的步骤。Please refer to Figure 5, which is a schematic diagram of the structure of a non-volatile readable storage medium provided in an embodiment of the present application. The non-volatile readable storage medium shown in Figure 5 stores a computer program, which implements the steps of the above-mentioned image processing method when executed by the processor 32.
对于本申请实施例提供的非易失性可读存储介质的介绍请参照上述方法实施例,本申请实施例在此不再赘述。For an introduction to the non-volatile readable storage medium provided in the embodiment of the present application, please refer to the above method embodiment, and the embodiment of the present application will not be repeated here.
还需要说明的是,在本说明书中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个......”限定的要素,并不排除在包括上述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the above elements.
对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本申请实施例。 对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本申请实施例的精神或范围的情况下,在其他实施例中实现。因此,本申请实施例将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。 The above description of the disclosed embodiments enables those skilled in the art to implement or use the embodiments of the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the embodiments of the present application. Therefore, the embodiments of the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims (20)

  1. 一种图像处理方法,其特征在于,包括:An image processing method, characterized by comprising:
    从连续的图像中依次获取各帧图像中的各个像素点数据;Sequentially obtain pixel data in each frame of the image from the continuous images;
    在压缩引擎为空闲状态时,将获取的当前像素点数据发送至所述压缩引擎,以使所述压缩引擎对所述当前像素点数据进行压缩后发送至系统存储器;When the compression engine is in an idle state, the acquired current pixel point data is sent to the compression engine, so that the compression engine compresses the current pixel point data and then sends it to the system memory;
    在所述压缩引擎为忙碌状态时,将所述当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块;When the compression engine is in a busy state, the current pixel point data is set as discarded pixel point data and sent to a discarded pixel point processing module;
    当所述当前像素点数据为一帧图像的帧尾像素点数据时,在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述丢弃像素点数据并发送至所述压缩引擎。When the current pixel point data is the frame end pixel point data of a frame image, after the current pixel point data is sent to the compression engine or the discarded pixel point processing module, when the compression engine is in an idle state, each discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine.
  2. 如权利要求1所述的图像处理方法,其特征在于,所述像素点数据包括在一帧图像中的位置数据和色彩数据。The image processing method according to claim 1, characterized in that the pixel point data includes position data and color data in a frame of image.
  3. 如权利要求2所述的图像处理方法,其特征在于,当所述当前像素点数据为一帧图像的帧尾像素点数据时,在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述丢弃像素点数据并发送至所述压缩引擎,包括:The image processing method according to claim 2, characterized in that when the current pixel point data is the end pixel point data of a frame of an image, after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in an idle state, each of the discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine, comprising:
    基于所述当前像素点数据的位置数据判断所述当前像素点数据是否位于一帧图像的帧尾;Determining whether the current pixel point data is located at the end of a frame of an image based on the position data of the current pixel point data;
    在所述当前像素点数据是否位于一帧图像的帧尾的情况下,则所述当前像素点数据为一帧图像的所述帧尾像素点数据;In the case that the current pixel point data is located at the end of a frame of an image, the current pixel point data is the end pixel point data of the frame of an image;
    在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述丢弃像素点数据并发送至所述压缩引擎。After the current pixel data is sent to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine.
  4. 如权利要求2所述的图像处理方法,其特征在于,从连续的图像中依次获取各帧图像中的各个所述像素点数据,包括:The image processing method according to claim 2, characterized in that the step of sequentially acquiring the pixel data in each frame of the image from the continuous image comprises:
    按照连续的各帧图像的各个像素点的位置依次获取各个所述像素点的所述色彩数据,并基于各个所述像素点在一帧图像中的位置确定所述像素点的位置数据;Sequentially acquiring the color data of each pixel point according to the position of each pixel point in each consecutive frame image, and determining the position data of the pixel point based on the position of each pixel point in a frame image;
    基于所述色彩数据和所述位置数据确定所述像素点数据。The pixel point data is determined based on the color data and the position data.
  5. 如权利要求2所述的图像处理方法,其特征在于,在所述压缩引擎为忙碌状态时,将所述当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块,包 括:The image processing method according to claim 2, characterized in that when the compression engine is in a busy state, the current pixel data is set as discarded pixel data and sent to the discarded pixel processing module, including include:
    在所述压缩引擎为忙碌状态时,记录所述当前像素点数据的位置数据为最末丢弃像素点位置数据,并将所述当前像素点数据设定为所述丢弃像素点数据发送至所述丢弃像素点处理模块。When the compression engine is in a busy state, the position data of the current pixel data is recorded as the last discarded pixel position data, and the current pixel data is set as the discarded pixel data and sent to the discarded pixel processing module.
  6. 如权利要求5所述的图像处理方法,其特征在于,在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述丢弃像素点数据并发送至所述压缩引擎,包括:The image processing method according to claim 5, characterized in that after sending the current pixel data to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, obtaining each of the discarded pixel data from the discarded pixel processing module and sending it to the compression engine, comprising:
    在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,按照各个所述丢弃像素点数据的位置数据的顺序依次获取各个所述丢弃像素点数据,直至获取到位置数据为所述最末丢弃像素点位置数据的所述丢弃像素点数据并发送至空闲状态的所述压缩引擎。After the current pixel data is sent to the compression engine or the discarded pixel processing module, each discarded pixel data is acquired in sequence according to the order of the position data of each discarded pixel data until the discarded pixel data whose position data is the last discarded pixel position data is acquired and sent to the compression engine in idle state.
  7. 如权利要求1所述的图像处理方法,其特征在于,还包括:The image processing method according to claim 1, further comprising:
    从所述系统存储器中获取各个压缩后的像素点数据并进行解压处理;Acquire each compressed pixel point data from the system memory and perform decompression processing;
    基于解压处理后的各个所述像素点数据中的位置数据还原各帧所述图像。The image of each frame is restored based on the position data in each of the decompressed pixel data.
  8. 如权利要求7所述的图像处理方法,其特征在于,基于解压处理后的各个所述像素点数据中的位置数据还原各帧所述图像,包括:The image processing method according to claim 7, characterized in that restoring each frame of the image based on the position data in each of the pixel point data after decompression processing comprises:
    按照解压处理后的各个所述像素点数据中的位置数据确定各个所述像素点在一帧图像中的位置,以还原各帧所述图像。The position of each pixel point in a frame of image is determined according to the position data in each pixel point data after decompression, so as to restore each frame of the image.
  9. 如权利要求1-8任一项所述的图像处理方法,其特征在于,从连续的图像中依次获取各帧图像中的各个所述像素点数据,包括:The image processing method according to any one of claims 1 to 8, characterized in that sequentially acquiring the pixel data in each frame image from a continuous image comprises:
    将连续的图像中依次获取各帧图像中的各个所述像素点数据依次存储至FIFO存储器中。The pixel data in each frame of the continuous image are sequentially obtained and stored in the FIFO memory in sequence.
  10. 如权利要求9所述的图像处理方法,其特征在于,在压缩引擎为空闲状态时,将获取的当前像素点数据发送至所述压缩引擎,以使所述压缩引擎对所述当前像素点数据进行压缩后发送至系统存储器,包括:The image processing method according to claim 9, characterized in that when the compression engine is in an idle state, the acquired current pixel point data is sent to the compression engine, so that the compression engine compresses the current pixel point data and then sends it to the system memory, comprising:
    在所述压缩引擎为空闲状态时,从所述FIFO存储器中获取所述当前像素点数据并发送至所述压缩引擎,以使所述压缩引擎对所述当前像素点数据进行压缩后发送至系统存储器。When the compression engine is in an idle state, the current pixel point data is obtained from the FIFO memory and sent to the compression engine, so that the compression engine compresses the current pixel point data and then sends it to the system memory.
  11. 如权利要求9所述的图像处理方法,其特征在于,在所述压缩引擎为忙碌状态时,将所述当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块,包括: The image processing method according to claim 9, characterized in that when the compression engine is in a busy state, the current pixel data is set as discarded pixel data and sent to the discarded pixel processing module, comprising:
    在所述压缩引擎为忙碌状态时,从所述FIFO存储器中获取所述当前像素点数据并设定为丢弃像素点数据发送至丢弃像素点处理模块。When the compression engine is in a busy state, the current pixel data is obtained from the FIFO memory and is set as discarded pixel data and sent to a discarded pixel processing module.
  12. 如权利要求9所述的图像处理方法,其特征在于,当所述当前像素点数据为一帧图像的帧尾像素点数据时,在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述丢弃像素点数据并发送至所述压缩引擎,包括:The image processing method according to claim 9, characterized in that when the current pixel point data is the frame end pixel point data of a frame image, after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in an idle state, each of the discarded pixel point data is obtained from the discarded pixel point processing module and sent to the compression engine, comprising:
    当所述当前像素点数据为一帧图像的帧尾像素点数据时,在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为忙碌状态时,从所述FIFO存储器中获取所述当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并设定为下一帧丢弃像素点数据发送至所述丢弃像素点处理模块;When the current pixel point data is the end pixel point data of a frame of an image, after sending the current pixel point data to the compression engine or the discarded pixel point processing module, when the compression engine is in a busy state, the next frame of pixel point data in the next frame of the image where the current pixel point data is located is obtained from the FIFO memory and set as the next frame of discarded pixel point data to be sent to the discarded pixel point processing module;
    所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述丢弃像素点数据并发送至所述压缩引擎;When the compression engine is in an idle state, obtaining each discarded pixel data from the discarded pixel processing module and sending the data to the compression engine;
    从所述FIFO存储器中获取所述当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并发送至所述压缩引擎,以使所述压缩引擎对所述下一帧像素点数据进行压缩后发送至系统存储器。The next frame of pixel point data in the next frame of the image where the current pixel point data is located is obtained from the FIFO memory and sent to the compression engine, so that the compression engine compresses the next frame of pixel point data and sends it to the system memory.
  13. 如权利要求12所述的图像处理方法,其特征在于,从所述FIFO存储器中获取所述当前像素点数据所在图像的下一帧图像中的下一帧像素点数据并发送至所述压缩引擎,以使所述压缩引擎对所述下一帧像素点数据进行压缩后发送至系统存储器之后,还包括:The image processing method according to claim 12, characterized in that after obtaining the next frame of pixel point data in the next frame of the image where the current pixel point data is located from the FIFO memory and sending it to the compression engine, so that the compression engine compresses the next frame of pixel point data and sends it to the system memory, it also includes:
    当所述下一帧像素点数据为一帧图像的帧尾像素点数据时,在将所述下一帧像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述下一帧丢弃像素点数据并发送至所述压缩引擎。When the next frame pixel data is the frame end pixel data of a frame image, after the next frame pixel data is sent to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, each next frame discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine.
  14. 一种图像处理系统,其特征在于,包括:An image processing system, comprising:
    第一获取单元,被设置为从连续的图像中依次获取各帧图像中的各个像素点数据;A first acquisition unit is configured to sequentially acquire pixel data in each frame of an image from continuous images;
    第一发送单元,被设置为在压缩引擎为空闲状态时,将获取的当前像素点数据发送至所述压缩引擎,以使所述压缩引擎对所述当前像素点数据进行压缩后发送至系统存储器;A first sending unit is configured to send the acquired current pixel point data to the compression engine when the compression engine is in an idle state, so that the compression engine compresses the current pixel point data and then sends it to the system memory;
    第二发送单元,被设置为在所述压缩引擎为忙碌状态时,将所述当前像素点数据设定为丢弃像素点数据并发送至丢弃像素点处理模块;A second sending unit is configured to set the current pixel data as discarded pixel data and send the discarded pixel data to a discarded pixel processing module when the compression engine is in a busy state;
    第二获取单元,被设置为当所述当前像素点数据为一帧图像的帧尾像素点数据时, 在将所述当前像素点数据发送至所述压缩引擎或所述丢弃像素点处理模块后,所述压缩引擎为空闲状态时,从所述丢弃像素点处理模块中获取各个所述丢弃像素点数据并发送至所述压缩引擎。The second acquisition unit is configured to, when the current pixel point data is the end pixel point data of a frame of image, After the current pixel data is sent to the compression engine or the discarded pixel processing module, when the compression engine is in an idle state, each discarded pixel data is obtained from the discarded pixel processing module and sent to the compression engine.
  15. 一种图像处理装置,其特征在于,包括:An image processing device, comprising:
    存储器,被设置为存储计算机程序;a memory arranged to store a computer program;
    处理器,被设置为执行所述计算机程序时实现如权利要求1至13任一项所述图像处理方法的步骤。A processor is configured to implement the steps of the image processing method according to any one of claims 1 to 13 when executing the computer program.
  16. 一种图像压缩装置,其特征在于,包括如权利要求15所述的图像处理装置,还包括:An image compression device, comprising the image processing device according to claim 15, further comprising:
    与所述处理器连接的压缩引擎,被设置为对像素点数据进行压缩后发送至系统存储器;A compression engine connected to the processor, configured to compress pixel data and then send it to a system memory;
    与所述处理器连接的丢弃像素点处理模块,被设置为缓存各个丢弃像素点数据。The discarded pixel processing module connected to the processor is configured to cache each discarded pixel data.
  17. 如权利要求16所述的图像压缩装置,其特征在于,所述丢弃像素点处理模块包括:The image compression device according to claim 16, wherein the pixel discarding processing module comprises:
    与所述处理器连接的丢弃控制模块,被设置为接收丢弃像素点数据和下一帧丢弃像素点数据并发送至像素丢弃记录模块,或通过所述像素丢弃记录模块获取所述丢弃像素点数据和所述下一帧丢弃像素点数据并发送至所述处理器;A discard control module connected to the processor is configured to receive discarded pixel data and discarded pixel data of the next frame and send them to the pixel discard recording module, or obtain the discarded pixel data and the discarded pixel data of the next frame through the pixel discard recording module and send them to the processor;
    与所述丢弃控制模块连接的帧尾信息追加模块,被设置为对各个丢弃像素点数据按照位置数据进行排序,以及对各个所述下一帧丢弃像素点数据按照位置数据进行排序,以使所述丢弃控制模块将各个丢弃像素点数据按照顺序或将各个所述下一帧丢弃像素点数据按照顺序发送至所述处理器;A frame tail information appending module connected to the discarding control module is configured to sort each discarded pixel point data according to position data, and sort each of the next frame discarded pixel point data according to position data, so that the discarding control module sends each discarded pixel point data in sequence or each of the next frame discarded pixel point data in sequence to the processor;
    与所述丢弃控制模块连接的所述像素丢弃记录模块,被设置为将所述丢弃像素点数据和所述下一帧丢弃像素点数据存储至丢弃存储器中,或将所述丢弃存储器中的所述丢弃像素点数据和所述下一帧丢弃像素点数据发送至所述丢弃控制模块;The pixel discarding recording module connected to the discarding control module is configured to store the discarded pixel point data and the discarded pixel point data of the next frame in the discarding memory, or send the discarded pixel point data and the discarded pixel point data of the next frame in the discarding memory to the discarding control module;
    与所述像素丢弃记录模块连接的所述丢弃存储器,被设置为存储所述丢弃像素点数据和所述下一帧丢弃像素点数据。The discarding memory connected to the pixel discarding recording module is configured to store the discarded pixel point data and the discarded pixel point data of the next frame.
  18. 如权利要求17所述的图像压缩装置,其特征在于,所述丢弃存储器包括第一丢弃存储器和第二丢弃存储器;The image compression device according to claim 17, characterized in that the discarding memory comprises a first discarding memory and a second discarding memory;
    所述第一丢弃存储器被设置为存储所述丢弃像素点数据;The first discarding memory is configured to store the discarded pixel data;
    所述第二丢弃存储器被设置为存储所述下一帧丢弃像素点数据。The second discarding memory is configured to store the discarded pixel data of the next frame.
  19. 如权利要求16所述的图像压缩装置,其特征在于,还包括: The image compression device according to claim 16, further comprising:
    与所述处理器连接的FIFO存储器,被设置为缓存各帧图像中的各个所述像素点数据。The FIFO memory connected to the processor is configured to cache the pixel data in each frame of the image.
  20. 一种非易失性可读存储介质,其特征在于,所述非易失性可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至13任一项所述的图像处理方法的步骤。 A non-volatile readable storage medium, characterized in that a computer program is stored on the non-volatile readable storage medium, and when the computer program is executed by a processor, the steps of the image processing method according to any one of claims 1 to 13 are implemented.
PCT/CN2023/105771 2022-12-06 2023-07-04 Image processing method, system and apparatus, image compression apparatus, and storage medium WO2024119812A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211554111.8A CN115633181B (en) 2022-12-06 2022-12-06 Picture processing method, system, device, image compression device and storage medium
CN202211554111.8 2022-12-06

Publications (1)

Publication Number Publication Date
WO2024119812A1 true WO2024119812A1 (en) 2024-06-13

Family

ID=84910018

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/105771 WO2024119812A1 (en) 2022-12-06 2023-07-04 Image processing method, system and apparatus, image compression apparatus, and storage medium

Country Status (2)

Country Link
CN (1) CN115633181B (en)
WO (1) WO2024119812A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115633181B (en) * 2022-12-06 2023-03-17 山东云海国创云计算装备产业创新中心有限公司 Picture processing method, system, device, image compression device and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002369199A (en) * 2001-06-11 2002-12-20 Nec Corp Image transmitting equipment, image transmitting method, and image transmission program used for performing the method
JP2003274323A (en) * 2002-03-14 2003-09-26 Canon Inc Still picture photographing device, storage control method, program, and storage medium
CN102945166A (en) * 2011-11-14 2013-02-27 微软公司 Method and system used for abandoning free graphic display elements
CN111953990A (en) * 2020-07-07 2020-11-17 西安万像电子科技有限公司 Encoding method and device
CN114302140A (en) * 2021-11-30 2022-04-08 山东云海国创云计算装备产业创新中心有限公司 Pre-frame loss method, system, equipment and computer readable storage medium
CN114567787A (en) * 2022-02-28 2022-05-31 山东云海国创云计算装备产业创新中心有限公司 Video compression method, system and related device applied to BMC
CN114615209A (en) * 2022-03-11 2022-06-10 山东云海国创云计算装备产业创新中心有限公司 Dynamic adaptive image compression method, device, equipment and readable medium
CN115633181A (en) * 2022-12-06 2023-01-20 山东云海国创云计算装备产业创新中心有限公司 Picture processing method, system, device, image compression device and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2950346B2 (en) * 1991-03-25 1999-09-20 ソニー株式会社 Image data decoding method and its decoder circuit
US6229927B1 (en) * 1994-09-21 2001-05-08 Ricoh Company, Ltd. Reversible embedded wavelet system implementation
US9514510B2 (en) * 2013-03-29 2016-12-06 Mediatek Inc. Method and apparatus for arranging pixels of picture in storage units each having storage size not divisible by pixel size

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002369199A (en) * 2001-06-11 2002-12-20 Nec Corp Image transmitting equipment, image transmitting method, and image transmission program used for performing the method
JP2003274323A (en) * 2002-03-14 2003-09-26 Canon Inc Still picture photographing device, storage control method, program, and storage medium
CN102945166A (en) * 2011-11-14 2013-02-27 微软公司 Method and system used for abandoning free graphic display elements
CN111953990A (en) * 2020-07-07 2020-11-17 西安万像电子科技有限公司 Encoding method and device
CN114302140A (en) * 2021-11-30 2022-04-08 山东云海国创云计算装备产业创新中心有限公司 Pre-frame loss method, system, equipment and computer readable storage medium
CN114567787A (en) * 2022-02-28 2022-05-31 山东云海国创云计算装备产业创新中心有限公司 Video compression method, system and related device applied to BMC
CN114615209A (en) * 2022-03-11 2022-06-10 山东云海国创云计算装备产业创新中心有限公司 Dynamic adaptive image compression method, device, equipment and readable medium
CN115633181A (en) * 2022-12-06 2023-01-20 山东云海国创云计算装备产业创新中心有限公司 Picture processing method, system, device, image compression device and storage medium

Also Published As

Publication number Publication date
CN115633181A (en) 2023-01-20
CN115633181B (en) 2023-03-17

Similar Documents

Publication Publication Date Title
WO2020220953A1 (en) Method and apparatus for graphics rendering
WO2024119812A1 (en) Image processing method, system and apparatus, image compression apparatus, and storage medium
CN113873255B (en) Video data transmission method, video data decoding method and related devices
CN109618225B (en) Video frame extraction method, device, equipment and medium
WO2022252488A1 (en) Image compression method and apparatus, electronic device, and readable storage medium
WO2020047843A1 (en) Method and system for transmitting video image data, storage medium, and program product
WO2021129830A1 (en) Video transmission method, apparatus, device and system
US9438917B2 (en) System and method for adaptive bandwidth management
WO2013134936A1 (en) Screen recording method, and screen recording control method and device
CN116996647B (en) Video transmission method of BMC, BMC and system-level chip
WO2022017096A1 (en) Screen recording method, electronic device, and computer readable storage medium
WO2024074012A1 (en) Video transmission control method, apparatus and device, and nonvolatile readable storage medium
CN111182306B (en) Video extraction method, system, terminal and storage medium for video compression
CN114422807B (en) Transmission optimization method based on Spice protocol
US20230396786A1 (en) Image processing method and apparatus, and related assembly
WO2018032696A1 (en) Method and system for desktop screenshot control
WO2020119411A1 (en) Method for transmitting image, terminal and storage medium
CN117009087A (en) Image output method, device, equipment and storage medium
US20240267544A1 (en) Video data transmission method, video data decoding method, and related apparatuses
CN114302140B (en) Pre-frame-loss method, system, equipment and computer readable storage medium
CN110798700B (en) Video processing method, video processing device, storage medium and electronic equipment
WO2018003685A1 (en) Image compressing method, image reconstructing method, image compressing device, image reconstructing device, image compressing program product, and image reconstructing program product
CN115643408A (en) Image compression method, device, equipment and storage medium
CN111857462B (en) Server, cursor synchronization method and device, and computer readable storage medium
CN114567787A (en) Video compression method, system and related device applied to BMC

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23899399

Country of ref document: EP

Kind code of ref document: A1