CN1290056C - Ultra-spectrum image real-time compression system based on noise masking - Google Patents
Ultra-spectrum image real-time compression system based on noise masking Download PDFInfo
- Publication number
- CN1290056C CN1290056C CN 200410025691 CN200410025691A CN1290056C CN 1290056 C CN1290056 C CN 1290056C CN 200410025691 CN200410025691 CN 200410025691 CN 200410025691 A CN200410025691 A CN 200410025691A CN 1290056 C CN1290056 C CN 1290056C
- Authority
- CN
- China
- Prior art keywords
- image
- data
- host
- compression
- noise
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000007906 compression Methods 0.000 title claims abstract description 82
- 230000006835 compression Effects 0.000 title claims abstract description 81
- 230000000873 masking effect Effects 0.000 title claims abstract description 24
- 238000001228 spectrum Methods 0.000 title 1
- 238000013144 data compression Methods 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims description 22
- 230000011218 segmentation Effects 0.000 claims description 4
- 230000009977 dual effect Effects 0.000 abstract 1
- 238000000034 method Methods 0.000 description 17
- 235000019800 disodium phosphate Nutrition 0.000 description 16
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 7
- 238000003384 imaging method Methods 0.000 description 6
- 238000011160 research Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000003672 processing method Methods 0.000 description 4
- 238000013139 quantization Methods 0.000 description 4
- 230000003595 spectral effect Effects 0.000 description 4
- 101150043088 DMA1 gene Proteins 0.000 description 3
- 101150090596 DMA2 gene Proteins 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 108091092878 Microsatellite Proteins 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
一种基于噪声掩蔽算法的超光谱图像实时压缩系统,包括主机、高速图像从处理机,以及图像采集装置,该图像采集装置经CAB总线接口与从处理机连接和经PCI总线与主机连接;该主机经PCI总线与从处理机成双向联结,以及该主机分别连接图像显示器和图像数据压缩结果存储器,其特征在于:a.在从处理机上设有成双向联结的图像噪声掩蔽压缩模块和主机接口,以便接受来自主机的命令数据和将图像实时压缩结果数据传送给主机;b.在主机上设有主机控制模板,从处理机接口和显示模块及存储模块,该控制模块接受原始图像数据和用户命令而形成系统数据源,并经从处理机接向从处理机发送命令和接受图像实时压缩结果数据;主机控制模块将原始图像数据送显示模块和将图像实时压缩结果送存储模块形成压缩文件。
A hyperspectral image real-time compression system based on a noise masking algorithm, comprising a host, a high-speed image slave processor, and an image acquisition device, the image acquisition device is connected to the slave processor through a CAB bus interface and connected to the host through a PCI bus; the The main frame is connected bidirectionally with the slave processor through the PCI bus, and the host is respectively connected to the image display and the image data compression result memory, and is characterized in that: a. The image noise masking compression module and the host interface of the dual bond are provided on the slave processor , so as to accept the command data from the host computer and transmit the image real-time compression result data to the host computer; b. The host computer control template is provided on the host computer, from the processor interface, display module and storage module, the control module accepts the original image data and the user command to form a system data source, and send commands and receive image real-time compression result data from the slave processor to the slave processor; the host control module sends the original image data to the display module and the image real-time compression result to the storage module to form a compressed file.
Description
技术领域technical field
本发明涉及一种超光谱图像实时压缩系统,特别是一种基于噪声分析的图像压缩系统,通过实时超光谱图像的信噪比估算,将由压缩算法所引入的噪声对图像信息的影响降低到最小,实现了对超光谱图像的高保真压缩,同时也保证了图像压缩率的图像压缩系统。The present invention relates to a hyperspectral image real-time compression system, in particular to an image compression system based on noise analysis, which minimizes the influence of noise introduced by compression algorithms on image information by estimating the signal-to-noise ratio of real-time hyperspectral images , realizes the high-fidelity compression of the hyperspectral image, and also guarantees the image compression rate of the image compression system.
背景技术Background technique
对超光谱图像压缩的研究成果已有不少报道,不过大多停留在理论研究和软件处理阶段,做到实时硬件应用的不多。究其原因,一是超光谱图像数据量庞大,对硬件处理能力要求很高,以前很难用硬件电路实时完成;二是对超光谱图像进行压缩研究的往往是应用处理单位,其研究工作没有和成像光谱仪的研制工作紧密结合在一起,很少被实际应用。There have been many reports on the research results of hyperspectral image compression, but most of them stay in the stage of theoretical research and software processing, and there are not many real-time hardware applications. The reasons are as follows: firstly, the data volume of hyperspectral images is huge, which requires high processing power of hardware, and it was difficult to complete it in real time with hardware circuits in the past; It is closely combined with the development of imaging spectrometers and is rarely used in practice.
随着大规模集成电路技术的发展,许多高速,高可靠性,低功耗的集成电路芯片被研制出来,数字图像的硬件实时处理已经成为可能。利用多片高性能处理芯片组成并行处理系统,结合超光谱图像压缩算法构成的实时压缩系统已经可以达到实用阶段。而成像光谱仪的小型化要求和大量超光谱图像数据存储及传输的压力也使得成像光谱仪的研制部门开始重视这方面的研究工作。如由美国海军研究实验室研究设计的NEMO海军地图观测卫星携带的近海成像仪(COIS)包括两台成像仪,分别包括60和150个宽度为10nm的光谱波段。这两台成像仪的数据率达到了145Mb/s。为了达到10倍的数据压缩率(有损),减轻超光谱图像在星上存储和向地面传输时的负担,美国海军研究实验室研制了一个特征提取和数据压缩星上实时处理系统,称为光学实时自适应光谱辨别系统(ORASIS)。在无人驾驶飞机进行的实验中,ORASIS达到的实际压缩效果是:当压缩比=12时,峰值信噪比=48.0db;当压缩比=20时,峰值信噪比=44.2db。在中国,北京航空航天大学、国防科技大学、清华大学、哈尔滨工业大学等单位也做过相关的研究。由中国清华大学、中国航天机电集团公司与英国萨瑞大学联合研制的“航天清华一号”微小卫星携带的成像光谱仪由绿(0.52-0.6μm)、红(0.63-0.69μm)、近红外(0.76-0.94μm)三个波段组成,采用a-MPBTC(Adaptive Moment Preserving Block Truncation Coding)压缩方法,取得4倍的压缩率。With the development of large-scale integrated circuit technology, many integrated circuit chips with high speed, high reliability and low power consumption have been developed, and real-time processing of digital images by hardware has become possible. The real-time compression system composed of multiple high-performance processing chips combined with the hyperspectral image compression algorithm has reached the practical stage. The miniaturization requirements of imaging spectrometers and the pressure of storage and transmission of a large number of hyperspectral image data also make the research and development departments of imaging spectrometers begin to pay attention to research work in this area. For example, the Offshore Imager (COIS) carried by the NEMO naval map observation satellite designed by the US Naval Research Laboratory includes two imagers, including 60 and 150 spectral bands with a width of 10nm. The data rate of these two imagers reaches 145Mb/s. In order to achieve a data compression rate of 10 times (lossy) and reduce the burden of hyperspectral images stored on the star and transmitted to the ground, the U.S. Naval Research Laboratory has developed a real-time processing system for feature extraction and data compression on the star, called Optical real-time adaptive spectral discrimination system (ORASIS). In the experiment conducted by unmanned aircraft, the actual compression effect achieved by ORASIS is: when the compression ratio = 12, the peak signal-to-noise ratio = 48.0db; when the compression ratio = 20, the peak signal-to-noise ratio = 44.2db. In China, Beijing University of Aeronautics and Astronautics, National University of Defense Technology, Tsinghua University, Harbin Institute of Technology and other units have also done related research. The imaging spectrometer carried by the "Aerospace Tsinghua-1" microsatellite jointly developed by China's Tsinghua University, China Aerospace Machinery and Electronics Corporation and the University of Surrey consists of green (0.52-0.6μm), red (0.63-0.69μm), near-infrared ( 0.76-0.94μm) composed of three bands, using the a-MPBTC (Adaptive Moment Preserving Block Truncation Coding) compression method to achieve a 4-fold compression rate.
但实际的遥感图像都不可避免地存在随机噪声的干扰,分析这些成像光谱图像压缩系统,其不足之处是它们并没有考虑图像的噪声特性,在对图像进行一定倍数的数据压缩时,图像边缘和过渡带的原始噪声被系统放大,并且蔓延、污染到了图像的高比特数据,造成图像信息的损失。简而言之利用这些压缩系统对图像进行压缩时,图像信息并不能得到合理的保留。However, the actual remote sensing images inevitably have the interference of random noise. The shortcoming of analyzing these imaging spectral image compression systems is that they do not consider the noise characteristics of the image. When the image is compressed by a certain multiple, the image edge The original noise of the transition zone is amplified by the system, and spreads and pollutes the high-bit data of the image, resulting in the loss of image information. In short, when these compression systems are used to compress images, the image information cannot be reasonably preserved.
发明内容Contents of the invention
如上所述,如何根据超光谱图像的噪声污染情况,在不增加图像信息损失的条件下提高图像的压缩倍数乃是本发明所要解决的技术问题。因此,本发明的目的在于提供一种超光谱图像压缩系统,通过对原始图像各波段数据的噪声分析,设计有效的图像压缩方法,对超光谱图像各波段数据进行有针对性的压缩,建立基于噪声掩蔽的超光谱图像实时压缩系统。As mentioned above, the technical problem to be solved by the present invention is how to increase the compression factor of the image without increasing the loss of image information according to the noise pollution of the hyperspectral image. Therefore, the object of the present invention is to provide a kind of hyperspectral image compression system, through the noise analysis to each band data of original image, design effective image compression method, carry out targeted compression to each band data of hyperspectral image, establish based on Noise-masked hyperspectral image real-time compression system.
本发明的技术解决方案如下:Technical solution of the present invention is as follows:
根据本发明的一种基于噪声掩蔽算法的超光谱图像实时压缩系统,包括主机、高速图像从处理机、以及图像采集装置,所述图像采集装置经CAB总线接口与高速图像从处理机连接和经PCI总线与主机连接;该主机经PCI总线与高速图像从处理机成双向联结,并还分别连接图像显示器和图像数据压缩结果存储器,特点是:According to a kind of hyperspectral image real-time compression system based on noise masking algorithm of the present invention, comprise host computer, high-speed image slave processor, and image acquisition device, described image acquisition device is connected with high-speed image slave processor through CAB bus interface and via The PCI bus is connected to the host; the host is bidirectionally connected to the high-speed image slave processor through the PCI bus, and is also connected to the image display and the image data compression result memory respectively. The characteristics are:
a、在所述高速图像从处理机上设有成双向数据流联结的图像噪声掩蔽压缩模块和主机接口,该图像噪声掩蔽压缩模块包括依次连接的原始图像输入单元、图像信噪比估算单元、图像子块分割单元、图像子块二维量化余弦变换单元和图像信噪比重建单元,以及图像数据编码压缩单元,所述图像信噪比重建单元其所重建的图像的信噪比比原始图像的信噪比大10db,以便接受来自主机的命令数据和将图像实时压缩结果数据传送给主机;a. The high-speed image slave processor is provided with an image noise masking compression module connected with a bidirectional data flow and a host interface, and the image noise masking compression module includes an original image input unit, an image signal-to-noise ratio estimation unit, and an image signal-to-noise ratio estimation unit connected in sequence. A sub-block segmentation unit, an image sub-block two-dimensional quantized cosine transform unit, an image signal-to-noise ratio reconstruction unit, and an image data coding compression unit, the image signal-to-noise ratio reconstruction unit has a reconstructed image with a signal-to-noise ratio that is higher than that of the original image The signal-to-noise ratio is 10db larger, so as to accept the command data from the host and transmit the image real-time compression result data to the host;
b、在主机上设有主机控制模块、从处理机接口和显示模块及存储模块,该控制模块接受图像采集装置送来的原始图像数据和主机送来的命令而形成系统的数据源,并经从处理机接口向高速图像从处理机发送命令并接受压送来的图像时压缩结果数据;主机控制模块将原始图像数据送显示模块和将图像实时压缩结果数据送存储模块形成压缩文件存放在图像数据压缩结果存储器中。b. The host is equipped with a host control module, a slave processor interface, a display module, and a storage module. The control module accepts the original image data sent by the image acquisition device and the commands sent by the host to form a data source of the system, and passes through Compress the result data when sending commands from the processor interface to the high-speed image slave processor and accept the image sent by compression; the host control module sends the original image data to the display module and sends the image real-time compressed result data to the storage module to form a compressed file and store it in the image Data compression result memory.
进一步,所述的主机为便携式PC机;Further, the host is a portable PC;
所述高速图像从处理机由多个DSP芯片图像处理板构成;Described high-speed image is made of multiple DSP chip image processing boards from processor;
所述的图像子块分割单元把原始图像分割成4×4或5×5或8×8子块。The image sub-block dividing unit divides the original image into 4×4 or 5×5 or 8×8 sub-blocks.
本发明的基于噪声掩蔽算法的超光谱图像压缩系统,其特点是:对于所设计的超光谱图像压缩算法,能够不加修改或尽量少修改地用硬件系统实现,节省重新评估算法所需的工作量。The hyperspectral image compression system based on the noise masking algorithm of the present invention is characterized in that: for the designed hyperspectral image compression algorithm, it can be implemented with a hardware system without modification or as little modification as possible, saving the work required for re-evaluating the algorithm quantity.
本发明系统还具有较强的灵活性,系统针对实际应用要求,可以容易地进行算法的改进,而不必重新开发设计整个硬件系统,以及具有可扩展性和可移植性,硬件设计便于系统以后扩展或应用到新的平台。The system of the present invention also has strong flexibility, and the system can easily improve the algorithm according to the actual application requirements without re-developing and designing the entire hardware system, and has scalability and portability, and the hardware design is convenient for future expansion of the system Or apply to a new platform.
本发明由于使用了基于噪声掩蔽效应的压缩方法,控制重建图像信噪比大于原始图像信噪比10db,使得压缩算法引入的噪声被原始图像噪声所掩蔽,从而保证在不增加图像失真的情况下提高了图像压缩倍数。Because the present invention uses the compression method based on the noise masking effect, the signal-to-noise ratio of the reconstructed image is controlled to be greater than the original image signal-to-noise ratio by 10db, so that the noise introduced by the compression algorithm is covered by the original image noise, thereby ensuring Improved the image compression factor.
概括地说,本发明充分利用了超光谱图像的噪声特性,将由压缩算法所引入的噪声对图像信息的影响降低到最小,实现了对超光谱图像的高保真压缩,同时也保证了图像压缩率,与传统的超光谱图像压缩系统相比具有明显的技术进步和实质性意义。In a nutshell, the present invention makes full use of the noise characteristics of hyperspectral images, minimizes the impact of noise introduced by compression algorithms on image information, realizes high-fidelity compression of hyperspectral images, and ensures image compression rate , compared with the traditional hyperspectral image compression system, it has obvious technical progress and substantial significance.
附图说明Description of drawings
图1是本发明的硬件体系结构示意图。FIG. 1 is a schematic diagram of the hardware architecture of the present invention.
图2是本发明的软件体系结构示意图。Fig. 2 is a schematic diagram of the software architecture of the present invention.
图3是本发明的图像处理板上多片DSP分时并行处理方式示意图。Fig. 3 is a schematic diagram of the time-sharing parallel processing method of multiple DSPs on the image processing board of the present invention.
图4是本发明的单片DSP两级双缓冲流水线工作流程示意图。Fig. 4 is a schematic diagram of the workflow of the single-chip DSP two-stage double-buffer pipeline of the present invention.
图5-1是本发明的基于噪声掩蔽算法中的图像压缩模块结构示意图。Fig. 5-1 is a schematic structural diagram of the image compression module in the noise-based masking algorithm of the present invention.
图5-2是本发明的基于噪声掩蔽压缩方法的压缩过程流程图。Fig. 5-2 is a flowchart of the compression process of the noise masking compression method of the present invention.
图6是本发明的噪声掩蔽效应实验原理示意图。Fig. 6 is a schematic diagram of the experimental principle of the noise masking effect of the present invention.
图7是本发明的噪声掩蔽效应实验结果曲线图。Fig. 7 is a graph showing the experimental results of the noise masking effect of the present invention.
图8-1和图8-2分别是本发明的基于噪声掩蔽的压缩方法应用实例曲线图。Fig. 8-1 and Fig. 8-2 are graphs of application examples of the compression method based on noise masking of the present invention, respectively.
具体实施方式Detailed ways
下面根据图1~图8-2给出本发明一个较好实施例,并结合对该实施例的描述进一步给出本发明的技术细节,以使能更好地理解本发明的结构特征和功能效果。A better embodiment of the present invention is provided below according to Fig. 1~Fig. 8-2, and further provides the technical detail of the present invention in conjunction with the description of this embodiment, so that can better understand structural feature and function of the present invention Effect.
参阅图1,本发明硬件体系结构包括系统控制主机10、高速图像从处理机20、图像采集板22、CAB总线接口21等。其中:系统控制主机10采用便携式PC机,高速图像从处理机20采用基于多片TMS320C6201的图像处理板Python/C6处理板。所述主机10其任务是总控整个系统,利用其友好界面接收用户命令,启动/停止从处理机即高速图像从处理机20的工作,改变从处理板上DSP的工作程序等,并将采集的图像数据和图像压缩的相关信息实时显示,将压缩后的数据存储下来。另外,所述主机10的软件还负责实时工作结束后,后处理时压缩结果的解压回放工作。Python/C6处理板的任务则是接受图像数据,让DSP按照主机选择的程序进行处理,输出压缩结果。所述图像采集板22采集的原始光谱图像数据分两路传输,一路通过CAB总线接口21直接输入到Python/C6中进行处理;一路通过计算机PCI总线30传送到主机10进行实时压缩并由图像显示器12显示,便于监控。而Python/C6的数据压缩结果则通过PCI总线30传给主机10,由存储器11存储或进一步处理。Referring to FIG. 1, the hardware architecture of the present invention includes a
参阅图2,本发明软件体系结构分为主机10平台(Host)和从处理机20平台(Slave)两部分。主机10上的主要模块有主控模块101、从处理机接口模块102、图像显示模块103和数据存储模块104。其主要功能是提供良好的人机界面,接受用户命令,控制从处理器机20的运行,接收微处理器板的压缩结果,利用多线程等技术实现原始图像的实时显示和压缩结果的存储功能。从处理机20软件的主要模块有图像压缩算法模块201和主机接口模块202。其主要功能则是在DSP平台上利用多种代码优化手段,并使用TI公司的高效率代码编译器,充分发挥DSP的硬件资源性能,根据用户的命令完成数据实时压缩工作并传给主机。整个软件以原始图像和用户命令作为数据源,以压缩结果文件结束。Referring to Fig. 2, the software architecture of the present invention is divided into two parts: a
如图3所示为本发明Python/C6图像处理板上多片DSP分时并行处理方式示意图。并行处理方式的每片DSP单独处理一路数据,完成一个完整的压缩算法任务,当各路数据都处理完毕后,将所有模块同时输出。这种结构的优点是任务分配简单,各DSP功能、算法相同,易于实现。在本发明的系统中,结合多DSP图像处理板的特点,采用了分时流水的并行处理方法,即:将输入的超光谱图像数据,根据每个DSP配置的缓冲存储器的大小,分成一定大小的帧,按时间顺序流水给各个DSP,而各个DSP的处理结果也按时间顺序组合起来,通过PCI总线传输给主机10。As shown in Figure 3, it is a schematic diagram of the multi-chip DSP time-sharing parallel processing method on the Python/C6 image processing board of the present invention. Each piece of DSP in the parallel processing mode independently processes one channel of data to complete a complete compression algorithm task. When all channels of data are processed, all modules are output at the same time. The advantage of this structure is that the task allocation is simple, the functions and algorithms of each DSP are the same, and it is easy to realize. In the system of the present invention, in combination with the characteristics of multi-DSP image processing boards, the parallel processing method of time-sharing pipeline is adopted, that is, the input hyperspectral image data is divided into a certain size according to the size of the buffer memory configured by each DSP. The frames are piped to each DSP according to time sequence, and the processing results of each DSP are also combined according to time sequence and transmitted to the
本实施例中所选用的DSP为TI公司的TMS320C6201芯片,CPU在一个时钟周期内可以访问IDRAM两次,相比要经过EMIF扩展存储器接口和外部总线的外接存储器,效率要高得多。为了充分发挥DSP的性能,就要把IDRAM作为数据交换的缓冲区。但对于需要处理大量数据的图像压缩来说,IDRAM容量太小,不能满足快速数据输入输出的需要。为此,采用了两级缓存结构:片外存储器SDRAM(16MB)作为帧缓存,IDRAM(64KB)作为图像子块缓存。原始图像数据先输入暂存在帧缓存中,再以子块为单位送入片内子块缓存给CPU处理。C6201的DMA控制器具有4个相互独立编程的通道,允许进行4个不同内容的DMA传送。对于存储密集型的图像压缩系统来说,I/O吞吐量对系统的处理能力和效率至关重要。利用Python/C6上C6201的四个DMA,可以实现两级I/O缓冲,即图像数据从总线到C6201相对较慢的SDRAM存储器的交换,及SDRAM存储器到C6201的片内高速数据RAM的交换。这样,数据压缩处理可以在片内高速数据RAM中进行,数据的吞吐量得到极大的提高。The DSP selected in this embodiment is the TMS320C6201 chip of TI Company, and the CPU can access the IDRAM twice in one clock cycle, which is much more efficient than the external memory that needs to expand the memory interface and external bus through the EMIF. In order to give full play to the performance of DSP, it is necessary to use IDRAM as a buffer for data exchange. However, for image compression that needs to process a large amount of data, the capacity of IDRAM is too small to meet the needs of fast data input and output. To this end, a two-level cache structure is adopted: off-chip memory SDRAM (16MB) is used as a frame buffer, and IDRAM (64KB) is used as an image sub-block cache. The original image data is first input and temporarily stored in the frame buffer, and then sent to the on-chip sub-block cache in units of sub-blocks for processing by the CPU. The DMA controller of C6201 has 4 independent programming channels, allowing DMA transmission of 4 different contents. For memory-intensive image compression systems, I/O throughput is critical to the system's processing power and efficiency. Using the four DMAs of C6201 on Python/C6, two-level I/O buffering can be realized, that is, the exchange of image data from the bus to the relatively slow SDRAM memory of C6201, and the exchange of SDRAM memory to the on-chip high-speed data RAM of C6201. In this way, the data compression process can be carried out in the on-chip high-speed data RAM, and the throughput of the data is greatly improved.
如图4所示为单片DSP两级双缓冲流水线工作流程示意图。用DMA2和DMA3分别实现第一级输入设备到输入帧缓存BufFrameIn和输出帧缓存BufFrameOut到输出设备的操作,用DMA0和DMA1分别实现第二级输入帧缓存BufFrameIn到片内子块缓存BufBlockIn和片内子块缓存BufBlockOut到输出帧缓存BufFrameOut操作。这两级都利用了乒乓缓存,使用流水线并行处理的方法,使得输入输出和数据压缩处理同时进行。图中的虚线和实线分别为两个互斥的操作,不能同时进行,但同一种线表示的操作可以同时进行。虚线和实线表示的操作交替执行形成流水线。具体的流水线并行处理过程如下(设两级流水线初始化填充已完成):As shown in Figure 4, it is a schematic diagram of the workflow of a single-chip DSP two-stage double-buffer pipeline. Use DMA2 and DMA3 to realize the operation of the first-level input device to the input frame buffer BufFrameIn and the output frame buffer BufFrameOut to the output device respectively, and use DMA0 and DMA1 to realize the operation of the second-level input frame buffer BufFrameIn to the on-chip sub-block buffer BufBlockIn and on-chip sub-block respectively Buffer BufBlockOut to output framebuffer BufFrameOut operations. These two stages both utilize the ping-pong cache, and use the pipeline parallel processing method, so that the input and output and data compression processing are performed simultaneously. The dotted line and the solid line in the figure are two mutually exclusive operations, which cannot be performed at the same time, but the operations represented by the same line can be performed at the same time. Operations indicated by dotted lines and solid lines are executed alternately to form a pipeline. The specific pipeline parallel processing process is as follows (assuming that the initialization filling of the two-stage pipeline has been completed):
1)启动DMA2,从输入设备采集下一帧图像数据到BufFrameIn1;1) Start DMA2 and collect the next frame of image data from the input device to BufFrameIn1;
2)启动DMA3,将上一帧图像压缩结果从BufFrameOut1输出到PCI总线;2) Start DMA3, output the last frame image compression result from BufFrameOut1 to PCI bus;
3)启动DMA0,将本帧图像数据BufFrameIn2中的下一图像子块传送到BufBlockIn2;3) start DMA0, and the next image sub-block in this frame image data BufFrameIn2 is sent to BufBlockIn2;
4)启动DMA1,将上一图像子块压缩结果从BufBlockOut2传送到BufFrameOut2;4) Start DMA1, and transfer the compression result of the last image sub-block from BufBlockOut2 to BufFrameOut2;
5)压缩处理BufBlockIn1中的本图像子块,结果放入BufBlockOut1;5) Compress and process the image sub-block in BufBlockIn1, and put the result into BufBlockOut1;
6)等待直到DMA0、DMA1传送结束,重复步骤3、4、5并交替使用两个片内子块缓存,直到本帧全部压缩完毕6) Wait until the transfer of DMA0 and DMA1 ends, repeat steps 3, 4, and 5 and alternately use the two on-chip sub-block caches until all the frames are compressed
7)等待直到DMA2、DMA3传送结束,重复步骤1、2、3、4、5、6并交替使用外扩帧缓存,开始压缩后续帧。7) Wait until the transfer of DMA2 and DMA3 ends, repeat steps 1, 2, 3, 4, 5, and 6 and alternately use the extended frame buffer to start compressing subsequent frames.
这样的处理过程使得4个DMA通道数据传输和DSP内核压缩工作完全并行,并且保证了主要计算任务在片内高速缓存中进行,充分发挥了系统硬件的性能,提高了数据吞吐能力。Such a processing process makes the data transmission of the 4 DMA channels and the compression work of the DSP core completely parallel, and ensures that the main calculation tasks are carried out in the on-chip cache, fully exerting the performance of the system hardware and improving the data throughput.
如图5-1和图5-2所示,本实施例中的超光谱图像压缩方法充分利用了图像的噪声特性,在对图像进行压缩前,首先要对图像的信噪比进行估算。本系统对图像信噪比估算的基本思想是:由于选择一定大小的均匀区域比较困难,便把图像分割成一个一个的小区域,这些小区域内基本上可以认为是均匀的;分别计算这些小区域内的LSD(Local Standard Deviation,局部标准差)作为局部噪声大小,并选择总数最多的那个区间的LSD作为整个图像的平均噪声值。具体的操作步骤如下:As shown in Figure 5-1 and Figure 5-2, the hyperspectral image compression method in this embodiment makes full use of the noise characteristics of the image. Before compressing the image, the signal-to-noise ratio of the image must first be estimated. The basic idea of this system for image signal-to-noise ratio estimation is: because it is difficult to select a uniform area of a certain size, the image is divided into small areas one by one, and these small areas can basically be considered uniform; The LSD (Local Standard Deviation, local standard deviation) is used as the local noise size, and the LSD of the interval with the largest total number is selected as the average noise value of the entire image. The specific operation steps are as follows:
将图像分割成4×4,或5×5,……,或8×8的小块,对于每一个图像子块,信号的LM(Local Mean局部均值)由下式得到:Divide the image into 4×4, or 5×5,…, or 8×8 small blocks. For each image sub-block, the LM (Local Mean) of the signal is obtained by the following formula:
这里,Si是图像子块中第i个象素的灰度值;N是图像子块中所有象素的总数。LSD由下式得到:Here, Si is the gray value of the i-th pixel in the image sub-block; N is the total number of all pixels in the image sub-block. LSD is obtained by the following formula:
对于均匀的图像子块,LSD较小,而对不均匀的图像子块,如包含图像边缘或纹理特征的子块,LSD则较大。计算出整幅图像的LM(记为LMo)、所有图像子块的LSD,并找出所有图像子块中最大和最小的LSD。For uniform image sub-blocks, LSD is small, while for non-uniform image sub-blocks, such as sub-blocks containing image edges or texture features, LSD is large. Calculate the LM of the entire image (denoted as LMo), the LSD of all image sub-blocks, and find the largest and smallest LSD of all image sub-blocks.
在最小和最大的LSD之间,建立若干个等值间隔的区间。将所有子块的LSD按照值的大小依次排入相应的区间。对每个区间的LSD的个数进行计数,计数值最大的那个区间的LSD的平均值即为整幅图像的噪声,记为LSDo。Between the minimum and maximum LSD, several intervals of equal intervals are established. Arrange the LSDs of all sub-blocks into corresponding intervals in sequence according to the value. The number of LSDs in each interval is counted, and the average value of the LSDs in the interval with the largest count value is the noise of the entire image, which is denoted as LSDo.
由下式可求得整幅图像的信噪比SNR:The signal-to-noise ratio (SNR) of the entire image can be obtained from the following formula:
即其基本步骤为:步骤51,原始图像输入到原始图像输入单元2011;步骤52,由图像信噪比估算单元2012对输入图像信噪比进行估算;步骤53,图像子块分割单元2013将图像分成一个个8×8图像子块;步骤54,图像子块二维量化余弦变换单元2014对各图像子块进行二维的离散余弦变换(2DCT);步骤55,图像信噪比重建单元2015根据信噪比估算结果对变换后数据进行量化,使重建图像信噪比大于原始图像信噪比10db;步骤56,图像数据编码压缩单元2016对量化后数据进行Huffman编码,实现对图像数据的压缩。That is, its basic steps are:
参阅图6为噪声掩蔽效应实验原理示意图。采用一理想的不受噪声干扰的图像作为原始输入信号,在其中加入不同方差的零均值高斯白噪声,作为含噪输入信号;采用基于DCT的JPEG压缩算法,对输入的含噪信号进行CR倍压缩;对压缩数据进行解压缩,又得到重建图像。参阅图7为噪声掩蔽效应实验结果曲线图。图中,横坐标为σc 2/σi 2,即量化失真方差与输入噪声方差的比值,纵坐标为σ2/σi 2,即重建图像总噪声方差与输入噪声方差的比值,如图所示,三条曲线分别表示输入信噪比为50db、35db、20db时关系曲线。由图可知,当σc 2/σi 2<-10db后,三条不同输入噪声下的曲线开始同时趋向于0,即σi 2≈σ2(重建图像总噪声方差约等于输入噪声方差),这表明重建图像的质量几乎取决于输入噪声的大小,而与压缩噪声(量化噪声)无关。由此,也得出了最佳压缩噪声的选取结果:只要控制压缩噪声(量化噪声)低于输入噪声10db以上,即σc 2/σi 2<-10db,就可在不增加重建图像失真的情况下加大数据压缩力度。Refer to FIG. 6 for a schematic diagram of the experimental principle of the noise masking effect. Use an ideal noise-free image as the original input signal, and add zero-mean Gaussian white noise with different variances to it as the noisy input signal; use the JPEG compression algorithm based on DCT to perform CR times on the input noisy signal Compression; decompress the compressed data, and get the reconstructed image. Refer to FIG. 7 for a graph showing the experimental results of the noise masking effect. In the figure, the abscissa is σ c 2 /σ i 2 , which is the ratio of the quantization distortion variance to the input noise variance, and the ordinate is σ 2 /σ i 2 , which is the ratio of the total noise variance of the reconstructed image to the input noise variance, as shown in As shown, the three curves respectively represent the relationship curves when the input signal-to-noise ratio is 50db, 35db, and 20db. It can be seen from the figure that when σ c 2 /σ i 2 <-10db, the curves under the three different input noises start to tend to 0 at the same time, that is, σ i 2 ≈σ 2 (the total noise variance of the reconstructed image is approximately equal to the input noise variance), This shows that the quality of the reconstructed image depends almost on the magnitude of the input noise and has nothing to do with the compression noise (quantization noise). Therefore, the selection result of the best compression noise is also obtained: as long as the compression noise (quantization noise) is controlled to be 10db lower than the input noise, that is, σ c 2 /σ i 2 <-10db, the reconstruction image can be reconstructed without increasing distortion In the case of increased data compression.
本发明的基于噪声掩蔽的压缩方法就是在σc 2/σi 2<-10db的基础上实现的。举一OMIS(实用型模块化成像光谱仪)超光谱图像压缩实例。对于含噪的OMIS超光谱图像,其原始图像信噪比SNRi为:The compression method based on noise masking of the present invention is realized on the basis of σ c 2 /σ i 2 <-10db. Give an example of OMIS (Modular Imaging Spectrometer Practical) hyperspectral image compression. For the noisy OMIS hyperspectral image, the signal-to-noise ratio (SNR) of the original image is:
重建图像信噪比SNRo为:The reconstructed image signal-to-noise ratio SNRo is:
由噪声掩蔽效应实验结果,令According to the experimental results of noise masking effect, let
代入SNRo,得Substitute into SNRo, get
因此,对于含噪超光谱图像的有损压缩,只要控制重建图像信噪比SNRo比原始图像信噪比SNRi大于10db以上,就可以保证在不增加重建图像失真的情况下提高图像的压缩倍数。基于这个思想,对OMIS图像的各波段数据进行不同程度的有损压缩,通过改变压缩算法的量化失真来控制SNRo大小,使每个波段SNRo=10+SNRi。如图8-1和图8-2所示为基于噪声掩蔽的压缩方法应用实例曲线图。其中图8-1是OMIS各波段原始图像及重建图像的信噪比曲线图;图8-2是OMIS各波段图像压缩比曲线图。从图可以看出,任一波段的图像数据,都根据其噪声污染情况得到了最大程度的压缩,而重建图像因为其SNRo始终保持比原始图像的SNRi大10db,图像信息基本无损失,图像信息得到了很好的保真。Therefore, for the lossy compression of noisy hyperspectral images, as long as the signal-to-noise ratio (SNRo) of the reconstructed image is controlled to be greater than the SNR of the original image (SNRi) by more than 10db, the compression factor of the image can be increased without increasing the distortion of the reconstructed image. Based on this idea, different degrees of lossy compression are performed on the data of each band of the OMIS image, and the size of SNR is controlled by changing the quantization distortion of the compression algorithm, so that each band SNR o =10+SNR i . Figure 8-1 and Figure 8-2 show the application example curves of the compression method based on noise masking. Among them, Figure 8-1 is the signal-to-noise ratio curve of the original image of each band of OMIS and the reconstructed image; Figure 8-2 is the curve of image compression ratio of each band of OMIS. It can be seen from the figure that the image data of any band has been compressed to the greatest extent according to its noise pollution, and the reconstructed image has basically no loss of image information because its SNRo is always 10db larger than the SNRi of the original image. Got great fidelity.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200410025691 CN1290056C (en) | 2004-07-01 | 2004-07-01 | Ultra-spectrum image real-time compression system based on noise masking |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200410025691 CN1290056C (en) | 2004-07-01 | 2004-07-01 | Ultra-spectrum image real-time compression system based on noise masking |
Publications (2)
Publication Number | Publication Date |
---|---|
CN1595445A CN1595445A (en) | 2005-03-16 |
CN1290056C true CN1290056C (en) | 2006-12-13 |
Family
ID=34663794
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200410025691 Expired - Fee Related CN1290056C (en) | 2004-07-01 | 2004-07-01 | Ultra-spectrum image real-time compression system based on noise masking |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN1290056C (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102547281A (en) * | 2011-12-29 | 2012-07-04 | 沈阳聚德视频技术有限公司 | Joint photographic experts group (JPEG) image compression concurrency control method based on digital signal processor (DSP) |
CN105652691A (en) * | 2016-02-24 | 2016-06-08 | 中国地质大学(武汉) | Power electronic control simulation system |
-
2004
- 2004-07-01 CN CN 200410025691 patent/CN1290056C/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
CN1595445A (en) | 2005-03-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101123723B (en) | Digital Video Decoding Method Based on Graphics Processor | |
CN112134567B (en) | An adaptive real-time compression method and system for absorption spectrum data | |
CN1234249C (en) | Embedded image processor | |
CN105120293A (en) | Image cooperative decoding method and apparatus based on CPU and GPU | |
CN103905831B (en) | Strip wave transform image compression method based on graphics processor | |
CN102724499B (en) | Variable-compression ratio image compression system and method based on FPGA | |
CN101415117B (en) | Transmission Method of High Realistic Image Based on GPGPU | |
Kumar et al. | A review: DWT-DCT technique and arithmetic-Huffman coding based image compression | |
CN103414901A (en) | Quick JPED 2000 image compression system | |
CN102685501B (en) | Fixed-point wavelet transform method for joint photographic experts group 2000 (JPEG2000) image compression | |
CN1169072C (en) | Pipeline discrete cosine transform equipment | |
CN1290056C (en) | Ultra-spectrum image real-time compression system based on noise masking | |
CN102300092B (en) | Lifting scheme-based 9/7 wavelet inverse transformation image decompressing method | |
Rubino et al. | Real-time rate distortion-optimized image compression with region of interest on the ARM architecture for underwater robotics applications | |
Kaur et al. | High Speed and Area Efficient 2D DWT Processor based Image Compression" Signal & Image Processing | |
CN102333222B (en) | Two-dimensional discrete wavelet transform circuit and image compression method using same | |
Datla et al. | Parallelizing motion JPEG 2000 with CUDA | |
CN1173574C (en) | Method for carrying out coding and decoding of wavelet video by digital signal processor | |
Li et al. | Rate pre-allocated compression for mapping image based on wavelet and rate-distortion theory | |
CN1317897C (en) | A parallel two-dimensional discrete wavelet transform circuit | |
CN1878313A (en) | Image compression chip based on image block dynamic division vector quantization algorithm | |
Reddy et al. | Image compression by discrete curvelet wrapping technique with simplified sphit | |
Tabra et al. | FPGA implementation of new LM-SPIHT colored image compression with reduced complexity and low memory requirement compatible for 5G | |
Çekli et al. | Enhanced SPIHT algorithm with pipelined datapath architecture design | |
CN1312933C (en) | A video image compression coding method based on dendritic structure |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
EE01 | Entry into force of recordation of patent licensing contract |
Assignee: Shanghai Nicera Sensor Co., Ltd. Assignor: Shanghai Inst. of Technical Physics, Chinese Academy of Sciences Contract fulfillment period: 2007.1.5 to 2012.1.4 contract change Contract record no.: 2008990000403 Denomination of invention: Ultra-spectrum image real-time compression system based on noise masking Granted publication date: 20061213 License type: Exclusive license Record date: 2008.9.17 |
|
LIC | Patent licence contract for exploitation submitted for record |
Free format text: EXCLUSIVE LICENCE; TIME LIMIT OF IMPLEMENTING CONTACT: 2007.1.5 TO 2012.1.4 Name of requester: SHANGHAI NISAILA TRANSDUCER CO., LTD. Effective date: 20080917 |
|
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20061213 Termination date: 20160701 |
|
CF01 | Termination of patent right due to non-payment of annual fee |