CN109636756B - Wavelet system for embedded image processing - Google Patents
Wavelet system for embedded image processing Download PDFInfo
- Publication number
- CN109636756B CN109636756B CN201811527446.4A CN201811527446A CN109636756B CN 109636756 B CN109636756 B CN 109636756B CN 201811527446 A CN201811527446 A CN 201811527446A CN 109636756 B CN109636756 B CN 109636756B
- Authority
- CN
- China
- Prior art keywords
- image data
- reconstruction
- module
- decomposition
- decomposed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000354 decomposition reaction Methods 0.000 claims abstract description 139
- 238000000034 method Methods 0.000 claims description 11
- 238000013500 data storage Methods 0.000 claims description 6
- 230000009466 transformation Effects 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/63—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/63—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
- H04N19/635—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by filter definition or implementation details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20064—Wavelet transform [DWT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses an embedded image processing wavelet system, which comprises j decomposition modules, processing modules and j reconstruction modules, wherein the processing modules are positioned between the j decomposition modules and the j reconstruction modules; the image data are decomposed into image data HH, HL, LH and LL through j decomposition modules in sequence, and are transmitted to the image processing module for processing, and the processed image data HH ', HL', LH 'and LL' are reconstructed into processed image data through j reconstruction modules in sequence. The embedded image processing wavelet system constructs a processing core with internal storage and processing capacity by storing and processing image data in a grading manner, limits multistage wavelet decomposition, image processing and wavelet reconstruction in the processing core, effectively enhances the multi-level reconfigurability of wavelet processing and can adapt to wavelet transformation and processing of different wavelets and different levels.
Description
Technical Field
The invention relates to the field of digital circuits, in particular to a wavelet system for embedded image processing.
Background
Wavelet transformation is used as a key technology in image processing, and different levels of detail information can be obtained through wavelet decomposition of different levels. The wavelet base can effectively extract the space information and the frequency information of the image at the same time. And the image size and storage amount are unchanged during the wavelet transform. Therefore, wavelet transform is widely used in image compression, image enhancement, and image fusion.
Typically, wavelet transformation and processing occurs at the software level or in an algorithmic processor where there is mass storage, such as an ISP or GPU. While embedded schemes rarely occur because of the limited storage of image data in embedded image processing and the great difficulty in controlling the flow of image data and processing the image data. With the increase of image processing requirements and process level, how to embed a simple wavelet processing module in the CIS image sensor to complete basic filtering or image compression processing, and gradually increase the agenda.
Disclosure of Invention
The invention aims to provide an embedded image processing wavelet system, which constructs a processing core with internal storage and processing capacity by storing and processing image data in a grading way, limits multilevel wavelet decomposition, image processing and wavelet reconstruction in the processing core, effectively enhances the multilevel reconfigurability of wavelet processing and can adapt to wavelet transformation and processing of different wavelets and different basic levels.
In order to achieve the above purpose, the present invention adopts the following technical scheme: the wavelet system for embedded image processing comprises j decomposition modules, processing modules and j reconstruction modules, wherein the processing modules are positioned between the j decomposition modules and the j reconstruction modules; the image data are decomposed into image data HH, HL, LH and LL through j decomposition modules in sequence, and are transmitted to the image processing module for processing, and the processed image data HH ', HL', LH 'and LL' are reconstructed into processed image data through j reconstruction modules in sequence;
the decomposition module decomposes the input image data into image data HH i 、HL i 、LH i And LL (all) i Wherein the 1 st decomposition module is an initial decomposition module for performing a first layer decomposition on the input image data, and the input image data is decomposed into image data HH by the 1 st decomposition module 0 、HL 0 、LH 0 And LL (all) 0 And transmitting the data to a 2 nd decomposition module; the 2 nd to the j th decomposition modules transmit the image data HH transmitted from the last decomposition module i 、HL i And LH i Output as it is, at the same time transmit the image data LL i Further decomposed into image data HH i+1 、HL i+1 And LH i+1 The method comprises the steps of carrying out a first treatment on the surface of the Wherein i represents the i+1th decomposition module, i is more than or equal to 1 and less than or equal to j-2;
the image data after being decomposed by the j decomposition modules are transmitted to the image data signal processing module for image data processing, and the processed image data is transmitted to the j reconstruction modules, wherein the j reconstruction modules are initial reconstruction modules and are used for processing the image data HH decomposed by the j decomposition modules after being processed by the image data signal processing module j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ' reconstruction is carried out, and the j-1 reconstruction module to the 1 st reconstruction module respectively decompose the corresponding decomposition module into image data HH i 、HL i 、LH i And LL (all) i Performing reconstruction, wherein i represents an i+1th reconstruction module, i is more than or equal to 1 and less than or equal to j-2; j is the decomposition level number and the reconstruction level number of the wavelet processing system, and j is not less than 1.
Further, the 1 st decomposition module outputs the image data HH 0 、HL 0 、LH 0 And LL (all) 0 ；
The 2 nd decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 And LL (all) 1 Wherein the image data HH 1 、HL 1 、LH 1 And LL (all) 1 For image data LL 0 Image data output through the 2 nd decomposition module;
the 3 rd decomposition module outputs image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 、HH 2 、HL 2 、LH 2 And LL (all) 2 Wherein the image data HH 2 、HL 2 、LH 2 And LL (all) 2 For image data LL 1 Image data output through the 3 rd decomposition module;
until the jth decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 、HH 2 、HL 2 、LH 2 ……HH j-1 、HL j-1 、LH j-1 And LL (all) j-1 Wherein the image data HH j-1 、HL j-1 、LH j-1 And LL (all) j-1 For image data LL j-2 Image data output through the j-th decomposition module;
the image data outputted by the j-th decomposition module is processed and outputted by the image processing module, and the signal processing module outputs the image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ’。
Further, the jth reconstruction module outputs image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-2 ’、HL j-2 ’、LH j-2 ' and LL j-2 ' wherein the image data HH j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ' reconstruction into image data LL via a j-th reconstruction module j-2 ’；
The j-1 th reconstruction module outputs the image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-3 ’、HL j-3 ’、LH j-3 ' and LL j-3 ' wherein the image data HH j-2 ’、HL j-2 ’、LH j-2 ' and LL j-2 ' reconstruction into image data LL through j-1 reconstruction module j-3 ’；
Until the 2 nd reconstruction module outputs the image data HH 0 ’、HL 0 ’、LH 0 ' and LL 0 ' wherein the image data HH 1 ’、HL 1 ’、LH 1 And LL (L) 1 ' reconstruction into image data LL via a 2 nd reconstruction module 0 ’；
The 1 st reconstruction module outputs the processed image data, wherein the image data HH 0 ’、HL 0 ’、LH 0 ' and LL 0 ' the 1 st reconstruction module reconstructs as processed image data.
Further, the decomposition module comprises a decomposition image data input port, a non-decomposition image data input port, a control signal input port, a decomposition image data output port, a non-decomposition image data output port and a control signal output port; the image data input and output by the decomposed image data input port and the decomposed image data output port are respectively the image data needing to be decomposed and the image data decomposed by the decomposition module; the image data input and output by the non-decomposed image data input port and the non-decomposed image data output port are image data which do not need to be decomposed; the decomposed image data output port, the non-decomposed image data output port and the control signal output port in the decomposed module are respectively connected with the decomposed image data input port, the non-decomposed image data input port and the control signal input port of the next decomposed module;
the reconstruction module comprises a reconstruction image data input port, a non-reconstruction image data input port, a control signal input port, a reconstruction image data output port, a non-reconstruction image data output port and a control signal output port; the image data input and output by the reconstruction image data input port and the reconstruction image data output port are respectively the image data needing to be reconstructed and the image data decomposed by the reconstruction module; the image data input and output by the non-reconstruction image data input port and the non-reconstruction image data output port are image data which do not need to be reconstructed; the reconstruction image data output port, the non-reconstruction image data output port and the control signal output port in the reconstruction module are respectively connected with the reconstruction image data input port, the non-reconstruction image data input port and the control signal input port of the next reconstruction module.
Further, the decomposition module comprises a memory control unit I, a decomposition unit, a decomposition control unit and an image data identifier generation unit I; the decomposition control unit is connected with and controls the memory control unit I and the image data identifier generation unit I at the same time; the input port of the memory control unit I is connected with the decomposed image data input port and the non-decomposed image data input port of the decomposition module, the output port is connected with the reconstructed image data output port and the non-reconstructed image data output port of the decomposition unit, and the memory control unit I is connected with the storage area I and is used for distributing the storage of input image data and reading stored image data; the input port of the image data identifier generating unit I is connected with the control signal input port of the decomposing unit, and the output port of the image data identifier generating unit I is connected with the control signal output port of the decomposing unit and is used for generating the image data identification signal of the decomposing unit.
Further, the decomposition unit comprises a delay subunit I, and the image data input by the non-decomposition image data input port of the decomposition module is output through the delay subunit I and the non-decomposition image data output port.
Further, the storage area I comprises line data storage and frame level storage, the length of the wavelet base is N, and when N is an odd number larger than 1, the storage area I stores line data of N lines and frame level data of (N-1)/2 lines; when N is an even number greater than 1, the storage area i stores data of N lines and frame level data of N/2 lines.
Further, the reconstruction module comprises a memory control unit II, a reconstruction unit, a reconstruction control unit and an image data identifier generation unit II; the reconstruction control unit is connected with and controls the memory control unit II and the image data identifier generation unit II at the same time; the input port of the memory control unit II is connected with the reconstructed image data input port and the non-reconstructed image data input port of the reconstruction module, the output port is connected with the reconstructed image data output port and the non-reconstructed image data output port of the reconstruction unit, and the memory control unit II is connected with the storage area II and is used for distributing the storage of input image data and reading the stored image data; the input port of the image data identifier generating unit II is connected with the control signal input port of the reconstruction unit, and the output port of the image data identifier generating unit II is connected with the control signal output port of the reconstruction unit and is used for generating the image data identification signal of the reconstruction unit.
Further, the reconstruction unit includes a delay subunit ii, and the image data input from the non-reconstruction image data input port of the reconstruction module is output through the delay subunit and the non-reconstruction image data output port.
Further, the storage area II comprises line data storage and frame level storage, the length of the wavelet base is N, and when N is an odd number larger than 1, the storage area II stores line data of N lines and frame level data of (N-1)/2 lines; when N is an even number greater than 1, the storage area ii stores data of N lines and frame level data of N/2 lines.
The beneficial effects of the invention are as follows: by hierarchically storing and processing the image data, a processing core with internal storage and processing capacity is constructed, and multilevel wavelet decomposition, image processing and wavelet reconstruction are limited in the processing core, so that the multilevel reconfigurability of wavelet processing is effectively enhanced, and the method can adapt to wavelet transformation and processing of different wavelets and different levels. By storing a certain number of lines of image data, the washhift operation in wavelet transformation is completed, the problem of maintaining the total image data amount while reducing the influence of boundary results is solved, and the wavelet decomposition and reconstruction of the whole image are achieved.
Drawings
FIG. 1 is a schematic diagram of wavelet decomposition results of a two-dimensional structure.
Fig. 2 is a data flow of the embedded image processing of the present invention.
Fig. 3 is a block diagram of a wavelet system for embedded image processing in accordance with the present invention.
Fig. 4 is a schematic diagram of a decomposition module according to the present invention.
Fig. 5 is a schematic diagram of a reconstruction module according to the present invention.
Fig. 6 is a schematic diagram of a two-stage decomposition reconstruction with a wavelet base length of 6 in an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following detailed description of the specific embodiments of the present invention will be given with reference to the accompanying drawings.
The image wavelet transformation, i.e. two-dimensional wavelet transformation, is to apply one-dimensional wavelet transformation to the horizontal and vertical directions of the image matrix to construct a two-dimensional scale functionNumber of digits
And three two-dimensional wavelets ψ H (x,y)，ψ V (x,y)，ψ D (x,y)。
As shown in fig. 1, the image data is output after the image data is subjected to multi-level wavelet transform. After the image data is subjected to the single-stage wavelet decomposition, four images of HH0, HL0, LH0, and LL0 are generated, wherein LL0 continues the wavelet decomposition in the next stage, yielding HH1, HL1, LH1, and LL1. And repeating the operation, and decomposing the LL1. A new decomposed image vector is generated. In the process of continuous decomposition, the total size of the image data is unchanged, and the total amount of the image data is unchanged. During the wavelet reconstruction, the opposite operation is performed, each time a new LL layer is generated. The total amount of image data remains unchanged.
Based on this, an image line storage structure is designed in which lines and columns in image data can be interchanged. Referring to fig. 2 and 3, the present invention includes j decomposition modules, a processing module, and j reconstruction modules, where the processing module is located between the j decomposition modules and the j reconstruction modules; the image data is decomposed into sum and sum through j decomposition modules in sequence, and is transmitted to an image processing module for processing, and the processed sum are reconstructed into processed image data through j reconstruction modules in sequence;
the decomposition module decomposes the input image data into image data HH, HL, LH and LL, and transmits the image data to the image processing module for processing, and the processed image data HH ', HL', LH 'and LL' are sequentially reconstructed into processed image data through j reconstruction modules;
the decomposition module decomposes the input image data into image data HH i 、HL i 、LH i And LL (all) i Wherein the 1 st decomposition module is an initial decomposition module for performing a first layer decomposition on the input image data, and the input image data is decomposed into image data HH by the 1 st decomposition module 0 、HL 0 、LH 0 And LL (all) 0 And transmitting the data to a 2 nd decomposition module; the 2 nd decomposition module to the j th decomposition module divide the lastImage data HH transmitted from the de-module i 、HL i And LH i Output as it is, at the same time transmit the image data LL i Further decomposed into image data HH i+1 、HL i+1 And LH i+1 The method comprises the steps of carrying out a first treatment on the surface of the Wherein i represents the i+1th decomposition module, i is more than or equal to 1 and less than or equal to j-2;
the image data after being decomposed by the j decomposition modules are transmitted to the image data signal processing module for image data processing, and the processed image data is transmitted to the j reconstruction modules, wherein the j reconstruction modules are initial reconstruction modules and are used for processing the image data HH decomposed by the j decomposition modules after being processed by the image data signal processing module j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ' reconstruction is carried out, and the j-1 reconstruction module to the 1 st reconstruction module respectively decompose the corresponding decomposition module into image data HH i 、HL i 、LH i And LL (all) i Performing reconstruction, wherein i represents an i+1th reconstruction module, i is more than or equal to 1 and less than or equal to j-2; j is the decomposition level number and the reconstruction level number of the wavelet processing system, and j is not less than 1.
Referring specifically to fig. 2 and 3, the 1 st decomposition module outputs image data HH 0 、HL 0 、LH 0 And LL (all) 0 The method comprises the steps of carrying out a first treatment on the surface of the The 2 nd decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 And LL (all) 1 Wherein the image data HH 1 、HL 1 、LH 1 And LL (all) 1 For image data LL 0 Image data output through the 2 nd decomposition module; the 3 rd decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 、HH 2 、HL 2 、LH 2 And LL (all) 2 Wherein the image data HH 2 、HL 2 、LH 2 And LL (all) 2 For image data LL 1 Image data output through the 3 rd decomposition module; until the jth decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 、HH 2 、HL 2 、LH 2 ……HH j-1 、HL j-1 、LH j-1 And LL (all) j-1 Wherein the image data HH j-1 、HL j-1 、LH j-1 And LL (all) j-1 For image data LL j-2 The image data output through the j-th decomposition module.
The image data output by the j decomposition module is processed and output by the image processing module, and the signal processing module outputs as image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ’。
The j-th reconstruction module outputs the image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-2 ’、HL j-2 ’、LH j-2 ' and LL j-2 ' wherein the image data HH j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ' reconstruction into image data LL via a j-th reconstruction module j-2 'A'; the j-1 th reconstruction module outputs the image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-3 ’、HL j-3 ’、LH j-3 ' and LL j-3 ' wherein the image data HH j-2 ’、HL j-2 ’、LH j-2 ' and LL j-2 ' reconstruction into image data LL through j-1 reconstruction module j-3 'A'; until the 2 nd reconstruction module outputs the image data HH 0 ’、HL 0 ’、LH 0 ' and LL 0 ' wherein the image data HH 1 ’、HL 1 ’、LH 1 And LL (L) 1 ' reconstruction into the number of images through the 2 nd reconstruction moduleAccording to LL 0 'A'; the 1 st reconstruction module outputs the processed image data, wherein the image data HH 0 ’、HL 0 ’、LH 0 ' and LL 0 ' the 1 st reconstruction module reconstructs as processed image data.
In the invention, in the decomposing process, the image data which does not need to be decomposed in the image data output by each decomposing module occupies the original position and is required to be decomposed into new image data, and the new image data is stored in the position of the decomposed image data; the total data amount is unchanged in the whole process, and is just a process of classifying and rearranging the data in the image data. In the reconstruction process, the same storage principle is adopted, and the image data to be reconstructed in each reconstruction module occupies the position of the previous image data after reconstruction until the final reconstruction is the processed image data.
Referring to fig. 3, the decomposition module of the present invention includes a decomposition image data input port D i IN, non-decomposed image data input port DUP i IN, control signal input port CTRL i Split image data output port D i OUT, non-decomposed image data output port DUP i OUT and control signal output port CTRL i OUT; the image data input and output by the decomposed image data input port and the decomposed image data output port are respectively the image data needing to be decomposed and the image data decomposed by the decomposition module; the image data input and output by the non-decomposed image data input port and the non-decomposed image data output port are image data which do not need to be decomposed; the decomposed image data output port, the non-decomposed image data output port and the control signal output port in the decomposed module are respectively connected with the decomposed image data input port, the non-decomposed image data input port and the control signal input port of the next decomposed module. The reconstruction module comprises a reconstruction image data input port B i IN, non-reconstruction of image data input port BUP i IN, control signal input port CTRLO i IN, reconstructed image data output port B i OUT, non-reconstructed image data outputPort BUP i OUT and control signal output port CTRLO i OUT; the image data input and output by the reconstruction image data input port and the reconstruction image data output port are respectively the image data needing to be reconstructed and the image data decomposed by the reconstruction module; the image data input and output by the non-reconstruction image data input port and the non-reconstruction image data output port are the image data which do not need to be reconstructed; the reconstruction image data output port, the non-reconstruction image data output port and the control signal output port in the reconstruction module are respectively connected with the reconstruction image data input port, the non-reconstruction image data input port and the control signal input port of the next reconstruction module.
As shown in fig. 4, which is a schematic diagram of the decomposition module, since there is only one decomposition unit, in fig. 4, the decomposed image data output port, the non-decomposed image data output port, and the control signal output port of the ith decomposition module are respectively represented as: d (D) i _OUT，DUP i OUT and CTRL i _OUT。
The decomposition module comprises a memory control unit I, a decomposition unit, a decomposition control unit and an image data identifier generation unit I; the decomposition control unit is connected with and controls the memory control unit I and the image data identifier generating unit I at the same time; the input port of the memory control unit I is connected with the decomposed image data input port and the non-decomposed image data input port of the decomposition module, the output port is connected with the reconstructed image data output port and the non-reconstructed image data output port of the decomposition unit, and the memory control unit I is connected with the storage area I and is used for distributing the storage of input image data and reading the stored image data; the input port of the image data identifier generating unit I is connected with the control signal input port of the decomposing unit, the output port of the image data identifier generating unit I is connected with the control signal output port of the decomposing unit for generating the image data identification signal of the decomposing unit,
it is noted that since wavelet transformation needs to ensure that the total amount of image data is unchanged, a washover operation is necessary. For each frame image, the calculation results of the first few lines are stored (the total amount of image data needs to be divided by 2 due to downsampling), and finally read out from the storage area, and added to the calculation results of the last few lines, thereby reducing the influence of the boundary on image processing. Referring to fig. 4 specifically, the storage area i includes a line data storage and a frame level storage, where the length of the wavelet base is N, and when N is an odd number greater than 1, the storage area i stores line data of N lines and frame level data of (N-1)/2 lines; when N is an even number greater than 1, the storage area i stores data of N lines and frame level data of N/2 lines.
Note that, the line storage for storing the frame-level image data may be omitted in the 1 st decomposition module, and therefore, the storage area in the 1 st decomposition module only needs to store the image data of N lines.
The decomposition unit comprises a delay subunit I, and the image data input by the non-decomposition image data input port of the decomposition module is output through the delay subunit I and the non-decomposition image data output port.
As shown in fig. 5, since there is only one reconstruction unit, in fig. 4, the image data input to the reconstruction image data output port, the non-reconstruction image data output port, and the control signal output port of the i-th stage reconstruction module are represented as: b (B) i _OUT，BUP i OUT and CTRLO i _OUT。
The reconstruction module comprises a memory control unit II, a reconstruction unit, a reconstruction control unit and an image data identifier generation unit II; the reconstruction control unit is connected with and controls the memory control unit II and the image data identifier generating unit II at the same time; the input port of the memory control unit II is connected with the reconstructed image data input port and the non-reconstructed image data input port of the reconstruction module, the output port is connected with the reconstructed image data output port and the non-reconstructed image data output port of the reconstruction unit, and the memory control unit II is connected with the storage area II and is used for distributing the storage of input image data and reading the stored image data; the input port of the image data identifier generating unit II is connected with the control signal input port of the reconstruction unit, and the output port of the image data identifier generating unit II is connected with the control signal output port of the reconstruction unit and is used for generating the image data identification signal of the reconstruction unit.
The reconstruction unit comprises a delay subunit II, and the image data input by the non-reconstruction image data input port of the reconstruction module is output through the delay subunit and the non-reconstruction image data output port.
Similar to the decomposition module, since wavelet transformation needs to ensure that the total amount of image data is unchanged, a washover operation is necessary. For each frame image, the calculation results of the first few lines are stored (the total amount of image data needs to be divided by 2 due to downsampling), and finally read out from the storage area, and added to the calculation results of the last few lines, thereby reducing the influence of the boundary on image processing. Referring to fig. 5, a storage area ii includes a line data storage and a frame level storage, where the length of the wavelet base is N, and when N is an odd number greater than 1, the storage area ii stores line data of N lines and frame level data of (N-1)/2 lines; when N is an even number greater than 1, the storage area ii stores data of N lines and frame level data of N/2 lines.
The port of the processing module is basically the same as that of the decomposition module, and the specific structure of the processing module can be specifically determined according to the processing mode of the processing module, and needless to say, the processing module also needs to distinguish processing image data from non-processing image data.
As shown in fig. 6, the embedded wavelet circuit with the wavelet base length of 6 and through two-stage decomposition and two-stage reconstruction is shown. The decomposed image data input port, the non-decomposed image data input port, and the control signal input port of the 1 st decomposition module are respectively inputted with image data expressed as: d (D) 1 _IN，DUP 1 IN and CTRL 1 IN, the decomposed image data output port, the non-decomposed image data output port, and the control signal output port of the 1 st decomposed module are connected to the decomposed image data input port, the non-decomposed image data input port, and the control signal input port of the 2 nd decomposed module, respectively, so that the decomposed image data input port, the non-decomposed image data input port, and the non-decomposed image data input port of the 2 nd decomposed module are connected to the control signal input port, respectivelyThe image data respectively inputted from the port and the control signal input port are expressed as: d (D) 2 _IN，DUP 2 IN and CTRL 2 The decomposed image data output port, the non-decomposed image data output port, and the control signal output port of the 2 nd decomposition module are respectively expressed as: d (D) 2 _OUT，DUP 2 OUT and CTRL 2 And the OUT is introduced into a decomposed image data input port, a non-decomposed image data input port and a control signal input port of the processing module ISP, and the reconstructed image data output port, the non-reconstructed image data output port and the control signal input port of the processing module ISP are respectively connected with the 2 nd-stage reconstruction module, wherein the reconstructed image data input port, the non-reconstructed image data input port and the control signal input port are respectively connected with the 2 nd-stage reconstruction module. The image data input by the reconstruction image data input port, the non-reconstruction image data input port and the control signal input port of the 2 nd stage reconstruction module are expressed as: b (B) 2 _IN，BUP 2 IN and CTRRO 2 IN, since the reconstructed image data output port, the non-reconstructed image data output port, and the control signal output port of the 2 nd stage reconstruction module are connected to the reconstructed image data input port, the non-reconstructed image data input port, and the control signal input port of the 1 st stage reconstruction module, respectively, the reconstructed image data input port, the non-reconstructed image data input port, and the control signal input port of the 1 st stage reconstruction module are expressed as: b (B) 1 _IN，BUP 1 IN and CTRRO 1 IN, the reconstructed image data output port, the non-reconstructed image data output port, and the control signal output port of the stage 1 reconstruction module are respectively inputted with image data expressed as: b (B) 1 _OUT，BUP 1 OUT and CTRLO 1 OUT, where B 1 OUT and BUP 1 OUT represents image data after decomposition and reconstruction by the wavelet circuit and image data without decomposition and reconstruction, respectively.
Since the line storage for storing the frame-level image data can be omitted in the 1 st-stage analysis module, the storage area in the 1 st-stage analysis module only needs to store 6 lines of image data.
The foregoing description is only of the preferred embodiments of the present invention, and the embodiments are not intended to limit the scope of the invention, so that all changes made in the structure and details of the invention which may be regarded as equivalents thereof are intended to be included within the scope of the invention as defined in the following claims.
Claims (10)
1. The wavelet system for embedded image processing is characterized by comprising j decomposition modules, a processing module and j reconstruction modules, wherein the processing module is positioned between the j decomposition modules and the j reconstruction modules; the image data are decomposed into image data HH, HL, LH and LL through j decomposition modules in sequence, and are transmitted to the processing module for processing, and the processed image data HH ', HL', LH 'and LL' are reconstructed into processed image data through j reconstruction modules in sequence;
the decomposition module decomposes the input image data into image data HH i 、HL i 、LH i And LL (all) i Wherein the 1 st decomposition module is an initial decomposition module for performing a first layer decomposition on the input image data, and the input image data is decomposed into image data HH by the 1 st decomposition module 0 、HL 0 、LH 0 And LL (all) 0 And transmitting the data to a 2 nd decomposition module; the 2 nd to the j th decomposition modules transmit the image data HH transmitted from the last decomposition module i 、HL i And LH i Output as it is, at the same time transmit the image data LL i Decomposition into image data HH i+1 、HL i+1 And LH i+1 The method comprises the steps of carrying out a first treatment on the surface of the Wherein i represents the i+1th decomposition module, i is more than or equal to 1 and less than or equal to j-2;
the image data after being decomposed by the j decomposition modules are transmitted to the processing module for image data processing, and the processed image data is transmitted to the j reconstruction modules, wherein the j reconstruction module is a starting reconstruction module and is used for processing the image data HH decomposed by the j decomposition modules after being processed by the processing module j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ' perform reconstruction, the j-1 th reconstruction modeThe block to 1 st reconstruction module respectively decompose the corresponding decomposition module into image data HH i 、HL i 、LH i And LL (all) i Performing reconstruction, wherein i represents an i+1th reconstruction module, i is more than or equal to 1 and less than or equal to j-2; j is the decomposition level number and the reconstruction level number of the wavelet processing system, and j is not less than 1.
2. The wavelet system of claim 1, wherein the 1 st decomposition module outputs image data HH 0 、HL 0 、LH 0 And LL (all) 0 ；
The 2 nd decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 And LL (all) 1 Wherein the image data HH 1 、HL 1 、LH 1 And LL (all) 1 For image data LL 0 Image data output through the 2 nd decomposition module;
the 3 rd decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 、HH 2 、HL 2 、LH 2 And LL (all) 2 Wherein the image data HH 2 、HL 2 、LH 2 And LL (all) 2 For image data LL 1 Image data output through the 3 rd decomposition module;
until the jth decomposition module outputs the image data HH 0 、HL 0 、LH 0 、HH 1 、HL 1 、LH 1 、HH 2 、HL 2 、LH 2 ……HH j-1 、HL j-1 、LH j-1 And LL (all) j-1 Wherein the image data HH j-1 、HL j-1 、LH j-1 And LL (all) j-1 For image data LL j-2 Image data output through the j-th decomposition module;
the image data outputted by the j decomposition module is processed and outputted by the processing module, and the processing module outputs the image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ’。
3. The wavelet system of claim 2, wherein the j reconstruction module outputs image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-2 ’、HL j-2 ’、LH j-2 ' and LL j-2 ' wherein the image data HH j-1 ’、HL j-1 ’、LH j-1 ' and LL j-1 ' reconstruction into image data LL via a j-th reconstruction module j-2 ’；
The j-1 th reconstruction module outputs the image data HH 0 ’、HL 0 ’、LH 0 ’、HH 1 ’、HL 1 ’、LH 1 ’、HH 2 ’、HL 2 ’、LH 2 ’……HH j-3 ’、HL j-3 ’、LH j-3 ' and LL j-3 ' wherein the image data HH j-2 ’、HL j-2 ’、LH j-2 ' and LL j-2 ' reconstruction into image data LL through j-1 reconstruction module j-3 ’；
Until the 2 nd reconstruction module outputs the image data HH 0 ’、HL 0 ’、LH 0 ' and LL 0 ' wherein the image data HH 1 ’、HL 1 ’、LH 1 And LL (L) 1 ' reconstruction into image data LL via a 2 nd reconstruction module 0 ’；
The 1 st reconstruction module outputs the processed image data, wherein the image data HH 0 ’、HL 0 ’、LH 0 ' and LL 0 ' the 1 st reconstruction module reconstructs as processed image data.
4. The wavelet system of claim 1, wherein the decomposition module comprises a decomposed image data input port, a non-decomposed image data input port, a control signal input port, a decomposed image data output port, a non-decomposed image data output port, and a control signal output port; the image data input and output by the decomposed image data input port and the decomposed image data output port are respectively the image data needing to be decomposed and the image data decomposed by the decomposition module; the image data input and output by the non-decomposed image data input port and the non-decomposed image data output port are image data which do not need to be decomposed; the decomposed image data output port, the non-decomposed image data output port and the control signal output port in the decomposed module are respectively connected with the decomposed image data input port, the non-decomposed image data input port and the control signal input port of the next decomposed module;
the reconstruction module comprises a reconstruction image data input port, a non-reconstruction image data input port, a control signal input port, a reconstruction image data output port, a non-reconstruction image data output port and a control signal output port; the image data input and output by the reconstruction image data input port and the reconstruction image data output port are respectively the image data needing to be reconstructed and the image data decomposed by the reconstruction module; the image data input and output by the non-reconstruction image data input port and the non-reconstruction image data output port are image data which do not need to be reconstructed; the reconstruction image data output port, the non-reconstruction image data output port and the control signal output port in the reconstruction module are respectively connected with the reconstruction image data input port, the non-reconstruction image data input port and the control signal input port of the next reconstruction module.
5. The wavelet system for embedded image processing according to claim 4, wherein said decomposition module comprises a memory control unit i, a decomposition unit, a decomposition control unit, and an image data identifier generation unit i; the decomposition control unit is connected with and controls the memory control unit I and the image data identifier generation unit I at the same time; the input port of the memory control unit I is connected with the decomposed image data input port and the non-decomposed image data input port of the decomposition module, the output port is connected with the reconstructed image data output port and the non-reconstructed image data output port of the decomposition unit, and the memory control unit I is connected with the storage area I and is used for distributing the storage of input image data and reading stored image data; the input port of the image data identifier generating unit I is connected with the control signal input port of the decomposing unit, and the output port of the image data identifier generating unit I is connected with the control signal output port of the decomposing unit and is used for generating the image data identification signal of the decomposing unit.
6. The wavelet system for embedded image processing according to claim 5, wherein the decomposition unit includes a delay subunit i, and the image data input from the non-decomposed image data input port of the decomposition module is output through the delay subunit i and the non-decomposed image data output port.
7. The wavelet system of claim 5, wherein the storage area i includes a line data storage and a frame level storage, the length of the wavelet base is N, and when N is an odd number greater than 1, the storage area i stores line data of N lines and frame level data of (N-1)/2 lines; when N is an even number greater than 1, the storage area i stores data of N lines and frame level data of N/2 lines.
8. The wavelet system of claim 4, wherein the reconstruction module comprises a memory control unit ii, a reconstruction unit, a reconstruction control unit, and an image data identifier generation unit ii; the reconstruction control unit is connected with and controls the memory control unit II and the image data identifier generation unit II at the same time; the input port of the memory control unit II is connected with the reconstructed image data input port and the non-reconstructed image data input port of the reconstruction module, the output port is connected with the reconstructed image data output port and the non-reconstructed image data output port of the reconstruction unit, and the memory control unit II is connected with the storage area II and is used for distributing the storage of input image data and reading the stored image data; the input port of the image data identifier generating unit II is connected with the control signal input port of the reconstruction unit, and the output port of the image data identifier generating unit II is connected with the control signal output port of the reconstruction unit and is used for generating the image data identification signal of the reconstruction unit.
9. The wavelet system of claim 8, wherein the reconstruction unit includes a delay subunit ii, and the image data input from the non-reconstruction image data input port of the reconstruction module is output through the delay subunit and the non-reconstruction image data output port.
10. The wavelet system of claim 8, wherein the storage area ii includes a line data storage and a frame level storage, the length of the wavelet base is N, and when N is an odd number greater than 1, the storage area ii stores line data of N lines and frame level data of (N-1)/2 lines; when N is an even number greater than 1, the storage area ii stores data of N lines and frame level data of N/2 lines.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811527446.4A CN109636756B (en) | 2018-12-13 | 2018-12-13 | Wavelet system for embedded image processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811527446.4A CN109636756B (en) | 2018-12-13 | 2018-12-13 | Wavelet system for embedded image processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109636756A CN109636756A (en) | 2019-04-16 |
| CN109636756B true CN109636756B (en) | 2023-06-30 |
Family
ID=66073646
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811527446.4A Active CN109636756B (en) | 2018-12-13 | 2018-12-13 | Wavelet system for embedded image processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109636756B (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2439921B1 (en) * | 2009-06-04 | 2015-08-05 | Kagoshima University | Watermark information embedding apparatus, watermark information processing system, watermark information embedding method, and program |
| CN105303535A (en) * | 2015-11-15 | 2016-02-03 | 中国人民解放军空军航空大学 | Global subdivision pyramid model based on wavelet transformation |
| CN107491747A (en) * | 2017-08-08 | 2017-12-19 | 西南大学 | Face Forecasting Methodology based on regression analysis and wavelet transformation |
| CN108986074B (en) * | 2018-06-12 | 2022-05-17 | 中国矿业大学 | Coal mine underground image processing method based on blocking sparse algorithm |
-
2018
- 2018-12-13 CN CN201811527446.4A patent/CN109636756B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109636756A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Nagaraj et al. | VLSI implementation of image compression using TSA optimized discrete wavelet transform techniques | |
| Barua et al. | An efficient architecture for lifting-based two-dimensional discrete wavelet transforms | |
| CN101309415B (en) | Information processing apparatus and method | |
| Hsia et al. | Improved low-complexity algorithm for 2-D integer lifting-based discrete wavelet transform using symmetric mask-based scheme | |
| Liu et al. | A VLSI architecture of JPEG2000 encoder | |
| Lafruit et al. | An efficient VLSI architecture for 2-D wavelet image coding with novel image scan | |
| CN109636756B (en) | Wavelet system for embedded image processing | |
| Chew et al. | Very low-memory wavelet compression architecture using strip-based processing for implementation in wireless sensor networks | |
| CN109168005A (en) | A kind of two-dimensional discrete wavelet conversion construction design method improving storage efficiency | |
| CN101309418A (en) | Information processing apparatus and method | |
| JP2000350208A (en) | Device and method for digital signal conversion | |
| CN111127300B (en) | Denoising method, device and system based on image pyramid decomposition | |
| US7277489B1 (en) | Two dimensional discrete wavelet transforms | |
| JP4097108B2 (en) | Wavelet transform device and encoding / decoding device | |
| US20120155749A1 (en) | Method and device for coding a multidimensional digital signal | |
| CN102333222A (en) | Two-dimensional discrete wavelet transform circuit and image compression method using same | |
| US20080285870A1 (en) | Information processing device and method | |
| US20230267310A1 (en) | Neural network processing apparatus, information processing apparatus, information processing system, electronic device, neural network processing method, and program | |
| CN109857367B (en) | Wavelet decomposition accelerating circuit for embedded image processing | |
| JP2001285643A (en) | Image converting apparatus and method | |
| Hsieh et al. | Implementation of an Efficient DWT Using a FPGA on a Real-time Platform | |
| US6681051B1 (en) | Arrangement for transforming picture data | |
| Zhao et al. | Dual-level template for enhancing resolution of quantum images | |
| CN114710677B (en) | Image compression method, device, storage medium and terminal | |
| Qi et al. | Self-Learned Feature Reconstruction and Offset-Dilated Feature Fusion for Real-Time Semantic Segmentation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |