SYSTEM OF CODING AND DECODING MULTIMEDIA DATA
TECHNICAL FIELD
The present invention relates to a system of coding and decoding multimedia data. More particularly, the present invention relates to a system of coding and decoding multimedia data that codes and decodes multimedia data by using an optimum compression method according to their own characteristics.
BACKGROUND ART
Generally, multimedia data comprises image data, audio data and text data, and size of the multimedia data is very large. Thus, it needs long transmission time to transmit the multimedia data through intemet or network and it needs a mass storage medium to store the multimedia in storage mediums such as CD.
Accordingly, in order to transmit the multimedia data through internet or network, or to store the multimedia data in a storage medium, the multimedia data is compressed for minimizing its own size. In other words, multimedia data is compressed by using compression method such as Moving Picture Image Coding Experts Group (MPEG) or Joint
Photographic Experts Group (JPEG).
The multimedia data comprises different and various data such as image data, audio data and text data though, the multimedia data is coded by applying same compression method regardless of own characteristics. Thus, there is a problem in that it is inefficient that compressibility of multimedia data is low.
DISCLOSURE OF INVENTION
The present invention is to solve the above problem and the object of the present invention is to provide a system of coding and decoding multimedia data which may improve compressibility of multimedia data by splitting the multimedia data comprising image data, audio data and text data according to their own characteristics and by coding and decoding the multimedia data using an optimum compression method.
' In order to achieve at least the above objects, in whole or in parts, there is provided a system of coding and decoding multimedia data, including: a coding system for coding the multimedia data after splitting the multimedia data according to characteristics and for creating a file with each data coded according to their own characteristics; and a decoding system for decoding the multimedia data created into the file by the coding system after dividing the file into the each data and for restoring the original multimedia data by synthesizing the each data decoded according to characteristics.
The coding system includes: a data separation unit for splitting the multimedia data, including various kinds of data, according to characteristics of each data; a number of codecs for coding each data, split by the data separation unit, by using optimum compression methods according to characteristics of the each data; and a data composition unit for creating a file with each data coded by the codec.
The data separation unit splits the multimedia data into data such as image data, audio data and text data according to their characteristics and includes: a binary coded processing unit for transforming input image, multimedia data including various kinds of data, into binary map data by binary coding the input image; a noise reduction unit for extracting
text components by removing noise included in the binary map data transformed by the binary coded processing unit; and a mask operation unit for extracting color components that the noise, included in the binary map data transformed by the binary coded processing unit, and the text components are removed. The mask operation unit extracts color components, that text components are removed, by performing mask operation for the binary map data whose noise is removed and the multimedia data, and includes an Infinite Impulse Response (JJR) filter for filtering the extracted color components.
The data composition unit is implemented by a multiplexer (MUX) for creating a file with each data coded by the codec by multiplexing the each data.
The decoding system includes: a data decomposition unit for dividing the file into each data according to characteristics of the each data; a number of codecs for decoding the each data, divided by the data decomposition unit, according to characteristics of the each data by using decoding method corresponding to the coding method; and a data restoration unit for restoring the original multimedia data by synthesizing the each data decoded by the codec.
The data restoration unit is implemented by a demultiplexer for splitting multimedia data according to the characteristics by demultiplexing the multimedia data created into the file by the coding system.
BRD2F DESCRD7TION OF THE DRAWINGS
Figure 1 illustrates a configuration of system of coding and decoding multimedia data according to the present invention.
Figure 2 illustrates a configuration of system of coding and decoding multimedia
data according to one preferred embodiment of the present invention.
Figure 3 illustrates a detailed configuration of a data separation unit illustrated in Figure 2.
Figure 4 is a drawing for explaining operations of binary coded processing unit illustrated in Figure 3.
Figures 5 and 6 are drawings for explaining method of removing noise according to the present invention.
Figure 7 is a drawing for explaining mask operation according to the present invention. Figure 8 is a drawing for explaining operations of data composition unit illustrated in Figure 2.
Figure 9 is a drawing for explaining operations of data decomposition unit illustrated in Figure 2.
of codes for important parts in drawings* 10: coding system 11 : data separation unit
12: codec 13: data composition unit
20: decoding system 21 : data decomposition unit
22: codec 23 : data restoration unit
BEST MODE FOR CARRYING OUT THE INVENTION
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
Figure 1 illustrates a configuration of system of coding and decoding multimedia
data according to the present invention. The system of coding and decoding multimedia data according to the present invention includes: a coding system 10 for creating a file after coding multimedia data according to characteristics; and a decoding system 20 for restoring the original multimedia data by synthesizing each data after decoding the file, created by the coding system 10, according to characteristics of the each data.
The coding system 10 includes: a data separation unit 11 for splitting multimedia data, including various kinds of data, such as image data, audio data and text data, according to characteristics of each data; a number of codecs 12 for coding each data, split by the data separation unit 11, by using optimum compression methods according to characteristics of the each data; and a data composition unit 13 for creating a file with data, such as image data, audio data and text data, coded by the codec 12.
The decoding system 20 includes: a data decomposition unit 21 for dividing the file into each data, such as image data, audio data and text data; a number of codecs for decoding the each data, such as image data, audio data and text data, divided by the data decomposition unit 21 , by using decoding method corresponding to the coding method; and a data restoration unit for restoring the original multimedia data by synthesizing the each data, such as image data, audio data and text data, coded by the codec.
Figure 2 illustrates a configuration of system of coding and decoding multimedia data according to one preferred embodiment of the present invention. Figure 2 illustrates a system of coding and decoding multimedia data including image data and text data.
A data separation unit 11 in a coding system 10 splits inputted multimedia data into image data and text data. The split image data (Real Color Image Data) is coded by real color image codec 12a that uses compression method such as JPEG, JPEG 2000, wavelet transform and is transformed into Color Image Coded (CIC) data.
The text data (Small Color Image Data) split by the data separation unit 11 is transformed into Binary Image Coded (BIC) data by small color image codec 12b that uses compression method such as JBIG. The image data and text data coded by using optimum compression method is created into a file by a data composition unit 13. In other words, a binary coded processing unit 1 la, as illustrated in Figure 3, extracts text area ("gray area") by binary coding input image, multimedia data including image components and text components, using algorithm like Equation 1 and transforms the multimedia data into binary map data by removing noise included in the area.
[Equation 1] X={r, g, b} min=MIN(r, g, b); max=MAX(r, g, b); diffhmax-min; if(max>=50){ if(difϊ th) "X is color" else "X is gray"
} else {
"X is gray"
}
A component of pixel X of the input image is {r, g, b}. The binary coded processing unit 11a calculates a maximum value (max) and a minimum value (min) of {r, g, b} and determines the pixel X as "gray" if the maximum value is less than 50. Further, if the maximum value is more than or equal to 50 and difference (diff) between the maximum value and the minimum value is more than threshold value (th), the binary coded processing unit 11a
determines the pixel X as "color". In contrast, if the maximum value is more than or equal to 50 and the difference between the maximum value and the minimum value is less than the threshold value (th), the binary coded processing unit determines the pixel X as "gray."
As described above, if the pixel X is determined as "gray" after determining whether the pixel X is "color" or "gray," the binary coded processing unit 1 la assumes a value of adjacent area as "gray." Pixels C0-C3 adjacent to the pixel X, as illustrated in Figure 4, is assumed as "gray" area. In the case illustrated in Figure 4, it is desirable to determine the pixels again by turning the image upside down because determination is performed in the right direction. On the other hand, if text area is detected as described above, the binary coded processing unit 11a removes noise included in the text area, other words, X is determined by checking Least Significant Bit (LSB) of 8 pixels C0-C7 adjacent to pixel X to be removed as noise as illustrated in Figure 5a or pixel X is determined by using pixels C0-C3 surrounding four sides of the pixel X as illustrated in Figure 5b. For example, if left side of Figure 6a illustrates area of which noise is to be removed, noise is removed by putting pixel X as "1" considering boundary in vertical direction, as illustrated in right side of Figure 6a. Further, if left side of Figure 6b illustrates area of which noise is to be removed, noise is removed by changing the value of pixel X into "0" in order a value of the pixel X to be equal to values of pixels surrounding four sides of the pixel X, as illustrated in right side of Figure 6b.
BIC data, text components obtained after removing noise included in the text area, may be extracted by removing noise included in binary map data, an output of the binary coded processing unit 11a, through a noise reduction unit 1 lb employing the same method as above.
Further, CIC data, color components of which text components are removed, is extracted by performing mask operation for binary map data and multimedia data through a mask operation unit lie after removing noise included in binary map data. The color components are filtered by UR filter. In other words, if a value of a current pixel is X as illustrated in Figure 7, a value of filtered X is obtained by Equation 2.
[Equation 2] X=(Cl+C2+C3+C4+C5+C6+C7+X)/8
Image components and text components of multimedia data split by the data separation unit 11 are separately coded by a real color image codec 12a which uses a compression method such as JPEG, JPEG 2000 and wavelet transform and a small color image codec 12b which uses a compression method such as JBIG and are respectively transformed into CIC data and BIC data. CIC data, which is coded image components, and BIC data, which is coded text components, are multiplexed by a MUX 13a in a data composition unit 13 as illustrated in Figure 8 and are created into a file.
As described above, the present invention may improve compressibility of data by splitting multimedia data including image data and text data according to their characteristics and by coding the each data in optimum compression method.
On the other hand, decoding is progressed in reverse order of coding. In other words, a DEMUX 21a in a data decomposition unit 21 divides the file, an output of the data composition unit 13, into image data and text data according to their characteristics. The divided image data and text data is decoded by codec 22a, 22b which uses decoding method
corresponding to the coding method and decoded data is restored into the original multimedia data by a data restoration unit 23.
INDUSTRIAL APPLICABILITY
As apparent from the above description of the present invention, it is made possible to improve compressibility of data by splitting multimedia data including image data, audio data and text data according to their characteristics and by coding and decoding the split data using optimum compression method. Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.