JP3967368B2 - Video compression program and video decompression program - Google Patents

Description

  The present invention relates to a moving image compression program for compressing moving image data, and a moving image expansion program for expanding moving image data compressed by the moving image compression program.

For example, MPEG (Moving Picture Experts Group) is known as a method for compressing / decompressing moving image data composed of a large number of continuously displayed frames (see Non-Patent Document 1, for example).
Nikkei BP Publishing Department, “Nikkei BP Digital Encyclopedia 2000-2001 Edition”, 3rd edition, published by Nikkei BP, March 20, 2000, p. 939

  In the MPEG as described above, the fact that frames adjacent to each other in time are often the same image, and the amount of information is reduced by taking the difference between frames, and then DCT (Discrete Cosine Transform) is used. Compression based on discrete cosine transform). Therefore, in the case of moving image data with a large image difference between frames, it is necessary to increase the compression rate in order to reduce the amount of information. As a result, mosquito noise and block noise similar to JPEG (Joint Photographic Experts Group) Occurs and the image quality is likely to deteriorate.

  The present invention has been made in view of the above problems, and a moving image compression program capable of compressing moving image data with high image quality even when the compression rate is increased, and compression by the moving image compression program. An object of the present invention is to provide a moving image expansion program that can expand the moving image data into high-quality moving image data.

  A moving image compression program for achieving the above object includes a computer for compressing moving image data consisting of a number of continuously displayed frames, a frame rate, a divided reference lightness difference, a divided reference saturation difference, and Storage means for storing the division reference hue difference, input means for inputting the video being shot as video data, and generation means for generating a frame at the frame rate stored by the storage means from the video data input by the input means Difference information calculating means for calculating brightness difference, saturation difference, and hue difference between adjacent pixels in the frame generated by the generating means, and the brightness difference calculated by the difference information calculating means is the storage means Dividing the frame into a plurality of lightness regions, with a plurality of pixels that are equal to or less than the division reference lightness difference stored by Dividing the frame into a plurality of saturation regions, using a plurality of pixels whose saturation difference calculated by the information calculation means is equal to or less than the division reference saturation difference stored by the storage means as one saturation region, A dividing unit that divides the frame into a plurality of hue regions by using a plurality of pixels whose hue difference calculated by the difference information calculating unit is equal to or less than the division reference hue difference stored in the storage unit as one hue region, and the division Mean value calculating means for calculating the average value of the brightness of all the pixels in the brightness area divided by the means, the average value of the saturation of all the pixels in the saturation area, and the average value of the hue of all the pixels in the hue area The lightness contour points constituting the contour of the lightness region and the contour of the chroma region are respectively constituted by the pixels in the lightness region, the pixels in the saturation region, and the pixels in the hue region divided by the dividing means. Saturation wheel A hue contour point that constitutes a point and a contour of the hue region, and a brightness feature point that constitutes a vertex of the brightness contour point from the extracted brightness contour point, saturation contour point, and hue contour point, Saturation feature points constituting the vertices of the saturation contour points, pixel compression means for extracting the hue feature points constituting the vertices of the hue contour points, and the average value of the brightness calculated by the average value calculation means And the brightness coding information consisting of the coordinates on the frame of the brightness feature points extracted by the pixel compression means are associated with the brightness area, and the average value of the saturation and the pixels calculated by the average value calculation means Saturation coding information composed of coordinates on the frame of the saturation feature points extracted by the compression unit is associated with the saturation region, and the average value of the hue calculated by the average value calculation unit and Coding compression for storing hue coding information consisting of coordinates on the frame of hue feature points extracted by the pixel compression means in association with the hue area and storing them as a compressed file of moving image data including the frame rate It is for functioning as a means.

  Another moving image compression program stores a computer for compressing moving image data composed of a number of consecutively displayed frames, and stores a division reference lightness difference, a division reference saturation difference, and a division reference hue difference. Means, data storage means for storing the compressed moving image data including the frame rate, generating means for decompressing the compressed moving image data stored in the data storage means to generate a large number of frames, and the generating means Difference information calculation means for calculating brightness difference, saturation difference, and hue difference between adjacent pixels in the generated frame, and division in which the brightness difference calculated by the difference information calculation means is stored by the storage means Saturation difference calculated by the difference information calculation means by dividing the frame into a plurality of brightness regions with a plurality of pixels having a reference brightness difference or less as one brightness region Dividing the frame into a plurality of saturation regions by using a plurality of pixels that are equal to or less than the division reference saturation difference stored by the storage unit as a saturation region, the hue difference calculated by the difference information calculation unit is Dividing means for dividing the frame into a plurality of hue areas with a plurality of pixels equal to or less than the division reference hue difference stored by the storage means, and all pixels in the brightness area divided by the dividing means Average value calculation means for calculating the average value of the brightness of all pixels in the saturation area, and the average value of the hue of all pixels in the hue area, and within the brightness area divided by the dividing means Pixels, pixels in the saturation region, and pixels in the hue region, respectively, a lightness contour point that forms the contour of the lightness region, a saturation contour point that forms the contour of the saturation region, and the contour of the hue region Configure Hue contour points are extracted, and from the extracted lightness contour points, saturation contour points, and hue contour points, lightness feature points that constitute the vertices of the lightness contour points, respectively, and saturations that constitute the vertices of the saturation contour points Pixel compression means for extracting feature points and hue feature points that constitute vertices of the hue outline points, and average values of the brightness calculated by the average value calculation means and brightness features extracted by the pixel compression means Corresponding brightness encoding information consisting of coordinates of points on the frame to the brightness area, the average value of the saturation calculated by the average value calculation means and the saturation feature point extracted by the pixel compression means The saturation coding information composed of coordinates on the frame is associated with the saturation region, the hue average value calculated by the average value calculation means, and the color extracted by the pixel compression means The function is to function as coding compression means for storing hue coding information composed of coordinates of phase feature points on the frame in association with the hue area and storing it as a compressed file of moving image data including the frame rate. is there.

  Further, the moving image decompression program causes the computer to decompress the moving image data compressed by the moving image compression program, and coordinates and saturation of the lightness feature points in the lightness coding information stored by the coding compression means. Decoding means for plotting a lightness feature point, a saturation feature point, and a hue feature point on a virtual frame based on the coordinates of the saturation feature point in the encoded information and the coordinate of the feature point in the hue encoded information, respectively Based on the coordinates of the brightness feature points, the coordinates of the saturation feature points, and the coordinates of the hue feature points plotted by the decoding means, the brightness contour constituent points between the brightness feature points adjacent to each other, Interpolation means for interpolating the saturation contour constituent points between the degree feature points and hue contour constituent points between adjacent hue feature points and plotting them on the virtual frame, and the decoding means The coordinates of the lightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points, the coordinates of the brightness contour constituent points plotted by the interpolation means, the coordinates of the saturation contour constituent points, and the hue contour constituent points Plot the brightness area point in the brightness area, the saturation area point in the saturation area, and the hue area point in the hue area on the virtual frame based on the coordinates of the brightness feature point and the brightness contour, respectively. The lightness of all the pixels in the lightness area consisting of the constituent points and the lightness area points is the average value of the lightness in the lightness coding information, and the saturation feature point, the saturation contour constituent point, and the saturation area point The saturation of all the pixels in the saturation region consisting of the average value of the saturation in the saturation coding information, and the hue composed of the hue feature point, the hue contour constituent point, and the hue region point The hues of all the pixels in the region in the hue coding information A restoration means for restoring a frame at a frame rate in the moving picture data compressed by the moving picture compression program according to claim 1 as an average value of the phase, and a display for displaying the frame restored by the restoration means It is for functioning as a means.

  In another moving image compression program, the coding compression unit associates lightness coding information including lightness vector information between lightness feature points adjacent to each other in the lightness area with the lightness area. Saturation coding information including saturation vector information between adjacent saturation feature points is associated with the saturation region, and includes hue vector information between adjacent hue feature points in the hue region Hue coding information is stored in association with the hue region.

  The other moving image decompression program is a computer for decompressing the moving image data compressed by the moving image compression program, and the coordinates and saturation of the lightness feature points in the lightness coding information stored by the coding compression means. Decoding means for plotting a lightness feature point, a saturation feature point, and a hue feature point on a virtual frame based on the coordinates of the saturation feature point in the encoded information and the coordinate of the feature point in the hue encoded information, respectively The coordinates of the brightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points plotted by the decoding means, the brightness vector information in the brightness coding information stored by the coding compression means, and the saturation code Brightness contour constituent points between adjacent brightness feature points and saturation feature points adjacent to each other based on the saturation vector information in the conversion information and the hue vector information in the hue encoding information. Interpolating means for interpolating hue contour constituent points between hue feature points adjacent to each other and plotting them on the virtual frame, coordinates of lightness characteristic points plotted by the decoding means, and saturation The brightness area in the brightness area based on the coordinates of the feature points, the coordinates of the hue feature points, the coordinates of the brightness contour constituent points plotted by the interpolation means, the coordinates of the saturation contour constituent points, and the coordinates of the hue contour constituent points, respectively. A lightness region composed of the lightness feature point, the lightness contour component point, and the lightness region point, and a point, the saturation region point in the saturation region, and the hue region point in the hue region are plotted on the virtual frame The lightness of all pixels in the lightness coding information is the average value of lightness in the lightness coding information, and the saturation of all the pixels in the saturation area composed of the saturation feature point, the saturation contour constituent point, and the saturation area point Degree of saturation encoding The average value of the hues in the hue coding information is the average value of the saturation in the report, and the hues of all the pixels in the hue area composed of the hue feature points, the hue outline constituent points, and the hue area points In order to function as a restoring unit that restores a frame at a frame rate in the moving image data compressed by the moving image compression program according to claim 4, and a display unit that displays the frame restored by the restoring unit belongs to.

  In another moving image compression program, the encoding compression unit associates brightness encoding information including inter-frame brightness vector information between adjacent brightness feature points between the frames with the brightness area, and Saturation coding information including inter-frame saturation vector information between adjacent saturation feature points is associated with the saturation region, and inter-frame hue vector information between adjacent hue feature points between the frames Is stored in association with the hue region.

  The other moving image decompression program is a computer for decompressing the moving image data compressed by the moving image compression program, and the coordinates and saturation of the lightness feature points in the lightness coding information stored by the coding compression means. Decoding means for plotting a lightness feature point, a saturation feature point, and a hue feature point on a virtual frame based on the coordinates of the saturation feature point in the encoded information and the coordinate of the feature point in the hue encoded information, respectively The coordinates of the brightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points plotted by the decoding means, the inter-frame brightness vector information in the brightness coding information stored by the coding compression means, Based on the inter-frame saturation vector information in the degree-encoding information and the inter-frame hue vector information in the hue-encoding information, the brightness contour structure between the adjacent brightness feature points, respectively. Interpolating means for interpolating points, saturation contour constituting points between adjacent saturation feature points, and hue contour constituting points between mutually adjacent hue feature points, and plotting them on the virtual frame, plotting by the decoding means The coordinates of the brightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points, the coordinates of the brightness contour constituent points plotted by the interpolation means, the coordinates of the saturation contour constituent points, and the coordinates of the hue contour constituent points Plot the lightness area point in the lightness area, the saturation area point in the saturation area, and the hue area point in the hue area on the virtual frame, respectively, and the lightness feature point and the lightness contour constituent point And the lightness of all pixels in the lightness area consisting of the lightness area point is the average value of the lightness in the lightness coding information, and from the saturation feature point, the saturation contour component point, and the saturation area point In the saturation region The saturation of all pixels is the average value of the saturations in the saturation encoding information, and the hues of all pixels in the hue region composed of the hue feature points, the hue contour constituent points, and the hue region points are determined. The restoration means for restoring a frame at a frame rate in the moving image data compressed by the moving image compression program according to claim 6 as an average value of hues in the hue coding information, and the restoration means restored by the restoration means It is for functioning as display means for displaying a frame.

  According to the moving image compression program of the present invention, a hybrid consisting of pixel compression and coding compression for pixels in a frame in a state where a high-quality frame can be reversibly restored without taking the difference between frames. Since it is configured to perform compression, the image quality of the moving image data does not deteriorate even if the compression rate is increased.

  Further, according to the moving image decompression program of the present invention, it is possible to decompress the moving image data compressed by the above-described moving image compression program into high-quality moving image data.

  According to another moving image compression program, brightness coding information including brightness vector information between brightness feature points adjacent to each other in the brightness area is associated with the brightness area, and the saturation features adjacent to each other in the saturation area Saturation encoding information including saturation vector information between points is associated with the saturation region, and hue encoding information including hue vector information between adjacent hue feature points in the hue region is associated with the hue region. Since it is configured to be added and stored, it is possible to more effectively improve the image quality when decompressing the compressed moving image data.

  According to another moving image decompression program, the coordinates of the brightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points, the brightness vector information in the brightness coding information, and the saturation vector information in the saturation coding information , And brightness contour constituent points between adjacent brightness feature points, saturation contour constituent points between adjacent saturation feature points, and hue features adjacent to each other based on hue vector information in the hue coding information Since it is configured to interpolate hue contour composing points between points, the moving image data compressed by the above moving image compression program can be expanded to higher-quality moving image data.

  According to another moving image compression program, brightness coding information including inter-frame brightness vector information between adjacent brightness feature points between frames is associated with a brightness area, and adjacent saturation feature points between frames Saturated coding information including inter-frame saturation vector information is associated with the saturation region, and hue encoded information including inter-frame hue vector information between adjacent hue feature points between frames is set in the hue region. Since they are configured to be stored in association with each other, it is possible to more effectively achieve high image quality when decompressing compressed moving image data.

  According to another moving image decompression program, the coordinates of the brightness feature point, the coordinates of the saturation feature point, the coordinates of the hue feature point, the inter-frame brightness vector information in the brightness encoding information, and the inter-frame in the saturation encoding information Based on the saturation vector information and the inter-frame hue vector information in the hue encoding information, the brightness contour constituent points between the adjacent brightness feature points, the saturation contour constituent points between the adjacent saturation feature points, Since the hue contour composing points between the hue feature points adjacent to each other are interpolated, the moving image data compressed by the moving image compression program can be expanded into higher-quality moving image data. it can.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
The moving image compression / decompression program 1 according to the present embodiment includes a built-in ROM (Read Only Memory) of the moving image compression / decompression chip 3 provided in the moving image compression / decompression apparatus 2 as shown in FIGS. 4 is stored. The moving image compression / decompression program 1 functions as a moving image compression program for reversibly compressing moving image data composed of a number of continuously displayed frames, and a moving image compressed by the moving image compression program. It also functions as a moving image expansion program that expands data into high-quality moving image data.

  As shown in FIG. 1, the moving image compression / decompression apparatus 2 includes a moving image compression / decompression chip 3, a control unit 5, a ROM 6, a RAM (Random Access Memory), a video memory 8, and a clock unit 9. The video input unit 10, the operation unit 11, the display unit 12, and a hard disk drive (HDD) 13 are provided. The units 3 and 5 to 13 are connected to each other via a bus 14 so as to communicate with each other.

  The ROM 6 stores a control program (not shown) for controlling the operations of the units 3 and 5 to 13. The control unit 5 includes a CPU (Central Processing Unit) and the like, and controls the operations of the units 3 and 5 to 13 according to a control program on the ROM 6. The RAM 7 is loaded with a control program or the like on the ROM 6 and temporarily stores various information related to the moving image compression / decompression apparatus 2.

  The video input unit 10 is composed of a digital video camera or the like, and inputs a video being shot (real-time video) as video data. The video memory 8 temporarily stores input video data, frames restored as described later, and the like. The clock unit 9 measures the elapsed time from the time of frame generation and also records the date and time.

  The display unit 12 is configured by an LCD (Liquid Crystal Display) or the like, and displays a video of the expanded moving image data, a video being shot, and the like. The operation unit 11 includes operation keys and the like for performing various operations. Various operations performed by the user on the moving image compression / decompression apparatus 2 are performed through the operation unit 11. The display unit 12 may be configured as a touch panel, and the display unit 12 as the touch panel may function as the operation unit 11.

  The moving image compression / decompression chip 3 is configured by a semiconductor chip (one chip) such as one LSI (Large Scale Integrated Circuit). As shown in FIG. 2, the moving image compression / decompression chip 3 includes a built-in ROM 4, a built-in control unit 15, a built-in RAM 16, and the like. The moving image compression / decompression apparatus 2 is configured to perform hardware encoding (hardware compression) and hardware decoding (hardware expansion) of moving image data by the moving image compression / decompression chip 3.

  The built-in ROM 4 stores the frame rate, the division reference brightness difference, the division reference saturation difference, the division reference hue difference, and the like in addition to the moving image compression / decompression program 1. The built-in ROM 4 also stores the reciprocal of the stored frame rate as the set time from frame generation to generation of the next frame.

  The built-in RAM 16 is loaded with the moving image compression / decompression program 1 on the built-in ROM 4 and temporarily stores various information related to the moving image compression / decompression chip 3. The built-in control unit 15 includes a CPU (Central Processing Unit) and the like, and compresses and decompresses moving image data according to the moving image compression / decompression program 1 loaded in the built-in RAM 16.

  Next, an example of moving image data compression processing will be described based on the flowchart shown in FIG. This process and each process described later are performed according to a command issued by the built-in control unit 15 based on the moving image compression / decompression program 1 on the built-in ROM 4 of the moving image compression / decompression chip 3.

  In this process, if recording is started by the operation unit 11 (step S1), the video being captured is input as video data by the video input unit 10 (step S2). A frame 21 as shown in FIG. 4 is generated from the input video data (step S3). As shown in FIG. 4, the frame 21 includes a large number of pixels 22 arranged in a grid pattern. For example, the lower left pixel 22 is set as an origin O of coordinates (XY coordinates) on the frame 21. Each pixel 22 has red (R) luminance, green (G) luminance, blue (B) luminance, and the like in the RGB color model.

  Then, the brightness difference, saturation difference, and hue difference between the adjacent pixels 22 in the generated frame 21 are calculated (step S4). In this case, the color model of the pixel 22 is converted from the RGB color model to the XYZ color model [CIE (International Lighting Commission) 1931] etc. After the color model is converted into an appropriate color model expressed by the hue, the lightness difference, the chroma difference, and the hue difference are calculated based on the lightness, saturation, and hue in the color model after the conversion. Further, as shown in FIG. 4, the lightness difference, the saturation difference, and the hue difference are respectively between the pixels 22 adjacent to each other in the X-axis direction, between the pixels 22 adjacent to each other in the Y-axis direction, and in the oblique 45-degree direction. Calculation is performed between adjacent pixels 22. For this reason, the built-in control unit 15 of the moving image compression / decompression chip 3 performs a vector processor so that the calculation of brightness difference, saturation difference, and hue difference and each process described later can be executed at high speed by parallel processing. Etc. are desirable.

  Next, as shown in FIG. 5, the frame 21 is divided into a plurality of lightness areas 23 with a plurality of pixels 22 having a calculated lightness difference equal to or less than the division reference lightness difference stored in the built-in ROM 4 as one lightness area 23. (Step S5). Similarly, although not shown in the drawing, the frame 21 is divided into a plurality of saturation areas, with a plurality of pixels 22 having a calculated saturation difference equal to or less than the division reference saturation difference stored in the built-in ROM 4 as one saturation area. At the same time, the frame 21 is divided into a plurality of hue regions, with the plurality of pixels 22 having the calculated hue difference equal to or smaller than the division reference hue difference stored in the built-in ROM 4 as one hue region (step S5).

  Then, the average value of the brightness difference of all the pixels 22 in the divided brightness region 23, the average value of the saturation difference of all the pixels 22 in the saturation region, and the average value of the hue difference of all the pixels 22 in the hue region. Is calculated (step S6). As shown in FIG. 6, brightness contour points 24 that constitute the contour of the brightness area 23 are extracted from the pixels 22 in the brightness area 23 (step S7). Similarly, although not shown, a saturation contour point constituting the contour of the saturation region and a hue contour point constituting the contour of the hue region are extracted from the pixel 22 in the saturation region and the pixel 22 in the hue region, respectively. (Step S7). As shown in FIG. 7, the brightness feature point 25 constituting the vertex is extracted from the extracted brightness contour point 24 (step S8). Similarly, although not shown, the saturation feature point and the hue feature point constituting the vertex of the hue contour point are extracted from the extracted saturation contour point and the hue contour point, respectively. (Step S8).

  Next, the lightness coding information composed of the calculated average value of the lightness difference and the coordinates of the extracted lightness feature point 25 on the frame 21 is associated with the lightness region 23, and the calculated average value of the chroma difference and the extraction are extracted. Saturation coding information composed of coordinates of the obtained saturation feature point on the frame 21 is associated with the saturation region, and the average value of the calculated hue difference and the extracted hue feature point on the frame 21 If the hue encoding information consisting of coordinates is associated with the hue area and temporarily stored in a work folder or the like on the external storage means such as the hard disk drive 13 (step S9), compression for one frame 21 is performed. Complete. Note that folder names such as work folders in which lightness coding information, saturation coding information, and hue coding information are temporarily stored are stored in the built-in ROM 4 or the like in advance. Examples of the external storage means include a hard disk drive, a magneto-optical disk drive, a CD-ROM (Compact Disc Read Only Memory) drive, a DVD (Digital Versatile Disk) -ROM drive, and the like.

  When the operation unit 11 has not finished recording (NO in step S10) and the elapsed time from the generation of the frame 21 has reached the set time stored in the built-in ROM 4 (YES in step S11). ) Returns to step S3, but if the set time has not been reached (NO in step S11), the process returns to step S11.

  On the other hand, when the recording end is executed by the operation unit 11 (YES in step S10), the lightness coding information, the saturation coding information, and the hue coding information for all the frames 21 include the moving image including the frame rate. The compressed data file is stored in the external storage means such as the hard disk drive 13 (step S12), and the process ends.

  Note that the start and end of recording may be executed at the reserved recording start time and the reserved recording end time input by the operation unit 11.

Next, another example of the compression processing of moving image data will be described based on the flowchart shown in FIG.
In this process, if file conversion is executed by the operation unit 11 (step S21), the compressed moving image data on the external storage means such as the hard disk drive 13 is expanded to generate a frame 21 as shown in FIG. (Step S22). The format of the moving image data after compression is not particularly limited, and examples thereof include MPEG-2, MPEG-1, AVI (Audio Video Interleave).

  Then, as described above, the brightness difference, the saturation difference, and the hue difference between the adjacent pixels 22 in the generated frame 21 are calculated (step S23). Next, as shown in FIG. 5, the frame 21 is divided into a plurality of lightness areas 23 with a plurality of pixels 22 having a calculated lightness difference equal to or less than the division reference lightness difference stored in the built-in ROM 4 as one lightness area 23. (Step S24). Similarly, although not shown in the drawing, the frame 21 is divided into a plurality of saturation areas, with a plurality of pixels 22 having a calculated saturation difference equal to or less than the division reference saturation difference stored in the built-in ROM 4 as one saturation area. At the same time, the frame 21 is divided into a plurality of hue areas, with the plurality of pixels 22 having the calculated hue difference equal to or smaller than the division reference hue difference stored in the built-in ROM 4 as one hue area (step S24).

  Then, the average value of the brightness difference of all the pixels 22 in the divided brightness region 23, the average value of the saturation difference of all the pixels 22 in the saturation region, and the average value of the hue difference of all the pixels 22 in the hue region. Is calculated (step S25). As shown in FIG. 6, the brightness contour points 24 that constitute the contour of the brightness area 23 are extracted from the pixels 22 in the brightness area 23 (step S26). Similarly, although not shown, a saturation contour point constituting the contour of the saturation region and a hue contour point constituting the contour of the hue region are extracted from the pixel 22 in the saturation region and the pixel 22 in the hue region, respectively. (Step S26). As shown in FIG. 7, the brightness feature point 25 constituting the vertex is extracted from the extracted brightness contour point 24 (step S27). Similarly, although not shown, the saturation feature point and the hue feature point constituting the vertex of the hue contour point are extracted from the extracted saturation contour point and the hue contour point, respectively. (Step S27).

  Next, the lightness coding information composed of the calculated average value of the lightness difference and the coordinates of the extracted lightness feature point 25 on the frame 21 is associated with the lightness region 23, and the calculated average value of the chroma difference and the extraction are extracted. Saturation coding information composed of coordinates of the obtained saturation feature point on the frame 21 is associated with the saturation region, and the average value of the calculated hue difference and the extracted hue feature point on the frame 21 If the hue coding information composed of coordinates is associated with the hue area and temporarily stored in a work folder or the like on the external storage means such as the hard disk drive 13 (step S28), compression for one frame 21 is performed. Complete.

  If there is data to be decompressed (YES in step S29), the process returns to step S22. On the other hand, if there is no data to be decompressed (NO in step S29), the lightness coding information, saturation coding information, and hue coding information for all frames 21 are compressed files of moving image data including the frame rate. Is stored in an external storage means such as the hard disk drive 13 (step S30), and the process is terminated.

Next, an example of moving image data decompression processing will be described with reference to the flowchart shown in FIG.
In this process, if the operation unit 11 executes the decompression of the moving image data compressed by the above-described compression process (step S41), as shown in FIG. 10, the frame 21 to be displayed first is displayed. Based on the coordinates of the brightness feature point 25 in the brightness encoding information, the brightness feature point 25 is plotted on the virtual frame (step S42). Similarly, although not shown, the saturation feature points are plotted on the virtual frame based on the coordinates of the saturation feature points in the saturation encoding information for the frame 21 to be displayed first, and are displayed first. Hue feature points are plotted on the virtual frame based on the coordinates of the hue feature points in the hue coding information for the frame 21 to be performed (step S42).

  Then, as shown in FIG. 11, based on the coordinates of the plotted lightness feature points 25, the lightness contour constituent points 26 between the lightness feature points 25 adjacent to each other are interpolated and plotted on the virtual frame (step S43). ). Similarly, although not shown, based on the coordinates of the saturation feature points and the coordinates of the hue feature points, the saturation contour configuration points between the adjacent saturation feature points and the hue contour configuration between the adjacent hue feature points, respectively. The points are interpolated and plotted on the virtual frame (step S43). Interpolation of the lightness contour composing point 26, the saturation contour composing point, and the hue contour composing point is executed based on the bilinear method formula or the bicubic method formula in the moving image compression / decompression program 1, respectively.

  Next, as shown in FIG. 12, the brightness area point 27 in the brightness area 23 is plotted on the virtual frame based on the plotted coordinates of the brightness feature point 25 and the coordinates of the brightness contour constituent point 26, and the brightness. The lightness of all the pixels 22 in the lightness region 23 composed of the feature point 25, the lightness contour component point 26, and the lightness region point 27 is set as the average value of the lightness in the lightness encoding information, and a plurality of lightnesses in one frame 21 The brightness area 23 is restored (step S44). In this case, when another lightness contour point 24 is included inside the lightness contour point 24 composed of the plotted lightness feature point 25 and lightness contour component point 26, the outer lightness contour point 24 and the inner lightness contour point are included. The brightness area point 27 located between the point 24 and the outer brightness contour point 24 constitutes one brightness area 23. On the other hand, when no other lightness contour point 24 is included inside the lightness contour point 24, the lightness region point 27 and the lightness contour point 24 located inside the lightness contour point 24 become one lightness region 23. .

  Similarly, although not shown, the saturation area points in the saturation area are plotted on the virtual frame based on the coordinates of the plotted saturation feature points and the coordinates of the saturation contour constituent points, and the saturation feature The saturation of all the pixels 22 in the saturation area composed of the point, the saturation contour constituting point, and the saturation area point is set as the average value of the saturations in the saturation encoding information, and a plurality of pixels in one frame 21 are obtained. Are restored (step S44). Although not shown, the hue area points in the hue area are plotted on the virtual frame based on the coordinates of the plotted hue feature points and the coordinates of the hue outline constituent points, and the hue feature points and the hue outline constituent points are also plotted. The hues of all the pixels 22 in the hue area composed of the hue area points are set as the average value of the hues in the hue coding information, and a plurality of hue areas in one frame 21 are restored (step S44).

  The frame 21 in which the plurality of lightness regions 23, the plurality of saturation regions, and the plurality of hue regions are restored is displayed on the display unit 12 (step S45). If all the frames 21 have not been restored (NO in step S46), and the elapsed time from the restoration of the frame 21 has reached the set time in the compressed moving image data (YES in step S47). ) Returns to step S42, but if the set time has not been reached (NO in step S47), the process returns to step S47. On the other hand, if all the frames 21 have been restored (YES in step S46), the process ends. In addition to the frame rate, the compressed moving image data includes a reciprocal of the frame rate as a set time from the restoration of the frame 21 to the restoration of the next frame 21.

  The moving image compression / decompression program 1 configured as described above performs pixel compression on the pixels 22 in the frame 21 in a state where the high-quality frame 21 can be restored almost reversibly without taking the difference between the frames 21. In addition, since the hybrid compression including the encoding compression is performed, there is an advantage that the image quality of the moving image data does not deteriorate even if the compression rate is increased.

  Here, as shown in FIG. 13, brightness coding information including brightness vector information between brightness feature points 25 adjacent to each other in the brightness area 23 is associated with the brightness area 23, although not shown, Saturation coding information including saturation vector information between adjacent saturation feature points is associated with the saturation region, and hue encoding including hue vector information between adjacent hue feature points in the hue region The information is stored in association with the hue area, and the coordinates of the brightness feature point 25, the coordinates of the saturation feature point, the coordinates of the hue feature point, the brightness vector information in the brightness coding information, and the saturation in the saturation coding information. Brightness contour constituent points 26 between brightness feature points 25 adjacent to each other, saturation contour constituent points between adjacent saturation feature points, respectively, based on the hue vector information in the hue vector information and the hue encoding information, and Next to each other If the hue contour composing points between the hue feature points to be interpolated are interpolated, the moving image data compressed by the moving image compression / decompression program 1 can be expanded to higher-quality moving image data. is there. The lightness vector information here refers to the difference coordinates between the lightness feature points 25 adjacent to each other in the lightness region 23, and the saturation vector information refers to the difference between the lightness feature points adjacent to each other in the saturation region. The hue vector information is a difference coordinate between adjacent hue feature points in the hue area. In this case, the brightness vector information, the saturation vector information, and the hue vector information are the coordinates of the brightness feature points 25 adjacent to each other, the coordinates of the saturation feature points adjacent to each other, and the coordinates of the hue feature points adjacent to each other. Is calculated based on

  Further, as shown in FIG. 14, brightness coding information including inter-frame brightness vector information between adjacent brightness feature points 25 between frames 21 is associated with the brightness area 23, and although not shown, Saturation coding information including inter-frame saturation vector information between adjacent saturation feature points is associated with the saturation region, and includes inter-frame hue vector information between adjacent hue feature points between frames 21 The hue coding information is stored in association with the hue region, and the coordinates of the brightness feature point 25, the coordinates of the saturation feature point, the coordinates of the hue feature point, the inter-frame brightness vector information in the brightness coding information, and the saturation code Brightness feature points 2 adjacent to each other in the frame 21 based on the inter-frame saturation vector information in the conversion information and the inter-frame hue vector information in the hue encoding information, respectively. Similarly, in the case where it is configured to interpolate the hue contour constituent points 26 between the adjacent saturation feature points, the saturation contour constituent points between adjacent saturation feature points, and the hue contour constituent points between adjacent hue feature points, There is an advantage that the moving image data compressed by the moving image compression / decompression program 1 can be expanded into higher-quality moving image data. The inter-frame lightness vector information referred to here is between lightness feature points 25 adjacent to each other between frames 21 whose intervals in the time axis (Z-axis) direction are constant (set time as the reciprocal of the frame rate). Is the difference coordinate. Similarly, inter-frame saturation vector information refers to difference coordinates between adjacent saturation feature points between frames 21 whose intervals in the time axis direction are constant. The inter-frame hue vector information refers to difference coordinates between hue feature points adjacent to each other between the frames 21 whose intervals in the time axis direction are constant. In this case, the inter-frame brightness vector information, the inter-frame saturation vector information, and the inter-frame hue vector information are the coordinates of the brightness feature points 25 adjacent to each other in the time axis direction, and the saturation feature points adjacent to each other in the time axis direction. It is calculated based on the coordinates of the hue feature points adjacent to each other in the time axis direction.

  In the present embodiment, the moving image compression / decompression chip 3 is configured to perform hardware encoding and hardware decoding of moving image data. However, the present invention is not limited to this. The moving image compression / decompression program 1 may be stored in an external storage unit, and the control unit 5 may perform software encoding and software decoding in a state where the moving image compression / decompression program 1 is loaded in the RAM 7.

  The moving image compression / decompression apparatus 2 may be equipped with an audio input unit configured with a microphone or the like, an audio output unit configured with a speaker or the like. MP3 (MPEG-1 Audio Layer-) which can synchronize and reproduce the audio data input by the audio input unit on the internal storage 4 such as the internal ROM 4 or the hard disk drive 13 on the moving image compression / decompression chip 3 and the moving image data. A conventionally known audio compression / expansion program for compressing in the format III) or the like, or decompressing the compressed audio data and reproducing / outputting it by the audio output unit may be stored.

  As described above, the moving image compression program according to the present invention is suitable for compressing moving image data with high image quality even when the compression rate is increased. The moving picture decompression program according to the present invention is suitable for enabling the moving picture data compressed by the moving picture compression program to be decompressed into high-quality moving picture data.

The block diagram which shows the structural example of the moving image compression / decompression apparatus which concerns on embodiment. The block diagram which shows the structural example of a moving image compression expansion | extension chip | tip. The flowchart which shows an example of the compression process of moving image data. The principal part expansion schematic diagram of a flame | frame. The principal part expansion schematic diagram which shows an example of the divided brightness area | region. The principal part expansion schematic diagram which shows the state which extracted the brightness outline point from the brightness area | region. The principal part expansion schematic diagram which shows the state which extracted the brightness characteristic point from the brightness outline point. The flowchart which shows the other example of the compression process of moving image data. 10 is a flowchart illustrating an example of moving image data decompression processing. The principal part expansion schematic diagram which shows the state which plotted the brightness characteristic point on the virtual frame. The principal part expansion schematic diagram which shows the state which interpolated the brightness outline component point and plotted on the virtual frame. The principal part expansion schematic diagram which shows the state which restored the brightness area | region. The principal part expansion schematic diagram which shows an example of the vector for calculating the brightness vector information between the brightness feature points adjacent to each other in the brightness area. The principal part expansion schematic diagram which shows an example of the vector for calculating the brightness | luminance vector information between the brightness | luminance feature points adjacent to each other between frames.

Explanation of symbols

1 Video compression / decompression program 2 Video compression / decompression device 3 Video compression / decompression chip 4 Built-in ROM
5 Control unit 6 ROM
7 RAM
8 Video memory 9 Clock unit 10 Video input unit 11 Operation unit 12 Display unit 13 Hard disk drive 15 Built-in control unit 16 Built-in RAM
21 Frame 22 Pixel 23 Lightness Area 24 Lightness Outline Point 25 Lightness Feature Point 26 Lightness Outline Component Point 27 Lightness Area Point

Claims (7)

In order to compress moving image data consisting of a number of frames displayed in succession,
Storage means for storing a frame rate, a division reference brightness difference, a division reference saturation difference, and a division reference hue difference;
An input means for inputting the video being shot as video data,
Generating means for generating a frame from the video data input by the input means at a frame rate stored by the storage means;
Difference information calculating means for calculating brightness difference, saturation difference, and hue difference between adjacent pixels in the frame generated by the generating means;
The difference information calculation means divides the frame into a plurality of brightness areas with a plurality of pixels whose brightness difference calculated by the storage means is equal to or less than the division reference brightness difference stored in the storage means, and the difference information Dividing the frame into a plurality of saturation regions by using a plurality of pixels whose saturation difference calculated by the calculation unit is equal to or less than the division reference saturation difference stored by the storage unit as one saturation region, the difference A dividing unit that divides the frame into a plurality of hue regions with a plurality of pixels in which the hue difference calculated by the information calculating unit is equal to or less than the division reference hue difference stored in the storage unit as one hue region;
Average value for calculating the average value of the brightness of all the pixels in the brightness area divided by this dividing means, the average value of the saturation of all the pixels in the saturation area, and the average value of the hue of all the pixels in the hue area Calculation means,
The brightness contour points that form the contour of the brightness region and the saturation that forms the contour of the saturation region from the pixels in the brightness region, the pixels in the saturation region, and the pixels in the hue region that are divided by the dividing unit, respectively. A brightness contour point and a hue contour point constituting the contour of the hue region are extracted, and a brightness feature point that constitutes a vertex of the brightness contour point from the extracted brightness contour point, saturation contour point, and hue contour point, respectively A pixel compression means for extracting a saturation feature point constituting the vertex of the saturation contour point, and a hue feature point constituting the vertex of the hue contour point, and
The lightness coding information comprising the lightness average value calculated by the average value calculation means and the coordinates on the frame of the lightness feature points extracted by the pixel compression means is associated with the lightness area, and the average value calculation is performed. Saturation coding information consisting of the average value of the saturation calculated by the means and the coordinates on the frame of the saturation feature points extracted by the pixel compression means is associated with the saturation area, and the average Hue coding information composed of the average value of the hue calculated by the value calculation unit and the coordinates on the frame of the hue feature point extracted by the pixel compression unit is associated with the hue region, and includes the frame rate. Encoding and compression means for storing the compressed data of moving image data;
Video compression program to function as In order to compress moving image data consisting of a number of frames displayed in succession,
Storage means for storing a division reference lightness difference, a division reference saturation difference, and a division reference hue difference;
Data storage means for storing compressed video data including a frame rate;
Generating means for expanding the compressed moving image data stored by the data storage means to generate a number of frames;
Difference information calculating means for calculating brightness difference, saturation difference, and hue difference between adjacent pixels in the frame generated by the generating means;
The difference information calculation means divides the frame into a plurality of brightness areas with a plurality of pixels whose brightness difference calculated by the storage means is equal to or less than the division reference brightness difference stored in the storage means, and the difference information Dividing the frame into a plurality of saturation regions by using a plurality of pixels whose saturation difference calculated by the calculation unit is equal to or less than the division reference saturation difference stored by the storage unit as one saturation region, A dividing unit that divides the frame into a plurality of hue regions, with a plurality of pixels in which the hue difference calculated by the information calculating unit is equal to or less than the division reference hue difference stored in the storage unit as one hue region;
Average value for calculating the average value of the brightness of all the pixels in the brightness area divided by this dividing means, the average value of the saturation of all the pixels in the saturation area, and the average value of the hue of all the pixels in the hue area Calculation means,
The brightness contour points that form the contour of the brightness region and the saturation that forms the contour of the saturation region from the pixels in the brightness region, the pixels in the saturation region, and the pixels in the hue region that are divided by the dividing unit, respectively. Brightness contour points and hue contour points that constitute the contour of the hue area, and brightness feature points that constitute the vertices of the brightness contour points from the extracted brightness contour points, saturation contour points, and hue contour points, respectively A pixel compression means for extracting a saturation feature point constituting the vertex of the saturation contour point, and a hue feature point constituting the vertex of the hue contour point, and
The average value calculation is performed by associating the brightness value information calculated by the average value of the brightness calculated by the average value calculation unit and the coordinates on the frame of the brightness feature point extracted by the pixel compression unit with the brightness region. Saturation coding information consisting of the average value of the saturation calculated by the means and the coordinates on the frame of the saturation feature points extracted by the pixel compression means is associated with the saturation region, and the average Hue coding information consisting of the average value of the hue calculated by the value calculation unit and the coordinates on the frame of the hue feature point extracted by the pixel compression unit is associated with the hue region and includes the frame rate. Encoding and compression means for storing the compressed data of moving image data;
Video compression program to function as A computer for decompressing moving image data compressed by the moving image compression program according to claim 1,
Lightness based on the coordinates of the lightness feature points in the lightness coding information stored by the coding compression means, the coordinates of the saturation feature points in the saturation coding information, and the coordinates of the feature points in the hue coding information. Decoding means for plotting feature points, saturation feature points, and hue feature points on a virtual frame;
Based on the coordinates of the brightness feature points, the coordinates of the saturation feature points, and the coordinates of the hue feature points plotted by the decoding means, the brightness contour constituent points between the brightness feature points adjacent to each other, and the saturations adjacent to each other Interpolating means for interpolating the saturation contour composing points between feature points and the hue contour composing points between mutually adjacent hue feature points and plotting them on the virtual frame;
The coordinates of the brightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points plotted by the decoding means, the coordinates of the brightness contour constituent points, the coordinates of the saturation contour constituent points plotted by the interpolation means, and Based on the coordinates of the hue contour constituent points, the brightness area point in the brightness area, the saturation area point in the saturation area, and the hue area point in the hue area are plotted on the virtual frame, and the brightness feature point And the brightness value of all the pixels in the brightness area consisting of the brightness contour constituent point and the brightness area point as an average value of brightness in the brightness coding information, the saturation feature point, the saturation contour constituent point, and the The saturation of all the pixels in the saturation area consisting of the saturation area points is the average value of the saturations in the saturation encoding information, and the hue feature point, the hue contour component point, and the hue area point The hues of all pixels in the hue area consisting of As the average value of the hue in the serial color coding information, restoring means for restoring the frame at a frame rate of the compressed moving picture data by claim 1 or 2, wherein the moving picture compression program, and,
Display means for displaying the frame restored by the restoration means;
Video decompression program to function as   The coding compression means associates lightness coding information including lightness vector information between lightness feature points adjacent to each other in the lightness region with the lightness region, and adjacent chroma feature points in the saturation region. The hue coding information including hue vector information between hue feature points adjacent to each other in the hue area and the hue coding information including the saturation vector information between the hue area and the hue area is associated with the hue area. The moving image compression program according to claim 1 or 2, wherein the moving image compression program is stored in association with each other. A computer for decompressing moving image data compressed by the moving image compression program according to claim 4,
Lightness based on the coordinates of the lightness feature points in the lightness coding information stored by the coding compression means, the coordinates of the saturation feature points in the saturation coding information, and the coordinates of the feature points in the hue coding information. Decoding means for plotting feature points, saturation feature points, and hue feature points on a virtual frame;
Coordinates of brightness feature points, coordinates of saturation feature points, coordinates of hue feature points plotted by the decoding means, brightness vector information in the brightness coding information stored by the coding compression means, and saturation coding Based on the saturation vector information in the information and the hue vector information in the hue coding information, the lightness contour constituent points between the lightness feature points adjacent to each other and the saturation contour constituent points between the saturation feature points adjacent to each other Interpolation means for interpolating hue contour constituent points between hue feature points adjacent to each other and plotting them on the virtual frame;
The coordinates of the brightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points plotted by the decoding means, the coordinates of the brightness contour constituent points, the coordinates of the saturation contour constituent points plotted by the interpolation means, and Based on the coordinates of the hue contour constituent points, the brightness area point in the brightness area, the saturation area point in the saturation area, and the hue area point in the hue area are plotted on the virtual frame, and the brightness feature point And the brightness value of all the pixels in the brightness area consisting of the brightness contour constituent point and the brightness area point as an average value of brightness in the brightness coding information, the saturation feature point, the saturation contour constituent point, and the The saturation of all the pixels in the saturation area consisting of the saturation area points is the average value of the saturations in the saturation encoding information, and the hue feature point, the hue contour component point, and the hue area point The hues of all pixels in the hue area consisting of As the average value of the hue in the serial color coding information, restoring means for restoring the frame at a frame rate of the moving image in data compressed by claim 4, wherein the moving picture compression program, and,
Display means for displaying the frame restored by the restoration means;
Video decompression program to function as   The coding compression means associates lightness coding information including inter-frame lightness vector information between lightness feature points adjacent to each other between the frames with the lightness region, and between adjacent saturation feature points between the frames. Saturation coding information including inter-frame saturation vector information is associated with the saturation region, and hue coding information including inter-frame hue vector information between mutually adjacent hue feature points between the frames 5. The moving image compression program according to claim 1, wherein the moving image compression program is stored in association with a hue area. A computer for decompressing moving image data compressed by the moving image compression program according to claim 6,
Lightness based on the coordinates of the lightness feature points in the lightness coding information stored by the coding compression means, the coordinates of the saturation feature points in the saturation coding information, and the coordinates of the feature points in the hue coding information. Decoding means for plotting feature points, saturation feature points, and hue feature points on a virtual frame;
Coordinates of brightness feature points, coordinates of saturation feature points, coordinates of hue feature points plotted by the decoding means, inter-frame brightness vector information in the brightness encoded information stored by the encoding compression means, saturation Based on the inter-frame saturation vector information in the encoded information and the inter-frame hue vector information in the hue encoded information, respectively, between the lightness contour constituting points between the adjacent lightness feature points and between the adjacent saturation feature points Interpolating means for interpolating hue contour composing points between hue feature points adjacent to each other and hue feature points adjacent to each other, and plotting them on the virtual frame,
The coordinates of the brightness feature points, the coordinates of the saturation feature points, the coordinates of the hue feature points plotted by the decoding means, the coordinates of the brightness contour constituent points, the coordinates of the saturation contour constituent points plotted by the interpolation means, and Based on the coordinates of the hue contour constituent points, the brightness area point in the brightness area, the saturation area point in the saturation area, and the hue area point in the hue area are plotted on the virtual frame, and the brightness feature point And the brightness value of all the pixels in the brightness area consisting of the brightness contour constituent point and the brightness area point as an average value of brightness in the brightness coding information, the saturation feature point, the saturation contour constituent point, and the The saturation of all the pixels in the saturation area consisting of the saturation area points is the average value of the saturations in the saturation encoding information, and the hue feature point, the hue contour component point, and the hue area point The hues of all pixels in the hue area consisting of As the average value of the hue in the serial color coding information, restoring means for restoring the frame at a frame rate of the compressed moving picture data by claim 6, wherein the moving picture compression program, and,
Display means for displaying the frame restored by the restoration means;
Video decompression program to function as

Images