KR20150088166A - Method and device for processing image data - Google Patents

Abstract

A method for processing image data determines a movement contrast ratio of movement difference of an object and a background forming an image, determines movement size of the object, determines movement importance weight for compensating movement importance determined based on the movement size of the object and the movement contrast ratio, and determines movement importance of each block in an image by using at least one among the determined movement size of the object and the determined movement importance weight.

Description

[0001] The present invention relates to a method and a device for processing image data,

One or more embodiments disclosed are directed to a method of processing image data and to a device that processes image data.

BACKGROUND ART As information communication technology has been developed, a technique for processing image data has been improved, so that image data is being displayed through a portable terminal.

Accordingly, there is an increasing need to process image data through a portable terminal or the like. However, when image data is displayed through the portable terminal, the image data can be displayed in a state where the size of the image is limited.

Therefore, it is necessary to process the image data in consideration of the characteristics of the portable terminal due to the performance of the portable terminal or the limitation of the display.

Also, as the throughput of video data increases, a video data compression technique for transmitting and storing video data is required.

The present invention can provide a method of efficiently processing image data.

In one or more embodiments disclosed in the present invention, a device may provide a method of classifying pixels according to a predetermined criterion and processing image data using the classified group.

A method of processing image data according to various embodiments includes determining a motion contrast ratio of a motion difference between a background and an object constituting an image, determining a motion size of the object, a motion determined based on a motion contrast ratio and a motion size of the object Determining a motion importance weight for correcting the importance, and determining importance of each block in the image using at least one of the determined motion contrast ratio, the determined motion magnitude of the object, and the determined motion importance weight.

1 is a diagram for explaining a video data processing method and a device according to various embodiments.
2 is a flowchart illustrating a method for determining motion importance of each block in an image according to various embodiments.
3 is a flow chart illustrating a method by which a device determines a contrast ratio according to various embodiments.
4 is a flow chart illustrating a method by which a device determines the magnitude of motion of an object in accordance with various embodiments.
5 is a flow chart illustrating a method by which a device determines global motion reliability in accordance with various embodiments.
6 is a flow chart illustrating a method for a device to determine a motion importance weight according to various embodiments.
7 is a flow chart illustrating a method by which a device detects critical points in accordance with various embodiments.
8 is a diagram illustrating a method in which a device uses a multi-scale scheme in accordance with various embodiments.
9 is a diagram illustrating a method by which a device determines motion importance according to various embodiments.
10 is a diagram for explaining a method in which a device corrects motion importance using motion importance weight according to various embodiments.
11 is a diagram illustrating a method by which a device determines an important point according to various embodiments.
12 is a block diagram for explaining the configuration of a device according to various embodiments.

In various embodiments of the present invention described herein, an 'image' can be generically referred to as a still image, as well as a moving image such as a video.

1 to 12, a method and a device for processing image data according to various embodiments are disclosed.

Furthermore, the singular forms "a", "an," and "the" include plural referents unless the context clearly dictates otherwise.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Referring to the accompanying drawings, the same or corresponding elements are denoted by the same reference numerals, and redundant explanations thereof may be omitted.

1 is a diagram for explaining a video data processing method and a device 110 according to various embodiments.

The device 110 may receive the image data 120. The device 110 can process the received image data 120. [

In the process of processing the received image data 120, the device 110 determines a motion based on a motion contrast ratio, a motion size of an object, a motion contrast ratio and a motion size of an object, The motion importance weight for correcting the importance can be determined. In addition, the device 110 may determine the motion importance of each block in the image using at least one of the determined motion contrast ratio, the determined motion magnitude of the object, and the determined motion importance weight.

Specific details will be described later.

Figure 2 is a flow chart illustrating a method for determining the importance of each block in an image according to various embodiments.

A plurality of blocks may be included in the image.

In step S210, the device 110 may determine a motion contrast ratio for a motion difference between a background and an object constituting an image.

The motion contrast ratio may be a value for the motion difference between the background of the image and the object.

Alternatively, the motion contrast ratio may indicate a motion difference between the surrounding area and the current area. For example, the motion contrast ratio may be determined using the motion difference between the current block and blocks adjacent to the current block.

The device 110 can determine the motion contrast ratio using the motion of the current block and the motion difference between the neighboring blocks of the current block. The neighboring block may mean a block located within a predetermined distance from the current block.

For example, the device 110 may determine the motion contrast ratio using Equation (1). Mi may denote the motion contrast ratio of the current block.

[Mathematical expression (1)]

bi may refer to the i-th block. Vi can be a motion vector of bi. ∥xi-xj∥ ^ 2 can be the difference of the center position between the current block and the neighboring block. Ni may refer to a set of blocks located around bi block. σb ^ 2 may be a parameter that determines the sensitivity of the motion contrast ratio.

The motion contrast ratio can be corrected through a multi-scale technique. The multi-scale technique will be described later with reference to FIG.

)는 움직임 중요도를 결정할 때 이용될 수 있다.The corrected motion contrast ratio (

) Can be used to determine the importance of movement.

)를 더하여 움직임 중요도(Et)를 결정할 수 있다.For example, as in Equation (2), the device 110 may calculate a motion compensation ratio (i) corrected to a value obtained by multiplying the global motion reliability &

) Can be added to determine the motion importance (Et).

[Mathematical expression (2)]

A method for determining the global motion reliability [tau] will be described later in Fig.

In step S220, the device 110 may determine the motion size of the object. The motion size of an object can mean the moving distance of the object per hour when the image changes with time.

For example, the device 110 may determine an average value of movement distances of blocks corresponding to an object as a motion size of the object. In addition, an object may mean an object distinguished from a background in an image.

In step S230, the device 110 may determine a motion importance weight for correcting the motion importance determined based on the motion contrast ratio determined in step S210 and the motion size of the object determined in step S220.

The device 110 may correct the motion importance using the motion importance weight.

The device 110 may determine the motion importance Et based on the motion contrast ratio determined in step S210 and the motion magnitude of the object determined in step S220.

The motion importance weight may mean a value for correcting the motion importance (Et).

The device 110 may determine the motion importance weight Q for correcting the determined motion importance Et.

)를 결정할 수 있다.For example, as in Equation (3), the device 110 multiplies the motion importance (Et) by the motion importance weight (Q)

Can be determined.

(3)

Et (x, y) can mean the motion importance of the x-th horizontal and y-th vertical blocks.

Q (x, y) may mean the motion importance weight of the x-th horizontal and y-th vertical blocks.

The device 110 may determine the corrected motion importance by multiplying Et (x, y) by Q (x, y).

The accuracy of the motion importance may be lowered due to the inaccuracy of motion information. The inaccuracy of motion information can occur at the boundaries of objects and regions without textures. Accordingly, the device 110 may use the motion importance weight to remove the noise of the motion importance caused by the error of the motion information.

For example, the device 110 may determine a motion importance weight for each block and multiply the determined motion importance weight by the motion importance of each block to remove noise of motion importance. The device 110 may determine the motion importance weight by comparing the current block with neighboring blocks of the current block having less motion. As the current block is similar to the neighboring blocks of the current block, the importance weight of the motion may be lower. Or the motion importance weight may be lower as the pixel values of neighboring blocks of the current block in which the current block has less motion are similar to each other.

For example, the device 110 may determine the motion importance weight of the block using Equation (4).

(4)

Sc is the pixel similarity between blocks, and WT (j) can be a weight for the motion size of bj. Wg can be a weight according to the distance between bi and bj blocks.

For example, the device 110 may determine Sc, WT, and Wg using equations (5) through (7).

(5)

[Expression (6)]

(7)

WT (j) can have a larger value as the motion size of bj is smaller. Also, Wg (i, j) can have a larger value as the distance between blocks bi and bj becomes closer.

In step S240, the device 110 may determine the motion importance of each block in the image using at least one of the motion contrast ratio determined in step S210, the motion magnitude of the object determined in step S220, and the motion importance weight determined in step S230.

)를 결정할 수 있다. 그리고 본 실시 예에서, 디바이스(110)는 움직임 중요도(Et)는 상술한 수학식(2)를 이용하여 결정될 수 있다.For example, the device 110 may determine the motion importance of each block in the image using both the motion contrast ratio determined at step S210, the motion magnitude of the object determined at step S220, and the motion importance weight determined at step S230. The device 110 multiplies the motion importance Et by the motion importance weight Q using the above-described equation (3)

Can be determined. And, in the present embodiment, the device 110 can determine the motion importance (Et) using the above-described equation (2).

The device 110 may discriminate the important area when compressing the image and perform differential compression on the important area and the non-important area. The important area may be an area occupied by the blocks whose corrected motion importance is greater than or equal to a predetermined reference value determined in step S240.

The device 110 may determine the compression scheme for the images of each block based on the corrected motion importance of each block determined in step S240. The importance may include the corrected motion importance.

The device 110 may determine a critical region when compressing an image and differentiate compression parameters for the critical region and the non-critical region. The device 110 may improve compression efficiency by differentiating compression parameters for critical and non-critical areas. The important area may be an area occupied by the blocks whose importance is not less than a predetermined standard. The non-critical area may mean an area occupied by the blocks whose importance is less than a predetermined standard.

For example, the device 110 selects a compression method that focuses more on the accuracy than the compression speed when compressing the blocks with a degree of importance greater than or equal to a predetermined reference, and compresses You can choose a compression method that is more focused on compression speed than accuracy.

In addition, the device 110 can emphasize important points in the image. The quality of the image can be improved by emphasizing the important points in the image.

For example, the device 110 may cause the blocks whose importance determined in step S240 to be greater than or equal to a predetermined reference to be displayed brighter by a predetermined ratio.

As another example, the device 110 may cause the blocks whose importance determined in step S240 to be higher than a predetermined reference level to be emphatically displayed in a predetermined manner.

The embodiments described above with reference to FIG. 2 are merely one embodiment, and those skilled in the art will understand that the present invention may be embodied in various forms without departing from the essential characteristics of the present invention. It can be understood that it is possible.

FIG. 3 is a flow chart illustrating a method by which device 110 determines a motion contrast ratio according to various embodiments.

In step S310, the device 110 may determine the motion value of the current block.

For example, the device 110 compares the position of the current block in the current frame with the position of the block corresponding to the current block in the next frame, and determines the motion value of the current block using the moving distance of the current block per time change .

In step S320, the device 110 may determine a motion value of neighboring blocks located around the current block.

For example, the device 110 may determine motion values of blocks located within a predetermined distance from the current block using the motion value determination method as described above.

In step S330, the device 110 may determine the motion contrast ratio using the difference between the motion value of the current block determined in step S310 and the motion value of the neighboring blocks determined in step S320.

For example, the motion contrast ratio can be calculated by the equation (1) as described above. In addition, the motion contrast ratio can be corrected through a multi-scale technique.

As another example, the motion contrast ratio may be set to be proportional to the sum of the motion values of the current block determined in step S310 and the motion values of the neighboring blocks determined in step S320.

4 is a flow chart illustrating a method by which device 110 determines the size of an object's motion in accordance with various embodiments.

In step S410, the device 110 may determine the motion value of the current block.

Since step S410 corresponds to step S310, a detailed description will be omitted for the sake of simplicity.

In step S420, the device 110 may determine a global motion value for the global motion of the image.

The global motion can mean the overall motion of the image. For example, when the camera moves, the motion value corresponding to the movement of the camera can be a global motion value.

Device 110 may determine a global motion. For example, the device 110 may determine an average motion of a plurality of blocks constituting an image as a global motion. As another example, device 110 may construct a motion histogram and select a motion that exhibits the highest frequency in the histogram as a global motion.

In step S430, the device 110 may determine the motion size of the object excluding the global motion value determined in step S420 from the motion value of the current block determined in step S410.

For example, the device 110 may determine a value obtained by subtracting the global motion value determined in step S420 from the motion value of the current block determined in step S410 as the motion size of the current block.

As another example, the device 110 may determine a value obtained by subtracting the global motion value determined in step S420 from the motion value of the current block determined in step S410 as the motion size of the object corresponding to the current block.

As another example, the device 110 may determine a value obtained by removing the global motion component determined in step S420 from the motion value of the current block determined in step S410 as the motion size of the current block.

FIG. 5 is a flow diagram illustrating a method for device 110 to determine global motion reliability in accordance with various embodiments.

In an embodiment of the method for excluding the global motion value from the motion value of the current block described in FIG. 4, there may be a method of using the motion reliability.

Global motion reliability can mean the exact degree of global motion.

The motion size can mean the absolute size of the motion of each block. When a user shoots a video using a camera, global movement may occur due to the movement of the camera. Therefore, the global motion may have to be compensated to calculate the absolute magnitude of the motion. Device 110 may construct a motion histogram and select a motion that exhibits the highest frequency in the histogram as a global motion. The device 110 can determine that the higher the rate of the selected motion is distributed in the image, the higher the probability of the global motion. Accordingly, the device 110 can define the ratio of the selected motion value in the histogram as the global motion reliability ([tau]). The device 110 may calculate the motion magnitude T by removing the global motion in the motion map.

In addition, the device 110 may determine the importance of each block in the image using at least one of the motion contrast ratio, the motion magnitude of the object, the motion importance weight, and the global motion reliability.

In addition, the device 110 may determine the importance of each block in the image using the motion contrast ratio, the motion magnitude of the object, the motion importance weight, and the global motion reliability.

Fig. 5 illustrates a method for determining the global motion reliability [tau] which can be used in calculating the motion magnitude T. [

In step S510, the device 110 may determine the motion sizes of the blocks constituting the image.

The device 110 may determine the motion sizes of the blocks constituting the image according to the position variation amount of the blocks constituting the image with the passage of time.

In step S520, the device 110 may determine a mode among the motion sizes of the blocks determined in step S510 as a global motion value.

For example, the device 110 may construct a motion histogram and select a motion that exhibits the highest frequency in the histogram as a global motion.

In another example, the device 110 may determine an average motion of a plurality of blocks constituting an image as a global motion.

In step S530, the device 110 may determine global motion reliability, which is a value for a ratio of 'global motion value determined in step S520' to 'motion sizes of blocks determined in step S510'.

For example, the device 110 may determine the global motion reliability, which is a value corresponding to a ratio of 'the global motion value determined in step S520' among the motion magnitudes of the blocks determined in step S510 '.

As another example, the device 110 may determine the global motion reliability, which is a value proportional to the proportion of the motion magnitudes of the blocks determined in step S510 occupied by the global motion value determined in step S520.

FIG. 6 is a flow chart illustrating a method by which device 110 determines a motion importance weight according to various embodiments.

In step S610, the device 110 may determine the pixel similarity between the current block and neighboring blocks located around the current block.

For example, the device 110 may determine the pixel similarity between the current block and neighboring blocks located within a predetermined range from the current block.

For example, if the neighboring blocks of the current block and the current block are all composed of only the same pixel value, the pixel similarity may be 1.

As another example, if the pixel of the current block is composed of only white and the pixels of the neighboring block are composed of only black, the pixel similarity may be zero.

In step S620, the device 110 may determine a neighboring block motion weight, which is a value for motion size of neighboring blocks.

For example, the neighboring block motion weighting may be a value indicating the extent to which the motion magnitude of the neighboring block affects the motion importance weights.

In step S630, the device 110 may determine an inter-block distance weight that is a value for a distance between the current block and neighboring blocks.

For example, the device 110 may determine the inter-block distance weight so that the distance between the current block and the neighboring block becomes larger, the smaller the inter-block distance weight.

As another example, the device 110 may determine the block-to-block distance weight such that the distance between the current block and the neighboring block is closer to a predetermined distance, the higher the inter-block distance weight.

In step S640, the device 110 may determine the motion importance weight using at least one of the pixel similarity determined in step S610, the neighboring block motion weight determined in step S620, and the inter-block distance weight determined in step S630.

For example, as described above, the device 110 may determine the motion importance weight using equation (4). Details are described above.

As another example, the device 110 may determine the motion importance weight to be proportional to the pixel similarity.

FIG. 7 is a flow diagram illustrating how a device 110 detects critical points in accordance with various embodiments.

In step S710, the device 110 may receive input image data.

In steps S720 through S740, the device 110 may determine the motion importance.

In step S720, the device 110 may determine a motion contrast ratio for a motion difference with neighboring blocks for each block constituting an image.

In step S730, the device 110 may determine the motion size of each block constituting the image.

In step S740, the device 110 may determine the motion reliability for the accuracy of motion size of each block constituting the image.

The device 110 can determine the motion importance for each block constituting the image using the motion contrast ratio determined in step S720, the motion magnitude determined in step S730, and the motion reliability determined in step S740.

In step S750, the device 110 may determine spatial importance for each block or pixel that constitutes the image.

The device 110 may determine the degree of rarity, cohesion, or central density of the pixels included in the image in the course of processing the received image data 120.

In processing the received image data 120, the device 110 may classify the pixels included in the image into one or more groups to determine the degree of rarity, cohesion, or central density for the respective groups. The device 110 may determine the importance of each group based on at least one of the determined degrees of rarity, cohesion and central density.

With respect to the rarity, the device 110 may determine, on a pixel-by-pixel basis, the degree to which the brightness value of each pixel is rare in the entire image. Alternatively, the device 110 may determine, on a pixel-by-pixel basis, the degree to which the color value of each pixel is rare in the entire image.

With regard to cohesion, the device 110 may determine the degree of cohesion of each group where the pixels of each group are close to each other.

With respect to the central density, the device 110 may determine the central density of each group where the pixels of each group are close to the center of the image.

The device 110 may determine the importance of each group based on at least one of the determined degrees of rarity, cohesion and central density. The device 110 may also determine the spatial importance of a block or pixel that constitutes an image according to the importance of each group.

In step S760, the device 110 may detect an important point using motion importance and spatial importance of a block or pixels in an image.

For example, the device 110 may assign importance to a block or pixels in an image such that it is proportional to the motion importance and spatial importance of the block or pixels in the image.

FIG. 8 is a diagram illustrating a method in which a device 110 uses a multi-scale scheme in accordance with various embodiments.

The device 110 may estimate the motion information of the moving image. For example, the device 110 may use a hierarchical block motion estimation technique to estimate motion information of a motion picture.

As shown in FIG. 8, the hierarchical block motion estimation scheme is a technique for quickly and accurately predicting motion by constructing an input frame as a pyramid-type multi-scale image and inheriting a motion estimation value at an upper level.

For example, the device 110 may determine a position 810 with motion at a low scale.

The device 110 may then scale the scale to analyze the motion of the portion 820 corresponding to the motion location 810.

The device 110 may further magnify the scale and analyze the motion of the portion 830 corresponding to the portion 820 analyzed.

9 is a diagram illustrating a method by which device 110 determines a motion contrast ratio, a motion magnitude, and a motion importance according to various embodiments.

9A is an image of image data received by device 110 according to various embodiments.

9B illustrates an embodiment in which a motion comparison ratio is extracted from image data received by the device 110 according to various embodiments.

The device 110 can extract the motion contrast ratio using the received image data 120. [ The device 110 may extract the motion contrast ratio from the input image 910. The motion contrast ratio image 920 may be extracted from the input image 910 by the device 110.

9C illustrates an embodiment in which a motion size is extracted from image data received by the device 110 according to various embodiments.

The device 110 may extract the motion magnitude image 930 from the input image 910. [

9D is an embodiment in which motion importance is extracted from image data received by the device 110 according to various embodiments.

For example, device 110 may extract motion importance image 940 using motion balance ratio image 920 and motion magnitude image 930.

FIG. 10 is a diagram illustrating a method for the device 110 to correct motion importance using motion importance weights according to various embodiments.

10A is an embodiment in which the device 110 extracts motion importance weights from image data according to various embodiments.

For example, the device 110 may extract the motion importance weighted image 1010 from the input image 910.

FIG. 10B is an embodiment in which the device 110 extracts a calibrated motion importance weight from image data according to various embodiments.

For example, the device 110 may determine a motion importance image 1020 that has been calibrated by correcting the motion importance image 940.

In another example, the device 110 may determine a motion importance image that has been corrected using the motion importance image 940 and the motion importance weight image 1010.

FIG. 11 is a diagram illustrating a method by which device 110 determines importance points according to various embodiments.

11A is an embodiment in which the device 110 extracts spatial importance from image data according to various embodiments.

For example, the device 110 may extract the spatial importance image 1110 from the input image 910.

11B is an embodiment in which the device 110 extracts important points from the image data according to various embodiments.

For example, the device 110 may extract critical points using the spatial importance image 1110 and the corrected importance image 1020. [

Specifically, in the important point extraction result image 1120, the lightness and darkness of the pixels of the low importance group are displayed low, and the lightness and darkness of the pixels of the high importance group are displayed high.

12 is a block diagram illustrating a configuration of a device 110 according to various embodiments.

The device 110 is an apparatus capable of performing the image data processing method described above, and it is possible to implement all the embodiments for performing the image data processing method described above.

12, the device 110 may include a motion comparison ratio determination unit 1210, a motion size determination unit 1220, a weight determination unit 1230, and an importance determination unit 1240. However, the device 110 may be implemented by more components than the components shown, and the device 110 may be implemented by fewer components than the components shown.

Hereinafter, the components will be described in order.

The motion contrast ratio determiner 1210 can determine a motion contrast ratio for a motion difference between a background and an object constituting an image.

The motion contrast ratio may be a value for the motion difference between the background of the image and the object.

The motion contrast ratio determiner 1210 can determine the motion contrast ratio using motion of the current block and motion difference between neighboring blocks of the current block. The neighboring block may mean a block located within a predetermined distance from the current block.

For example, the motion-contrast-ratio determining unit 1210 can determine the motion-contrast ratio using the above-described equation (1).

The motion contrast ratio can be corrected through a multi-scale technique. Multi-scale techniques have been described above in FIG.

)는 움직임 중요도를 결정할 때 이용될 수 있다.The corrected motion contrast ratio (

) Can be used to determine the importance of movement.

)를 더하여 움직임 중요도(Et)를 결정할 수 있다.For example, as in Equation (2), the device 110 may calculate a motion compensation ratio (i) corrected to a value obtained by multiplying the global motion reliability &

) Can be added to determine the motion importance (Et).

A method for determining the global motion reliability [tau] is described above in Fig.

The motion size determination unit 1220 may determine a motion size of an object constituting an image.

The motion size of an object can mean the moving distance of the object per hour when the image changes with time.

For example, the motion size determination unit 1220 may determine an average value of movement distances of blocks corresponding to an object as a motion size of the corresponding object. In addition, an object may mean an object distinguished from a background in an image.

The weight determining unit 1230 can determine the motion importance weight. The device 110 may correct the motion importance using the motion importance weight. The motion importance can be determined based on the motion contrast ratio and the motion size of the object.

The device 110 may correct the motion importance using the motion importance weight.

The device 110 may determine the motion importance Et based on the motion contrast ratio and the motion magnitude of the object.

The motion importance weight may mean a value for correcting the motion importance (Et).

The weight determining unit 1230 may determine a motion importance weight Q for correcting the determined motion importance Et.

)를 결정할 수 있다.For example, as in Equation (3) above, the device 110 multiplies the motion importance Et and the motion importance weight Q by the motion importance (Q)

Can be determined.

Et (x, y) can mean the motion importance of the x-th horizontal and y-th vertical blocks.

Q (x, y) may mean the motion importance weight of the x-th horizontal and y-th vertical blocks.

The device 110 may determine the corrected motion importance by multiplying Et (x, y) by Q (x, y).

The accuracy of the motion importance may be lowered due to the inaccuracy of motion information. The inaccuracy of motion information can occur at the boundaries of objects and regions without textures. Accordingly, the device 110 may use the motion importance weight to remove the noise of the motion importance caused by the error of the motion information.

For example, the device 110 may determine a motion importance weight for each block and multiply the determined motion importance weight by the motion importance of each block to remove noise of motion importance. The weight determining unit 1230 may determine the motion importance weight by comparing the current block with neighboring blocks of the current block having less motion. As the current block is similar to the neighboring blocks of the current block, the importance weight of the motion may be lower. Or the motion importance weight may be lower as the pixel values of neighboring blocks of the current block in which the current block has less motion are similar to each other.

For example, the weight determining unit 1230 can determine the motion importance weight of the block using the above-described equation (4).

The importance determining unit 1240 can determine the importance of motion of each block in the image using at least one of a motion contrast ratio, an object motion size, and a motion importance weight.

Alternatively, the importance determining unit 1240 may determine the motion importance of each block in the image using the motion contrast ratio, the object motion size, the motion importance weight, and the global motion reliability.

For example, the importance determining unit 1240 can determine the motion importance of each block in the image using both the motion contrast ratio, the motion magnitude of the object, and the motion importance weight.

)를 결정할 수 있다. 그리고 본 실시 예에서, 중요도 결정부(1240)는 움직임 중요도(Et)는 상술한 수학식(2)를 이용하여 결정할 수 있다.For example, the importance level determination unit 1240 multiplies the motion importance Et by the motion importance weight Q using the above-described equation (3)

Can be determined. In this embodiment, the importance degree determining unit 1240 can determine the motion importance Et using the above-described equation (2).

The device 110 may discriminate the important area when compressing the image and perform differential compression on the important area and the non-important area. The important area may refer to an area occupied by the blocks whose determined corrected motion importance is equal to or greater than a predetermined reference value.

The device 110 may determine the compression scheme for the images of each block based on the determined motion importance of each determined block. The importance may include the corrected motion importance.

The device 110 may determine a critical region when compressing an image and differentiate compression parameters for the critical region and the non-critical region. The device 110 may improve compression efficiency by differentiating compression parameters for critical and non-critical areas. The important area may be an area occupied by the blocks whose importance is not less than a predetermined standard. The non-critical area may mean an area occupied by the blocks whose importance is less than a predetermined standard.

For example, the device 110 selects a compression method that focuses more on the accuracy than the compression speed when compressing the blocks with a degree of importance greater than or equal to a predetermined reference, and compresses You can choose a compression method that is more focused on compression speed than accuracy.

In addition, the device 110 can emphasize important points in the image. The quality of the image can be improved by emphasizing the important points in the image.

For example, the device 110 may cause the blocks whose importance determined in step S240 to be greater than or equal to a predetermined reference to be displayed brighter by a predetermined ratio.

As another example, the device 110 may cause the blocks whose importance determined in step S240 to be higher than a predetermined reference level to be emphatically displayed in a predetermined manner.

The embodiments described above with reference to FIG. 12 are only one embodiment, and those skilled in the art will understand that the present invention may be embodied in various forms without departing from the essential characteristics of the present invention. It can be understood that it is possible.

It is to be understood that the terms "comprises", "comprising", or "having" as used in the foregoing description mean that the constituent element can be implanted unless specifically stated to the contrary, But should be construed as further including other elements.

The above-described embodiments of the present invention can be embodied in a general-purpose digital computer that can be embodied as a program that can be executed in a computer and operates the program using a computer-readable recording medium. The computer-readable recording medium includes a storage medium such as a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD ROM,

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (15)

A method for processing image data,
Determining a motion contrast ratio for a motion difference between a background and an object constituting the image;
Determining a motion size of the object;
Determining a motion importance weight for correcting the motion importance determined based on the motion contrast ratio and the motion magnitude of the object; And
Determining motion importance of each block in the image using at least one of the determined motion contrast ratio, the motion magnitude of the determined object, and the determined motion importance weight. The method according to claim 1,
The step of determining the motion contrast ratio
Determining a motion value of a current block;
Determining a motion value of neighboring blocks located around the current block; And
And determining the motion-contrast ratio using the difference between the motion value of the determined current block and the motion value of the determined neighboring blocks. The method according to claim 1,
The step of determining the motion size of the object
Determining a motion value of a current block;
Determining a global motion value for a global motion of the image; And
And determining a motion size of the object excluding the determined global motion value from the motion value of the determined current block. The method of claim 3,
The step of determining the global motion value
Determining motion sizes of blocks constituting the image; And
And determining a mode among the motion sizes of the determined blocks as the global motion value. The method of claim 3,
The step of determining the importance of each block in the image
Determining global motion confidence for the precise degree of the determined global motion value; And
Determining motion importance of each block in the image using the determined motion contrast ratio, the motion magnitude of the determined object, the determined motion importance weight, and the determined global motion reliability. 6. The method of claim 5,
The step of determining the global motion reliability
Determining motion sizes of blocks constituting the image;
Determining a mode among the motion sizes of the determined blocks as the global motion value; And
And determining the global motion reliability as a value for a ratio of the global motion values to the motion magnitudes of the determined blocks. The method according to claim 1,
The step of determining the motion importance weight
Determining a pixel similarity between a current block and neighboring blocks located around the current block;
Determining a neighboring block motion weight that is a value for a motion size of the neighboring blocks;
Determining a block-to-block distance weight that is a value for a distance between the current block and the neighboring blocks; And
Determining the motion significance weight using at least one of the determined pixel similarity, the determined neighboring block motion weight, and the determined inter-block distance weight. An apparatus for processing image data,
A motion contrast ratio determination unit for determining a motion contrast ratio for a motion difference between a background and an object constituting the image;
A motion size determination unit for determining a motion size of the object;
A weight determining unit for determining a motion importance weight for correcting the motion importance determined based on the motion contrast ratio and the motion magnitude of the object; And
And an importance determining unit for determining a motion importance of each block in the image by using at least one of the determined motion contrast ratio, the motion magnitude of the determined object, and the determined motion importance weight. 9. The method of claim 8,
The motion-to-
The motion value of the current block is determined,
Determining motion values of neighboring blocks located around the current block,
And determines the motion contrast ratio using the difference between the motion value of the determined current block and the motion value of the determined neighboring blocks. 9. The method of claim 8,
The motion size determination unit
The motion value of the current block is determined
A global motion value for the global motion of the image is determined
And determines a motion size of the object excluding the determined global motion value from the determined motion value of the current block. 11. The method of claim 10,
The motion size determination unit
The motion magnitudes of the blocks constituting the image are determined
And determines a mode among the motion sizes of the determined blocks as the global motion value. 11. The method of claim 10,
The importance determining unit
The determined global motion value determines the global motion reliability for the correct degree
Wherein the motion importance of each block in the image is determined using the determined motion contrast ratio, the motion magnitude of the determined object, the determined motion importance weight, and the determined global motion reliability. 13. The method of claim 12,
The importance determining unit
Determining motion sizes of blocks constituting the image,
Determining a mode among the motion sizes of the determined blocks as the global motion value,
And determines the global motion reliability as a value for a ratio of the global motion values to the motion magnitudes of the determined blocks. 9. The method of claim 8,
The weight determining unit
The pixel similarity between the current block and neighboring blocks located around the current block is determined
A neighboring block motion weight value which is a value for the motion size of the neighboring blocks is determined
Block distance weights that are values for the distance between the current block and the neighboring blocks are determined
And determines the motion importance weight using at least one of the determined pixel similarity, the determined neighboring block motion weight, and the determined inter-block distance weight. A computer-readable recording medium storing a program for causing a computer to execute the method according to any one of claims 1 to 7.

Images