JP2021056936A5

JP2021056936A5 -

Info

Publication number: JP2021056936A5
Application number: JP2019181532A
Authority: JP
Filing date: 2019-10-01
Publication date: 2022-10-12
Anticipated expiration: 2039-10-01

Claims

An image processing device that generates a foreground image showing the shape of an object from a captured image,
Acquisition means for acquiring the captured image;
extracting means for extracting a foreground area corresponding to the shape of the object from the captured image to generate a foreground image;
detection means for detecting a contour area of the object from the foreground image;
a correction means for correcting pixels forming the contour region in the foreground image based on whether the color of the pixel in the captured image corresponding to the pixel is similar to the color of the background;
An image processing device comprising:

The obtaining means further obtains a background image in which the object does not exist,
further comprising determination means for determining whether the color of each pixel constituting the captured image is similar to the color of the background indicated by the background image;
The correction means performs the correction based on the determination result of the determination means.
2. The image processing apparatus according to claim 1, wherein:

When the color of the pixel of interest in the captured image is closer to the color of the background indicated by the background image than the color of the object, the determination means determines that the color of the pixel of interest is similar to the color of the background. and
When a pixel in the foreground image corresponding to the pixel of interest determined by the determination means to be close to the color of the background is a pixel forming the outline region, the correction means changes the pixel value of the pixel to Make corrections to pixel values that indicate the background,
3. The image processing apparatus according to claim 2, wherein:

3. The judging means judges whether the color of the target pixel is closer to the color of the background than the color of the object, using a predetermined evaluation value relating to tint. 4. The image processing apparatus according to 3.

5. The image processing apparatus according to claim 4, wherein the predetermined evaluation value is one of MSE, MAE, and RMSE.

comparing pixel values of corresponding pixels between the foreground image and the background image, and determining that the color of the target pixel is similar to the color of the background when the difference is equal to or less than a predetermined threshold; 4. The image processing apparatus according to claim 3, characterized by:

5. The determining means performs the determination using a pixel value in the color space of the captured image or a pixel value in a converted color space obtained by converting the color space into a different color space. 7. The image processing apparatus according to any one of items 1 to 6.

The captured image and the background image have a common color space represented by a plurality of color components,
The judging means determines whether the color of the target pixel is closer to the color of the background indicated by the background image than to the color of the object. 4. The image processing apparatus according to claim 3, wherein the determination is made based on:

further comprising derivation means for deriving a color component with the highest appearance frequency in the color space of the background image;
If the color component with the highest appearance frequency in the background image derived by the derivation means is not the same as the color component with the maximum value in the target pixel in the captured image, the determination means determines that determining that the color of the pixel of interest is close to the color of the background;
9. The image processing apparatus according to claim 8, characterized by:

The determination means performs the determination using a pixel value in accordance with the common color space or a pixel value in accordance with a converted color space obtained by converting the color space into a different color space. The image processing apparatus according to claim 8.

Based on whether the detection means satisfies a predetermined condition that a pixel in the foreground image generated by the extraction means satisfies a predetermined condition that can be regarded as a pixel constituting a vicinity of a boundary between the object and the background, 11. The image processing apparatus according to any one of claims 3 to 10, wherein the pixel of interest detects the contour area.

The predetermined condition is that a pixel in the foreground image is a pixel that constitutes the object, and one or more pixels that constitute the background exist in a predetermined block containing the pixel. 12. The image processing apparatus according to claim 11, characterized by:

The predetermined condition is a case where a pixel value of a pixel in the foreground image and a pixel value of a corresponding pixel in a contracted image obtained by performing morphological processing on the foreground image are not the same. 12. The image processing apparatus according to claim 11.

2. The image processing apparatus according to claim 1, wherein the corrected foreground image obtained by said correcting means is used as a foreground image to be processed by said detecting means and said correcting means.

An image processing method for generating a foreground image showing the shape of an object from a captured image,
an acquisition step of acquiring the captured image;
an extracting step of extracting a foreground area corresponding to the shape of the object from the captured image to generate a foreground image;
a detection step of detecting a contour region of the object from the foreground image;
a correction step of correcting a pixel forming the contour region in the foreground image based on whether the color of the pixel in the captured image corresponding to the pixel is similar to the color of the background;
An image processing method comprising:

A program that causes a computer to function as each means of the image processing apparatus according to any one of claims 1 to 14.