JP2019054471A - Microscope image processing apparatus, microscope image processing method, and microscope image processing program - Google Patents

Abstract

To make a boundary between the background of an original image and an unphotographed area inconspicuous when the image is rotated or resized.SOLUTION: A microscope image processing apparatus 1 includes a rotation/resize unit 3 which performs rotation processing and/or resizing processing on an original image acquired by a microscope 10 to generate a photographed area image consisting of a part of the original image, an unphotographed area color setting unit 4 which sets a pixel value of an unphotographed area based on the pixel value of the edge of the part of the original image or the pixel value of the part excluded from the original image by the rotation processing and the resizing processing, and a combining unit 5 which combines the photographed area image and the unphotographed area image having the pixel value set by the unphotographed area color setting unit 4 to generate a combined image.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a microscope image processing apparatus, a microscope image processing method, and a microscope image processing program.

  2. Description of the Related Art Conventionally, a microscope system that generates a composite image by combining a plurality of partial images obtained by photographing different regions of a sample is known (see, for example, Patent Document 1). When using this microscope system to shoot only the user's area of interest, not the entire sample, and paste it together, only a partial image of the area of interest is pasted in a mosaic pattern to a part of the entire image range. A combined image is generated.

  In such a composite image, there is an unphotographed area where no partial image exists, and in order to make the background color of the partial image and the color of the unphotographed area close to each other, the unphotographed area is Generally, a process of painting with a predetermined color for each observation method is performed. For example, an unphotographed area is filled with white for bright-field observation and black for fluorescence observation.

JP 2014-224929 A

  When a user pastes an image on a report, a paper, or the like or compares images, the user may perform processing such as rotation or resizing. For example, the image is rotated so that a subject to be imaged that is tilted in the image stands upright, or the image is resized so that the image is the same size as other images. In this way, an unphotographed area in which the original image does not exist also occurs in the image after rotation or resizing. Therefore, in order to make the boundary between the background of the original image and the non-photographed area inconspicuous, there is an inconvenience that an additional process for filling the non-photographed area is required.

  In addition, when the unphotographed area is filled with a color according to the observation method, when the white balance is not properly performed during bright field observation or when light shielding is not sufficiently performed during fluorescence observation, the original image is displayed. There is a disadvantage that the background does not become constant white or black, and the boundary between the original image and the unphotographed area becomes conspicuous.

  The present invention has been made in view of the circumstances described above, and is a microscope image processing apparatus that can make the boundary between the background of an original image and an unphotographed area inconspicuous even when the image is rotated or resized. An object of the present invention is to provide a microscope image processing method and a microscope image processing program.

In order to achieve the above object, the present invention provides the following means.
One aspect of the present invention includes a rotation / resize unit that generates at least one of a rotation process and a resizing process on an original image acquired by a microscope to generate a captured region image including a part of the original image; An unphotographed area color setting unit that sets a pixel value of an unphotographed area based on a pixel value, the photographed area image generated by the rotation / resizing unit, and pixels set by the unphotographed area color setting unit And a combining unit that generates a composite image by combining the unphotographed region image having the value, and the unphotographed region color setting unit includes the pixel value of the edge of the part of the original image or the rotation processing And a microscope image processing apparatus that sets a pixel value of the unphotographed area based on a pixel value of a portion excluded from the original image by the resizing process.

  According to this aspect, when the original image acquired by the microscope is input, the rotation / resize unit performs at least one of the rotation process and the resizing process on the original image, so that the corner area of the original image or An area along the side is excluded, and a captured area image including a part of the original image is generated. Then, the synthesized image is generated by synthesizing the photographed area image with the unphotographed area image by the synthesis unit.

  Usually, the rotation process and the resizing process are performed so that the entire shooting target is arranged at the center of the shot area image. In many cases, the portion excluded from the region (the region along the corner and the side of the original image) is the background. Based on the pixel values of a part of the edge of the original image or the portion excluded from the original image, the pixel value of the unphotographed area is set so that the color of the unphotographed area is close to the background color of the original image. It is set by the unphotographed area color setting unit. As a result, it is possible to generate a composite image in which the boundary between the background of the photographed area image and the unphotographed area is not noticeable even when white balance and light shielding are not properly performed when the original image is acquired.

In the above aspect, the unphotographed area color setting unit is configured to determine a pixel value of the unphotographed area based on a pixel value of an edge adjacent to the excluded part of the edge of the part of the original image. May be set.
In general, the portion excluded from the original image by the rotation processing and the resizing processing and the edge adjacent to the excluded portion are often the background. Accordingly, the pixel value of the unphotographed area can be set so that the color of the unphotographed area becomes closer to the background color of the original image based on the pixel value of the edge adjacent to the excluded portion.

In the above aspect, the unphotographed area color setting unit calculates the pixel value of the unphotographed area based on the pixel value of the edge along the side of the original image among the partial edges of the original image. It may be set.
Usually, since the original image is acquired so that the entire photographing target is arranged at the center of the original image, the edge along the side of the original image is often the background. Therefore, the pixel value of the unphotographed area can be set so that the color of the unphotographed area is closer to the background color of the original image based on the pixel value of the edge along the side of the original image.

In the above aspect, the unphotographed area color setting unit obtains the mode value or the average value of the pixel values of the edge of the part of the original image or the pixel values of the excluded part of the original image. The pixel value of the area may be set.
In this way, the pixel value of the unphotographed area can be set so that the color of the unphotographed area becomes closer to the background color of the original image.

In the above aspect, an observation method setting unit that sets an observation method of the microscope used for photographing the original image is provided, and the unphotographed region color setting unit is an observation method set by the observation method setting unit. Based on a part of the range that can be taken by the pixel value of the original image based on the calculation target, and set the mode value or the average value of the pixel values not applicable to the calculation target as the pixel value of the unphotographed area Also good.
Some image having a color different from the background may be reflected around the subject in the original image. By setting the pixel value of a color different from the background color out of the calculation target and excluding it in the calculation of the pixel value of the unphotographed area, the color of the unphotographed area becomes closer to the background color of the original image. As described above, the pixel value of the unphotographed area can be set.

  According to another aspect of the present invention, there is provided a rotation / resize step for generating a photographed region image including a part of the original image by performing at least one of a rotation process and a resizing process on the original image acquired by a microscope, and the original image An unphotographed area color setting step for setting a pixel value of an unphotographed area based on the pixel value of the image, the photographed area image generated in the rotation / resizing step, and the non-photographed area color setting step Combining a non-photographed region image having a pixel value to generate a composite image, and in the unphotographed region color setting step, the pixel value of the portion of the original image, or the rotation process and the Based on the pixel value of the portion excluded from the original image by the resizing process, the microscope image process for setting the pixel value of the unphotographed area. It is a method.

  According to another aspect of the present invention, there is provided a rotation / resize step for generating a photographed region image including a part of the original image by performing at least one of a rotation process and a resizing process on the original image acquired by a microscope, and the original image An unphotographed area color setting step for setting a pixel value of an unphotographed area based on the pixel value of the image, the photographed area image generated in the rotation / resizing step, and the non-photographed area color setting step A synthesis step of generating a synthesized image by synthesizing the unphotographed area image having pixel values, and in the unphotographed area color setting step, the pixel value of the edge of the part of the original image, or , Pixels in the unphotographed area based on pixel values of portions excluded from the original image by the rotation process and the resizing process Is a microscope image processing program for setting.

  According to the present invention, even when the image is rotated or resized, the boundary between the background of the original image and the unphotographed area can be made inconspicuous.

It is a block diagram which shows the structure of the microscope image processing apparatus which concerns on one Embodiment of this invention. It is a figure explaining the rotation process of the original image by the rotation and resizing part of the microscope image processing apparatus of FIG. 1, and the production | generation process of the synthesized image by a synthetic | combination part. It is a figure explaining the resizing process of the original image by the rotation and resizing part of the microscope image processing apparatus of FIG. 1, and the production | generation process of the synthesized image by a synthetic | combination part. It is a figure explaining the edge part adjacent to an exclusion area | region among the edge parts of a picked-up area | region image. 6 is a chart showing an example of a correspondence relationship between an observation method and a default color of an unphotographed area, which is held by an unphotographed area color setting unit of the microscope image processing apparatus in FIG. 1. It is a flowchart which shows the microscope image processing method by the microscope image processing apparatus of FIG. It is a flowchart which shows the subroutine of the unphotographed area | region pixel value setting process of FIG. It is a figure explaining the edge part along the edge | side of an original image among the edge parts of a picked-up area | region image. It is a flowchart which shows the subroutine of the unphotographed area | region pixel value setting process in the modification of the microscope image processing method of FIG. It is a figure which shows an example of the original image in which writing was reflected in the background. FIG. 11 is an example of a histogram of luminance values in the excluded area in FIG. 10 and is a diagram for explaining pixel values that are not subject to calculation.

A microscope image processing apparatus 1, a microscope image processing method, and a microscope image processing program according to an embodiment of the present invention will be described below with reference to the drawings.
The microscope image processing apparatus 1 according to the present embodiment processes an original image D of a specimen A acquired by a microscope 10 to which a camera is attached. As shown in FIG. 1, the microscope image processing apparatus 1 is connected to a microscope 10 and stores an original image D input from the microscope 10 in a memory (not shown). Based on the image processing.

  In the present embodiment, the specimen A is assumed to be a slide specimen in which a section of biological tissue is pasted on a slide glass. Therefore, as shown in FIGS. 2 and 3, the original image D includes a section that is the imaging target B and a background C that is an area outside the section.

  The microscope image processing apparatus 1 includes an observation method setting unit 2 that sets an observation method of the microscope 10 used for photographing the original image D, and at least one of rotation processing and resizing processing performed on the original image D. A rotation / resize unit 3 that generates E, an unphotographed region color setting unit 4 that generates a non-photographed region image by setting a pixel value of the non-photographed region G, and a photographed region image E and an unphotographed region image And a combining unit 5 that generates a combined image F by combining.

  The microscope image processing apparatus 1 is realized by, for example, a dedicated or general-purpose computer. That is, the microscope image processing apparatus 1 includes a processor such as a CPU (Central Processing Unit), a main storage device such as a RAM (Random Access Memory) used as a work area of the processor, and an auxiliary storage device. . The auxiliary storage device is a non-transitory computer-readable recording medium such as a hard disk drive, and stores a microscope image processing program that causes the processor to execute processing to be described later for each of the units 2, 3, 4, and 5. A computer (not shown) that displays the original image D and the composite image F and an input device (not shown) such as a mouse and a keyboard are connected to the computer constituting the microscope image processing apparatus 1. The user can input an instruction necessary for image processing to the microscope image processing apparatus 1 using an input device.

The observation method setting unit 2 sets one of a plurality of types of observation methods such as bright field observation, dark field observation, phase difference observation, and fluorescence observation as the observation method of the microscope 10 based on a user input. For example, the user selects one observation method from the pull-down menu displayed on the display using the input device, and the observation method setting unit 2 sets the observation method selected by the user as the observation method of the microscope 10. Configured to set.
Alternatively, the observation method setting unit 2 may automatically acquire information on the observation method from the properties of the microscope 10 or the original image D, and set the observation method based on the acquired information.

FIG. 2 shows the rotation processing of the original image D, and FIG. 3 shows the resizing processing of the original image D.
As shown in FIGS. 2 and 3, the rotation / resize unit 3 performs at least one of a rotation process and a resizing process on the original image D based on a user input operation. For example, the user operates the input device while observing the original image D displayed on the display, thereby causing the rotation / resize unit 3 to execute processing. In the rotation processing, as shown in FIG. 2, the corner portion (exclusion region) H of the original image D protrudes from the image region of the original image D (rectangular region indicated by a two-dot chain line in the drawing). In the resizing process, as shown in FIG. 3, a portion (exclusion region) H along the side of the original image D protrudes from the image region of the original image D. The rotation / resize unit 3 excludes such an exclusion area H and generates a captured area image E including a part of the original image D located in the image area. Therefore, an unphotographed area G in which the original image D does not exist is generated in the image area of the composite image F having the same size as the image area of the original image D.

  The unphotographed area color setting unit 4 includes first, second, and third colors described later so that the color of the unphotographed area G is the same as or substantially the same as the color of the background C (background color) in the original image D. A pixel value (for example, RGB value) constituting the color of the unphotographed region G is set based on the pixel value of the original image D by any of the methods. Next, the unphotographed area color setting unit 4 generates an unphotographed area image having the set pixel value. The unphotographed area image is an image corresponding to the unphotographed area G in FIGS. For example, in the example of FIG. 2, four triangular unphotographed area images of the corners are generated, and in the example of FIG. 3, two rectangular unphotographed area images along the upper and lower sides are generated.

The first method is a method of setting the pixel value of the unphotographed area G based on the pixel value of the excluded area H of the original image D. The exclusion region H is a portion excluded from the original image D in the rotation process and the resizing process as described above. The unphotographed area color setting unit 4 sets the mode value or average value of the pixel values of all the pixels in the excluded area H as the pixel value of the unphotographed area G.
The excluded area H excluded from the original image D by the user's rotation operation or resizing operation often does not include the subject B and is a part of the background C. Accordingly, a pixel value of a color closer to the background color can be calculated from the pixel value of the exclusion region H.

The second method is a method of setting the pixel value of the unphotographed region G based on the pixel value at the edge of the photographed region image E. The unphotographed area color setting unit 4 is arranged along the edge in at least one edge (adjacent area) I adjacent to the excluded area H, as shown in FIG. The mode value or the average value of the pixel values in the pixel column is set as the pixel value of the unphotographed area G. When there are a plurality of (four in the example of FIG. 4) adjacent regions I in the captured region image E, the pixel values of all the adjacent regions I may be used for calculating the mode or average value. The pixel values of some adjacent regions I may be used.
The adjacent area I adjacent to the excluded area H excluded from the original image D by the user's rotation operation or resizing operation often does not include the subject B and is a part of the background C. Therefore, a pixel value of a color closer to the background color can be calculated from the pixel value of the adjacent region I of the photographed region image E.

  The third method is a method of setting the pixel value of the unphotographed region G based on the observation method set by the observation method setting unit 2. The background color of the original image D is a color within a certain range according to the photographing method. For example, the background color of the bright field image is white, the background color of the phase difference image is gray, and the background color of the dark field image and the fluorescence image is black. As shown in FIG. 5, the unphotographed area color setting unit 4 stores the correspondence between the observation method and the pixel value of the default color. The default color is the background color of the image acquired by the corresponding observation method. The unphotographed region color setting unit 4 sets the pixel value of the default color corresponding to the observation method set by the observation method setting unit 2 as the pixel value of the unphotographed region G.

The unphotographed area color setting unit 4 determines which one of the first, second, and third methods is to be adopted based on the area of the excluded area H and the pixel value according to the following procedure.
The unphotographed area color setting unit 4 calculates the area of the excluded area H, the area of the excluded area H is larger than a first predetermined value (for example, 10% of the area of the original image D), and the excluded area H The first method is adopted when the maximum difference between the luminance values (difference between the maximum luminance value and the minimum luminance value) is smaller than a second predetermined value (for example, 30 when the luminance value is 8 bits). To do. The luminance value is a pixel brightness value calculated from the pixel value.

  When the entire exclusion area H is the background C, the brightness value of the exclusion area H is substantially uniform. However, when the exclusion area H includes any image other than the background, the brightness value of the exclusion area H is The maximum difference increases. In addition, the wider the excluded area H, the higher the reliability of the background color calculated from the pixel values in the excluded area H. Therefore, when the exclusion area H is sufficiently wide and the maximum difference in luminance value in the exclusion area H is sufficiently small, a pixel value of a color closer to the background color can be calculated from the pixel values of the exclusion area H.

  When the area and pixel value of the excluded region H do not satisfy the above conditions, the unphotographed region color setting unit 4 calculates the maximum difference in luminance values (difference between the maximum luminance value and the minimum luminance value) in the adjacent region I. When the calculated difference is smaller than a third predetermined value (for example, 30 when the luminance value is 8 bits), the unphotographed area color setting unit 4 selects the second method, and the calculated difference is When the value is not less than the third predetermined value, the unphotographed area color setting unit 4 selects the third method.

  The synthesizing unit 5 synthesizes (combines) the photographed region image E and the non-photographed region image generated by the non-photographed region color setting unit 4 to generate a composite image F having the same size as the original image D. .

Next, the operation of the microscope image processing apparatus 1 will be described with reference to FIGS.
In order to perform rotation processing and resizing processing on the original image D acquired by the microscope 10 using the microscope image processing apparatus 1 according to the present embodiment, first, the user observes the original image D displayed on the display. Then, the observation method used for photographing the original image D is selected using the input device. Thereby, as shown in FIG. 6, an observation method is set by the observation method setting unit 2 (step S1).

  Next, the user performs a rotation operation and a resize operation of the original image D using the input device. Based on the user's operation, at least one of the rotation process and the resizing process is performed on the original image D by the rotation / resize unit 3 to generate a captured region image E including a part of the original image D (rotation). -Resizing step S2).

Next, based on the pixel value of the background C in the original image D, the pixel value of the unphotographed area G is set by the unphotographed area color setting unit 4 (unphotographed area color setting step S3).
Specifically, as shown in FIG. 7, the area of the exclusion region H is calculated (step S31), the area of the exclusion region H is larger than the first predetermined value, and the luminance value of the exclusion region H is It is determined whether or not the maximum difference is smaller than a second predetermined value (steps S32 and S33). When the area and brightness value of the excluded area H satisfy the above conditions (YES in step S32 and YES in step S33), the mode value or average value of the pixel values in the excluded area H is set as the pixel value in the unphotographed area G. (Step S34).

  On the other hand, if the area and luminance value of the excluded region H do not satisfy the above conditions (NO in at least one of steps S32 and S33), whether or not the maximum difference in luminance value of the adjacent region I is smaller than the third predetermined value. Is determined (step S35). When the luminance value of the adjacent area I satisfies the above condition (YES in step S35), the mode value or average value of the pixel values of the adjacent area I is set as the pixel value of the unphotographed area G (step S36). When the luminance value of the adjacent region I does not satisfy the above condition (NO in step S35), the pixel value associated with the observation method set in step S1 is set as the pixel value of the unphotographed region G (step S37). ).

  Next, the unphotographed area color setting unit 4 generates an unphotographed area image having the pixel value set in step S3. Next, the synthesized image F is generated by synthesizing the photographed area image E and the unphotographed area image by the synthesizing unit 5 (synthesis step S5).

  As described above, in the image area of the composite image F generated by the rotation process and the resizing process of the original image D, the original image D is not present in addition to the photographed area image E that is a part of the original image D. An imaging region G is generated. According to the microscope image processing apparatus 1 according to the present embodiment, the color is close to the color of the background C in the original image D based on the pixel value of the excluded area H or the adjacent area I that is likely to be a part of the background C. The pixel value of the color is set to the pixel value of the unphotographed area G. Therefore, even when white balance and light shielding are not properly performed at the time of acquisition of the original image D, the unphotographed area G is filled with a color close to the background C of the photographed area image E, and the background of the photographed area image E A composite image F in which the boundary between C and the unphotographed region G is not noticeable can be generated.

  Further, when a pixel value of a color close to the color of the background C cannot be obtained with high reliability from the pixel values of the exclusion region H and the adjacent region I, a general background color in the observation method used for photographing the original image D Is set to the pixel value of the unphotographed area G. As a result, the difference between the color of the background C of the photographed region image E and the color of the unphotographed region G is suppressed as much as possible, and the composite image F in which the boundary between the background C of the photographed region image E and the non-photographed region G is inconspicuous. There is an advantage that can be generated.

In the present embodiment, the pixel value of the adjacent region I is used in the second method for setting the pixel value of the unphotographed region G. Instead, as shown in FIG. Of the edges of the captured region image E, the pixel values of the pixel columns at the edge J along at least one side of the original image D may be used. Or you may use the pixel value of the pixel row | line | column in both the edge I and the edge J over the perimeter of the edge of the picked-up area | region image E. FIG.
Usually, since the original image D is acquired so that the entire photographing target B is arranged at the center of the original image D, there is a high possibility that the edge J is also a part of the background C. Therefore, the pixel value of the color closer to the background color can also be calculated by using the pixel value of the edge J instead of the edge I or in addition to the edge I.

  In the present embodiment, the unphotographed area color setting unit 4 uses all the pixel values in the excluded area H or all the pixel values in the adjacent area I in calculating the pixel values of the unphotographed area G. Instead, as shown in FIG. 9, a part of the range of pixel values that can be taken by each pixel of the original image D is set out of the calculation target (step S38), and the remaining non-calculation target is left out. The pixel value may be used to calculate the pixel value of the unphotographed region G (Steps S33 ′, S34 ′, S35 ′, S36 ′).

  An identification sticker may be affixed around the section of the slide specimen A, which is the imaging target B, or may be written with a pen. For example, when the specimen A is observed in the bright field, as shown in FIG. 10, a black mark indicating the position of the section that is the imaging target B may be attached around the section. When any image other than the imaging target B is reflected in the exclusion area H, as shown in FIG. 11, the pixel values in the exclusion area H include pixel values different from the pixel values of the background color. included. Accordingly, when all the pixel values in the excluded area H are used for calculation, a pixel value different from the original background color pixel value is calculated, and the unphotographed area G is filled with a color different from the original background color. become. The same inconvenience may occur when the pixel value of the unphotographed area G is calculated from the pixel value of the adjacent area I.

  The unphotographed area color setting unit 4 sets a range corresponding to a color different from the background color of the original image D out of the range that can be taken by the pixel value of the original image D as a calculation target. Since the background color of the original image D varies depending on the observation method as described above, the range of pixel values that are not subject to calculation is set according to the observation method. For example, in the case of a 24-bit color bright-field image, as shown in FIG. 11, the pixel value range in which the luminance value is 50 or less is set out of the calculation target.

  The unphotographed area color setting unit 4 excludes pixel values that are not subject to calculation from the pixel values in the exclusion area H or the adjacent area I, and determines the remaining pixel values in steps S33 ′ and S35 ′. It is used to calculate the pixel value of the unphotographed area G in S34 ′ and S36 ′. Thereby, a pixel value of a color closer to the color of the background C of the original image D can be calculated, and a composite image F in which the boundary between the captured region image E and the uncaptured region image is not noticeable can be generated.

  In the present embodiment, the non-photographed area color setting unit 4 selects the pixel value setting method for the non-photographed area G from the first, second, and third methods. The first method and the second method may be selected. Alternatively, the unphotographed area color setting unit 4 may always use the first method or always use the second method.

  In the present embodiment, the original image D is a single image acquired by the microscope 10, but the original image D is not limited to this, and is subject to rotation processing and resizing processing. It may be an arbitrary image. For example, the original image D may be a combined image obtained by combining a plurality of images acquired by the microscope 10 or may be a frame image of a moving image acquired by the microscope 10.

DESCRIPTION OF SYMBOLS 1 Microscope image processing apparatus 2 Observation method setting part 3 Rotation / resizing part 4 Unphotographed area color setting part 5 Composition part 10 Microscope A specimen B Image object C Background D Original image E Photographed area image F Composite image G Unphotographed area H Excluded area I Edge, adjacent area J Edge S2 Rotation / Resize step S3 Unphotographed area color setting step S5 Composition step

Claims (7)

A rotation / resize unit that performs at least one of a rotation process and a resizing process on an original image acquired by a microscope to generate a captured region image including a part of the original image;
An unphotographed area color setting unit for setting a pixel value of an unphotographed area based on the pixel value of the original image;
A combining unit that combines the photographed region image generated by the rotation / resizing unit with the unphotographed region image having the pixel value set by the unphotographed region color setting unit to generate a composite image; ,
The unphotographed area color setting unit is configured to select the non-photographed area based on a pixel value of an edge of the part of the original image or a pixel value of a part excluded from the original image by the rotation process and the resizing process. A microscope image processing apparatus for setting a pixel value of a region.   The unphotographed area color setting unit sets a pixel value of the unphotographed area based on a pixel value of an edge adjacent to the excluded part of the edge of the part of the original image. 2. The microscope image processing apparatus according to 1.   The unphotographed area color setting unit sets a pixel value of the unphotographed area based on a pixel value of an edge along a side of the original image among edges of the part of the original image. Or the microscope image processing apparatus of Claim 2.   The unphotographed area color setting unit sets the pixel value of the edge of the part of the original image or the mode value or average value of the pixel value of the excluded part of the original image as the pixel value of the unphotographed area. The microscope image processing apparatus according to any one of claims 1 to 3, wherein the microscope image processing apparatus is set. An observation method setting unit for setting an observation method of the microscope used for photographing the original image;
Based on the observation method set by the observation method setting unit, the unphotographed area color setting unit sets a part of the range that can be taken by the pixel value of the original image, and does not fall outside the calculation target The microscope image processing apparatus according to claim 4, wherein a mode value or an average value of pixel values is set as a pixel value of the unphotographed area. A rotation / resizing step that generates at least one of a rotation process and a resizing process on the original image acquired by the microscope to generate a captured region image including a part of the original image;
An unphotographed area color setting step for setting a pixel value of an unphotographed area based on the pixel value of the original image;
And a combining step of generating a combined image by combining the captured region image generated in the rotation / resizing step with the uncaptured region image having the pixel value set in the unphotographed region color setting step. ,
In the unphotographed area color setting step, based on the pixel value of the edge of the part of the original image or the pixel value of the part excluded from the original image by the rotation process and the resizing process, A microscope image processing method for setting a pixel value of a region. A rotation / resizing step that generates at least one of a rotation process and a resizing process on the original image acquired by the microscope to generate a captured region image including a part of the original image;
An unphotographed area color setting step for setting a pixel value of an unphotographed area based on the pixel value of the original image;
A compositing step of compositing the captured region image generated in the rotation / resizing step with the uncaptured region image having the pixel value set in the unphotographed region color setting step to generate a composite image To run
In the unphotographed area color setting step, based on the pixel value of the edge of the part of the original image or the pixel value of the part excluded from the original image by the rotation process and the resizing process, A microscope image processing program that sets the pixel value of an area.

Images