JP2013079857A - Image processing apparatus, and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus and an image processing program for easily extracting a desired area from an image.SOLUTION: An initial image IM based on image data is displayed on a display unit 260. A user designates an extraction range including an area to be extracted in the initial image IM; and therefore, one or more areas are extracted on the basis of an extraction condition set in the extraction range. A feature area is selected from the extracted one or more areas on the basis of feature information relating to the areas. The selected feature area is determined as an extracted area. The user designates an extraction range including other areas to be extracted in the initial image IM; and therefore, one or more areas are extracted on the basis of the extraction condition set in the extraction range. A feature area is selected from the extracted one or more areas on the basis of feature information relating to the areas. The selected feature area is added to the extracted area that has already been determined.

Description

  The present invention relates to an image processing apparatus and an image processing program for processing an image.

  In the magnifying observation apparatus, for example, the size and area of the region can be calculated by extracting a specific region from the image of the observation object. Thereby, the user of the magnification observation apparatus can analyze the observation object quantitatively.

JP 2010-0797780 A

  In the image processing apparatus described in Patent Document 1, in order to extract a specific region from the image of the observation target, an extraction condition such as a threshold can be set, and the image of the observation target is set. Thus, processing such as blurring processing can be performed. Thereby, a desired area | region can be extracted appropriately.

  Examples of the process performed on the image of the observation target include a process for reducing spatial high-frequency noise in the image, and a process for reducing brightness unevenness in the image. The user can select various processes according to the purpose.

  However, if the type of processing is not properly selected, it may be difficult to set extraction conditions for extracting a desired region from an image. In addition, it may be difficult to set an extraction condition for extracting a desired region from an image only by applying the type of processing prepared in the image processing apparatus to the image.

  An object of the present invention is to provide an image processing apparatus and an image processing program capable of easily extracting a desired area from an image.

  (1) An image processing apparatus according to a first aspect of the present invention provides a display unit for displaying an image based on image data, and a user for designating a range including a region to be extracted in the image displayed on the display unit. Selecting a feature region based on feature information about the region from one or a plurality of regions extracted based on an operation unit operated by the operation unit and an extraction condition set within a range specified by operation of the operation unit; A processing unit that determines the selected feature region as an extraction region, and the processing unit adds the feature region selected by one operation of the operation unit to the extraction region determined by the previous operation of the operation unit. It works.

  In this image processing apparatus, an image based on the image data is displayed. A range including an area to be extracted in the displayed image is designated by the operation of the operation unit of the user. One or more regions are extracted based on the extraction conditions set within the specified range. A feature region is selected from the extracted region or regions based on the feature information regarding the region. The selected feature region is determined as the extraction region. In addition, the feature region selected by one operation is added to the extraction region determined by the previous operation of the operation unit.

  In this case, a feature region is selected by the user performing an operation of designating a range including a part of a desired region from the image, and the selected feature region is determined as an extraction region. In addition, a new feature region is selected by the user performing an operation of designating a range including another part of the desired region from the image, and the selected feature region is an extraction region determined by the previous operation. Added. By repeating this operation, the user can easily extract a desired region from the image.

  (2) The extraction condition may include a condition regarding the luminance, color, or contour component of the image displayed on the display unit.

  In this case, a region is extracted from the designated range based on the conditions relating to the luminance, color, or contour component of the image displayed on the display unit. Thereby, the user can easily extract a region having a desired luminance, color, or contour component from the image.

  (3) The extraction condition may be changeable for each designated range. It may be difficult to set one extraction condition for extracting a desired region in the entire image. Even in such a case, it is possible to easily extract a desired region from the image by changing the extraction condition for each designated range for each designated range.

  (4) The processing unit sets, as a feature region, a region satisfying a selection condition in which feature information is preset among one or a plurality of regions extracted by an extraction condition set within a range designated by an operation of the operation unit. You may choose.

  There are cases where a desired area and an unnecessary area are included in a designated range. Even in such a case, the desired region can be easily extracted from the image by appropriately setting the selection condition of the feature information that distinguishes the desired region from the unnecessary region.

  (5) The feature information is at least one of the area of the region, the length of the predetermined portion of the region, and the distance between the predetermined portion of the region and the center of gravity within the specified range. Also good.

  In this case, the user selects the desired region based on the area of the region, the length of the predetermined portion of the region, or the distance between the predetermined portion of the region and the center of gravity within the specified range. It can be easily extracted.

  (6) The feature information may be information related to the shape of the region. In this case, the user can easily extract a desired region based on the shape of the region.

  (7) The feature information may be information regarding the value of the pixel in the region. In this case, the user can easily extract a desired region based on the information regarding the pixel value.

  (8) The processing unit may select an area where the feature information is maximized or minimized as the feature area as a preset selection condition.

  In this case, the user can easily extract a desired region where the feature information is maximized or minimized.

  (9) An image processing program according to the second invention is operated by a user to specify a range including an area to be extracted in a displayed image and a process for displaying an image based on the image data Select a feature region based on feature information about the region from one or more regions extracted based on the processing and the extraction conditions set within the range specified by the operation, and extract the selected feature region And a process that operates to add the feature region selected by one operation to the extraction region determined by the previous operation is executed by the processing device.

  According to this image processing program, an image based on the image data is displayed. A range including an area to be extracted in the displayed image is designated by a user operation. One or more regions are extracted based on the extraction conditions set within the specified range. A feature region is selected from the extracted region or regions based on the feature information regarding the region. The selected feature region is determined as the extraction region. In addition, the feature region selected by one operation is added to the extraction region determined by the previous operation of the operation unit.

  In this case, a feature region is selected by the user performing an operation of designating a range including a part of a desired region from the image, and the selected feature region is determined as an extraction region. In addition, a new feature region is selected by the user performing an operation of designating a range including another part of the desired region from the image, and the selected feature region is an extraction region determined by the previous operation. Added. By repeating this operation, the user can easily extract a desired region from the image.

  According to the present invention, a desired region can be easily extracted from an image.

It is a block diagram which shows the structure of the magnification observation apparatus provided with the image processing apparatus which concerns on one embodiment of this invention. It is a perspective view which shows the microscope of the magnification observation apparatus provided with the image processing apparatus which concerns on one embodiment of this invention. It is a mimetic diagram showing the state where the imaging device of a microscope is being fixed in parallel with the Z direction. It is a schematic diagram which shows the state in which the imaging device of the microscope was tilted from the Z direction to a desired angle. It is a schematic diagram which shows an example of the screen of a display part. FIG. 6 is a schematic diagram illustrating an image obtained by binarizing the initial image in FIG. 5. It is a schematic diagram which shows the initial image in the 1st example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 1st example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 1st example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 1st example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 1st example of selection of a characteristic area. It is a schematic diagram which shows the other example of the screen of a display part. It is a schematic diagram which shows the initial image in the 2nd example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 2nd example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 2nd example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 2nd example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 2nd example of selection of a characteristic area. It is a schematic diagram which shows the initial image in the 2nd example of selection of a characteristic area. It is a flowchart which shows the area | region extraction process by an image processing apparatus. It is a flowchart which shows the area | region extraction process by an image processing apparatus. It is a flowchart which shows the area | region extraction process by an image processing apparatus.

  Hereinafter, a magnification observation apparatus provided with an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.

(1) Configuration of Magnification Observation Device FIG. 1 is a block diagram showing a configuration of a magnification observation device provided with an image processing device according to an embodiment of the present invention.

  Hereinafter, two directions orthogonal to each other in the horizontal plane are defined as an X direction and a Y direction, and a direction (vertical direction) perpendicular to the X direction and the Y direction is defined as a Z direction.

  As shown in FIG. 1, the magnification observation apparatus 300 includes a microscope 100 and an image processing apparatus 200.

  The microscope 100 includes an imaging device 10, a stage device 20, and a rotation angle sensor 30. The imaging device 10 includes a color CCD (charge coupled device) 11, a half mirror 12, an objective lens 13, an A / D converter (analog / digital converter) 15, an illumination light source 16, and a lens driving unit 17. The stage apparatus 20 includes a stage 21, a stage drive unit 22, and a stage support unit 23. An observation object S is placed on the stage 21.

  The illumination light source 16 is, for example, a halogen lamp that generates white light or a white LED (light emitting diode). The white light generated by the illumination light source 16 is reflected by the half mirror 12 and then focused on the observation object S on the stage 21 by the objective lens 13.

  The white light reflected by the observation object S passes through the objective lens 13 and the half mirror 12 and enters the color CCD 11. The color CCD 11 includes a plurality of red pixels that receive red wavelength light, a plurality of green pixels that receive green wavelength light, and a plurality of blue pixels that receive blue wavelength light. The plurality of red pixels, the plurality of green pixels, and the plurality of blue pixels are two-dimensionally arranged. From each pixel of the color CCD 11, an electrical signal corresponding to the amount of received light is output. The output signal of the color CCD 11 is converted into a digital signal by the A / D converter 15. Digital signals output from the A / D converter 15 are sequentially supplied to the image processing apparatus 200 as image data. An imaging element such as a CMOS (complementary metal oxide semiconductor) image sensor may be used instead of the color CCD 11.

  The objective lens 13 is provided so as to be movable in the Z direction. The lens driving unit 17 moves the objective lens 13 in the Z direction under the control of the image processing apparatus 200. Thereby, the position of the focus of the imaging device 10 moves in the Z direction.

  The stage 21 is provided on the stage support 23 so as to be rotatable around an axis in the Z direction. The stage drive unit 22 moves the stage 21 relative to the stage support unit 23 in the x direction and the y direction, which will be described later, based on a movement command signal (drive pulse) given from the image processing apparatus 200. A stepping motor is used for the stage drive unit 22. The rotation angle sensor 30 detects the rotation angle of the stage 21 and gives an angle detection signal indicating the detected angle to the image processing apparatus 200.

  The image processing apparatus 200 includes an interface 210, a CPU (Central Processing Unit) 220, a ROM (Read Only Memory) 230, a storage device 240, an input device 250, a display unit 260, and a work memory 270.

  The ROM 230 stores a system program. The storage device 240 is composed of a hard disk or the like. The storage device 240 stores an image processing program and various data such as image data given from the microscope 100 through the interface 210. Details of the image processing program will be described later. The input device 250 includes a keyboard and a pointing device. A mouse or a joystick is used as the pointing device.

  The display unit 260 is configured by, for example, a liquid crystal display panel or an organic EL (electroluminescence) panel.

  The working memory 270 includes a RAM (Random Access Memory), and is used for processing various data.

  The CPU 220 executes an image processing program stored in the storage device 240 to perform image processing such as region extraction processing described later based on the image data using the work memory 270 and displays an image based on the image data on the display unit. 260 is displayed. In addition, the CPU 220 controls the color CCD 11, the illumination light source 16, the lens driving unit 17, and the stage driving unit 22 of the microscope 100 through the interface 210.

  FIG. 2 is a perspective view showing the microscope 100 of the magnification observation apparatus 300 according to the embodiment of the present invention. In FIG. 2, the X direction, the Y direction, and the Z direction are indicated by arrows.

  As shown in FIG. 2, the microscope 100 has a base 1. On the base 1, a first support base 2 is attached, and a second support base 3 is attached so as to be fitted on the front surface of the first support base 2.

  A connecting portion 4 is attached to the upper end portion of the first support base 2 so as to be rotatable around a rotation axis R1 extending in the Y direction. A rotating column 5 is attached to the connecting portion 4. Thereby, the rotation support column 5 can be tilted in a vertical plane parallel to the Z direction with the rotation axis R1 as a fulcrum as the connection portion 4 rotates. The user can fix the connecting portion 4 to the first support base 2 with the fixing knob 9.

  An annular support portion 7 is attached to the front surface of the connecting portion 6. A substantially cylindrical imaging device 10 is attached to the support portion 7. In the state of FIG. 2, the optical axis R2 of the imaging device 10 is parallel to the Z direction. The support unit 7 includes a plurality of adjustment screws 41 for moving the imaging device 10 in a horizontal plane. The position of the imaging device 10 can be adjusted using the plurality of adjustment screws 41 so that the optical axis R2 of the imaging device 10 intersects the rotation axis R1 perpendicularly.

  A slider 8 is attached to the front surface of the second support 3 on the base 1 so as to be slidable in the Z direction. An adjustment knob 42 is provided on the side surface of the second support base 3. The position of the slider 8 in the Z direction (height direction) can be adjusted by the adjustment knob 42.

  The support unit 23 of the stage device 20 is attached on the slider 8. The stage 21 is provided so as to be rotatable around a rotation axis R <b> 3 in the Z direction with respect to the support portion 23. The stage 21 is set with an x direction and ay direction that are orthogonal to each other in the horizontal plane. The stage 21 is provided to be movable in the x direction and the y direction by the stage driving unit 22 of FIG. When the stage 21 rotates around the rotation axis R3, the x direction and the y direction of the stage 21 also rotate. Thereby, the x direction and the y direction of the stage 21 are inclined in the horizontal plane with respect to the X direction and the Y direction.

  The imaging range (field-of-view range) of the imaging device 10 varies depending on the magnification of the imaging device 10. Hereinafter, the imaging range of the imaging device 10 is referred to as a unit region. Image data of a plurality of unit regions can be acquired by moving the stage 21 in the x direction and the y direction. By connecting the image data of a plurality of unit areas, the images of the plurality of unit areas can be displayed on the display unit 260 in FIG.

  FIG. 3 is a schematic diagram illustrating a state in which the imaging device 10 of the microscope 100 is fixed in parallel with the Z direction. FIG. 4 is a schematic diagram showing a state in which the imaging device 10 of the microscope 100 is tilted from the Z direction to a desired angle.

  As shown in FIG. 3, the connecting portion 4 is fixed to the second support 3 by tightening the fixing knob 9 with the rotating support column 5 parallel to the Z direction. Thereby, the optical axis R2 of the imaging device 10 intersects the rotation axis R1 perpendicularly in a state parallel to the Z direction. In this case, the optical axis R2 of the imaging device 10 is perpendicular to the surface of the stage 21.

  By loosening the fixing knob 9, the connecting portion 4 can be rotated around the rotation axis R1, and the rotation column 5 can be tilted about the rotation axis R1. Thereby, as shown in FIG. 4, the optical axis R2 of the imaging device 10 can be inclined at an arbitrary angle θ with respect to the Z direction. In this case, the optical axis R2 of the imaging device 10 intersects the rotation axis R1 perpendicularly. Similarly, the optical axis R2 of the imaging device 10 can be tilted at an arbitrary angle on the opposite side to FIG. 4 with respect to the Z direction.

  Therefore, by matching the height of the surface of the observation object on the stage 21 with the height of the rotation axis R1, the same portion of the observation object can be observed from the vertical direction and the oblique direction.

(2) Image Processing Device FIG. 5 is a schematic diagram illustrating an example of the screen of the display unit 260. As shown in FIG. 5, an image display area 261 and an extraction condition setting area 262 are displayed on the screen of the display unit 260.

  In the image display area 261, an image of the observation object is displayed based on the image data stored in the storage device 240 of FIG. An image is composed of a plurality of pixels. Hereinafter, an image displayed in the image display area 261 based on the image data stored in the storage device 240 is referred to as an initial image IM. In the extraction condition setting area 262, a next button 263a, a return button 263b, an end button 263c, and the like are displayed. Further, a threshold setting bar 264 is displayed in the extraction condition setting area 262. The threshold setting bar 264 has a slider 264s that can move in the horizontal direction. Further, in the extraction condition setting area 262, luminance check boxes 265a and 265b, a hole filling process check box 266, and an auto process check box 267 are displayed.

  In FIG. 5, different regions of the initial image IM are represented by a plurality of dot patterns and hatching patterns. In the initial image IM, an image showing a part of a ruler is displayed as an observation object. Regions “3” and “0” in the numerical portion “30” of the observation object are referred to as regions A and B, respectively. Similarly, areas “4” and “0” in the numerical portion “40” of the observation object are referred to as areas C and D, respectively. An area having a low luminance in the background pattern of the number portion is referred to as an area X. Here, each region is composed of one or a plurality of continuous pixels.

  In the following example, let us consider extracting only the areas A to D of the number part of the ruler from the initial image IM displayed on the display unit 260. In this case, an appropriate threshold value for distinguishing between the plurality of areas A to D and the background is set. Here, when the luminance check box 265a is designated, pixels having a luminance value lower than the threshold value are extracted by binarization of the initial image IM. On the other hand, when the luminance check box 265b is designated, pixels having a luminance value higher than the threshold value are extracted by binarization of the initial image IM. In the example of FIG. 5, the luminance values of the areas A to D are lower than the luminance value of the background. Therefore, when extracting a plurality of regions A to D from the initial image IM, the luminance check box 265a is designated.

  FIG. 6 is a schematic diagram showing an image obtained by binarizing the initial image IM of FIG. In the entire initial image IM, it may be difficult to set an appropriate threshold value for distinguishing between the plurality of areas A to D and the background. In such a case, when the initial image IM is binarized, a part of the region to be extracted is not extracted. For example, in the example of FIG. 6, a part of the region D is not extracted. Or a part of unnecessary area | region will be extracted. For example, in the example of FIG. 6, a part of the region X is extracted.

  Therefore, in image processing apparatus 200 according to the present embodiment, the user designates a range including an area to be extracted from initial image IM displayed on display unit 260 using input device 250 in FIG. be able to. A range specified by the user is called an extraction range. One or more regions are extracted based on the extraction conditions set within the extraction range. One or a plurality of regions satisfying a selection condition in which feature information related to the region is set in advance is selected as the feature region from the one or more extracted regions. The extraction conditions can be changed for each extraction range. The selected feature region is determined as the extraction region. In the present embodiment, pixels in the extraction region are represented by “1”, and pixels in other regions are represented by “0”. By adding the selected feature region to the previously determined extraction region, only the extraction region can be extracted integrally from the initial image IM.

  In the present embodiment, one or more regions are extracted from an image within the extraction range using luminance as an extraction condition. In this case, one or a plurality of regions are extracted by binarizing the initial image IM within the extraction range using a threshold value of luminance (hereinafter, abbreviated as a threshold value). For example, a region constituted by pixels having a luminance value equal to or less than a threshold value within the extraction range is extracted.

  The position of the slider 264s on the threshold setting bar 264 corresponds to the threshold set in the initial image IM. The user changes the threshold value set in the initial image IM within the extraction range by moving the slider 264s of the threshold value setting bar 264 in FIG. 5 in the horizontal direction using the input device 250 in FIG. can do. When the auto process check box 267 is designated, the threshold value is automatically set.

  The extraction condition may be information regarding the color or contour component of the image instead of the luminance of the image.

  Next, a feature region that satisfies a selection condition in which feature information is set in advance is selected from one or a plurality of regions extracted within the extraction range. The feature information may be the area of the region, the length of a predetermined portion of the region, or the distance between the predetermined portion of the region and the center of gravity within a specified range. The feature information may be information related to the shape of the region or information related to the value of the pixel in the region. The pixel value may represent luminance, color, or contour component. A region in which these feature information satisfies a preset selection condition is selected as a feature region. For example, a region having the largest area among a plurality of regions satisfying the extraction condition may be selected as the feature region, or a region having the smallest area may be selected as the feature region. Also, an area whose shape is closest to a circle, rectangle, polygon, or the like may be selected as the feature area.

  When the hole filling process check box 266 is designated, the portion of the pixel “0” surrounded by the feature area (hereinafter referred to as a hole) is also selected as the feature area. The size (number of pixels) of the hole selected as the feature region may be arbitrarily set by the user. Further, the number of pixels of the hole selected as the feature region may be set to, for example, 5% or less of the number of pixels of the selected feature region.

(3) First selection example of feature region In the first selection example of feature region, a region having the lowest luminance value among one and a plurality of regions having a luminance value lower than a threshold value in the extraction range Selection conditions are set in advance so that is selected as a feature region. 7 to 11 are schematic diagrams illustrating the initial image IM in the first selection example of the feature region. The feature regions are selected in the order of FIGS. 7, 8, 9 and 10.

  First, the user designates an extraction range R including the area A in the initial image IM displayed in the image display area 261 using the input device 250 of FIG. 1 as shown in FIG. A pixel having a plurality of luminance values is included in the extraction range R. Here, the user can change the threshold within the extraction range R by moving the slider 264 s of the threshold setting bar 264 of FIG. 5 using the input device 250. The user can select only the region A as the feature region by setting an appropriate threshold value for distinguishing the region A from the other region X in the extraction range R.

  When the auto process check box 267 of FIG. 5 is designated, the threshold value within the extraction range R is automatically set. Therefore, if the area A can be distinguished from the other area X by the set threshold value, the user needs to operate the slider 264s of the threshold setting bar 264 to change the threshold value. There is no. The same applies to the following description.

  Thereafter, the user operates the next button 263 a in FIG. 5 using the input device 250. Thereby, the selected feature region (region A) is determined as the extraction region, and extraction region data for displaying the extraction region is generated. The generated extraction area data is stored in the work memory 270 of FIG. When the user operates the return button 263b in FIG. 5 using the input device 250, the selected feature region is removed from the extraction region. Thereby, the user can re-specify the area including the area A as the extraction range R from the initial image IM.

  In the present embodiment, the pixels in the extraction region, that is, “1” pixels are displayed in black so as to overlap the initial image IM. In FIG. 8, since the area A is an extraction area that has already been determined, the area A is displayed in black based on the image data stored in the work memory 270.

  Next, the user designates an extraction range R including the region B from the initial image IM displayed in the image display region 261 using the input device 250 as shown in FIG. Here, the user can select only the region B as the feature region by setting an appropriate threshold value for distinguishing the region B from the other region X in the extraction range R.

  Thereafter, the user operates the next button 263 a using the input device 250. As a result, the selected feature region (region B) is added to the already determined extraction region (region A) and determined as a new extraction region. Extraction area data for displaying the determined new extraction area is generated, and the generated extraction area data is stored in the work memory 270. In FIG. 9, since the areas A and B are already determined extraction areas, the areas A and B are displayed in black based on the image data stored in the work memory 270.

  Next, the user uses the input device 250 to specify an extraction range R including the region C from the initial image IM displayed in the image display region 261, as shown in FIG. Here, the user can select only the region C as the feature region by setting an appropriate threshold value for distinguishing the region C from the other region X in the extraction range R.

  Thereafter, the user operates the next button 263 a using the input device 250. As a result, the selected feature region (region C) is added to the already determined extraction regions (regions A and B), and is determined as a new extraction region. Extraction area data for displaying the determined new extraction area is generated, and the generated extraction area data is stored in the work memory 270. In FIG. 10, since the areas A to C are already determined extraction areas, the areas A to C are displayed in black based on the image data stored in the work memory 270.

  Next, the user designates an extraction range R including the region D from the initial image IM displayed in the image display region 261 using the input device 250 as shown in FIG. Here, the user can select only the region D as the feature region by setting an appropriate threshold value for distinguishing the region D from the other region X in the extraction range R.

  Thereafter, the user operates the next button 263 a using the input device 250. As a result, the selected feature region (region D) is added to the already determined extraction regions (regions A to C), and is determined as a new extraction region. Extraction area data for displaying the determined new extraction area is generated, and the generated extraction area data is stored in the work memory 270. In FIG. 11, since the areas A to D are already determined extraction areas, the areas A to D are displayed in black based on the image data stored in the work memory 270.

  Finally, the user uses the input device 250 to operate the end button 263c in FIG. Thereby, the extraction area data of the work memory 270 is stored in the storage device 240 of FIG. In this way, only the areas A to D can be extracted from the initial image IM as extraction areas. In this case, the image data corresponding to the areas A to D are combined as integral data.

  In this way, by setting an appropriate threshold value that does not extract unnecessary areas within the extraction range R, only necessary areas are sequentially added to the extraction area. Thereby, even when it is difficult to set an appropriate threshold value in the entire initial image IM, a desired region can be easily extracted.

  In this example, when an area is first extracted, an extraction range R including the area is specified, but the present invention is not limited to this. When an area is first extracted, the extraction range R including the area may not be specified. Thereby, the entire initial image IM is regarded as the extraction range R. In this case, the necessary area can be determined as the extraction area by setting a threshold value that does not extract the unnecessary area while extracting the necessary area in the entire initial image IM.

  Specifically, a threshold value is set so as not to extract an unnecessary area while extracting the area A in the entire initial image IM. Thereby, the area A is determined as the extraction area. In this case, other desired regions such as the region B and the region C may not be determined as the extraction region at the same time. Thereafter, by designating an extraction range R that includes a region that has not been extracted among desired regions, only the necessary regions can be sequentially added to the extraction region.

(4) Second Selection Example of Feature Area FIG. 12 is a schematic diagram illustrating another example of the screen of the display unit 260. As shown in FIG. 12, in the image display area 261 of the display unit 260, an initial image IM2 different from the initial image IM is displayed based on the image data stored in the storage device 240 of FIG.

  In FIG. 12, different areas of the initial image IM2 are represented by a plurality of dot patterns and hatching patterns. In the initial image IM2, an image showing a part of the wall surface as an observation object is displayed. The wall has a plurality of cracks. Of the plurality of cracks, the regions of particularly large cracks that can be visually recognized are called regions E, E1, F, G, H, and I, respectively. In addition, innumerable small cracks are generated on the wall surface, but illustration of these cracks is omitted. The wall background is referred to as region Y. Here, each region is composed of one or a plurality of continuous pixels. In the second selection example of the feature region, it is considered that only the regions E and E1 are extracted from the initial image IM2 displayed on the display unit 260.

  In the second selection example of the feature region, the selection is made in advance so that the region having the maximum area among the one or more regions having luminance values lower than the threshold value in the extraction range is selected as the feature region. The condition is set. 13 to 18 are schematic diagrams illustrating the initial image IM2 in the second selection example of the feature region.

  First, the user designates an extraction range R including areas E and E1 in the initial image IM2 displayed in the image display area 261, as shown in FIG. 13, using the input device 250 of FIG. In the example of FIG. 13, the extraction range R includes all of the regions E and E1, a part of the region F, and a part of the region Y. Therefore, the regions G, H, and I are not selected as feature regions. The extraction range R includes pixels having a plurality of luminance values corresponding to the regions E, E1, F, and Y. Here, the user can change the threshold within the extraction range R by moving the slider 264 s of the threshold setting bar 264 of FIG. 5 using the input device 250.

  In this example, the brightness of the areas E to I is substantially equal. Therefore, it is not possible to set a threshold value for distinguishing between the regions E and E1 and the region F in the extraction range R. Therefore, in this example, an appropriate threshold value for distinguishing the areas E, E1, and F from the other areas Y is set. As a result, only the regions E, E1, and F satisfy the extraction condition. The extraction condition in this case is to have an average luminance lower than the threshold value.

  Similar to the first selection example of the feature region, when the automatic processing check box 267 of FIG. 12 is designated, the threshold value within the extraction range R is automatically set. Therefore, when the areas E, E1, F can be distinguished from other areas Y by the set threshold, the user operates the slider 264s of the threshold setting bar 264 to set the threshold. There is no need to change. The same applies to the following description.

  As described above, in this example, a region having the maximum area among one or a plurality of regions satisfying the extraction condition is selected as the feature region. In the extraction range R, the area E is larger than the areas E1 and F. That is, the region E has the largest area among the plurality of regions that satisfy the extraction condition. Therefore, only the region E is selected as the feature region.

  Thereafter, the user operates the next button 263 a in FIG. 12 using the input device 250. Thereby, the selected feature region (region E) is determined as the extraction region, and extraction region data for displaying the extraction region is generated. The generated extraction area data is stored in the work memory 270 of FIG. When the user operates the return button 263b in FIG. 5 using the input device 250, the selected feature region is removed from the extraction region. Thereby, the user can re-specify the area including the area E as the extraction range R from the initial image IM2.

  In the present embodiment, the pixels in the extraction region, that is, “1” pixels are displayed in black so as to overlap the initial image IM2. In FIG. 14, since the area E is an extraction area that has already been determined, the area E is displayed in black based on the image data stored in the work memory 270. However, the region E1 is not selected as a feature region.

  FIG. 15 is an enlarged view of a portion Z in FIG. An area E1 in FIG. 14 exists in the vicinity of the area E. However, since the region E1 is separated from the region E, it is regarded as a region different from the region E. As shown in FIG. 15, the region E is selected as a feature region because it has the largest area within the extraction range R. On the other hand, the region E1 has a smaller area than the region E. For this reason, the region E1 is not selected as the feature region.

  Therefore, the user uses the input device 250 to specify an extraction range R including the area E1 in the initial image IM2 displayed in the image display area 261, as shown in FIG. Thereby, E1 having the largest area within the extraction range R in FIG. 16 is selected as the feature region.

  Thereafter, the user operates the next button 263 a using the input device 250. As a result, the selected feature region (region E1) is added to the already determined extraction region (region E) and determined as a new extraction region. Extraction area data for displaying the determined new extraction area is generated, and the generated extraction area data is stored in the work memory 270. 17 and 18, areas E and E1 are already determined extraction areas, and are therefore displayed in black based on the image data stored in the work memory 270.

  Finally, the user operates the end button 263c in FIG. Thereby, the extraction area data of the work memory 270 is stored in the storage device 240 of FIG. In this way, only the areas E and E1 can be extracted from the initial image IM2 as extraction areas. In this case, the image data corresponding to the areas E and E1 are combined as integral data.

(5) Region Extraction Processing FIGS. 19, 20, and 21 are flowcharts showing region extraction processing by the image processing apparatus 200. The area extraction process is performed by the CPU 220 executing an image processing program stored in the storage device 240. Hereinafter, processing for extracting a desired region from the initial image IM (IM2) will be described with reference to the flowcharts of FIGS.

  The CPU 220 in FIG. 1 determines whether or not the image data stored in the storage device 240 in FIG. 1 has been selected by the user (step S1). If no image data is selected, the CPU 220 waits until image data is selected by the user. When image data is selected by the user in step S1, the CPU 220 displays the initial image IM (IM2) in the image display area 261 of the display unit 260 in FIG. 5 (FIG. 12) based on the selected image data ( Step S2).

  Next, the CPU 220 determines whether or not the first extraction range R is designated from the initial image IM (IM2) by the user operating the input device 250 of FIG. 1 (step S3). If the first extraction range R is not designated, the CPU 220 determines whether or not the user has operated the end button 263c (step S4). When the end button 263c is not operated, the CPU 220 returns to the process of step S3.

  When the first extraction range R is designated by the user in step S3, the CPU 220 determines whether or not the extraction condition has been changed by the user operating the slider 264s of the threshold setting bar 264 in FIG. 5 (FIG. 12). Is determined (step S5). In the examples of FIGS. 5 and 12, the extraction condition is a threshold value. When the extraction condition is not changed in step S5, the CPU 220 extracts one or a plurality of areas in the extraction range R under the preset extraction condition (step S6). On the other hand, when the extraction condition is changed in step S5, the CPU 220 extracts one or a plurality of regions in the extraction range R with the changed extraction condition (step S7).

  If the auto process check box 267 in FIG. 5 (FIG. 12) is not designated, whether or not the extraction condition is changed in step S5 is determined by the user operating the next button 263a. When the auto process check box 267 is designated, the process of step S5 is not performed.

  Next, the CPU 220 selects, as a feature region, a region that satisfies a selection condition in which feature information is set from one or more regions (step S8). In the example of FIG. 5, the selection condition is that the average luminance of the region is lower than the threshold value. In the example of FIG. 12, the selection condition is that the area of the plurality of areas having luminance values lower than the threshold value is the maximum.

  Subsequently, the CPU 220 determines the selected feature area as an extraction area (step S9). Thereafter, the CPU 220 stores the extraction area data for displaying the extraction area in the work memory 270 of FIG. 1 (step S10). Further, the CPU 220 displays the extraction area on the initial image IM (IM2) based on the extraction area data (step S11).

  Next, the CPU 220 determines whether or not the next extraction range R is designated from the initial image IM (IM2) by the user operating the input device 250 (step S12). When the next extraction range R is not designated, the CPU 220 determines whether or not the end button 263c has been operated by the user (step S13). When the end button 263c is not operated, the CPU 220 returns to the process of step S12.

  When the first extraction range R is designated by the user in step S12, the CPU 220 determines whether or not the extraction condition has been changed by the user operating the slider 264s of the threshold setting bar 264 (step S14). ). If the extraction condition is not changed in step S14, the CPU 220 extracts one or a plurality of regions in the extraction range R under the preset extraction condition (step S15). On the other hand, when the extraction condition is changed in step S14, the CPU 220 extracts one or a plurality of regions in the extraction range R with the changed extraction condition (step S16). If the auto process check box 267 is designated, the process of step S14 is not performed.

  Next, the CPU 220 selects, as a feature region, a region that satisfies the selection condition for which feature information is set from one or more regions (step S17). Subsequently, the CPU 220 adds the selected feature region to the extraction region (step S18). Thereafter, the CPU 220 returns to the process of step S10, and stores the extraction area data for displaying the extraction area in the work memory 270 (step S10). Further, the CPU 220 displays the extraction area on the initial image IM (IM2) based on the extraction area data (step S11).

  Thereafter, the processes of steps S12 and S13 are repeated, or the processes of steps S12, S14 to S20, S10, and S11 are repeated. When the end button 263c is operated by the user in step S4 or step S13, the CPU 220 stores the extraction area data of the work memory 270 in the storage device 240 of FIG. 1 and ends the area extraction process.

(6) Effect In the present embodiment, the extraction range R including a part of a desired region in the initial images IM and IM2 displayed on the initial display region 261 of the display unit 260 by the user using the input device 250 is obtained. A feature region is selected by performing a designated operation. The selected feature region is determined as the extraction region. In addition, the user performs an operation of designating an extraction range R including another part of a desired region from the initial images IM and IM2 displayed in the image display region 261 of the display unit 260 using the input device 250. A feature region is selected, and the selected feature region is added to the extraction region determined by the previous operation. By repeating this operation, the user can easily extract a desired region from the initial images IM and IM2.

(7) Correspondence between each component of claim and each part of embodiment The following describes an example of the correspondence between each component of the claim and each part of the embodiment. It is not limited.

  The initial images IM and IM2 are examples of images, the display unit 260 is an example of a display unit, the input device 250 is an example of an operation unit, the extraction range R is an example of a specified range, and the CPU 220 performs processing. The image processing apparatus 200 is an image processing apparatus.

  As each constituent element in the claims, various other elements having configurations or functions described in the claims can be used.

  The present invention can be effectively used for various image processing apparatuses and image processing programs.

DESCRIPTION OF SYMBOLS 1 Base 2, 3 Support stand 4,6 Connection part 5 Rotating support | pillar 7 Support part 8 Slider 9 Fixed knob 10 Imaging device 11 Color CCD
DESCRIPTION OF SYMBOLS 12 Half mirror 13 Objective lens 15 A / D converter 16 Illumination light source 17 Lens drive part 20 Stage apparatus 21 Stage 22 Stage drive part 23 Stage support part 30 Rotation angle sensor 41 Adjustment screw 42 Adjustment knob 100 Microscope 200 Image processing apparatus 210 Interface 220 CPU
230 ROM
240 Storage Device 250 Input Device 260 Display Unit 261 Image Display Area 262 Extraction Condition Setting Area 263a Next Button 263b Back Button 263c End Button 264 Threshold Setting Bar 264s Slider 265a, 265b Luminance Check Box 266 Filling Process Check Box 267 Auto Process Check box 270 Working memory 300 Magnifying observation apparatus A to I, X, Y area IM, IM2 Initial image R Extraction range R1 Rotating axis R2 Optical axis R3 Rotating axis S Observation object

Claims (9)

A display unit for displaying an image based on the image data;
An operation unit operated by a user to designate a range including an area to be extracted in the image displayed on the display unit;
A feature region is selected from one or a plurality of regions extracted based on an extraction condition set within a range specified by the operation of the operation unit, and the selected feature region is extracted. A processing unit for determining the area,
The processor is
An image processing apparatus that operates to add a feature region selected by one operation of the operation unit to an extraction region determined by a previous operation of the operation unit. The image processing apparatus according to claim 1, wherein the extraction condition includes a condition relating to a luminance, a color, or a contour component of an image displayed on the display unit. The image processing apparatus according to claim 1, wherein the extraction condition can be changed for each of the designated ranges. The processing unit includes a region that satisfies a selection condition in which the feature information is preset among one or a plurality of regions extracted by the set extraction condition within a range specified by an operation of the operation unit. The image processing apparatus according to claim 1, which is selected as The feature information is at least one of an area of a region, a length of a predetermined portion of the region, and a distance between a predetermined portion of the region and a centroid within the specified range. Item 5. The image processing device according to any one of Items 1 to 4. The image processing apparatus according to claim 1, wherein the feature information is information related to a shape of a region. The image processing apparatus according to claim 1, wherein the feature information is information related to a value of a pixel in a region. The image processing apparatus according to claim 4, wherein the processing unit selects, as the feature region, a region where the feature information is maximized or minimized as the preset selection condition. Processing for displaying an image based on image data;
A process operated by a user to specify a range including an area to be extracted in the displayed image;
A feature region is selected based on feature information about the region from one or a plurality of regions extracted based on an extraction condition set within a range specified by the operation, and the selected feature region is determined as an extraction region. Processing,
A process that operates to add the feature region selected by one operation to the extraction region determined by the previous operation;
An image processing program to be executed by a processing device.

Images