JP2007318555A - Magnified observation device and magnified observation method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a magnified observation device and magnified observation method capable of easily executing image comparison by a simple method. <P>SOLUTION: The magnified observation device makes a designation point 11A displayed in a first image display area 11 coincide with a designation point 12A displayed in a second image display area, changes the position and magnification of an image P2 displayed in the second image display area so as to make the designation point 12B displayed in the second image display area coincide with the designation point 11B displayed in the first image display area 11, performs superposition processing of the image P1 displayed in the first image display area upon the image obtained by changing the position and magnification of the image P2 displayed in the second image display area, and displays the combined image in a superposition display area 13. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a magnification observation apparatus and a magnification observation method such as a microscope and a microscope that capture and display an enlarged image.

  Today, an optical microscope using an optical lens, a digital microscope, and the like are used as a magnifying observation device that magnifies and displays a minute object.

  The digital microscope includes a light receiving element such as a solid-state imaging element (CCD element) that electrically reads reflected light or transmitted light from an observation object incident via an optical system for each pixel arranged two-dimensionally. The image electrically read using the CCD element is displayed on a display unit such as a display.

  By using this CCD element, the magnifying observation apparatus can observe without observing the object to be observed. For example, the magnifying apparatus can easily perform magnifying observation at a magnification of 20 to 1000 times. is there.

  In this magnifying observation apparatus, various analytical observations are possible if it is possible to observe a plurality of images by comparing them in parallel or to synthesize and observe the images. In this regard, in recent years, various observation methods have been proposed. For example, in Patent Document 1, a method of performing comparative observation of a plurality of images by providing a plurality of imaging system units and switching them is provided. Is disclosed.

In addition, regarding comparative observation, it is possible to facilitate the determination by using it for the determination of a non-defective product or a defective product, that is, by observing a non-defective product image and a defective product image in parallel. is there.
JP-A-5-292386

  However, when comparatively observing a plurality of images, accurate comparative observation is difficult unless, for example, the imaging conditions and the arrangement of the non-defective image and the defective image match.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide a magnified image apparatus and a magnified observation method that can easily perform image comparison by a simple method.

  An enlarged observation apparatus according to the present invention includes an imaging unit for imaging an observation target, a comparison image that generates an observation image based on a signal received for the observation target imaged by the imaging unit and is compared with the observation image And a display unit. The control unit displays, as the first display image, one of the observation image and the comparison image on the display unit together with first and second designated points that can be designated at any position on one image. As the second display image, the other of the observation image and the comparison image is displayed on the display unit together with third and fourth designated points that can be designated at an arbitrary position on the other image. As the third display image, the first designated point displayed on the first display image is matched with the third designated point displayed on the second display image, and the first display is performed. The position and magnification of at least one of the first and second display images is such that the second designated point displayed on the image matches the fourth designated point displayed on the second display image. The composite image obtained by superimposing the first and second display images in the changed state is displayed on the display unit.

  Preferably, a designation unit for designating an arbitrary position on the corresponding display image of the first to fourth designated points is further provided.

  Particularly, the positions of the first to fourth designated points on the first and second display images are changed by the designation means while maintaining the relative relationship with the corresponding display images in the third display image. .

  Preferably, a distance between the first line segment connecting the first designated point and the second designated point displayed on the first display image and a third designated point displayed on the second display image. The magnification is changed so that the distance between the second line segment connecting the first specified point and the fourth designated point becomes equal, and the first line segment displayed on the first display image and the second display image are displayed on the second display image. The position is changed so that the displayed second line segment matches.

  Preferably, when the first line segment or the second line segment on the first and second display images is selected by the designation unit, the designation is performed while maintaining the distance and angle between the corresponding designated points. The point can be moved.

  Preferably, the control unit displays a composite image obtained by performing the superimposition processing based on the superposition ratio of the observation image and the comparison image on the display unit.

  Preferably, the control unit displays, on the display unit, a composite image obtained by performing an overlay process by adjusting at least one of luminance and color of the observation image and the comparison image.

  Preferably, the control unit detects a difference between the observation image and the comparison image in response to the second instruction, and displays the difference image on the display unit.

  Preferably, the control unit causes the display unit to display any one of the observation image, the comparison image, and the composite image in response to the second instruction.

  An enlarged observation method according to the present invention includes an imaging unit for imaging an observation target, a comparison image that generates an observation image based on a signal received for the observation target imaged by the imaging unit and is compared with the observation image Is a magnification observation method of a magnification observation apparatus that includes a control unit that executes image processing between the display unit and a display unit, wherein one of the observation image and the comparison image is an arbitrary image on one image as the first display image The third and second display points are displayed on the display unit together with first and second designated points which can be designated as positions, and the other of the observation image and the comparison image can be designated as an arbitrary position on the other image as the second display image. The third designated point displayed on the display unit together with the fourth designated point and displayed as the third display image on the first display image and the third designated point displayed on the second display image And the first display The position and magnification of at least one of the first and second display images are set so that the second designated point displayed on the image matches the fourth designated point displayed on the second display image. The composite image obtained by superimposing the first and second display images in the changed state is displayed on the display unit.

  The magnified observation apparatus and magnified observation method according to the present invention match the first designated point displayed in the first display area with the third designated point displayed in the second display area and the first designated point. The position of the other image displayed in the second display area so that the third designated point displayed in the display area matches the fourth designated point displayed in the second display area. The magnification is changed, the image displayed in the first display area is overlaid with the image in which the position and magnification of the other image displayed in the second display area are changed, and the composite image is converted into the third image. Display in the display area. Therefore, the first and second designated points in the first display area and the third and fourth designated points in the second display area can be easily aligned by specifying the arbitrary positions, and Since a composite image can be generated by superimposing, image comparison can be easily performed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and description thereof will not be repeated.

FIG. 1 is an overall configuration diagram of a magnification observation apparatus according to an embodiment of the present invention.
Referring to FIG. 1, a magnifying observation apparatus 100 according to an embodiment of the present invention includes an imaging unit 110 that images a sample illuminated by an illumination unit (not shown), and a display that displays an enlarged image captured by the imaging unit 110. And an information processing apparatus 101 having a unit 152.

  Further, the magnification observation apparatus 100 further includes a sample fixing unit (a stage 130 on which the sample S is placed) for fixing a sample, a stage elevator 120 that controls the lifting operation of the stage 130, a stand base 141, and a stand base 141. And a mounting portion 143 of the imaging unit 110 fixed to a support column 142 extending in the vertical direction. Also, a mouse 103 as a pointing device is connected to the information processing apparatus 101, and a selection / designation operation and the like described later are executed using the mouse 103 provided with a click button.

FIG. 2 is a diagram for explaining a specific configuration of the magnification observation apparatus 100.
Referring to FIG. 2, the imaging unit 110 drives the CCD 112 and an imaging element (CCD 112) that electrically reads reflected light or transmitted light from the sample S fixed to the stage 130 that is incident via the optical system 111. And a CCD control circuit 113 for controlling. The stage elevator 120 also includes a stepping motor 121 that raises and lowers the stage 130 to change the relative distance between the sample fixing unit and the optical system 111 in the optical axis direction, and a motor that controls the driving of the stepping motor 121. And a control unit 122.

  The imaging unit 110 and the stage elevator 120 are connected to and controlled by the information processing apparatus 101.

  The information processing apparatus 101 includes a display unit 152 such as a display or a monitor that displays a captured image based on image data electrically read by the image sensor of the imaging unit 110, an operation unit 155 such as a mouse 103, and an operation. A control unit 151 for performing image processing and other various processes based on information input by the unit 155, and an interface (I / F) 154 for data communication between the information processing apparatus 101 and the imaging unit 110 and the stage elevator 120. And a memory 153 that records various control programs for executing image processing and the like in the information processing apparatus 101 and an image captured by the imaging unit 110 or an image input from the outside. The memory 153 further includes an operation function or an operation program for operating the magnification observation apparatus 100. This operation program can be installed or updated in the magnifying observation apparatus 100 in the form of rewritable software, firmware, or the like. Although not shown here, it is also possible to connect to an external device and execute data communication with the outside.

  With this configuration, the magnification observation apparatus 100 has a configuration in which a sample with respect to an area designated by using an imaging element that electrically reads reflected light or transmitted light from a sample fixed to a sample fixing portion that is incident via an optical system. Images can be displayed.

  In the following, a method capable of easily performing image comparison in an image comparison mode in which a plurality of images are compared in parallel will be described.

FIG. 3 is a diagram illustrating screen 10 in the image comparison mode according to the embodiment of the present invention.
Referring to FIG. 3, in the image comparison mode according to the embodiment of the present invention, a case where the entire screen of display unit 152 is divided into display areas for displaying a plurality of images is shown.

  In this example, the case where the screen 10 of the display unit 152 is divided into four display areas is shown as an example.

  Specifically, a first image display area 11, a second image display area 12, a superimposed display area 13, and a difference display area 14 are shown.

  For example, when the user selects an image comparison mode among a plurality of modes for executing image processing, the screen 10 is divided into a plurality of display areas as described above, and the image selection dialog 16 is displayed.

  The image selection dialog 16 prompts selection of image information to be displayed on a divided screen as an example. Specifically, in the image selection dialog 16, a list of image candidates that can be displayed in the first image display area 11 and the second image display area 12 is shown and determined by user selection. Here, as a list of image candidates, “current image”, image V, image W, image X, etc. are shown as an example. It is assumed that the “current image” is a real-time captured image based on image data electrically read by the image sensor of the imaging unit 110.

  This list of image candidates is acquired by searching the image data stored in the memory 153 and the current captured image from the imaging unit 110 or the file name of image data input from the outside by the control unit 151 as an example. They are arranged in an image selection dialog. The list of image candidates arranged in the image selection dialog 16 is designated by the user using the mouse 103, so that one image is displayed in each of the first image display area and the second image display area. Shall be selected. Then, for example, when the user presses the “OK” button of the image selection dialog 16 using the mouse 103, the images selected by the user are displayed in the first image display area 11 and the second image display area 12. . As an example, it is assumed that the image comparison mode can be ended when the user presses the “cancel” button of the image selection dialog 16 using the mouse 103.

  In this example, as an example, the user designates the image V as an image to be displayed in the first image display area using the mouse 103 which is a pointing device, and currently displays the image to be displayed in the second image display area. However, any image can be specified and selected.

  FIG. 4 is a diagram illustrating a case where two images are displayed in the first image display area 11 and the second image display area 12 by the user's selection in the image comparison mode according to the embodiment of the present invention.

  As shown in FIG. 4, the user operates the image selection dialog 16 to specify two images. As an example, the first image display area 11 has an alphabet “A” shape as an example. In the image P1 and the second image display area 12, an image P2 having the shape of the alphabet “V” is shown. Here, it is assumed that a captured image from the imaging unit 110 is displayed in the second image display area 12 as an example.

  FIG. 4 shows an image comparison dialog 15 for executing various functions in the image comparison mode. By selectively executing a plurality of function mode buttons shown in the image comparison dialog 15, various functions are displayed. It is possible to perform the function.

  Here, as an example, the image comparison dialog 15 includes an “overlay” button 15A for superimposing images displayed in the first image display area 11 and the second image display area 12 in the image comparison mode, A “difference execution” button 15B that executes difference processing of images displayed in the image display area 11 and the second image display area 12, and a “full screen” button 15C that displays an image of the selected display area in full screen. A “setting” button 15D for calling a setting dialog for setting various parameters in the image comparison mode, and an “end” button 15E for ending the image comparison mode.

FIG. 5 is a flowchart of an image comparison mode according to the embodiment of the present invention.
Referring to FIG. 5, the image comparison mode is started by the user's selection instruction (image comparison start) (step S0), and the two images P1 and P2 selected by the image selection dialog 16 as described in FIG. It is read (step S1). Then, as shown in FIG. 4, images P1 and P2 are displayed in the first and second image display areas 11 and 12 (step S2). Various function mode buttons, such as (15A to 15E), are pressed (step S3), and the corresponding various function modes are executed (step S4).

  For example, when the “overlay” button 15A is pressed in the image comparison dialog 15, the process of superimposing images displayed in the first image display area 11 and the second image display area 12 in the image comparison mode, respectively. Is executed. When the “difference execution” button 15B is pressed, the difference processing of images displayed in the first image display area 11 and the second image display area 12 is executed. When the “full screen” button 15C is pressed, the image of the selected display area is displayed on the full screen. When the “setting” button 15D is pressed, a setting dialog for setting various parameters in the image comparison mode is called. If the “end” button 15E is pressed, the image comparison mode ends.

Hereinafter, various function modes will be described.
[Overlay mode]
FIG. 6 is a flowchart illustrating superposition processing according to the embodiment of the present invention.

  Referring to FIG. 6, when “overlay” button 15A is pressed, the superposition mode is entered (start) (step S10).

  Then, designated points and designated lines are displayed in the first and second image display areas 11 and 12, respectively (step S11).

  Next, the image P1 and the image P2 are superimposed and displayed on the superimposed display area 13 (step S12). The overlay display in step S12 will be described later.

  Next, it is determined whether or not other various function mode buttons have been pressed (step S13), and if the various other function mode buttons are pressed, other various function modes are executed (step S17).

  On the other hand, if the other various function mode buttons are not pressed in step S13, the process proceeds to the next step S14, and it is determined whether or not the designated point is selected by the pointing device (mouse) (step S14).

  If the designated point is not selected by the pointing device, the process returns to step S13 again.

  On the other hand, when a designated point is selected by the point device in step S14, the process proceeds to the next step, and the selected designated point becomes movable (step S15).

  Then, the process proceeds to the next step, and it is determined whether or not the selected designated point has moved (step S16). If it has moved, the process returns to step S12. If no movement is made in step S16, the process returns to step S13.

  The designated point selected here is movable. When the click button is pressed after aligning the area pointing to the designated point with the pointing device, the designated point is selected and the click button of the pointing device is pressed. It shall indicate the state in which the state is maintained. In this state, by operating the pointing device, the designated point moves according to the operation, and the selection of the designated point selected when the click button of the pointing device is released is released. Therefore, the selected designated point is changed to the position of the released designated point. Here, as an example, the case where the state in which the state where the click button of the pointing device is pressed is maintained is the designated point selection state, but the present invention is not limited to this method, and the designated point is selected, Any method can be adopted as long as the designated point can be moved.

  The movement of the selected designated point shown here is not only performed when the designated point moves and the selected point is deselected, but the designated point is in the selected state and can be operated by operating the pointing device. The case where the designated point is moved accordingly is also included.

  When the “overlay” button 15A is pressed, the image P2 displayed in the second image display area 12 is stored in the memory 153 as being displayed as a still image of the image immediately before being pressed. It shall be displayed. For example, before the “overlay” button 15A is pressed, a real-time “current image” can be displayed in the second image display area 12, but when the “overlay” button 15A is pressed. In this case, since it is necessary to perform image processing, the image is processed as a still image.

FIG. 7 is a flowchart in the case of executing overlay display according to the embodiment of the present invention.
With reference to FIG. 7, a flow diagram in the case of executing overlay display according to the embodiment of the present invention will be described.

First, the coordinates of the designated point are detected (step S20).
Then, the distance between the designated line segments 11C and 12C and the angle D between the designated line segments 11C and 12C are detected from the coordinates of the designated points 11A, 11B, 12A and 12B of the images P1 and P2 (step S21).

  Next, the zoom ratio is calculated from the ratio of the distances between the designated line segments 11C and 12C (step S22).

Next, the image P2 is zoomed with the calculated zoom ratio (step S23).
For the zoomed image, the position of the image displayed in the second image display area 12 is changed (rotated / translated) so that the designated points 11A and 11B and 12A and 12B coincide with each other, and superimposed on the image P1. The matching process is performed (step S24). Specifically, with respect to the zoomed image, the image displayed in the second image display area 12 based on the coordinates and the angle D of the designated point so that the designated points 11A and 11B and 12A and 12B coincide with each other. Rotate and translate.

  Then, the overlay ratio and color of the image P1 and the image P2 are read from the overlay setting parameter (step S25).

  Then, the images P1 and P2 are superimposed (added) and synthesized with the set overlapping ratio and color (step S26).

  Then, the synthesized composite image is displayed in the overlay display area 13 (step S27). FIG. 8 is a diagram for explaining a case where a composite image that has been subjected to the overlay process is displayed in the overlay display area 13. Specifically, the case where the overlay button 15A is pressed is shown.

  As shown in FIG. 8, an image P1 in the shape of the letter A is shown in the first image display area 11, and designated points 11A and 11B are shown. A designated line segment 11C connecting the designated point 11A and the designated point 11B is shown. Similarly, in the second image display area 12, as described above, a captured image captured by the imaging unit 110 is displayed as a current image, and an image P2 is shown here. The designated point 12A and the designated point 12B are similarly displayed, and a designated line segment 12C connecting the designated point 12A and the designated point 12B is displayed.

  In this figure, when the overlay button 15A is pressed in the image comparison dialog 15, the designated point 11B and the designated point 12B are made to coincide with each other so that the designated point 11A and the designated point 12A coincide in the superimposed display area 13. Overlay processing is performed to match. As a result, the overlap display area 13 shows a designated point 13A, a designated point 13B, and a designated line segment 13C that connects the designated point 13A and the designated point 13B. In this case, as an example, a case where the overlay process is executed at the initial position in the initial state where the designated points 11A, 11B, 12A, and 12B are not moved is shown. Here, the designated points 11A and 12A are represented by the symbol “circle”, and the designated points 11B and 12B are represented by the symbol “square”. Symbols may be used.

  FIG. 9 is a diagram illustrating a case where another composite image that has been subjected to the overlay process is displayed in the overlay display area 13. Here, as an example, a superimposed image when designated points 11A, 11B, 12A, and 12B are moved from the initial state is shown.

  As shown in FIG. 9, the designated point 11 </ b> A and the designated point 11 </ b> B in the image P <b> 1 of the first image display area 11 are in a state designated to cross the central portion of the character “A”. In addition, in the image P2 of the second image display area 12, the designated point 12A and the designated point 12B are set so that the designated point 12A is aligned with the bottom that is the depression of the character “V”, and the upper part of the character “V” on the opposite side to the bottom. A state in which the designated point 12B has been moved to a nearby position is shown.

  In this state, as described above, the magnification of the image P2 is changed based on the ratio between the designated line segment 11C and the designated line segment 12C, so that the designated point 11A and the designated point 12A match, and the designated point 11B The position is changed (rotated and translated) so that the designated point 12B coincides, and the composite image is displayed in the superimposed display area 13.

  As shown in the flowchart of FIG. 6, as the next step for determining the movement of the selected designated point in step S16, the process proceeds to step S12, and once the superposition mode is entered, the “superposition” button is pressed again. Instead, the composite image is automatically displayed on the overlay display unit 13 in accordance with the change of the designated point. Further, as described above, the movement of the selected designated point shown here is selected because the designated point is in a selected state and the designated point is moved according to the operation by operating the pointing device. In accordance with the movement of the designated point, the position is changed so that the designated point 11A and the designated point 12A coincide as described above, and the designated point 11B and the designated point 12B coincide (rotation / translation). As a result, the composite image is displayed in the overlay display area 13. That is, when any one of the designated points 11A, 11B, 12A, and 12B is selected and moved by the pointing device, the position of the designated point maintains a relative relationship with the image corresponding to the designated point in the overlay display area 13. However, it will be changed.

  In this example, only the case where the designated point is selected and moved is described for the sake of simplicity, but the designated line segments 11C and 12C can be selected and moved. In this case, by operating the pointing device, it is possible to select the specified line segment by pressing the click button, and in the selected state, the relationship between the distance and angle of the specified line segment. It is assumed that the designated point can be moved while maintaining the above.

  When the designated line segment is moved, the composite image is displayed in the superimposed display area 13 so that the designated points coincide with each other as in the above-described movement of the designated points.

  In this method, the composite image is automatically changed according to the change of the designated point, but the method in which the composite image is changed by pressing the “superposition” button after changing the designated point once. Of course, it is also possible to adopt.

  FIG. 10 is a diagram illustrating a case where still another composite image that has been subjected to the overlay process is displayed in the overlay display area 13. Here, as an example, a superimposed image when designated points 11A, 11B, 12A, and 12B are moved from the initial state is shown.

  Specifically, in the first image display area 11, a designated point 11 </ b> A and a designated point 11 </ b> B are designated corresponding to the end along the diagonal line of the character “A”. Further, in the second image display area 12, a case is shown in which designated points 12A and 12B are designated corresponding to the ends along the diagonal line of the letter “V”.

  Then, the magnification and position of the image P <b> 2 are changed according to the above-described method so that the designated points coincide with each other, and the composite image is displayed in the superimposed display area 13.

  Therefore, in the method according to the embodiment of the present invention, the image P1 can be obtained simply by designating the designated points 11A and 11B and the designated points 12A and 12B provided in the first image display area 11 and the second image display area 12, respectively. And P2 can be aligned according to the position of the designated point, and it is possible to compare two images using a simpler method because it is possible to generate a composite image by performing alignment using a simple method. It becomes. Conventionally, when images are compared by performing alignment, the user arbitrarily adjusts the image ratio, and the user needs to move and compare the images so that the images can be easily compared. In the present application, since the operation can be automatically executed by designating two designated points, the number of operations by the user is reduced and the convenience of the user is high.

  Here, the position of the image comparison dialog 15 has been changed. In particular, the image comparison dialog 15 can be arranged at any position. For example, the area of the image comparison dialog 15 is positioned by a pointing device. When the click button is pressed together, the image comparison dialog 15 becomes movable. When the click button of the pointing device is pressed, the image comparison dialog 15 can be arbitrarily set according to the operation by operating the pointing device. It is possible to arrange in a position.

  In this example, the case where the image P2 shown in the second image display area 12 is overlaid on the image P1 shown in the first image display area 11 has been described as an example. Of course, it is possible to superimpose the image P1 shown in the first image display area 11 on the image P2 shown in the image display area 12.

  In this example, as an example, when the image P1 shown in the first image display area 11 is subjected to superposition processing by changing the magnification of the image P2 as necessary, that is, the magnification of the image P1 is changed. Although the case where it is not changed has been described, it is naturally possible to perform superposition processing by changing both the magnifications of the images P1 and P2.

[Differential execution mode]
FIG. 11 is a flowchart of the differential execution mode according to the embodiment of the present invention.

  Referring to FIG. 11, when "difference execution" button 15B is pressed, a difference execution mode is entered (start) (step S30). Then, the differential execution parameter is read (step S31). In this example, the case where the difference execution mode is executed after superposition processing will be described. However, if the images are displayed in the first image display area 11 and the second image display area 12, respectively, the difference is executed. It can be processed.

  Next, a difference process between the image P1 and the image P2 displayed in the superimposed display area 13 is executed in the difference display area 14 based on the information included in the difference execution parameter to display a difference image (step S32). ). In the difference processing, a density difference for each corresponding pixel between the image P1 and the image P2 is detected, subtraction is performed, and the result is displayed as a difference image. Therefore, there is no display when they match. It is assumed that the information included in the difference execution parameter includes information such as the difference superposition ratio and color. Note that the difference execution parameter can be changed to an arbitrary value by the user in a setting mode to be described later.

  Then, it is determined whether or not there is an instruction to superimpose the difference image on the other display areas (step S33). Here, as to whether or not the difference image is to be superimposed on each other display area, whether or not the user has previously instructed the difference execution parameter when the difference execution parameter is read in step S31. Information shall be included.

  In step S33, if there is an instruction to superimpose the difference image on each of the other display areas (there is a difference image superimposition instruction), the process proceeds to step S34, and the first difference superposition ratio and color are used. The difference image is superimposed and displayed on the second image display areas 11 and 12 and the overlay display area 13 (step S34).

  On the other hand, if there is no difference image overlay instruction in step S33, the process proceeds to step S35, and step S35 is maintained until the other various function mode buttons are pressed.

  When other various function mode buttons are pressed, other various function modes are executed (step S36).

  FIG. 12 is a diagram for explaining a case where a difference image subjected to difference processing is displayed in the difference display area 14.

  Referring to FIG. 12, here, a case where a “difference execution” button 15B is pressed and a difference image is displayed is shown.

  Specifically, the images P1 and P2 are shown in the first and second image display areas 11 and 12, respectively, the composite image P3 superimposed on the overlay display area 13 is shown, and superimposed on the difference display area 14 A difference image P4 between the image P1 and the image P2 displayed in the combined display area 13 is shown. In this example, there is shown a case where there is no instruction to superimpose the difference image on other display areas.

  FIG. 13 is a diagram for explaining another case in which a differential image subjected to differential processing is displayed in the differential display area 14.

  Referring to FIG. 13, here, for images P1 and P2 shown in first and second image display areas 11 and 12 described in FIG. 12 and synthesized image P3 shown in superimposed display area 13, respectively, The case where the difference image P4 shown in the difference display area 14 is superimposed is shown. Thereby, in the first and second image display areas 11 and 12, the composite images P1 # and P2 # are shown, and the difference detection result obtained by the superimposition process is displayed by a dotted line.

  In the second image display area 12, the case where the magnification and position of the image shown in the second image display area 12 are changed and displayed in the overlay display area 13 in the above-described superimposition processing has been described. In this superimposition process, a case is shown in which the magnification and position of the difference detection result are changed and the second image display area 12 is superimposed by the reverse procedure.

  This display makes it possible to clearly identify the difference in the comparative observation of the two images. For example, the user or the like can easily determine whether the product is good or defective.

[Full screen display mode]
FIG. 14 is a flowchart of the full screen display mode according to the embodiment of the present invention.

  Referring to FIG. 14, first, it is determined whether or not any of the first and second image display areas 11 and 12 and any one of the overlapping display area 13 and the difference display area 14 is in a selected state (step S41). . Here, in order to set the display area to the selected state, an arbitrary position in the display areas 11 to 14 shown on the screen is aligned with a pointing device and the click button is pressed, thereby displaying the corresponding area. Is set to the selected state. Further, it is assumed that the selection state of the display area is canceled by pressing the click button again. When the image selection dialog 16 and the designated point described above are aligned by the pointing device and the click button is pressed, it is determined that the image selection dialog 16 and the designated point are selected, and the corresponding area is selected. It is assumed that the display area is not selected. Note that here, a case has been described in which a corresponding display area is selected by aligning an arbitrary position of the display area with a pointing device and pressing a click button. However, the present invention is not limited to this method. Of course, it is possible to replace the display area with a method capable of selecting the display area.

  If it is determined in step S41 that it is not in the selected state, step S41 is maintained.

  On the other hand, if it is determined in step S41 that any one of the display areas is selected, it is next determined whether or not the “full screen” button 15C has been pressed (step SS42).

  If the “full screen” button 15C is not pressed in step S42, the process returns to step S41 again.

  On the other hand, if the “full screen” button 15C is pressed in step S42, the selected display area is displayed in full screen (step S43).

  Next, in the full screen display mode, it is determined whether or not the “return” button has been selected (step S44).

  If the “return” button 15C is selected in step S44, the previous screen is displayed (step S45). When the “return” button 15C is not selected, the full screen display is continued.

FIG. 15 is a diagram illustrating a case where a full screen is displayed.
Referring to FIG. 15, here, a case where an image P1 displayed in the first image display area 11 is displayed on a full screen is shown as an example. In this screen, a full screen display dialog 20 is shown, and a “return” button 21 can be pressed in the dialog.

  Note that this full-screen display mode allows full-screen display even in other overlay modes and differential execution modes as long as any display area can be selected in the image comparison mode. Shall.

  For example, in FIG. 4, even before the “overlay” button 15A is pressed, the display area of the first and second image display areas 11 and 12 can be selected by the pointing device, and the “full screen” button 15C is selected. By pressing the button, it is possible to display the entire screen of the image in the selected display area.

  8 to 10, when the “overlay” button 15A is pressed, the first and second image display areas 11 are displayed by the pointing device after the overlay processing, that is, after step S12 described in FIG. , 12 and the overlay display area 13 can be selected, and the image of the selected display area can be displayed in full screen by pressing the “full screen” button 15C.

  12 and 13, when the “difference execution” button 15B is pressed, after the difference execution processing, that is, after step S32 described in FIG. Any one of the two image display areas 11, 12 and the overlapping display area 13 or the difference display area 14 can be selected, and an image of the selected display area can be selected by pressing the “full screen” button 15C. Full screen display is possible.

  Then, as described above, when the “return” button 21 of the full screen display dialog 20 is pressed in the full screen display mode, the screen returns to the previous screen and returns to the previous processing mode.

[Setting mode]
FIG. 16 is a diagram illustrating a setting dialog for setting various parameters in the image comparison mode.

  The setting dialog 30 is called by pressing the “setting” button 15D in the image comparison dialog 15.

  In this example, an overlay dialog 31 in the setting dialog 30 is shown, and the overlay setting parameter is shown in the overlay dialog 31. The user can change the overlapping ratio of the images P1 and P2 by adjusting the cursor in the overlapping ratio setting area 33 using, for example, a pointing device.

  In addition, regarding the overlay process, it is possible to select either the overlay process of image information or the overlay process of luminance information, and the overlay process is executed according to the selected content.

  In the color selection area 35, the colors of the images P1 and P2 can be specified and selected. As for the designation of this color, it is possible to designate that the gradation is inverted.

  Then, the overlay setting parameter having the contents changed by pressing the “OK” button 36 of the setting dialog 30 is stored, and the setting parameter is used in the subsequent overlay processing. In the initial state, it is assumed that default values at the time of shipment are stored as setting parameters.

  The setting dialog 30 is provided with a difference execution dialog 32 that can adjust the difference execution parameter. By pressing a click button using, for example, a pointing device, the portion is displayed in the overlay dialog 31. In the same manner as shown, the difference execution parameter can be adjusted, for example, the overlay ratio and color can be adjusted and changed. Although not shown, the difference image overlay instruction can be designated in the overlay dialog 32.

  Here, it is assumed that by pressing the “cancel” button, the setting mode is canceled and the original screen and the original mode are returned again in the same manner as the full screen display mode.

  In the magnifying observation apparatus according to the embodiment of the present invention, by executing the image comparison mode described above, it is possible to perform image overlay processing and image difference processing by a simple method. In addition, since it is possible to change the setting parameters when displaying an image in full screen and performing image processing, it is possible to improve the visibility when observing the image.

  Therefore, it is possible to easily execute image comparison in an image comparison mode in which a plurality of images are compared in parallel.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 is an overall configuration diagram of a magnification observation apparatus according to an embodiment of the present invention. 2 is a diagram illustrating a specific configuration of a magnifying observation apparatus 100. FIG. It is a figure explaining the screen 10 of the image comparison mode according to embodiment of this invention. It is a figure explaining the case where two images are displayed by user's selection in the 1st image display area 11 and the 2nd image display area 12 in the image comparison mode according to an embodiment of the invention. It is a flowchart of the image comparison mode according to the embodiment of the present invention. It is a flowchart explaining the superimposition process according to embodiment of this invention. It is a flowchart in the case of performing the superimposition display according to embodiment of this invention. It is a figure explaining the case where the composite image by which the superimposition process was carried out is displayed on the superimposition display area. It is a figure explaining the case where another synthetic image by which the superimposition process was carried out is displayed on the superimposition display area. It is a figure explaining the case where another synthetic image by which the superimposition process was carried out is displayed on the superimposition display area. It is a flowchart in the differential execution mode according to the embodiment of the present invention. It is a figure explaining the case where the difference image by which the difference process was displayed on the difference display area is displayed. It is a figure explaining the other case where the difference image by which the difference process was displayed on the difference display area is displayed. It is a flowchart of the full screen display mode according to the embodiment of the present invention. It is a figure explaining the case where it displays on a full screen. It is a figure explaining the setting dialog for setting various parameters in image comparison mode.

Explanation of symbols

  10 screens, 11 first image display area, 12 second image display area, 13 superimposed display area, 14 difference display area, 100 magnification observation apparatus, 101 information processing apparatus, 103 mouse, 110 imaging unit, 111 optical system, 112 CCD, 113 CCD control circuit, 120 stage elevator, 121 stepping motor, 122 motor control circuit, 130 stage, 141 stand base, 142 column, 143 mounting part, 151 control part, 152 display part, 153 memory, 154 I / F 155 Operation unit.

Claims (10)

An imaging unit for imaging an observation target;
A control unit that generates an observation image based on a signal received for the observation target imaged by the imaging unit and executes image processing between the comparison image and the comparison image;
A display unit,
The controller is
As the first display image, one of the observation image and the comparison image is displayed on the display unit together with first and second designated points that can be designated at an arbitrary position on the one image,
As the second display image, the other of the observation image and the comparison image is displayed on the display unit together with third and fourth designated points that can be designated at arbitrary positions on the other image,
As the third display image, the first designated point displayed on the first display image and the third designated point displayed on the second display image coincide with each other, and At least one of the first and second display images so that the second designated point displayed on one display image and the fourth designated point displayed on the second display image coincide with each other. A magnification observation apparatus that displays a combined image obtained by superimposing the first and second display images on the display unit in a state in which the position and magnification of the image are changed.   The magnification observation apparatus according to claim 1, further comprising designation means for designating an arbitrary position on the corresponding display image of the first to fourth designated points.   The designation means changes the positions of the first to fourth designated points on the first and second display images while maintaining a relative relationship with the corresponding display image in the third display image. The magnification observation device according to claim 2. A distance between a first line segment connecting the first designated point and the second designated point displayed on the first display image, and the third line displayed on the second display image. The magnification is changed so that the distance between the second line segment connecting the designated point and the fourth designated point is equal,
The position is changed so that the first line segment displayed on the first display image and the second line segment displayed on the second display image coincide with each other. Magnifying observation device described in 1.   When the first line segment or the second line segment on the first and second display images is selected by the specifying unit, the distance between the corresponding specified points and the angle between the corresponding specified points are maintained. The magnification observation apparatus according to claim 1, which is movable.   The magnification observation apparatus according to claim 1, wherein the control unit displays a composite image obtained by performing a superimposition process based on a superposition ratio between the observation image and the comparison image on the display unit.   The magnification observation apparatus according to claim 1, wherein the control unit displays on the display unit a combined image obtained by adjusting and superimposing at least one of luminance and color of each of the observation image and the comparison image.   The magnification observation apparatus according to claim 1, wherein the control unit detects a difference between the observation image and the comparison image in response to a second instruction, and displays the difference image on the display unit.   The magnification observation apparatus according to claim 1, wherein the control unit displays any one of the observation image, the comparison image, and the composite image on the display unit in response to a second instruction. Image processing between an imaging unit for imaging an observation target and a comparison image that is generated based on a signal received for the observation target captured by the imaging unit and compared with the observation image A magnification observation method of a magnification observation apparatus comprising a control unit to execute and a display unit,
As the first display image, one of the observation image and the comparison image is displayed on the display unit together with first and second designated points that can be designated at an arbitrary position on the one image,
As the second display image, the other of the observation image and the comparison image is displayed on the display unit together with third and fourth designated points that can be designated at arbitrary positions on the other image,
As the third display image, the first designated point displayed on the first display image and the third designated point displayed on the second display image coincide with each other, and At least one of the first and second display images so that the second designated point displayed on one display image and the fourth designated point displayed on the second display image coincide with each other. Change the position and magnification of
A magnified observation method of displaying a composite image obtained by superimposing the first and second display images in the changed state on the display unit.

Images