JP2018066908A - Magnifying observation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a magnifying observation device capable of facilitating the use of an improvement function of observation or analysis.SOLUTION: A magnifying observation device comprises: illumination means for irradiating an observation object on a stage with an illumination light; a camera for receiving a reflected light or a transmitted light of the illumination light to take an image of the observation object; a lens part optically connected to the camera; monitor screen display means for displaying the taken image taken by the camera on a monitor screen: function executing means for executing observation improving functions specified by a user; use history storing means for storing, as a use history, the fact that the observation improving function has been used; use frequency calculating means for calculating a use frequency for each of the observation improving functions on the basis of the use history; determination threshold storing means for holding a determination threshold determined for each of the observation improving functions; and use promotion screen displaying means for regarding, as a recommended function, the observation improving function whose use frequency goes below the determination threshold and displaying, on the monitor screen, a use promotion screen for facilitating the use of the recommended function.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a magnifying observation apparatus, and more particularly, to an improvement of a magnifying observation apparatus that images an observation object by irradiating illumination light onto the observation object placed on a stage.

  The magnifying observation device is a digital microscope that irradiates an observation object placed on a stage with illumination light and receives the reflected or transmitted light to image the observation object, and monitors the captured image. Display on the screen, and measure the size of the object to be observed and record the captured image. In addition, the magnification observation device has a depth composition function that increases the depth of field, an image connection function that connects multiple captured images to widen the field of view, an HDRI (High Dynamic Range Imaging) function that acquires an image with a wide dynamic range, etc. Have

  Various functions for observation and dimension measurement are mounted on the magnification observation apparatus as described above. However, because of the nature of the magnifying observation device, it is sufficient for the user to observe the observation object, and there is a problem that it is difficult to notice even if there is a function that is not used. For example, if a function different from the function that is normally used is used, better observation and analysis may be realized, such as improving the image quality of a captured image or simply measuring.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a better observation environment. In particular, an object of the present invention is to provide a magnifying observation apparatus that can promote the use of an improvement function of observation or analysis.

  The magnification observation apparatus according to the first aspect of the present invention includes a stage for placing an observation object, illumination means for irradiating the observation object on the stage with illumination light, reflected light of the illumination light, or A camera that receives transmitted light and detects the amount of received light to image the object to be observed, a lens unit that is optically coupled with the optical axis of the camera, and a captured image captured by the camera Monitor screen display means to be displayed on the screen, function execution means having a plurality of observation improvement functions and executing the observation improvement function specified by the user, and use of storing the observation improvement function as usage history A history storage means, a usage frequency calculation means for obtaining a usage frequency for each observation enhancement function based on the usage history, and a determination threshold storage means for holding a judgment threshold determined for each observation enhancement function The frequency of use is the recommended function the observation improved functionality is below the determination threshold, and a use prompt screen display means for displaying the use prompt screen for prompting the use of the recommended features on the monitor screen.

  According to such a configuration, since the use promotion screen for prompting the use of the observation enhancement function whose use frequency is lower than the determination threshold as a recommended function is displayed on the monitor screen, the recommended function having a low use frequency is provided. It is possible to make the user recognize that there is.

  The magnification observation apparatus according to the second aspect of the present invention, in addition to the above configuration, when the use promotion screen display means has a use frequency of the observation enhancement function different from the recommended function equal to or higher than a corresponding determination threshold value, The usage promotion screen is configured to be displayed. According to such a configuration, it is possible to prevent a specific observation enhancement function from being selected as a recommended function and displaying a use promotion screen even though the frequency of use of the observation enhancement function is low overall. .

  In addition to the above configuration, the magnification observation apparatus according to the third aspect of the present invention is based on a screen operation for a region other than the use promotion screen, a microscope operation, or an operation to the operation unit. It is comprised so that the display of the said use promotion screen may be complete | finished. According to such a configuration, it is possible to prevent the use promotion screen from interfering with screen operation and observation.

  The magnification observation apparatus according to the fourth aspect of the present invention, in addition to the above configuration, the use promotion screen display means ends the display of the use promotion screen based on the start of use of the observation enhancement function other than the recommended function. Configured to do. According to such a configuration, when the observation enhancement function other than the recommended function is used, the use promotion screen can be prevented from interfering with the screen operation.

  The magnification observation apparatus according to the fifth aspect of the present invention has the above configuration, in addition to the above configuration, if the use promotion screen display means finishes displaying the use promotion screen and then a certain time elapses without any screen operation. The usage promotion screen is displayed again. According to such a configuration, it is possible to recognize that there is a recommended function with a low use frequency even if the user is different from the user who displayed the use promotion screen last time.

  In addition to the above configuration, the magnification observation apparatus according to the sixth aspect of the present invention is configured such that the use promotion screen display means displays an operation method for using the recommended function on the use promotion screen. According to such a configuration, the user can easily recognize the operation method for using the recommended function by checking the use promotion screen.

  In addition to the above-described configuration, the magnification observation apparatus according to the seventh aspect of the present invention is a rotation axis orthogonal to a light receiving axis of the camera and the lens unit, and the camera and the rotation axis parallel to the stage. The lens unit is rotatably supported, and further includes support means for tilting the light receiving axis with respect to the stage. The observation enhancement function includes the observation with the light receiving axis tilted with respect to the stage. Includes the ability to observe objects. According to such a configuration, the use promotion screen displays the existence of an observation enhancement function for observing an observation object with the light receiving axis tilted with respect to the stage for a user who uses the tilt observation function less frequently. Can be recognized.

  The magnification observation apparatus according to the eighth aspect of the present invention further includes drive means for relatively moving the stage, the camera, and the lens unit in addition to the above configuration. According to such a configuration, the stage, the camera, and the lens unit can be relatively moved by remote control or the like.

  According to the present invention, since the use promotion screen is displayed on the monitor screen to promote the use of the observation enhancement function whose use frequency is lower than the determination threshold as the recommended function, there is a recommended function having a low use frequency. Can be recognized by the user. Therefore, it is possible to promote the use of a function that improves the observation performance or analysis performance, and to provide a better observation environment or analysis environment.

It is the system figure which showed one structural example of the magnification observation apparatus 1 by embodiment of this invention. It is the perspective view which showed the example of a structure of the support stand 6 with which the head unit 2 of FIG. 1 was mounted | worn. It is the figure which showed the structural example of the support stand 6 of FIG. FIG. 6 is a perspective view showing another configuration example of the head unit 2. It is the block diagram which showed an example of the function structure in the controller 4 of FIG. It is the figure which showed an example of the presentation file hold | maintained at the presentation file memory | storage part 105 of FIG. It is the figure which showed an example of the operation | movement at the time of power activation in the controller 4 of FIG. It is the figure which showed an example of the operation | movement at the time of screen operation in the controller 4 of FIG. It is the figure which showed the other example of the operation | movement at the time of screen operation in the controller 4 of FIG. It is the flowchart which showed an example of the operation | movement at the time of the presentation file selection in the controller 4 of FIG.

  First, a schematic configuration of the magnification observation apparatus according to the present invention will be described below with reference to FIGS.

<Magnification observation apparatus 1>
FIG. 1 is a system diagram showing a configuration example of a magnification observation apparatus 1 according to an embodiment of the present invention. The magnification observation apparatus 1 is a digital microscope capable of magnifying and observing the observation object S, and includes a head unit 2, a transmission cable 3, a controller 4, an operation unit 5 and a support base 6.

<Head unit 2>
The head unit 2 irradiates the observation object S with illumination light consisting of visible light, receives the reflected light reflected by the observation object S or the transmitted light transmitted through the observation object S, and observes the observation object S. A light projecting / receiving unit that captures the image, and is configured by a camera 21 and a lens unit 22. The head unit 2 is connected to the controller 4 via the transmission cable 3 and is mounted on the support base 6 with the camera 21 facing downward.

  The camera 21 is an imaging device that images the observation object S, and includes an imaging element 211 that receives reflected light or transmitted light of illumination light, detects the amount of received light, and generates a captured image. For example, an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) is used as the imaging device 211.

  The lens unit 22 includes a plurality of lenses optically coupled to the image sensor 211 of the camera 21 and is detachably attached to the camera 21. The lens unit 22 includes, for example, an objective lens 221 that faces the observation object S, and the imaging magnification can be adjusted by rotating the lens barrel unit. The lens unit 22 is provided with a coaxial incident illumination unit 71 and a ring illumination unit 72.

  The camera 21 is disposed so as to be rotatable around the optical axis of the lens unit 22 in a state where the light receiving axis coincides with the optical axis of the lens unit 22. For this reason, the imaging angle at the time of imaging the observation object S can be adjusted without rotating the stage 65.

  The coaxial epi-illumination unit 71 is a light projecting device that irradiates the observation object S with illumination light, and the illumination light transmitted from the controller 4 via the transmission cable 3 is coaxially connected to the light receiving axis of the camera 21 from the lens unit 22. Exit.

  The ring illumination unit 72 is a light projection device that irradiates the observation object S with illumination light, and emits illumination light from an annular light projection region that surrounds the objective lens 221. The ring illuminator 72 switches between bi-directional illumination that lights the entire projection area and single-illumination that lights only a part of the projection area in order to emphasize the unevenness of the surface of the observation object S. be able to. In the one-sided illumination, the light projection area is divided into 4 to 16 parts, and a lighting part can be selected.

<Supporting stand 6>
The support base 6 is a stand that supports the head unit 2 in order to observe the observation object S at a desired imaging angle, and includes a base unit 60, a column unit 61, a head mounting arm unit 62, a Z driving unit 63, and lens detection. The unit 64, the stage 65, the XY drive unit 66, and the stage adjustment unit 67 are configured. Here, the vertical direction, that is, the vertical direction is defined as the Z-axis direction, and the X-axis and the Y-axis are defined in the horizontal plane.

  In the base portion 60, a support column portion 61, an XY drive portion 66, and a stage adjustment portion 67 are arranged. The column 61 extends in the vertical direction and supports the head unit 2 via the head mounting arm 62.

  The head mounting arm portion 62 extends in the horizontal direction from the column portion 61 and holds the head unit 2. The head unit 2 is detachably attached to the head mounting arm portion 62. The head unit 2 or the head mounting arm portion 62 is provided with a sensor (not shown) for detecting that the head unit 2 is mounted on the head mounting arm portion 62.

  The Z drive unit 63 is a camera drive unit that moves the camera 21 in the light receiving axis direction by moving the head mounting arm unit 62 in the vertical direction along the support column 61. The lens detection unit 64 detects that the lens unit 22 is attached to the camera 21 and acquires various types of lens information from the lens unit 22. The acquired lens information includes, for example, a photographing magnification and a focal length.

  The stage 65 is a work table having a placement surface 65a on which the observation object S is placed. The stage 65 is horizontally arranged and a transmission illumination unit 73 is provided. The transmitted illumination unit 73 is a light projecting device that irradiates the observation object S with illumination light.

  The XY drive unit 66 is a stage drive unit that moves the stage 65 in a direction parallel to the placement surface 65a. The stage adjustment unit 67 moves the stage 65 in the vertical direction (Z-axis direction), or rotates the stage 65 and the XY drive unit 66 about the vertical rotation axis. The stage 65 is moved up and down and rotated, for example, by operating an operator such as an adjustment knob, and the height and imaging angle of the observation object S can be adjusted.

  The stage adjustment unit 67 is provided with a position sensor (not shown) for detecting the position of the stage 65 in the Z-axis direction and a rotation angle sensor (not shown) for detecting the rotation angle of the stage 65.

<Transmission cable 3>
The transmission cable 3 includes a control cable 31 for transmitting control signals and captured images, and an illumination light transmission cable 32 for transmitting illumination light. The illumination light transmission cable 32 is made of an optical fiber.

<Controller 4>
The controller 4 is an information processing terminal that controls the camera 21, the ring illumination unit 72, the transmission illumination unit 73, the Z drive unit 63, and the XY drive unit 66 and displays a captured image acquired from the camera 21 on the display unit 41. An operation unit 5 is connected. The controller 4 switches the main power source to an on state by operating the power button 42. In addition, the controller 4 is provided with a light source device that generates illumination light for coaxial epi-illumination. The display unit 41 is a display device that displays a captured image on a monitor screen.

<Operation unit 5>
The operation unit 5 is an input device that receives user operations, and includes a keyboard 51, a mouse 52, and a console 53. The console 53 can instruct capturing of a captured image, illumination brightness, and focusing of the camera 21 by operating buttons and adjustment knobs.

  FIG. 2 is a perspective view showing a configuration example of the support base 6 on which the head unit 2 of FIG. 1 is mounted. FIG. 3 is a diagram showing a configuration example of the support base 6 of FIG. (A) in the figure shows the left side surface of the support base 6, (b) shows the case where the support base 6 is viewed from above, and (c) shows the front surface of the support base 6. It is shown.

  The support column 61 is attached to the base unit 60 via a tilt unit 68 and can be inclined in the left-right direction. The tilt part 68 is a part of the base part 60, and supports the support | pillar part 61 rotatably centering | focusing on the horizontal rotating shaft of the front-back direction. The rotation axis of the tilt unit 68 is orthogonal to the light receiving axis of the head unit 2 and extends in parallel with the mounting surface 65 a of the stage 65. That is, the head unit 2 attached to the head mounting arm portion 62 is supported so as to be rotatable about the rotation axis, and the light receiving axis can be inclined with respect to the mounting surface 65 a of the stage 65.

  For example, the support column 61 can be inclined about 90 ° from the vertical direction to the right side, or can be inclined about 60 ° from the vertical direction to the left side. For this reason, the observation object S on the stage 65 can be observed not only in the upward direction but also in an oblique direction or a lateral direction. The stage 65 can be rotated about 90 ° in the right direction and the left direction, respectively.

  The support unit 61 or the tilt unit 68 is provided with a sensor (not shown) for detecting the tilt angle of the support unit 61. Further, the support 61 is provided with a lock mechanism for fixing the tilt unit 68 at a position where the tilt angle is 0 °, that is, a position where the light receiving axis of the head unit 2 is orthogonal to the mounting surface 65 a of the stage 65. It is done.

  FIG. 4 is a perspective view showing another configuration example of the head unit 2 and shows a lens unit 22 including two objective lenses 221a and 221b having different photographing magnifications. The lens unit 22 includes two objective lenses 221a and 221b having different photographing magnifications, and the photographing magnification can be largely changed by switching the objective lenses 221a and 221b. The objective lenses 221a and 221b are different objective lenses and are arranged on the light receiving axis of the camera 21 so as to be switchable.

  The objective lens 221a is a high-power lens having a high shooting magnification. On the other hand, the objective lens 221b is a low-magnification lens having a photographing magnification lower than that of the objective lens 221a. The objective lenses 221a and 221b are switched by rotating around a horizontal rotation axis 222 in the left-right direction, and either the objective lens 221a or 221b is disposed on the light receiving axis of the camera 21.

  Next, a more detailed configuration of the magnification observation apparatus 1 according to the present invention will be described below with reference to FIGS.

<Controller 4>
FIG. 5 is a block diagram showing an example of a functional configuration in the controller 4 of FIG. The controller 4 includes a usage history generation unit 101, a usage history storage unit 102, a usage frequency calculation unit 103, a determination threshold storage unit 104, a presentation file storage unit 105, a usage promotion screen display unit 106, a power supply device 107, and peripheral device connection detection. Unit 108, function execution unit 109, imaging condition specifying unit 110, imaging setting storage unit 111, imaging control unit 112, and monitor screen display unit 113.

  The imaging condition designating unit 110 designates imaging conditions when the observation object S is imaged by the camera 21. The imaging condition includes various parameters such as exposure time, gain, and white balance, is specified based on an operation signal from the operation unit 5, and is stored in the imaging setting storage unit 111 as imaging setting information.

  The imaging control unit 112 controls the camera 21 based on the imaging setting information in the imaging setting storage unit 111 and acquires a captured image from the camera 21. The monitor screen display unit 113 controls the display unit 41 to display the captured image captured by the camera 21 according to the imaging conditions and acquired by the imaging control unit 112 on the monitor screen.

  The function execution unit 109 has a plurality of predetermined observation enhancement functions, and the user can control the head unit 2, the support base 6, the coaxial incident illumination unit 71, the ring illumination unit 72, and the transmission illumination unit 73. Perform the specified observation enhancement function.

  The observation enhancement function is a function that improves the observation performance. For example, the observation enhancement function is provided by a predetermined application program. The observation enhancement function includes a function that involves physical movement of components that constitute the magnification observation apparatus 1. For example, the tilt observation function, the function of moving the stage 65 in the XY plane, the function of moving the stage 65 in the Z-axis direction, the function of moving the head unit 2 in the Z-axis direction, the function of switching the objective lens 221, and switching the illumination Functions, functions for switching the operating conditions of the lighting, and the like. The observation enhancement function includes an image processing function for processing a captured image.

  The usage history generation unit 101 generates a usage history indicating that the observation improvement function has been used, and stores the usage history in the usage history storage unit 102. For a plurality of observation enhancement functions, the operation date and time and operation details are stored as a usage history. The usage history is generated based on the operation signal from the operation unit 5 and the detection result of each sensor, and operation information on the monitor screen and operation information on peripheral devices are sequentially recorded.

  The operation on the monitor screen includes operation of a button displayed on the monitor screen, input of a check mark to a check box, and operation of a slider. For operations in which the value continuously changes, such as a slider operation or a long button press, the amount of change may be collectively recorded as a usage history after a certain time has elapsed.

  With each part sensor, for example, the position of the stage 65 in the XY plane, the position and rotation angle in the Z direction, the position in the Z direction of the camera 21, the photographing magnification of the lens unit 22, the inclination angle of the column 61, and the inclination The state of the lock mechanism is detected. The tilt lock mechanism is a mechanism that locks the support column 61 at an tilt angle = 0 °. The usage history storage unit 102 includes, for example, a ring buffer. When the usage history storage amount is saturated, the oldest data is overwritten.

  The usage frequency calculation unit 103 obtains the usage frequency for each observation enhancement function based on the usage history in the usage history storage unit 102. The usage frequency can be obtained from the number of times the target function is used. Or it can also obtain | require from the operating time of the magnification observation apparatus 1, the usage time of an observation improvement function, the frequency | count of usage, etc. The determination threshold value storage unit 104 holds a determination threshold value determined for each observation enhancement function.

  The use promotion screen display unit 106 sets the observation enhancement function whose use frequency is below the determination threshold as a recommended function, and displays a use promotion screen for prompting the use of the recommended function on the monitor screen. On the usage promotion screen, for example, an operation method for using the recommended function is displayed using a text message, a thumbnail image composed of a still image, a moving image, and the like. The thumbnail image is created using a simulation diagram or a figure representing the magnification observation apparatus 1. Character information and image data to be displayed on the use promotion screen are created in advance as a presentation file and are held in the presentation file storage unit 105. A presentation file is created for each observation enhancement function.

  The power supply device 107 switches the main power source to the on state based on the operation of the power button 42, and switches the main power source to the off state based on the operation of the operation unit 5. In addition, the power supply device 107 switches the display unit 41 to the sleep state if the operation is not performed for a certain time in the on state, and switches the sleep state to the original state if the operation is performed thereafter. In the sleep state, power consumption is suppressed, for example, the backlight is turned off.

  The usage promotion screen display unit 106 displays the usage promotion screen when the main power source is switched to the on state and when the main power source is returned from the sleep state, for example. In order to prevent the same presentation file from being repeatedly displayed, the usage promotion screen display unit 106 excludes the presentation file displayed on the usage promotion screen most recently from the display target. For example, the past several presentation files from the previous display are excluded from the display target.

  The peripheral device connection detection unit 108 detects that a peripheral device is connected to the controller 4, acquires device information such as a type, and outputs the device information to the use promotion screen display unit 106. Peripheral devices include a head unit 2, an operation unit 5, a support base 6, a lighting device, other terminal devices, and the like. The usage promotion screen display unit 106 excludes the presentation file corresponding to the recommended function that cannot be used in the current system configuration from the display target.

  When a plurality of presentation files are to be displayed, the usage promotion screen display unit 106 performs weighting according to the difference between the usage frequency and the determination threshold, and uses the presentation file having the highest priority represented by the weight. Display on the screen. If there are a plurality of presentation files with the highest priority, a display target is selected at random from these presentation files.

  In addition, the use promotion screen display unit 106 prevents the use promotion screen from being displayed because the specific observation improvement function is selected as the recommended function even though the use frequency of the observation improvement function is generally low. In addition, when the use frequency of the observation enhancement function different from the recommended function is equal to or higher than the corresponding determination threshold, the use promotion screen is displayed. For all observation enhancement functions different from the recommended function selected as the display target, the use promotion screen is not displayed if the use frequency is below the determination threshold.

  The use promotion screen display unit 106 is used based on a screen operation on a region other than the use promotion screen, a microscope operation, or an operation on the operation unit 5 in order to prevent the use promotion screen from interfering with the screen operation. End the promotion screen display. The operation of the microscope is, for example, an operation on the head unit 2 or the support base 6. Further, the use promotion screen display unit 106 ends the display of the use promotion screen based on the start of use of the observation enhancement function other than the recommended function.

  Further, the use promotion screen display unit 106 displays the use promotion screen again after a certain period of time has elapsed without any screen operation after the display of the use promotion screen. For example, after about 30 minutes have elapsed after the display of the use promotion screen, the use promotion screen is displayed again. By adopting such a configuration, it is possible to recognize that there is a recommended function with a low use frequency even if the user is different from the user who displayed the use promotion screen last time.

  In this controller 4, among the observation enhancement functions, a plurality of particularly recommended observation enhancement functions are designated in advance as recommended candidate functions. The presentation file corresponding to the recommended candidate function is a recommended candidate file. Then, when the usage promotion screen is displayed for an odd number of times counted from the first operation after being shipped as a product, a display target is selected from the recommended candidate files. On the other hand, when the usage promotion screen is displayed for the even number of times, a display target is selected from all the presentation files.

  6 is a diagram showing an example of a presentation file held in the presentation file storage unit 105 of FIG. In the figure, 25 recommended candidate files classified into 14 types are shown. The recommended candidate file related to hardware includes a presentation file corresponding to the tilt observation function. The tilt observation function is a function of observing the observation object S in a state where the optical axis of the head unit 2 is tilted with respect to the stage 65 by tilting the support 61.

  The recommended file for illumination / brightness includes a presentation file for the illumination switching function. The illumination switching function is a function that switches illumination methods, and selects an illumination method from coaxial incident illumination, coaxial incident illumination, coaxial side illumination, ring illumination, ring incident illumination, transmitted illumination, or a combination of these. can do.

  The recommended shooting setting file includes a moving image recording function presentation file and a camera shake correction function presentation file. The moving image recording function is a function for recording a moving image taken by the camera 21. The camera shake correction function is a function for canceling the influence of fine vibration during observation.

  The recommended measurement file for measurement / scale includes the flat measurement function presentation file, the scale function presentation file, the one-click automatic measurement function presentation file, the automatic area measurement function presentation file, and the maximum area measurement function presentation. There is a file. The plane measurement function is a function for measuring the size of the observation object S on the captured image. The scale function is a function for displaying a scale in association with a captured image.

  The one-click automatic measurement function is a function that automatically stores a measurement location, dimension type, search image data, etc. as a template and automatically performs dimension measurement by designating a measurement location on a captured image by operating a mouse. . The automatic area measuring function is a function for automatically extracting and measuring particles to be counted, that is, particles to be measured from a captured image. The maximum area measurement function is a function for measuring an area by specifying an object having the largest area in a region designated by a mouse operation.

  The depth enhancement recommended candidate files include a live depth synthesis function presentation file, a quick synthesis and 3D function presentation file, and an autofocus function presentation file. The live depth composition function obtains a plurality of captured images with different positions in the Z-axis direction of the head unit 2 each time the stage 65 is moved in the XY plane by remote operation using the console 53 or the like, and performs depth composition. This is a function for automatically creating and displaying a combined depth image in which the depth of field is deeper than the original captured image.

  The quick composition and 3D function creates a depth composite image by acquiring a plurality of captured images having different positions in the Z-axis direction of the head unit 2 by moving the head unit 2 in the Z-axis direction by remote control. This is a function for automatically creating and displaying a 3D image representing the three-dimensional shape of the observation object S from position information in the Z-axis direction. The autofocus function is a function for acquiring a plurality of captured images having different positions in the Z-axis direction of the head unit 2 and automatically creating and displaying a depth composite image.

  The image quality improvement recommended candidate files include a resolution improvement function presentation file and a reflection removal function presentation file. The resolution enhancement function is a function that creates a high dynamic range (HDR) image with higher gradation than the original captured image by acquiring and combining multiple captured images with different shutter speeds (exposure times). An HDR image can also be created using a resolution image.

  A high-resolution image is acquired using a pixel shift technique that uses a single-wavelength filter that selects an optimum wavelength according to lens characteristics, and interpolates pixel data between pixels by shifting the image sensor 211 to increase the resolution. It is a captured image, and it is possible to obtain a clear image that is not easily affected by chromatic aberration. When displaying an HDR image on a monitor screen, an image with a reduced dynamic range is created by tone mapping. The reflection removal function is a function for creating an image with reduced halation by acquiring and synthesizing a plurality of captured images having different shutter speeds (exposure times).

  The multi-writing recommended candidate file includes a multi-writing function presentation file. The multi-lighting function is a function for switching a lighting method by acquiring and synthesizing a plurality of photographed images with different illumination methods and operating a mouse or the like after photographing.

  The display / comment recommendation candidate file includes a split display function presentation file. The split display function is a function for splitting the monitor screen and displaying a plurality of captured images simultaneously. The navigation recommendation candidate file includes a navigation function presentation file. The navigation function is a function that moves the stage 65 in the XY plane and moves the imaging field of view to a designated position by designating a position to be observed on the wide-field image displayed on the navigation screen.

  The recommended image connection file includes a 2D or 3D function presentation file. The 2D or 3D function is a function that acquires a captured image from the camera 21 and creates a connected image by connecting a plurality of captured images every time the position of the stage 65 in the XY plane is changed. A plurality of depth composite images with different positions of the stage 65 in the XY plane can be connected to create a 3D image with a wide field of view. The connected image is a composite image with a wider field of view than the original captured image.

  The recommended album files for the album include a presentation file for the PC soft copy function and a presentation file for the report output function. The PC soft copy function is a function for installing software held by another terminal device such as a personal computer in the controller 4. The report output function is a function for outputting a photographed image and a result of dimension measurement as a report file.

  The recommended files for the side album include a presentation file for the shooting setting reproduction function. The shooting setting reproduction function is a function that facilitates observation under the same shooting conditions as the previous time by holding shooting conditions at the time of observation as a shooting setting file and reading the shooting setting file.

  The recommended candidate files for 3D display include a point height measurement function presentation file, a profile function presentation file, and a roughness function presentation file. The point height measurement function is a function for measuring the height of a measurement point by designating the measurement point on the 3D image. The profile function is a function for acquiring profile data representing the shape of the cut surface when the observation object S is cut by the cutting line by designating the cutting line on the 3D image. The roughness function is a function for measuring the surface roughness of the observation object S.

  The recommended system files include a system protection function presentation file. The system protection function is a function for protecting a captured image, a shooting setting file, or the like captured in the memory by operating the console 53 or the monitor screen, or temporarily canceling or completely canceling the system protection.

  When the support file 6 that can move the stage 65 in the XY plane by remote control is connected to the presentation file of the live depth synthesis function, the presentation file of the navigation function, and the presentation file of the 2D or 3D function It can be selected as a display target. That is, these presentation files can be selected as a display target when the support base 6 includes the XY drive unit 66, and can be selected as a display target when the support base 6 does not include the XY drive unit 66. Can not do it.

  In addition, the live depth synthesis function presentation file, the quick synthesis and 3D function presentation file, the autofocus function presentation file, and the 2D or 3D function presentation file are arranged in the Z-axis direction by remote control. When the support base 6 that can be moved is connected, it can be selected as a display target. That is, these presentation files can be selected as a display target when the support base 6 includes the Z drive unit 63, and can be selected as a display target when the support base 6 does not include the Z drive unit 63. Can not do it.

  The presentation files other than the recommended candidate files include, for example, ones corresponding to a function of switching the objective lens 221, a function of rotating the stage 65, a function of moving the stage 65 in the Z-axis direction, and a lighting composition function. The illumination composition function is a function for acquiring and combining a plurality of captured images with different illumination methods.

<Monitor screen 300>
FIG. 7 is a diagram showing an example of the operation at the time of power-on in the controller 4 of FIG. 5, and shows a monitor screen 300 displayed on the display unit 41 of the controller 4. (A) in the figure shows a monitor screen 300 immediately after the power is turned on. The monitor screen 300 is an observation setting screen for displaying a captured image, measuring the size of the observation object S, recording the captured image, and the like.

  The monitor screen 300 is provided with a display area 301 for displaying an image captured by the camera 21 and an operation column 302 for performing various operations. The operation column 302 is provided with a menu column 303 in which a plurality of menu tabs for selecting various functions are arranged.

  The menu tab is assigned with functions of simple mode, illumination / brightness, shooting setting, measurement / scale, depth improvement, image quality improvement, multi-lighting and image connection. For example, in the simple mode, various settings relating to observation, recording, and measurement can be easily performed. With illumination / brightness, the type of illumination and the brightness of the light source can be adjusted.

  Further, the operation column 302 is provided with an end button, a stop button, a shooting button, and a magnification display column. The end button is an operation icon for switching the main power source to the off state. The stop button is an operation icon for temporarily stopping image processing and the like. The shooting button is an operation icon for taking a shot image into the memory. In the magnification display field, the current shooting magnification is displayed.

  (B) in the figure shows a use promotion screen 310 displayed on the monitor screen 300. The use promotion screen 310 is a guide screen that presents a description of the recommended function and an operation method to the user by a text message, a thumbnail image, or a moving image in order to promote the use of the recommended function.

  This use promotion screen 310 is displayed based on, for example, a presentation file corresponding to a tilt observation function that is used less frequently, and the display area 311 represents a text message 312 that tilt observation is possible and an operation procedure. A thumbnail image is displayed. By displaying such a use promotion screen 310, it is possible to urge the user who rarely observes the column 61 of the support base 6 to tilt so far to use the tilt observation function.

  The usage promotion screen 310 is displayed as a pop-up in the display area 301 of the monitor screen 300, for example. That is, the use promotion screen 310 is displayed on the forefront of the monitor screen 300 and appears so as to cover other elements that are already displayed. With such a pop-up display, the usage promotion screen 310 can be easily recognized and made conspicuous.

  FIG. 8 is a diagram showing an example of an operation at the time of screen operation in the controller 4 of FIG. 5, and shows a case where the monitor screen 300 is operated after the use promotion screen 310 is displayed. (A) in the figure shows a case where the mouse pointer 8 is moved onto the use promotion screen 310. When the mouse pointer 8 is moved onto the usage promotion screen 310 by a mouse operation, a playback button or the like for playing back a moving image is displayed in the usage promotion screen 310.

  (B) in the figure shows a case where the playback of the moving image is started by operating the playback button in the usage promotion screen 310. In the use promotion screen 310, a pause button and an end button for pausing the playback of the moving image are displayed, and a moving image explaining a specific procedure for tilting the support base 6 is displayed in the display area 311. Is displayed. Note that a configuration may be adopted in which a plurality of thumbnail images are sequentially displayed instead of a moving image.

  FIG. 9 is a diagram showing another example of the operation at the time of screen operation in the controller 4 of FIG. 5, and shows a case where a measurement function is selected by operating an area other than the use promotion screen 310. If an area other than the use promotion screen 310, for example, the menu column 303 is operated and a function other than the recommended function is selected, the display of the use promotion screen 310 is automatically ended. When the usage promotion screen 310 is displayed as a thumbnail and changes to a state in which the corresponding moving image is played by a user operation, even if the operation of the menu column or the like is started, the usage promotion screen 310 is displayed. Display does not end.

  Steps S101 to S112 in FIG. 10 are flowcharts showing an example of the operation when the presentation file is selected in the controller 4 in FIG. First, the controller 4 refers to the display history of the presentation file (step S101), and excludes the presentation file displayed most recently from the display target (step S102). Next, the controller 4 confirms the connection status of the peripheral device (step S103), and excludes the presentation file corresponding to the observation enhancement function that cannot be used because the peripheral device is not connected from the display target (step S103). S104).

  The controller 4 refers to the display count of the usage promotion screen 310, and if the current display is an odd-numbered display (step S105), the presentation file designated in advance as the recommended candidate file is set as the display target, and other than the recommended candidate file. The presentation file is excluded from the display target (step S106). On the other hand, if the current display is an even-numbered display (step S105), the controller 4 sets all the presentation files remaining without being excluded from the display target in the processing procedure up to step S104 as the display target.

  Next, the controller 4 calculates the usage frequency for each observation enhancement function (step S107), compares the usage frequency with a determination threshold value, and extracts an observation improvement function whose usage frequency is below the determination threshold value as a recommended function ( Step S108). The controller 4 performs weighting according to the difference between the usage frequency and the determination threshold (step S109), and narrows down the display target based on the weight (step S110). Then, the controller 4 randomly selects a display target from the presentation files having the highest priority represented by the weight (step S111), and displays it on the use promotion screen 310 (step S112).

  According to the present embodiment, since the use promotion screen 310 for prompting the use of the observation enhancement function whose use frequency is below the determination threshold as a recommended function is displayed on the monitor screen 300, the recommendation with a low use frequency is recommended. The user can recognize that there is a function. Further, since the use promotion screen 310 is displayed when the use frequency of the observation enhancement function different from the recommended function is equal to or higher than the corresponding determination threshold, the use frequency of the observation improvement function is low overall, It is possible to prevent a specific observation enhancement function from being selected as a recommended function and displaying the use promotion screen 310.

  In addition, after the display of the use promotion screen 310 is finished, if a certain time elapses without any screen operation, the use promotion screen 310 is displayed again. Even a different user can recognize that there is a recommended function that is used infrequently.

  In the present embodiment, an example has been described in which the use promotion screen 310 is displayed with the observation enhancement function whose use frequency is lower than the determination threshold as the recommended function. For example, in the observation enhancement function in which the usage frequency is below the determination threshold, an observation enhancement function related to or similar to a function with a high usage frequency is displayed as a recommended function on the usage promotion screen 310. There may be. A similar function is, for example, a separate function that can achieve the same kind of effect for a certain function. The related functions include, for example, a reflection removal function for the resolution improvement function, and an image connection function for a function for moving the stage 65 and a function for photographing at a high magnification.

  Further, as a method of selecting a recommended function, when the frequency of use of a certain function is below the determination threshold, it may be determined which function is to be displayed in consideration of the frequency of use of other functions. For example, if the frequency of use of the autofocus function and the resolution enhancement function is below the threshold for judgment, both are subject to guide display, but if the user has a record of using the reflection removal function, the image quality is the same as the reflection removal. The resolution improvement function in the improvement classification is not used intentionally by the user, but the resolution improvement function is excluded from the candidates for the guide display target, and the autofocus function, which is another depth improvement classification, is displayed as a guide. May be.

  Further, based on the opposite concept, it is also possible to display a guide for a resolution improvement function, which is the same classification of image quality improvement, assuming that the function is similar to a function that has been used by the user but not used by the user.

  Further, when the user uses the magnification observation apparatus 1 for the first time, all the usage frequencies of the observation enhancement function are zero. In such a case, you may make it display one by one in an order from a high priority among the several observation improvement functions defined beforehand. For example, a setting may be made such that the priority related to hardware is high and the priority decreases in the order of illumination / brightness and shooting settings.

  In addition, when display is required with the same priority, a guide for the function that has not been used most recently may be displayed.

  Further, the observation enhancement function may be determined for each recommended function as shown in FIG. 6, or the functions in the large classification are based on the use history for each large classification such as measurement / scale and depth improvement. May be recommended. For example, when the use frequency of the depth enhancement function is equal to or less than the determination threshold, the function within the large classification may be displayed as the recommended function.

DESCRIPTION OF SYMBOLS 1 Magnification observation apparatus 2 Head unit 21 Camera 211 Image pick-up element 22 Lens part 221,221a, 221b Objective lens 222 Rotating shaft 3 Transmission cable 31 Control cable 32 Illumination light transmission cable 4 Controller 41 Display part 42 Power button 5 Operation part 51 Keyboard 52 mouse 53 console 6 support base 60 base part 61 support part 62 head mounting arm part 63 Z drive part 64 lens detection part 65 stage 65a placement surface 66 XY drive part 67 stage adjustment part 68 tilt part 71 coaxial incident illumination part 72 ring Illumination unit 73 Transparent illumination unit 8 Mouse pointer 101 Usage history generation unit 102 Usage history storage unit 103 Usage frequency calculation unit 104 Determination threshold storage unit 105 Presentation file storage unit 106 Usage promotion screen display unit 107 Power supply device 108 Peripheral device connection detection unit 109 Machine Execution unit 110 imaging condition specifying unit 111 imaging setting storage unit 112 an imaging control unit 113 monitor screen display unit 300 monitor screen 310 used prompt screen

Claims (8)

A stage for placing an observation object;
Illuminating means for illuminating the observation object on the stage with illumination light;
A camera that receives reflected light or transmitted light of the illumination light, detects the amount of received light, and images the observation object;
A lens unit whose optical axis is matched with the camera and optically coupled;
Monitor screen display means for displaying a captured image captured by the camera on a monitor screen;
A function execution unit having a plurality of observation enhancement functions and executing the observation enhancement function designated by the user;
Use history storage means for storing the use of the observation enhancement function as a use history;
Based on the usage history, a usage frequency calculation means for obtaining a usage frequency for each observation enhancement function;
Determination threshold value storage means for holding a determination threshold value determined for each observation enhancement function;
Using the observation enhancement function whose use frequency is lower than the determination threshold as a recommended function, and a use promotion screen display means for displaying a use promotion screen for prompting the use of the recommended function on the monitor screen. A magnifying observation device.   The said use promotion screen display means displays the said use promotion screen, when the usage frequency of the said observation improvement function different from the said recommended function is more than the corresponding determination threshold value. Magnifying device.   The said use promotion screen display means terminates the display of the said use promotion screen based on screen operation with respect to area | regions other than the said use promotion screen, operation of a microscope, or operation to an operation part. 2. The magnification observation apparatus according to 2.   The magnification observation apparatus according to claim 1 or 2, wherein the use promotion screen display means ends the display of the use promotion screen based on the start of use of the observation enhancement function other than the recommended function.   The said use promotion screen display means displays the said use promotion screen again, if a fixed time passes without screen operation being performed after complete | finishing the display of the said use promotion screen. Or a magnifying observation device according to 4;   The magnification observation apparatus according to claim 1, wherein the use promotion screen display unit displays an operation method for using the recommended function on the use promotion screen. A rotation axis perpendicular to the light receiving axis of the camera and the lens unit, the camera and the lens unit being supported rotatably about the rotation axis parallel to the stage, and the light receiving axis with respect to the stage And further supporting means for inclining,
The magnified observation according to claim 1, wherein the observation enhancement function includes a function of observing the observation object in a state where the light receiving axis is inclined with respect to the stage. apparatus.   The magnification observation apparatus according to claim 1, further comprising a driving unit that relatively moves the stage, the camera, and the lens unit.

Images