JPH08146302A - Microscope system - Google Patents

Abstract

PURPOSE: To provide a microscope system which can specify a desired photometric area having an optional shape with high resolution for a sample image simple in constitution, and excellent in operability. CONSTITUTION: The sample image observed by a microscope 11 is picked up by a television camera 15, the sample image is displayed on a display device 18 by a video signal obtained by the picture pickup, the photometric area having the optional shape is specified so as to be superimposed on the specimen picture on the screen of the display device 18 by the operation of a photometric area input part 17, the photometric value of the photometric area is found by an arithmetic part 164 by the photometric area specification, and exposure time obtained when the microscope 11 performs photographing is decided based on the photometric value.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a microscope system having a function of taking a photograph of a specimen image observed with a microscope.

[0002]

2. Description of the Related Art Conventionally, there is a microscope system having a function of taking a photograph of a specimen image observed with a microscope. In photography with such a microscope system, however, when the observation image is photographed, the specimen or the spectroscopic method causes a large difference in luminance between the specimens, and high luminance portions or low luminance portions are scattered.

Therefore, when taking a photograph of such a specimen, it is conceivable that the exposure amount is determined by averaging the two. However, if this is done, the brightness of the scattered portions is backed up. Sometimes it is buried in the ground and the exposure is improper. In particular, in a fluorescence microscope that detects a fluorescently labeled protein or gene on living tissues or cells, the above-mentioned tendency is strong because the high-brightness part where the background is dark and emits fluorescence is scattered. If you do, there is a problem that it is regarded as a low-brightness sample, resulting in an overexposed photograph.

Therefore, conventionally, as disclosed in Japanese Unexamined Patent Publication No. Hei 5-164971, the photometric portion is moved to a position desired by the photographer by looking through the eyepiece lens before taking a photograph.
There is a method in which this is confirmed in an observation image, and the designated area is metered, and the exposure time is calculated to obtain an appropriate exposure.

According to this method, the index image for designating the photometric region on the sample image is projected on the observation optical path and the photometric optical path, and the photometric sensor detects the index image to determine the photometric region. Therefore, the photometric region can be confirmed by the operator through the eyepiece lens, and in the photometric process, the photometric region can be detected from the output difference of the light receiving sensor between when the index image is projected on the light receiving surface and when it is not. The photometry operation can be performed in the photometry area determined by this, and the shooting can be performed with the calculated exposure time.

However, in the above method, the photometric area designated through the eyepiece lens may not be completely included in one pixel of the matrix of the light receiving sensor. For example, when a small area is designated or near the contour of the designated area.

In such a case, it is impossible to divide the area into smaller areas. Therefore, in Japanese Patent Application No. 6-34549, an accurate exposure amount is obtained by using a weighting coefficient converted from the occupied area of the designated area. Is calculated.

On the other hand, not only taking photographs but also automating the operation of each part of the microscope system, switching magnification of the objective lens,
An optical filter, an optical path, an in-focus position, and a photo taking operation are automatically put into practical use.

FIG. 10 shows an example of such a microscope system. 1 is a microscope, 2 is a camera for photographing,
Reference numeral 3 is a photometric and camera optical path splitting unit, and 4 is an operation unit having an operation menu display unit forming a touch panel for controlling the microscope 1. The operation unit 4 is provided separately from the microscope 1.

With such a structure, the operating section 1 can be used at a position where an observer can easily operate. Generally, in the case of a microscope observing system in which the operation unit 1 is separated and can be remotely operated, a touch panel is operated on the operation menu display unit of the operation unit 1 to give a control signal to the microscope 1 to operate the microscope 1. Each part will be automatically operated.

In this case, in the operation section 4, the operation menu display section displays the operation menu for each operation item in order to recognize the current operation and setting and to improve the visibility. Then, by pressing the position right above the selection area of the display menu on the touch panel of the operation menu display unit, the menu is selected.

In this manner, since the operation section 4 selects and operates the operation item from the displayed menu image,
There are no operational mistakes because the operation contents and status can be grasped accurately and it is easy to use. Further, since the optimum menu screen can be switched depending on the item, efficient work can be performed.

A small-sized panel type display is mainly used as such a menu display, but a panel type plasma display may be used, for example.

As described above, in the microscope system as described above, the operation section 4 can be used as a control section to confirm the setting and perform operations such as switching the optical path and taking a picture. Therefore, it is widely used at present.

[0015]

However, each of the above-mentioned techniques has the following problems. First, the one disclosed in Japanese Patent Laid-Open No. 5-164971 is good in that the photometric portion can be confirmed by the measurer, but due to the structure, it is an optical sensor such as a photometric area sensor attached to the microscope main body or an index LED for confirming the photometric position. The system and photometric mechanism become complicated and large. Further, since the designated shape of the photometric area is determined by the shape of the index, the area can be designated only in a limited circular shape. Furthermore, since the operation proceeds in the order of the photometric region detection step, the photometric step, and the imaging step as the imaging sequence, the number of processing steps is too many, which is time-consuming and inefficient. Further, in the photometric processing, the exposure time of the photometric region is determined from the output data when the index image is projected and the output data when the projection of the index image is eliminated, so the exposure time processing method and processing time are limited. .

Further, in the case of Japanese Patent Application No. 6-34549, the number of divisions of the photometric area is small, and the shape for designating the photometric position is limited. Therefore, it is not possible to divide the photometric area more finely. For example, the photometric sensor currently used divides a 35 mm × 24 mm shooting area of a 35 mm camera into about 20,000 pixels, but at this level the number of divisions is too small to allow detailed designation. For this reason, since the area of the minimum unit of photometry is large, the actual photometry area to be measured becomes larger than the designated photometry area to be obtained when designating a small light emitting portion, or becomes smaller near the contour. Specifically, as shown in FIG. 11, in a 35 mm camera shooting area of 35 mm × 24 mm, the minimum unit area of one pixel on the light receiving surface of the photometric sensor is about 0.2 mm × 0.2 mm. In order to specify a smaller photometric area, a troublesome process is required in which the exposure amount is calculated by multiplying the coefficient calculated from the occupied area of the designated photometric area.

The present invention has been made in view of the above circumstances, and provides a microscope system capable of designating a desired photometric region for a sample image with a high resolution and an arbitrary shape and having a simple structure and excellent operability. The purpose is to

[0018]

According to the present invention, in a microscope system having a function of photographing a sample image to be observed with a microscope, a photometric value of a predetermined area is obtained from a video signal of the sample image, and the photometric value is obtained. The exposure time at the time of taking the photograph is determined based on the value.

Further, the present invention provides a microscope system having a function of taking a photograph of a specimen image observed by a microscope,
A video image pickup means for picking up the sample image and outputting a video signal, a display means for displaying a sample image from the video signal output from the video image pickup means, and a sample image superimposed on the screen of the display means. , A photometric area designating means for designating a photometric area of an arbitrary shape, and a computing means for determining a photometric value of the photometric area designated by the photometric area designating means and determining an exposure time at the time of photographing based on the photometric value. It is composed of and.

Further, the present invention provides a microscope system having a function of taking a photograph of a specimen image observed by a microscope,
It corresponds to a video image pickup means for picking up the sample image and outputting a video signal, a display means for displaying a sample image by the video signal output from the video image pickup means or an operation menu of the microscope, and a display screen of the display means. And an operation unit having a touch panel switch provided on the operation unit, and a calculation for determining a photometric value of a photometric area for the sample image designated by the touch panel switch of the operation unit, and determining an exposure time at the time of photographing based on the photometric value. And means.

[0021]

As a result, in the present invention, the image signal of the microscope image is used to determine the exposure time at the time of taking a photograph from the photometric value. By the way, by setting the image pickup position of the television camera to the same size as the sample image with the same focus, it is possible to specify the photometric region of the microscope sample image with an arbitrary shape with high resolution, and it is possible to specify a plurality of regions. For example, if the video signal has the NTSC signal band, the resolution limit is 720 pixels × 480.
If all the effective areas of the pixels are photometric areas, it is possible to provide a resolution equivalent to about 350,000 pixels. Also,
Since you do not need any area sensor for photometry, the index for checking the photometric position projected on the observation surface, the complicated and enormous optical system and mechanism for arranging it, you only have to prepare the TV camera and the optical path of the shooting camera. , Its configuration can be greatly simplified.

Further, according to the present invention, the photometric area can be displayed simultaneously with displaying the sample image, and the photographer can be surely recognized without looking through the eyepiece lens.
Further, according to the present invention, the photometric area can be displayed on the operation menu screen in a superimposed manner with the sample image, and these inputs can be performed on the touch panel, so that the operation can be dramatically simplified.

[0023]

Embodiments of the present invention will be described below with reference to the drawings. (First Embodiment) FIG. 1 shows a schematic configuration of the first embodiment. In the figure, 11 is an optical microscope, and this microscope 1
1 has a lighting device 12. Further, a camera 14 for photographing and a television camera 15 for photographing a microscope sample are connected to the microscope 11 via a camera optical path division unit 13. The camera optical path splitting unit 13 is for splitting the optical path to the camera 14 for taking a picture or the television camera 15 for taking a picture of a microscopic specimen so as to match the specimen surface with the same focal position.

Then, a television camera 1 for photographing a microscope sample.
An exposure amount calculation unit 16 is connected to 5. The exposure amount calculation unit 16 measures the exposure amount by photometrically measuring a plurality of arbitrary areas of a microscope image, and stores an A / D converter 161 for converting a video signal into an analog signal, digital image data, that is, photometric data. Image memory 1 for
62, a memory control unit 163 for controlling the image memory 162 to control the synchronization of the image data, a photometric region to be displayed, and a calculation unit 164 for performing a desired calculation on the photometric region, and the entire exposure control unit. C
It comprises a PU 165 and a D / A converter 166 for converting image digital data into analog data. here,
The CPU 165 is an image memory 16 that stores photometric data.
2 can be read and written randomly, and the area to be measured from the photometric area input unit 17 is detected, and
Data such as a photometric value in the arithmetic unit 164 is managed, and a control signal is output to the microscope 11 as exposure data for photography. In addition, 18 is a D / A converter 166.
It is a display device for displaying image data converted into analog data as a sample image or a photometric area.

However, when a microscope image is taken in from the microscope 11 to the microscope sample photographing TV camera 15 through the camera optical path division unit 13, the video signal picked up by the CCD of the TV camera 15 is stored in the memory controller. It is A / D converted by the A / D converter 161 at a cycle of a predetermined clock from 163, and stored in the image memory 162 under the control of the memory control unit 163. The image data stored in the image memory 162 becomes photometric data.

Here, the A / D converter 161 converts the A / D
If the clock used for conversion determines the maximum number of divisions of the photometric area and the clock is made high speed, a large amount of data with high resolution can be obtained. In this case, FIG. 2 shows a typical example of the image pickup device 1 pixel size corresponding to the film surface. The image pickup device 1 pixel size here is 0.05 mm.
It becomes about 0.05 mm, and a resolution 16 times larger than that of one pixel of the light receiving surface of the photometric sensor shown in FIG. 11 can be obtained. This change in the number of pixels can be changed by changing the clock cycle according to the system requirements.

The image data of the sample is digital-analog converted by the D / A converter 166 through the arithmetic unit 164 and displayed on the display device 18 as a sample image. Then, the side light area input unit 17 specifies a photometric area for the sample image displayed on the display device 18. Then
Based on the information on the designated photometric area, the CPU 16
The metering data stored in the image memory 162 is read in accordance with the instruction No. 5, and the exposure amount is calculated from the data of the metering area designated by the calculator 164. The calculation in this case uses, for example, integration or pixel addition.

Then, the exposure amount obtained as a result of calculation in the calculation unit 164 is sent from the CPU 165 to the microscope 11 as a control signal and becomes exposure data for photographing. In this case, it is possible to superimpose the sample image and the photometric area using the arithmetic unit 164 and simultaneously display which part of the photometric area is planned and where the photometric area is.

FIG. 3 shows a schematic structure for realizing such overlapping display of the photometric areas. In this case, the photometric area memory 19 for storing the data of the designated photometric areas.
1. Memory 19 for holding display brightness data in the photometric area
2 and an image output selection unit 193 that selectively outputs image data or photometric area data according to a selection signal.
When the photometric area data designated in the photometric area memory 191 is set by the reference numeral 65, if the photometric area data exists by the selection signal according to the photometric area data of the photometric area memory 191, the display brightness of the photometric area from the memory 192 is displayed. Data is obtained as an image output through the image output selecting unit 193, and if there is no photometric area data, only normal image data is obtained as an image output.

On the other hand, in order to specify the photometric area by the side light area input section 17, as an example, as shown in FIG. 4, a text screen is displayed by superimposing it on the sample image 181 on the display device 18 to specify the area. A convenient arrow 182 is displayed.

A mouse 171 is used as an input means of the side light area input unit 17, and a mouse 171 is used to specify a photometric area and a photometric point for the sample image 181 while moving an arrow 182. In this way, the sample image and the designated area can be displayed simultaneously, so that the designated area can be confirmed on the display device 18 without the necessity of looking through the eyepiece lens and making designation as in the conventional case.

In this case, in the case of the sample image 181, as shown in FIG. 5A, it is only necessary to move the arrow 182 along the sample image 181 as shown in FIG. 5B while operating the mouse 171. , It is possible to specify the side light area with pixel-by-pixel accuracy.

By doing so, it is possible to specify any shape, such as a circle or rectangle, so that it overlaps the contour of the photometric area, and to specify a plurality of photometric areas, whereby light is emitted. Only the required area can be selected, and accurate photometry is possible.

The input means of the side light area input section 17 is
Not limited to a mouse, a joystick, a trackball, a dome point, etc. can also be used. In addition, the calculation unit 164 not only performs simultaneous display of the sample image and the photometric area, but also includes a plurality of adders 194, a plurality of adders 194, as shown in FIG. Of the adder 194 and the adder 195 and the image data are input to the adders 194 and 195, respectively.
Then, the arithmetic unit 195 performs arithmetic operations such as averaging processing and adjacent pixel addition. in this case,
Since a plurality of adders 194 and arithmetic units 195 are provided, a plurality of processes can be performed in parallel.

Then, the arithmetic operations in the adder 194 and the arithmetic unit 195 are executed for each pixel based on the data in the photometric area memory 191, and the result is calculated by the CPU 16
It will be sent to 5.

Therefore, according to such a first embodiment,
The television camera 15 captures a sample image to be observed with the microscope 11, and the sample image is displayed on the display device 1 by the captured video signal.
8, the photometric region input unit 17 is operated to designate a photometric region of an arbitrary shape on the screen of the display device 18 so as to be superimposed on the sample image, and the arithmetic unit 1 is designated by the photometric region designation.
The photometric value of the photometric region is obtained by 64, and the exposure time of the microscope 11 at the time of taking a picture is determined based on the photometric value. Considering almost the same as the area, the photometric area of the microscope specimen image can be designated with an arbitrary shape with high resolution, and more than one area can be designated, and accurate photometry can be performed. For example, in the case of a video signal having an NTSC signal band, if the entire effective area of resolution limit of 720 pixels × 480 pixels is the photometric area, it is possible to provide a resolution equivalent to about 350,000 pixels. In addition, as compared with the conventional one that requires an area sensor for photometry, an index for confirming the photometric position projected on the observation surface and a complicated and enormous optical system and mechanism for arranging the index, the observation optical path has a camera, Since it can be limited to only the TV camera, the entire configuration including the optical system can be simplified. (Second Embodiment) FIG. 7 shows a schematic configuration of the second embodiment, and the same parts as those in FIG. 1 are designated by the same reference numerals.

The second embodiment is an NTSC color camera 1 which is usually often used as a television camera for photographing a microscope sample.
In this case, the NTSC color camera 15 outputs a color signal, and therefore the exposure amount rendering unit 16 converts the NTSC composite signal into a luminance signal component (Y) and a color signal component (Y). C / Y separating unit 167, a separating unit 168 separating the separated luminance signal into a synchronizing signal to form a reference synchronizing signal, and a PLL 169 and Y generating a synchronized reference clock based on the synchronizing signal. It has a synthesizing unit 170 which outputs an NTSC composite signal based on C.

However, in the case of such a configuration,
The luminance component of the color signal is used as the photometric data, and the subsequent processing is the same as in FIG. 1 described above. Further, in the display on the display device 18, the synthesizing unit 170 outputs an NTSC composite signal based on Y and C to perform color display. Regarding the display here, the S signal (Y, C) may be displayed without using the synthesizing unit 170, or the black and white display of only Y may be performed. Also, R
The exposure amount may be calculated for each component of R, G, B if the system is a system in which a GB decoder processes each R, G, B separately.

In addition, the same level of resolution as described above can be obtained for the television cameras of the PAL and SECAM signal systems. Further, if the television camera is capable of picking up an image in a higher band, it is possible to specify the photometric area with higher resolution. For example, a high-definition type camera can obtain higher resolution. (Third Embodiment) FIG. 8 shows a schematic configuration of the third embodiment. The same parts as those in FIG. 1 are designated by the same reference numerals.

The third embodiment shows an example in which an operation section having an operation menu display section having a touch panel is used as an operation section for controlling the microscope 11. In this case, the operation unit 20 includes a plasma display 201 that displays a sample image and also displays a control and operation menu of the microscope 1, and a touch panel switch 202 provided corresponding to the display screen of the plasma display 201. The sample image stored in 162 is displayed on the plasma display 201, and the touch panel switch 202 is used to specify the photometric region on this display screen.

Here, the sample image on the plasma display 201 is displayed as shown in FIG. 9A, and the transparent touch panel switch 202 is arranged thereon with a matrix switch of dotted line. In this case, one matrix of the touch panel switch 202 corresponds to one switch, and the photometric area can be designated by an input with a human finger.

FIG. 9B shows a screen in which the area is designated. In this case, the portion shown by the solid line is the designated range, and the frames a and b
Will be specified. Further, since such a switch matrix has a coarse number of divisions, the frame may not completely include a selected area like the frame a. In that case, that part can be enlarged and displayed to make more detailed settings. FIG. 9C shows an example in which the settings are finely set. In this way, the image can be enlarged and displayed in accordance with the frame of the switch matrix so as to be selected.

Then, the photometric area thus selected is displayed on the display device 18 through the arithmetic unit 164 in the same manner as the above-described processing, and is displayed in a superimposed manner with the sample image. In this way, even if the specimen display screen is all switched to the menu selection screen on the operation unit 20, it is possible to confirm the photometric region and view the specimen image on the display device 18.

Therefore, according to such a third embodiment,
Since the touch panel switch 202 is provided for the sample image on the plasma display 201 of the operation unit 20 to integrate the input designation portion of the photometric area, the designation input of the photometric area can be made easier.

In this third embodiment, the value display plasma display 201 is used, but not limited to this, a multi-valued plasma display, a color plasma display, an electroluminescence display (EL display), a light emitting diode display ( A panel type display such as an LED display) can also be used. Here, when the color plasma display 201 is used, the color signals described in the previous embodiment are processed in the same manner, and color display on the operation unit 20 becomes possible.

If an analog input type touch panel is used instead of the matrix-shaped touch panel switch 202, the input can be designated by tracing the contour of the light emitting portion of the sample in an analog manner with a pen input or the like, which can be more easily used.

Although the above description is based on the embodiments, the present invention also includes the following inventions. (1) In the microscope system according to the second aspect, the image pickup means is a monochrome camera.

(2) In the microscope system according to the second aspect, the image pickup means is an NTSC type camera. (3) In the microscope system according to the second aspect, the image pickup means is a PAL type camera.

(4) In the microscope system according to the second aspect, the image pickup means is a SECAM type camera. (5) In the microscope system according to the second aspect, the image pickup means is a high-definition type camera.

(6) In the microscope system according to the third aspect, the image pickup means is a monochrome camera. (7) In the microscope system according to the third aspect, the image pickup means is an NTSC camera.

(8) In the microscope system according to the third aspect, the image pickup means comprises a PAL system camera. (9) In the microscope system according to the third aspect, the image pickup means is a SECAM type camera. (10) In the microscope system according to the third aspect, the image pickup means is a high-definition type camera.

[0052]

As described above, according to the present invention, when determining the exposure time during photography from the photometric value, the photometric region of the microscope sample image can be designated with a high resolution in an arbitrary shape.
Moreover, it is possible to specify a plurality of areas, obtain an appropriate amount of exposure with accurate photometric values, and realize optimal photography.

In addition, the conventional photometric area sensor, the indicator for confirming the photometric position projected on the observation surface, the complicated and enormous optical system for arranging the index, the mechanical mechanism, etc. are not required at all, and the image is taken with the television camera. Since it can be realized only by the optical path of the camera, its configuration can be greatly simplified.

At the same time that the sample image is displayed, the photometric area can also be displayed, and the photographer can be surely recognized without looking through the eyepiece lens. In addition, the photometry area can be displayed on the operation menu screen in a superimposed manner,
Moreover, since these inputs can be performed on the touch panel, the operation can be dramatically simplified.

[Brief description of drawings]

FIG. 1 is a diagram showing a schematic configuration of a first embodiment of the present invention.

FIG. 2 is a diagram showing a typical example of a pixel size of the image sensor of the first embodiment.

FIG. 3 is a diagram showing a schematic configuration for realizing overlapping display of photometric areas according to the first embodiment.

FIG. 4 is a diagram for explaining a photometric area designation by a side light area input section of the first embodiment.

FIG. 5 is a diagram for explaining designation of a photometric area in the first embodiment.

FIG. 6 is a diagram for explaining another example of the arithmetic unit of the first embodiment.

FIG. 7 is a diagram showing a schematic configuration of a second embodiment of the present invention.

FIG. 8 is a diagram showing a schematic configuration of a third embodiment of the present invention.

FIG. 9 is a diagram for explaining the third embodiment.

FIG. 10 is a diagram showing an example of a conventional microscope system.

FIG. 11 is a diagram showing a typical example of one pixel size in the microscope system.

[Explanation of symbols]

Reference numeral 11 ... Microscope, 12 ... Illumination device, 13 ... Camera optical path splitting unit, 14 ... Photographing camera, 15 ... Microscope specimen photographing TV camera, 16 ... Exposure amount calculation unit, 161 ... A
/ D converter, 162 ... Image memory, 163 ... Memory control section, 164 ... Arithmetic section, 165 ... CPU, 166 ... D
/ A converter, 167 ... Y / C separation section, 168 ... Sync separation section, 169 ... PLL, 170 ... Combining section, 17 ... Side light area input section, 171 ... Mouse, 18 ... Display device, 181
... specimen image, 182 ... arrow, 191 ... photometric area memory, 1
92 ... Memory, 193 ... Image output selection section, 194 ... Adder, 195 ... Calculation section, 20 ... Operation section, 201 ... Plasma display, 202 ... Touch panel switch.

Claims (3)

[Claims] 1. A microscope system having a function of taking a photograph of a specimen image to be observed with a microscope, wherein a photometric value of a predetermined area is obtained from a video signal of the specimen image, and the photographed time is taken based on the photometric value. A microscope system characterized by determining the exposure time of the. 2. A microscope system having a function of photographing a sample image to be observed with a microscope, comprising: a video image pickup means for picking up the sample image and outputting a video signal; and a video signal outputted from the video image pickup means. Display means for displaying a sample image, a photometric area designating means for designating a photometric area of an arbitrary shape so as to be superimposed on the sample image on the screen of the display means, and a photometric area designated by the photometric area designating means. A microscope system, comprising: a calculation unit that obtains a photometric value and determines an exposure time at the time of taking the photograph based on the photometric value. 3. A microscope system having a function of photographing a sample image to be observed with a microscope, comprising: a video image pickup means for picking up the sample image and outputting a video signal; and a video signal outputted from the video image pickup means. Display means for displaying a sample image or an operation menu of the microscope, and operating means having a touch panel switch provided corresponding to the display screen of the display means, and a photometric area for the sample image designated by the touch panel switch of the operating means. And a calculation means for determining the exposure time at the time of taking the photograph based on the photometric value.