JP2002196257A - Image processor, computer readable recording medium and microscopic system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable an operator to carry out display processing so as to make images easily discriminatable with an image processor for making display processing of the images, a computer readable recording medium recorded the program in order to function as image processor and a microscopic system for displaying the images acquired by a microscope. SOLUTION: This image processor has a region information storage means which receives the external operation to assign an arbitrary region within the images and stores the region information indicating the assigned region by this external operation correspond to the image and a display means which extracts the region image from the images in correspondence to the region information and displays this region image. The display means enumerates and displays the plural region images assigned by the region information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus for performing image display processing, a computer-readable recording medium storing a program for causing a computer to function as the image processing apparatus, and a computer-readable recording medium. The present invention relates to a microscope system for displaying images.

[0002]

2. Description of the Related Art In the medical, research, and industrial fields,
At the time of microscopy, particularly when the data to be handled is enormous, a microscope system including a microscope, an electronic camera, and a personal computer may be used. According to such a microscope system, an operator takes a desired sample image into a personal computer, displays the image on a display or prints the image on a paper surface, edits such as enlargement / reduction, a hard disk, an optical disk, and the like. Various operations such as saving to a remote location and sending to a remote location can be easily performed.

[0003] Hereinafter, it is used in fields such as medical care and research,
In particular, a microscope system for a living body for acquiring an image of a living body specimen will be described. FIG. 15 is a diagram showing a display screen of the microscope system for living body use. In the display screen 101, a moving image screen 101b for displaying a live image of a specimen
And a still image screen 101a for displaying a still image are arranged side by side.

[0004] Both the live image and the still image show images of the same specimen, but the live image is an image sequentially sent from an electronic camera, and has a low spatial resolution due to the importance of the transfer rate. It is an image. On the other hand, the still image is a still image obtained by giving an instruction to the electronic camera, and is a fine image with a high spatial resolution suitable for observation.

[0005] In a microscope system for a living body, the operator mainly observes a specimen, and often displays and saves a still image having a large amount of spatial information.
As shown in the figure, the still image screen 101a is displayed larger. The operator performs various settings of the microscope and the electronic camera while checking the rough state of the sample by visually observing the live image displayed relatively small, and presses the photographing button 101c when these settings are completed. select.

On the electronic camera side, the imaging device is driven in accordance with this operation to capture a fine still image. The personal computer captures the still image thus captured and newly displays it on the still image screen 101a.
The operator can save a necessary still image from among the still images of the specimen displayed in this way to a hard disk or the like of a personal computer by a predetermined operation.

[0007] The display screen 101 includes a thumbnail screen 10 for displaying a list of previously captured still images as thumbnail images further reduced from the live images.
1d are arranged, and the operator can use the same display screen 10
It is also possible to compare a still image newly photographed on 1 with a still image photographed before (corresponding to a thumbnail image).

[0008]

However, in the thumbnail screen 101d, since the entire still image previously captured is displayed as a thumbnail image, a similar still image (for example, a specimen in the process of microscopy) is displayed. (For example, an image in which only a minute area has changed, an image in which only the focus has changed, etc.) are displayed as thumbnail images, it is difficult for the operator to distinguish the difference. Therefore, there is a problem that a desired image cannot be easily determined only by referring to the thumbnail image.

In recent years, the resolution of an electronic camera has been increased, and even an image obtained by enlarging a fine area from an entire image of a specimen by image processing can be displayed as an image that can withstand observation. Therefore, even when observing a process in which a minute region of a specimen changes, an operator often photographs only the entire image of the specimen without capturing an image in which the region is enlarged. Therefore, similar images are often displayed as thumbnail images, and the above-described problem is likely to occur.

It should be noted that some microscope systems have a function of displaying a character string indicating an imaging condition and the like together with a thumbnail image. However, since such a character string is difficult for an operator to read, it is not efficient to determine each thumbnail image based on an imaging condition or the like indicated by the character string. Therefore, the present invention provides an image processing apparatus capable of performing display processing so that an operator can easily identify an image, a computer-readable recording medium storing a program for causing a computer to function as the image processing apparatus, and It is an object to provide a microscope system.

[0011]

Here, the contents corresponding to the embodiments described later are shown in parentheses, but such descriptions in parentheses do not limit the invention. The image processing apparatus according to claim 1, receives an external operation (an instruction to change the attention frame 141g from the operator) for specifying an arbitrary region in the image, and receives region information indicating the region specified by the external operation. Region information storage means for storing (attention frame information: the size and position of the attention frame 141g) in association with the image, and extracting the region image from the image based on the region information, and displaying the region image (Displaying enlarged thumbnail images). The display unit displays a list of the plurality of area images specified by the area information (displays a plurality of enlarged thumbnail images on the thumbnail screen 141f). (Displayed above).

According to a second aspect of the present invention, in the image processing apparatus according to the first aspect, the area information storage means stores an image for which the area information is not specified (a recording medium 137a by another microscope system). Is stored as area information (initial value of attention frame information) for the stored image stored in the storage area, and the external operation is performed on the image already associated with the area information. Upon receipt, the area information is updated according to the external operation.

[0013] According to a third aspect of the present invention, there is provided an image processing apparatus comprising:
3. The image processing apparatus according to claim 1, wherein the display unit switches between the area image (enlarged thumbnail image) and a reduced image obtained by reducing the image (standard thumbnail image). It is characterized by displaying. The image processing device according to claim 4 is the image processing device according to claim 3, wherein the display unit switches between the area image and the reduced image when displaying the area image and the reduced image. A different form of frame (thick frame / thin frame) is provided.

The image processing apparatus according to claim 5, wherein
The microscope system (10) in the still image display mode is the image processing apparatus according to any one of claims 1 to 4, wherein the area information storage unit stores an object (sample 11).
a) imaging means (electronic camera 1) for imaging to generate an image
When an image is generated by 2), an external operation for specifying an arbitrary region in the image is accepted, and region information for the region specified by the external operation is stored in association with the image. And

According to a sixth aspect of the present invention, there is provided an image processing apparatus comprising: an area information storage unit for storing area information (initial value of attention frame information) indicating a predetermined area in an image; A display unit that acquires the region information, extracts a region image from the image based on the region information, and displays the region image (displays a thumbnail image in an enlarged format). A feature is to display a list of area images (a plurality of enlarged thumbnail images are displayed on the thumbnail screen 141f).

According to a seventh aspect of the present invention, there is provided a computer-readable recording medium for storing a computer in a first to a sixth aspect.
A program for causing the computer to function as the area information storage unit and the display unit according to any one of the above items is recorded. A microscope system according to a ninth aspect of the present invention is a microscope system for displaying an image acquired through a microscope, comprising the area information storage unit and the display unit according to any one of the first to sixth aspects. It is characterized by.

[0017]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram illustrating a microscope system according to the present embodiment. As shown in FIG. 1, a microscope system 10 includes a microscope 11, an electronic camera 12 for acquiring an image of a sample 11a enlarged by the microscope 11, a personal computer 13, a display device 14 such as a display connected to the personal computer 13, It has an input device 15 such as a keyboard and a mouse.

FIG. 2 is a diagram showing the configuration of the personal computer 13. As shown in FIG. 2, the personal computer 13 includes a CPU 131,
A main memory 131 and a ROM 133 are connected to the hard disk 131 via a bus 134.
5, storage device 1 such as memory 136 and disk drive
37, a display controller 138, an input device interface circuit 139, and an external interface circuit 140.

The personal computer 13 is connected to the microscope 11 and the electronic camera 12 via an external interface circuit 140, the input device 15 via an input device interface circuit 139, and via a display control section 138. And the display device 14 is connected. The display control unit 138 includes a frame memory (not shown), sends image data for one frame to the display device 14 in response to an instruction from the CPU 131, and displays the display screen 141 on the display device 14. Is to be displayed.

In this embodiment, the personal computer 13 has a GUI (Graphical User Interface).
Is installed, and a display screen 141 displayed on the display device 14 by the display control unit 138 includes images for receiving various instructions and various inputs by the operator. In the present embodiment, the following “live / still image display mode” and “saved image display mode” are provided as screen display modes. The “live / still image display mode” is a mode in which a live image corresponding to a moving image sequentially transmitted from the electronic camera 12 and the latest still image captured by the electronic camera 12 and taken into the memory 136 are displayed. It is. On the other hand, in the “saved image display mode”, a still image that has already been captured and has been stored in the hard disk 135 in advance, or has been captured by another microscope system and has been stored in the recording medium 137a such as a removable disk This is a mode for displaying a still image. Hereinafter, a still image stored in the hard disk 135 or the recording medium 137a in advance is referred to as a “stored image”.

Switching between these modes is performed by an operator. When the power of the personal computer 13 is turned on, the CPU 131 displays a predetermined menu screen via the display control unit 138. Switching of the mode by the operator is accepted via such a menu screen. When switching to the stored image display mode, the operator also specifies the storage location (the hard disk 135 or the recording medium 137a) of the stored image to be displayed and the file name via the menu screen.

Further, in the present embodiment, a program for causing the CPU 131 to function as driver software for the microscope system 10 is stored in a recording medium 137a such as a removable disk. This program is installed in the personal computer 13 in advance via the storage device 137, and is executed by the CPU 131.

FIGS. 3 to 8 are operation flowcharts of the CPU 131. However, in FIG. 3 to FIG.
The operation after one of the three modes (live / still image display mode and saved image display mode) is selected by the operator. 9 to 12 are diagrams illustrating examples of the display screen 141 displayed on the display device 14. FIG.

9 to 11 show examples of the display screen 141 displayed on the display device 14 in the live / still image display mode. Display screen 141 shown in FIG.
And a part of functions related to display in the live / still image display mode will be described. In FIG. 9, a relatively large left screen 141a is arranged on the left side of the display screen 141, and a relatively small right screen 141b is arranged at a position adjacent to the right side of the left screen 141a.

On the lower side of the right screen 141b, a setting screen 141c for receiving settings such as imaging conditions and display conditions is arranged. In FIG. 9, a display condition setting screen 1 for receiving a setting of a display condition is set as a setting screen 141c.
Although 43 is displayed, on the setting screen 141c, in addition to such a display condition setting screen 143, an imaging condition setting screen for accepting setting of imaging conditions can be displayed.

On the lower side of the setting screen 141c, a photographing button 141d for accepting a photographing instruction from the operator and a save for accepting an instruction for saving a still image taken into the memory 136 by the electronic camera 12 into the hard disk 135 are taken. Button 141e is arranged. Left screen 141a
On the lower side, a thumbnail screen 1 for displaying a still image already captured in the memory 136 as a thumbnail image
41f is arranged.

In this embodiment, a live image is displayed on one of the left screen 141a and the right screen 141b.
On the other hand, the latest still image captured in the memory 136 is displayed. On the live image, an attention frame 141g indicating a region of interest in the live image is displayed.
Note that the main memory 132 stores attention frame information indicating the size and position of the attention frame 141g to be displayed on the live image. Such attention frame information is stored in the memory 136 in association with the still image when the still image is taken into the memory 136.

In this embodiment, the thumbnail screen 1
As the display format of 41c, the following “standard format” and “enlarged format” are provided. "Standard format" is memory 1
In this format, the entirety of the still image captured in 36 is reduced and displayed as a thumbnail image. "Expanded format"
Extracts an area image corresponding to the attention frame 141g at the time of imaging based on the attention frame information stored in the memory 136 in association with the still image, and extracts the extracted area image (partial image). This format is displayed as a thumbnail image.

In the present embodiment, whether the live image is displayed on the left screen 141a or the right screen 141b,
Display relation information indicating whether the thumbnail screen 141c is displayed in the standard format or the enlarged format is stored in the main memory 132. On the display condition setting screen 143, setting of a screen for displaying a live image is received. The instruction to display the thumbnail screen 141f in the standard format is issued by the standard display button 14
An instruction to display the thumbnail screen 141f in an enlarged format is received via the enlarged display button 143b. The display-related information is updated according to the settings and instructions accepted in this way. FIG. 9 shows a condition in which a live image is displayed on the left screen 141a.
Further, a state is shown in which the standard display button 143a for displaying the thumbnail screen 141f in the standard format is selected.

The size and position of the attention frame 141g are as follows.
For example, the change can be made by dragging the mouse or inputting a numerical value by the operator, and the attention frame information is updated according to such a change. The display-related information and the attention frame information are based on the power of the personal computer 13.
It is assumed that the contents are stored not only in N / OFF but also in the hard disk 135 in addition to the main memory 132 so that the contents are retained. However, if the operator has never changed the attention frame, the attention frame 141g having a size of 25% of the live image is displayed in the center of the live image as an initial value in the attention frame information. It is assumed that the information indicating that is set.

The attention frame information is stored on the hard disk 135 together with the still image when the save button 141e is selected by the operator. Hereinafter, with reference to FIGS. 3 to 6, the CPU 13 in the live / still image display mode will be described.
1 will be described, and then the operation of the CPU 131 in the saved image display mode will be described with reference to FIG.

<< Processing in Live / Still Image Display Mode >>
When the live / still image display mode is selected by the operator, the CPU 131 copies the display relationship information and the attention frame information in the hard disk 135 to the main memory 132, and displays the information in accordance with the display relationship information and the attention frame information. Screen 1
41 is displayed on the display device 14 via the display control unit 138 (step S1 in FIG. 3).

Next, the CPU 131 obtains a signal from the input device 15 (step S2 in FIG. 3), and determines what kind of operation has been performed by the operator based on the signal (step S3 in FIG. 3). S3). And CPU1
31 performs one of the following processes (steps S4 to S11 in FIG. 3) according to the result of the determination, and thereafter repeats the processes in and after step S2 in FIG.

<< Processing when a setting screen is selected >>
When the setting screen is selected by the operator, the CPU
131 displays the setting screen selected by the operator via the display control unit 138 (step S in FIG. 3).
4). That is, when “display” at the top of the setting screen 141c is selected by the operator, the display control unit 138 displays the display condition setting screen 143 as shown in FIG. 9, and the operator selects “display” at the top of the setting screen 141c. When "imaging" is selected, an imaging condition setting screen is displayed.

<< Processing when a condition is selected / input on the imaging condition setting screen >> When an operator selects / inputs a condition on the imaging condition setting screen, the CPU 131
Updates various settings of the microscope 11 and the electronic camera 12 based on the conditions (step S5 in FIG. 3). << Processing when an instruction to change the attention frame is performed >> When an instruction to change the attention frame 141g is given by the operator, C
The PU 131 displays the frame of interest 140g via the display control unit 138 based on the instruction, and
2 and the attention frame information in the hard disk 135 are updated (step S6 in FIG. 3).

FIG. 10 is a diagram showing an example of the display screen 141 when the attention frame 141g is changed by the operator while the display screen 141 of FIG. 9 is displayed on the display device 14. << Process when the Shooting Button is Selected >> When the operator selects the shooting button 141d, the CPU 131
Performs the "imaging process" shown in FIG. 4 (step S3 in FIG. 3).
7).

Here, the "imaging process" will be described with reference to FIG. << Imaging Process >> First, the CPU 131 performs imaging via the electronic camera 12 based on the settings of the microscope 11 and the electronic camera 12 at the time when the imaging button 141d is selected, and stores a still image obtained by the imaging in the memory 136. Capture (Fig. 4
Step S101).

At this time, the CPU 131 gives a file name of a predetermined format to the still image. As such a file name, for example, a name obtained by combining the date on which the image was captured, a serial number, and an extension is given. Here, the file name of the still image is automatically generated by the CPU 131, but the file name of the still image may be a name input by the operator.

Next, the CPU 131 stores the contents of the attention frame information at the time when the shooting button 141d is selected in the memory 136 as attention frame information corresponding to a new still image (step S102 in FIG. 4). At this time, the CPU 131
The attention frame information is given a file name in a predetermined format. Here, in order to associate a new still image with the attention frame information, the attention frame information is expanded from the file name of the new still image. Only children have different file names.

Next, the CPU 131 displays a display screen 141 corresponding to the display relation information and the attention frame information on the display device 14 via the display control section 138. That is, C
When the display-related information indicates that the live image is to be displayed on the left screen 141a, the PU 131 displays the attention frame 141.
A live image is displayed on the left screen 141a together with g, and a new still image is displayed on the right screen 141b. On the other hand, when the display-related information indicates that the live image is to be displayed on the right screen 141b, the live image is displayed on the right screen 141b together with the attention frame 141g, and the new still image is displayed on the left screen 141b.
Display in a.

The CPU 131 has a standard display button 143.
If the display-related information indicates that “a” is selected, the standard format thumbnail image is displayed on the thumbnail screen 14 in the same manner as in “standard format thumbnail display processing” described later.
1f, and when the display-related information indicates that the enlarged display button 143b has been selected, the enlarged thumbnail image is displayed on the thumbnail screen 141f in the same manner as “enlarged thumbnail display processing” described later. indicate.

<< Processing when the save button is selected >> When the save button 141e is selected by the operator, C
The PU 131 stores the new still image in the memory 136 and the attention frame information associated with the new still image in the hard disk 135 (step S in FIG. 3).
8). << Process When Screen Setting for Displaying Live Image is Set >> When the screen setting for displaying the live image is set by the operator, the CPU 131 determines the live image and the still image based on the set contents. Is displayed, and the display-related information in the main memory 132 and the hard disk 135 is updated (step S9 in FIG. 3).

That is, when “left” on the display condition setting screen 143 is selected by the operator, the CPU 131 displays the live image on the left screen 1 via the display control unit 138.
41a, and the still image is displayed on the right screen 141b. Further, when “right” on the display condition setting screen 143 is selected by the operator, the CPU 131 displays a live image on the right screen 141b and a still image on the left screen 141a via the display control unit 138. I do.

<< Process when the Standard Display Button is Selected >> When the operator selects the standard display button 143a, the CPU 131 displays a message indicating that the standard display button 143a is selected. Update the relevant information, Figure 5
Perform "standard-format thumbnail display processing" shown in FIG.
Step S10). Here, "standard format thumbnail display processing" will be described with reference to FIG.

<< Standard Format Thumbnail Display Process >>
The CPU 131 performs thinning processing and averaging processing using the latest four still images among the existing still images fetched into the memory 136 before the new still image to generate four standard format thumbnail images. (Step S201 in FIG. 5).

Next, the CPU 131 displays the thumbnail image in the standard format generated in this manner on the thumbnail screen 141f together with a frame constituted by a thin line (FIG. 5).
Step S202). In the present embodiment, the thin line is a thin line as compared with a frame line displayed together with the thumbnail image in the enlarged format. The above-described processing may be performed immediately after the standard display button 143a is selected by the operator, but the operator is informed that the display format of the thumbnail screen 141f is to be changed to the standard format. The change may be performed after the execution of the change is permitted by the operator.

<< Processing when Selection of Enlarged Display Button >> When the operator selects the enlarged display button 143b, the CPU 131 displays a message indicating that the enlarged display button 143b is selected. Update the relevant information, Figure 6
3 is performed as shown in FIG.
Step S11).

Here, with reference to FIG. 6, the "thumbnail display processing in enlarged format" will be described. << Enlarged Thumbnail Display Process >> First, the CPU 131
The four thumbnails in the enlarged format are obtained by using the latest four still images and the attention frame information corresponding to each of the still images among the existing still images fetched into the memory 136 before the new still image. Generate an image (Step S in FIG. 6)
301).

Next, the CPU 131 displays the thumbnail image in the enlarged format generated in this manner on the thumbnail screen 141f together with a frame constituted by a thick line (FIG. 6).
Step S302). In the present embodiment, the bold line is a line that is thicker than the frame line displayed together with the thumbnail image in the standard format. The above-described processing may be performed immediately after the operator selects the enlargement display button 143b, but the operator is informed that the display format of the thumbnail screen 141f is to be changed to the enlargement format. The change may be performed after the execution of the change is permitted by the operator.

FIG. 11 is a diagram showing an example of the display screen 141 when the operator selects the enlarged display button 143b while the display screen 141 of FIG. 9 is displayed on the display device 14. However, FIG. 11 shows the display screen 141 after the same sample 11a is repeatedly imaged in a state where the size and the position of the attention frame 141g are fixed. This indicates that the image within 141 g has changed.

<< Process in Saved Image Display Mode >>
Referring to FIG. 7, CPU in saved image display mode
The operation of the display 131 will be described. Here, the display screen 141 shown in FIG. 12 will be described first to simplify the description.

FIG. 12 shows an example of the display screen 141 displayed on the display device 14 in the stored image display mode. In FIG. 12, the left screen 141a and the thumbnail screen 141f display one of a plurality of stored images corresponding to a storage location and a file name specified by the operator. In the present embodiment, immediately after the saved display mode is selected by the operator and the storage location and the file name of the saved image to be displayed are specified, among the saved images, It is assumed that the stored image with the latest storage date and time is displayed on the left screen 141a.

On the saved image displayed on the left screen 141a, a notice frame 141g indicating a noticeable area in the saved image is displayed. Note that the attention frame information indicating the size and position of the attention frame 141g on the saved image is as follows.
Like the attention frame information in the live / still image display mode, it is stored in the main memory 132. The setting screen 141c includes a standard display button 143a for receiving an instruction for displaying the thumbnail screen 141f in the standard format, and a thumbnail screen 1
An enlarged display button 143b for receiving an instruction to display 41f in an enlarged format is provided.

Information indicating whether the thumbnail screen 141f is displayed in the standard format or the enlarged format is stored in the main memory 132 and the hard disk 135 as display-related information, as in the live / still image display mode. In addition,
FIG. 12 shows a state where the standard display button 143a is selected. On the lower side of the setting image 141c, the left screen 141
Attention frame 1 specified on the saved image displayed in a
Save button 14 for instructing storage of attention frame information for 41g
1e is displayed.

Hereinafter, the operation of the CPU 131 in the stored image display mode will be described with reference to FIG. CPU1
Reference numeral 31 denotes a designated storage location when the operator selects the stored display mode and designates a storage location (the hard disk 135 or the recording medium 137a) and a file name of the stored image to be displayed. Then, it is determined whether or not attention frame information is associated with the stored image indicated by the file name (step S401 in FIG. 7).

However, in the present embodiment, it is assumed that file names corresponding to five still images are specified by the operator. When the operator specifies a stored image stored in the hard disk 135 in the above-described live / still image display mode, attention frame information is associated with the stored image in advance, and another microscope is used. It is assumed that attention frame information is not associated with the stored image stored in the recording medium 137a by the system.

The CPU 131 determines whether or not attention frame information is associated with a saved image specified by the operator.
The stored image and attention frame information are copied to the memory 136 (step S402 in FIG. 7). Further, the CPU 131
Stores, in the main memory 132, the contents of the attention frame information having the latest storage date and time among the attention frame information corresponding to the saved image specified by the operator (step S4 in FIG. 7).
03).

On the other hand, when the attention frame information is not associated with the saved image specified by the operator, the CPU 1
31 copies only the stored image to the memory 136 (step S404 in FIG. 7), and sets an initial value to the attention frame information in the main memory 132 (step S405 in FIG. 7). In the present embodiment, the initial value of the attention frame information is set as FIG.
As shown in FIG. 2, information indicating that an attention frame 141g having a size of 25% of the left screen 141a is displayed in the center of the left screen 141a is set.

Next, the CPU 131
The display relation information in 35 is copied to the main memory 132, and a display screen 141 corresponding to the display relation information and the attention frame information set as described above is displayed on the display device 14 via the display control unit 138. (Step S406 in FIG. 7).

That is, of the five saved images specified by the operator, the saved image with the latest save date and time is displayed on the left screen 141a, and the saved image is displayed on the left screen 141a.
An attention frame 141g corresponding to the attention frame information is displayed, and the remaining four stored images that are not displayed on the left screen 141a are displayed on the thumbnail screen 141f as thumbnail images in the display format indicated by the display-related information. However,
In the present embodiment, when the attention frame information is not associated with the stored image displayed on the left screen 141a, the thumbnail image in the enlarged format is generated using the attention frame information in the main memory 132. And

Next, the CPU 131 obtains a signal from the input device 15 (step S407 in FIG. 7), and determines what the operation performed by the operator is based on the signal (step S407 in FIG. 7). S408). And C
The PU 131 performs one of the following processes (steps S409 to S414 in FIG. 7) in accordance with the result of the determination, and thereafter repeats the processes in and after step S407 in FIG.

<< Processing when a setting screen is selected >>
When the setting screen is selected by the operator, the CPU
The display 131 displays the setting screen selected by the operator via the display control unit 138 (step S40 in FIG. 7).
9). However, in the present embodiment, for the sake of simplicity, the selection of “display” or “other” at the top of the setting screen 141c is permitted in the stored image display mode.

<< Process when Thumbnail Image is Selected >> When the operator selects a thumbnail image on the thumbnail screen 141f, the CPU 131 executes the processing shown in FIG.
Is performed (step S410 in FIG. 7).

Here, with reference to FIG. 8, a description will be given of the “left screen display change processing”. << Display Change Processing of Left Screen >> First, the CPU 131 determines whether or not attention frame information is associated with the thumbnail image selected by the operator (step S5 in FIG. 8).
01). Then, when the attention frame information is associated with the thumbnail image selected by the operator, the CPU 131 updates the attention frame information in the main memory 132 with the contents of the attention frame information (step S502 in FIG. 8). . On the other hand, when the attention frame information is not associated with the thumbnail image selected by the operator, the CPU 131 sets the above-described initial value to the attention frame information in the main memory 132 (step S503 in FIG. 8).

Next, the CPU 131 sets the stored image displayed on the left screen 141a as a display target on the thumbnail screen 141f, and sets the stored image corresponding to the thumbnail image selected by the operator on the left screen 141a. A display screen 141 corresponding to the display relationship information and the attention frame information is displayed on the display device 14 via the display control unit 138.
(Step S504 in FIG. 8).

<< Processing When Instruction of Changing Attention Frame is Instructed >> When the operator instructs to change the attention frame 141g, the CPU 131 performs attention via the display control unit 138 based on the instruction. While displaying the frame 140g,
The attention frame information in the main memory 132 is updated (step S411 in FIG. 7). << Process when save button is selected >> When the save button 141e is selected by the operator, the CPU 131
Shows the contents of the attention frame information in the main memory 132 on the left screen 1
It is stored as attention frame information corresponding to the stored image displayed in 41a (step S412 in FIG. 7).

That is, when attention frame information is associated with the stored image displayed on the left screen 141a in advance, the CPU 131 updates the content of the attention frame information and stores the content on the left screen 141a. When the attention frame information is not associated with the completed image, the CPU 131 newly saves the content of the attention frame information. The storage destination of the attention frame information is the memory 136 and the original storage location of the stored image (the hard disk 135 or the recording medium 137a).

<< Process when the Standard Display Button is Selected >> When the operator selects the standard display button 143a, the CPU 131 displays a message indicating that the standard display button 143a is selected. The related information is updated, and the same process as the above-described “standard-format thumbnail display process” is performed on the stored image to be displayed on the thumbnail screen 141f (step S413 in FIG. 7).

<< Processing when the Enlarged Display Button is Selected >> When the operator selects the enlarged display button 143b, the CPU 131 displays a message indicating that the enlarged display button 143b is selected. The related information is updated, and the above-described “enlarged-format thumbnail display processing” is performed on the stored image to be displayed on the thumbnail screen 141f (step S414 in FIG. 7).

However, when the attention frame information is not associated with the stored image to be displayed on the thumbnail screen 141f, the enlarged thumbnail image is generated by using the initial value of the attention frame information. . As described above, in the present embodiment, in the live / still image display mode, when the shooting button 141d is selected, not only the still image is captured but also the attention frame information associated with the image information is stored. When the enlarged display button 143b is selected,
In accordance with the attention frame information, a thumbnail image in an enlarged format corresponding to the still image captured before the new still image is displayed on the thumbnail screen 141f. In addition, for the stored image captured in the live / still image display mode and stored in the hard disk 135, when the enlarged display button 143b is selected in the stored image display mode, the thumbnail screen 141f is displayed as an enlarged thumbnail image. Is displayed.

Therefore, according to the present embodiment, when the operator repeatedly photographs the specimen 11a in which the minute area changes in the course of the microscopic examination, the operator sets the size and position of the attention frame 141g so that the minute area fits. Is set, the respective images can be easily compared only by referring to the thumbnail images in the enlarged format corresponding to the plurality of images obtained by such shooting.

Therefore, the operator can easily determine a desired image. In addition, when observing the stored images stored in the hard disk 135 at a later date as described above, the operator captures those stored images with any intention, even when referring to the standard format thumbnail images. Although it may not be possible to remember, by referring to the thumbnail image in the enlarged format, it is possible to remember the purpose of shooting the stored image.

According to the present embodiment, the same sample 1
In the case of photographing 1a while changing only the focus, the operator sets the size and position of the attention frame 141g so that the area to be focused can be accommodated, and a plurality of images obtained by such photographing can be obtained. The in-focus image can be easily determined simply by referring to the corresponding enlarged thumbnail image.

Further, in this embodiment, in the stored image display mode, selection of a thumbnail image by the operator,
When the change of the attention frame and the selection of the save button are continuously performed, the attention frame information of the saved image corresponding to the selected thumbnail image can be newly set or updated. That is, according to the present embodiment, even a stored image stored in the recording medium 137a by another microscope system is displayed as an enlarged thumbnail image based on the attention frame 141g specified by the operator. be able to.

Therefore, when displaying an image similar to that stored in the recording medium 137a by another microscope system, the operator sets the size and position of the attention frame 141g so that the area showing the characteristic of each image is accommodated. Is set, each image can be easily identified only by referring to the thumbnail image in the enlarged format. By the way, there is a sample 11a in which only the entire shape changes during the microscopy process (the local region does not change). In the present embodiment, the display format of the thumbnail screen 141f can be switched between the standard format and the enlarged format.
A plurality of images of the specimen 11a whose only shape changes in the course of microscopy can be easily determined by referring to the thumbnail images in the standard format.

In this embodiment, the thumbnail screen 1
Since the thickness of the frame of the thumbnail image is changed according to the display format of 41f, even if the display condition setting image is not displayed on the setting screen 141c, the operator can operate the thumbnail screen 1
The display format of 41f can be easily grasped. In this embodiment, the frame of the thumbnail image in the enlarged format is made thicker than the frame of the thumbnail image in the standard format.
Either frame may be thick, and such a difference in frame depending on the display format is realized by changing not only the thickness but also any form such as color, line type (for example, solid line / dotted line), and outer shape. Is also good. Further, it is also possible to indicate a difference in display format by displaying a frame only for a thumbnail image in one of the display formats.

Further, in this embodiment, the standard display button 143 a and the enlarged display button 143 on the display condition setting image 143 are displayed.
b, the display format of all thumbnail images on the thumbnail screen 141f is set uniformly. For example, as shown in FIG. 13, a standard display button and an enlarged display button are provided on the thumbnail screen 141f, and each thumbnail image is provided. The display format may be set for each image. The thumbnail screen 141f may display a thumbnail image in a display format based on display-related information at the time of imaging. That is, the thumbnail image for the still image captured with the standard display button 143a selected is displayed in the standard format, and the thumbnail image for the still image captured with the enlarged display button 143b selected is the enlarged format. Is displayed with.

In this embodiment, the thumbnail screen 1
The thumbnail image in the standard format and the thumbnail image in the enlarged format are switched and displayed on 41f.
As shown in FIG. 14, thumbnail images in the standard format may be constantly displayed, and switching between display of character strings such as file names and imaging conditions and thumbnail images in the enlarged format may be performed. However,
When realizing such display switching, it is desirable that the names of the buttons for receiving the display switching instruction from the operator be the information display button and the enlarged display button.

Further, in the present embodiment, in the stored image display mode, the selection of the thumbnail image by the operator is effective, and the selection of the thumbnail image, the change of the attention frame, and the selection of the save button are successively performed. Although the attention frame information can be updated, even in the live / still image display mode, the selection of the thumbnail image by the operator may be enabled, and the attention frame information of the still image corresponding to the selected thumbnail image may be updated.

For example, the display screen 14 shown in FIG.
When a thumbnail image is selected by the operator in a state where 41 is displayed, the CPU 131 displays a still image and an attention frame corresponding to the thumbnail image on the right screen 141.
b, and then an instruction to change the attention frame by the operator is received. Further, in the present embodiment, in the live / still image display mode, the still image and the attention frame information are individually stored as different files, but the still image and the attention frame information are a single file of a predetermined format. You may save them together as a file.

Further, in this embodiment, when the standard display button 143a or the enlarged display button 143b is selected by the operator, a thumbnail image in a standard format or an enlarged format is generated. Is a live
In the still image display mode, the save button 1
The thumbnail image in the enlarged format may be generated simultaneously with the update of the attention frame information.

In this embodiment, the microscope system 1
0 is stored in a recording medium 137 a such as a removable disk, and is stored in the personal computer 1 via the storage device 137.
3 is installed in such a program,
It may be written in the ROM 33 of the personal computer 13 in advance.

Further, in the present embodiment, such a program is stored in the CPU 131 of the personal computer 13.
However, such a program may be executed by a control unit in an image processing apparatus connected to a display device and provided with a user interface. Further, in the present embodiment, an example in which the present invention is applied to a microscope system has been described. However, the present invention is not limited to the microscope system. For example, a system including a film scanner and a personal computer and an electronic camera with a display device For example, the present invention can be applied to any system or apparatus that performs image display processing.

Further, in this embodiment, the operator and the CPU
The transmission and reception of information to and from the PC 131 is realized by a GUI, but may be realized by any user interface as long as similar transmission and reception of information is performed.

[0085]

As described above, according to the first to fifth, seventh, and eighth aspects of the present invention, an area image specified by an operator can be displayed. For this reason, if the operator specifies a region of interest in the image in advance, the operator can easily determine the image only by referring to the region image. According to the invention described in claim 6, since the area image of the predetermined area can be displayed, the operator can easily determine the image only by referring to the area image.

In particular, according to the first and sixth aspects of the present invention, since the area images for each of the plurality of images are displayed in a list, the operator can compare the area images to obtain a desired image. Can be more easily determined.

According to the second aspect of the present invention, it is possible to perform initial setting of region information for an image generated by a system or apparatus to which the present invention is not applied. The area information for the area specified by the operator can be updated. Therefore, the operator
Regions suitable for discrimination can be easily specified for various images, and image discrimination can be performed more easily.

According to the third aspect of the present invention,
Since the area image and the reduced image are switched and displayed, it is possible to display the one of the area image and the reduced image that is more suitable for the image determination by the operator, so that the image can be more easily identified. According to the fourth aspect of the present invention, since the area image and the reduced image have different frames, the operator can easily determine which of the area image and the reduced image is being displayed. It can be grasped and the image can be more easily determined.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a microscope system according to an embodiment.

FIG. 2 is a diagram showing a configuration of a personal computer 13.

FIG. 3 is an operation flowchart of a CPU 131.

FIG. 4 is an operation flowchart of a CPU 131.

FIG. 5 is an operation flowchart of a CPU 131.

FIG. 6 is an operation flowchart of a CPU 131.

7 is an operation flowchart of a CPU 131. FIG.

FIG. 8 is an operation flowchart of the CPU 131.

FIG. 9 is a diagram showing an example of a display screen 141 displayed on the display device 14.

FIG. 10 is a diagram showing an example of a display screen 141 displayed on the display device 14.

FIG. 11 is a diagram showing an example of a display screen 141 displayed on the display device 14.

FIG. 12 is a diagram showing an example of a display screen 141 displayed on the display device 14.

FIG. 13 is a diagram showing another example of the display screen 141 displayed on the display device 14.

FIG. 14 is a diagram showing a display example of a thumbnail screen 141f.

FIG. 15 is a diagram illustrating a display screen of the microscope system for living body use.

[Explanation of symbols]

 Reference Signs List 10 microscope system 11 microscope 11a sample 12 electronic camera 13 personal computer 14 display device 15 input device 101, 141 display screen 101a still image screen 101b moving image screen 101c, 141d shooting button 101d, 141f thumbnail screen 131 CPU 132 main memory 133 ROM 134 Bus 135 Hard disk 136 Memory 137 Storage device 137a Recording medium 138 Display control unit 139 Input device interface circuit 140 External interface circuit 141a Left screen 141b Right screen 141c Setting screen 141e Save button 141g Attention frame 143 Display condition setting screen 143a Standard display button 143b Enlarged display button

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification code FI Theme coat ゛ (Reference) G09G 5/08 G09G 5/08 E 5C082 5/36 H04N 1/387 5E501 H04N 1/387 5/262 5 / 262 5/265 5/265 7/18 U7 / 18 G06F 3/00 654A // G06F 3/00 654 656A 656 G09G 5/36 520G 520P F-term (reference) 2H052 AB05 AD33 AD37 AF14 AF21 AF25 5B057 BA24 CA08 CA12 CA16 CB08 CB12 CB16 CC01 CD05 CE08 CH20 5C023 AA02 AA06 AA14 AA31 AA34 AA37 AA38 CA01 CA08 DA04 5C054 AA01 CA04 CC02 FC11 FE09 FE17 GA01 GA04 GB01 HA00 5C076 AA01 AA14 AA19 AA02 BA03 CA02 CB032 5E501 AA24 AA25 AC15 BA03 BA05 CA02 EA14 EB05 FA06 FA14 FA23 FB04 FB43

Claims (8)

[Claims] 1. An area information storage means for receiving an external operation for specifying an arbitrary area in an image, and storing area information indicating an area specified by the external operation in association with the image, Display means for extracting an area image from the image based on the area information, and displaying the area image, wherein the display means displays a list of the plurality of area images specified by the area information. Image processing device. 2. The image processing apparatus according to claim 1, wherein the area information storage unit stores a predetermined area as area information for an image for which the area information is not specified, and An image processing apparatus, wherein, when an external operation is received for an image associated with region information, the region information is updated in accordance with the external operation. 3. The image processing apparatus according to claim 1, wherein the display unit switches and displays the area image and a reduced image obtained by reducing the image. apparatus. 4. The image processing apparatus according to claim 3, wherein the display unit assigns a different frame to the area image and the reduced image when the area image and the reduced image are switched and displayed. An image processing apparatus, comprising: 5. The image processing apparatus according to claim 1, wherein the area information storage unit is configured to generate an image when an image is generated by an imaging unit configured to capture an image of a subject and generate an image. An image processing apparatus for receiving an external operation for designating an arbitrary region in the image, and storing region information for the region designated by the external operation in association with the image. 6. An area information storing means for storing area information indicating a predetermined area in an image, acquiring the area information from the area information storing means, and obtaining an area from the image based on the area information. A display unit for extracting an image and displaying the region image, wherein the display unit displays the region image in a list. 7. A computer-readable recording medium on which a program for causing a computer to function as the area information storage means and the display means according to claim 1 is recorded. . 8. A microscope system for displaying an image acquired through a microscope, comprising: the area information storage unit and the display unit according to claim 1. system.