JP2010097482A - Image display system, image information management apparatus, display control apparatus, and method for controlling image display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display system which can quickly present a desired color image which is spectrally analyzed on the basis of a multi-spectral image to a user or the like. <P>SOLUTION: While referring to a spectral analysis image information managed by a server apparatus 10, image information instructed by spectral analysis instruction information for instructing spectral analysis corresponding to a display result of display color image information of a display apparatus 30 is transmitted from the server apparatus 10 to a client apparatus 20, and a color image corresponding to the image information transmitted from the server apparatus 10 to the client apparatus 20 is controlled to be displayed on the display apparatus 30. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention provides display color image information consisting of spectral components of three primary colors obtained from image information consisting of spectral components of N (N is a natural number greater than 3) band (hereinafter referred to as multispectral image information), and multi The present invention relates to an image display system that displays a color image obtained from a spectrum analysis result based on a spectrum image, an image information management device, a display control device, and an image display control method incorporated in the image display system.

  By storing high-definition and huge images in a special format on the server, search for image information for viewing huge still images to be displayed while changing the observation area and magnification according to instructions from the user on the client side There is a display system.

  On the other hand, in a wide range of fields such as remote sensing, art digital archives, and medical use, image analysis technology based on image information (hereinafter referred to as multispectral image information) composed of N (N is a natural number greater than 3) band spectral components. Has been used since ancient times. By using multispectral image information, it is possible to perform image processing such as classification and discrimination of a specific target and region extraction with high accuracy (Patent Documents 1 and 2). However, the existing image information search and display system for viewing giant still images does not support multispectral image information, and the color displayed in the existing image information search and display system for viewing giant still images If the image is simply replaced with the spectrum image, the analysis result according to the instruction from the user cannot be presented quickly for the following reason.

  The first reason is that since a multispectral image cannot be displayed as a color image as it is, processing to convert it into a display color image is necessary to display it. From the viewpoint of processing speed, the observation area, magnification, etc. This is because it is difficult to display while changing.

  The second reason is that since the image capacity of the multispectral image information is larger than that of the color image information, it is difficult to display while changing the observation region, magnification, etc. from the viewpoint of transmission capacity.

  To solve this problem, as a compression encoding technique for multispectral image information composed of spectral components of N (N is a natural number greater than 3) band, multiband image information is converted into three bands corresponding to color information of three primary colors. A technique has been proposed in which image information and (N-3) band image information corresponding to other spectrum information are converted into N band image information and compressed and encoded (Non-Patent Document 1). 2).

  In the methods according to Non-Patent Documents 1 and 2 described above, by assigning many bits to the 3-band image information corresponding to the color information, the deterioration of the color information can be suppressed to a small level, and the decoded N-band image information When only three-band image information is used, compatibility with a conventional image display system that displays a color image can be maintained.

US Patent No. 20070153370 US Patent No. 20080212866 S. Yu et al., “Multispectral image compression for improvement of colorimetric and spectral reproducibility by nonlinear spectral transform,” Optical Review, 13, 346-356 (2006). Keusen, “Multispectral color system with an encoding format compatible with the conventional tristimulus model,” Journal of Imaging Science and Technology, 40, 510- (1996).

  However, in the methods according to Non-Patent Documents 1 and 2 described above, when a multispectral image is displayed, compatibility with an image display system that displays an existing color image can be improved. The data size is not significantly different from the data size obtained by encoding the original N-band image information. Therefore, in the image display system realized by this method, from the viewpoint of transmission capacity, a color image indicating the analysis result of the multispectral image information as necessary on the display device side is quickly accessed by accessing the image information management device. It could not be presented to users.

  The present invention has been proposed in view of such a situation. For example, when observing a huge multispectral image as a color image, a color image with a desired observation region and magnification is quickly presented to a user or the like. An image display system capable of promptly presenting a desired color image spectrum-analyzed based on a multispectral image at the request of a user or the like, and image information incorporated in the image display system It is an object to provide a management device, a display control device, and an image display control method.

  As means for solving the above-described problems, an image display system according to the present invention includes spectral analysis image information for analyzing spectral information of N (N is a natural number greater than 3) band spectral information, and N band. An image information storage unit that stores the display color image information including the spectral components of the three primary colors obtained from the image information including the spectral components, and the image information stored in the image information storage unit. An image information management device having a first communication unit and a first control unit that controls the first communication unit; a second communication unit that receives image information transmitted from the image information management device; A display control unit that displays on the display device a color image corresponding to the image information received by the communication unit, and a spectrum analysis that instructs spectrum analysis according to the display result of the display device Display control having an instruction information input unit for inputting display information, and a second control unit for controlling the second communication unit based on the display result by the display device and the spectrum analysis instruction information input by the instruction information input unit And the first control unit transmits the display color image information stored in the image information storage unit to the display control device, and then the spectral image analysis instruction information transmitted from the display control device. So that the image information indicated by the spectral image analysis instruction information is transmitted to the display control device with reference to the spectral analysis image information stored in the image information storage unit. The second control unit transmits the spectrum analysis instruction information input to the instruction information input unit to the image information management apparatus, and then transmits from the image information management apparatus. The second communication unit is controlled so as to receive the image information instructed by the spectrum analysis instruction information, and the display control unit is image information instructed by the spectrum image analysis instruction information received by the second communication unit. A color image corresponding to the above is displayed on the display device.

  The image information management apparatus according to the present invention includes spectral analysis image information for analyzing spectral information of N (N is a natural number greater than 3) band spectral information and image information including N band spectral components. Display information of a display device that displays color images corresponding to image information stored in the image information storage unit, and an image information storage unit that stores the color image information for display composed of spectral components of the three primary colors obtained. And a control unit that controls the communication unit. The control unit receives spectrum analysis instruction information that instructs spectrum analysis according to image display by the display control device from the display control device. Receive and refer to the image information for spectral image analysis stored in the image information storage unit for the image information specified by the spectral image analysis instruction information Te controls the communication unit to transmit to the display control device.

  The display control apparatus according to the present invention obtains from spectrum analysis image information for analyzing spectral information of N (N is a natural number greater than 3) band spectral information and image information consisting of N band spectral components. A communication unit that receives image information transmitted from an image information management apparatus that associates and manages display color image information including spectral components of the three primary colors, and a color image corresponding to the image information received by the communication unit A display control unit for displaying the information on the display device, an instruction information input unit for inputting spectrum analysis instruction information for instructing spectrum analysis according to a display result by the display device, and a control unit for controlling the communication unit. Transmits the spectrum analysis instruction information input to the instruction information input unit to the image information management apparatus, and then transmits the spectrum analysis instruction information from the image information management apparatus. Comes to receive image information indicated in the spectral analysis instruction information, controls the communication unit, the display control unit displays the display image corresponding to the image information received by the communication unit to the display device.

  The image display control method according to the present invention includes spectral analysis image information for analyzing spectral information of N (N is a natural number greater than 3) band spectral information and image information consisting of N band spectral components. A first transmission control step of transmitting display color image information to a display control device from an image information management device that manages display color image information comprising spectral components of the three primary colors obtained in association; A first display control step for displaying on the display device the image of the display color image information transmitted by the transmission control step and received by the display control device, and instructing spectrum analysis according to the display result of the first display control step The instruction information input step for inputting the spectrum analysis instruction information to be performed, and the spectrum analysis input by the instruction information input step Display control with reference to image information for spectrum analysis managed by the image information management device in the second transmission control step for transmitting the display information from the display control device to the image information management device, and the second transmission control step. Image information management is performed by a third transmission control step for transmitting image information instructed by spectrum analysis instruction information transmitted from the apparatus from the image information management apparatus to the display control apparatus, and a third transmission control step. And a second display control step for displaying on the display device a display image corresponding to the image information transmitted from the device to the display control device.

  The present invention relates to the display control from the image information management device by referring to the image information for spectrum analysis managed by the image information management device for the image information specified by the spectrum analysis instruction information according to the display result by the display device. Control is performed so that a display image corresponding to the image information transmitted from the image information management apparatus to the display control apparatus is displayed on the display apparatus. In this way, in the present invention, by transmitting only the image information instructed by the spectrum analysis instruction information from the image information management apparatus to the display control apparatus among the image information managed by the image information management apparatus, It is possible to reduce the amount of information transmitted.

  Therefore, for example, when observing a huge multispectral image as a color image, the present invention can quickly present a color image of a desired observation region or magnification to a user or the like. A desired color image that has been spectrally analyzed based on a multispectral image can also be quickly presented as required.

  An image display system to which the present invention is applied is for display comprising spectral components of three primary colors obtained from image information consisting of spectral components of N (N is a natural number greater than 3) band (hereinafter referred to as multispectral image information). A color image obtained from color image information and a spectrum analysis result based on a multispectral image is displayed. In the present embodiment, a mode for carrying out the present invention will be described using an image display system 1 as shown in FIG.

  As shown in FIG. 1, the image display system 1 includes a server device 10 that functions as a management device that manages image information, a client device 20 that is connected to the server device 10 via an electric communication line such as the Internet, and a client. The display device 30 is configured to display a color image processed by the device 20.

  The server device 10 is, for example, a computer including a mass storage device such as a hard disk, a CPU, a RAM, and a ROM, and has the following functions to manage multispectral image information. That is, the server device 10 includes an image information storage unit 11 that stores image information, an image processing unit 12 that performs image processing on the image information stored in the image information storage unit 11, and a main unit of the image processing unit 12. A frame memory 13 that functions as a memory, a communication unit 14 that performs communication with the client device 20, and a control unit 15 that controls these units are provided. Here, the multispectral image information is image information obtained by receiving N-band spectral components with respect to the same subject by using, for example, a plurality of image sensors.

  The image information storage unit 11 stores spectrum analysis image information for analyzing multispectral image information and display color image information including spectral components of three primary colors obtained from the multispectral image information in association with each other. Specifically, in the image information storage unit 11, as shown in FIG. 2, in the three-dimensional orthogonal coordinate system of the xyz axis, the observation position of the subject is defined in the xy coordinate system, and the magnification is defined in the z-axis direction. A first storage area 11a in which analysis image information is stored and a second storage area 11b in which display color image information is stored are stored in association with each other. That is, in the image information storage unit 11, the observation position and the magnification are managed in association with each other in the first storage area 11a and the second storage area 11b as indicated by the arrow A in FIG.

  The image processing unit 12 reads out the image information stored in the image information storage unit 11 in accordance with a control command from the control unit 15, and the read image information is specifically described later using the frame memory 13. Such image processing is performed. Further, the image processing unit 12 supplies the image information subjected to the image processing to the communication unit 14.

  The communication unit 14 transmits / receives data to / from the client device 20 in accordance with a control command from the control unit 15, including processing for transmitting image information subjected to image processing by the image processing unit 12 to the client device 20.

  The control unit 15 controls the operation of each processing unit according to information transmitted from the client device 20 to the communication unit 14.

  The client device 20 that is communicably connected to the server device 10 having the above-described configuration is a computer that includes, for example, a large-capacity storage device such as a hard disk, a CPU, a RAM, and a ROM. In order to function as a display control device that displays a color image, it has the following functions. That is, the client device 20 includes a communication unit 21 that communicates with the server device 10, an image processing unit 22 that performs image processing on image information received from the server device 10 via the communication unit 21, and the image processing unit 22. A frame memory 23 that functions as a main memory; a display control unit 24 that displays image information decoded by the image processing unit 22 on the display device 30; an operation command input unit 25 that receives an operation command from a user; And a control unit 26 that controls the entire processing units.

  The communication unit 21 transmits information for acquiring image information to the server device 10 in accordance with a control command from the control unit 26, and supplies image information transmitted from the server device 10 to the image processing unit 22. Information is transmitted to and received from the server device 10.

  In accordance with a control command from the control unit 26, the image processing unit 22 performs image processing specifically described below using the frame memory 23 on the image information received from the server device 10 via the communication unit 21. Apply. Further, the image processing unit 22 supplies the image information subjected to the image processing to the display control unit 24.

  The display control unit 24 displays a color image of the image information supplied from the image processing unit 22 on the display device 30.

  The operation command input unit 25 functions as a graphical interface through which an operation command is input by a user or the like according to the display result displayed by the display device 30. The operation command input unit 25 notifies the control unit 26 of the operation command input by the user.

  The control unit 26 controls the operation of each processing unit described above according to the operation command input to the operation command input unit 25.

  In the image display system 1 having the server device 10 and the client device 20 configured as described above, the server device 10 may manage data obtained by encoding multispectral image information as spectrum analysis image information. From the viewpoint of reducing storage capacity and transmission amount, image information including image information of the difference between multispectral image information reconstructed from display color image information and multispectral image information (hereinafter referred to as Plus image information). .) May be stored in the first storage area 11a.

<Generation of image information>
Here, prior to the description of the overall operation of the image display system 1, a generation process for generating display color image information including three primary color spectral components and Plus image information from multispectral image information will be described with reference to FIG. To explain.

  First, it is assumed that a target object is photographed by a camera that detects a spectral component of a K (K is a natural number greater than 3) band, and K-band multispectral image information D1 is acquired. At this time, the signal value at the pixel (x, y) of the K-band multispectral image information D1 is represented by a K-dimensional column vector m (x, y) as shown in the following equation (1).

Here, T represents transposition of the vector. Further, the spectrum (wavelength λ _{1 to} λ _L ) of light emitted from the position corresponding to the pixel (x, y) of the actual target object is defined as an L-dimensional column vector s (x, y).

At this time, if the nonlinearity due to the photoelectric conversion of the camera is removed, the relationship of the following expression (3) is established between m (x, y) and s (x, y).

Here, the K × L matrix H is a matrix determined by the spectral sensitivity characteristics of the camera.

  Next, when generating RGB image information D2 that is display color image information from the multispectral image information MSI in step S11, the following equation (4) is used using P that is a 3 × K matrix. calculate.

Here, c (x, y) is a signal value of the RGB image information D2 at the pixel (x, y) and is a three-dimensional column vector. Further, the matrix P is obtained by the following equation (5).

Here, H ⁺ is a K × L matrix and a pseudo inverse matrix of the system matrix H, the matrix T _RGB is a 3 × L matrix and is calculated as T _RGB = MT _XYZ , and the matrix T _XYZ is 3 × L. The L matrix is a matrix having a CIEXYZ color matching function as a row vector, and the matrix M is a 3 × 3 matrix for converting from the CIEXYZ color space to the RGB color space. An sRGB color space or the like can be used as the RGB color space. Further, the pseudo inverse matrix of the K × L matrix H is a matrix that satisfies the condition that HH ⁺ becomes a unit matrix of K × K when K <L. In general, the pseudo inverse matrix H ⁺ is not uniquely determined, but here it is derived from the following equation (6) based on Wiener estimation theory.

Here, the matrix R _ss is an L × L matrix that is a correlation matrix of s (x, y). The matrix R _ss can be obtained in any way, but a large number of spectra ^T of the target object σ (i) = [σ (i, λ ₁ ),..., Σ (i, λ _L )] ^T are collected, and i = 1,... N can be obtained by the following equation (7).

Also, the (a, b) element of R _ss

It is also possible to substitute the matrix generated as At this time, ρ is preferably a value of 0.99 to 0.9999.

  In step S12, the RGB image information D2 generated by the above-described processing is encoded to compress the data amount, and the encoded RGB image information D3 is used as display color image information for the image information storage unit 11. Is stored in the second storage area 11b.

  In step S13, a decoding process is performed on the encoded RGB image information D3. In step S14, multispectral image information is predicted from the RGB image information subjected to the decoding process.

  Let c ′ (x, y) be the signal value at pixel (x, y) of the image obtained by decoding the RGB image information D3. At this time, the signal value of the predicted multispectral image information D4 corresponding to the pixel (x, y)

Is obtained from the following equation (8) using the pseudo inverse matrix P ⁺ of the 3 × K matrix P defined by the above equation (5).

In general, the pseudo inverse matrix is not uniquely determined, but here it is derived from the following equation (9) based on Wiener estimation theory.

Here, the matrix R _mm is a K × K matrix that is a correlation matrix of m (x, y). The matrix R _mm can be obtained in any manner, but can be obtained by the following equation (10) using the signal value m (x, y) of the multispectral image information D1.

Here, X and Y represent the number of vertical and horizontal pixels of the multispectral image information D1, and are calculated using information on all the pixels. Further, the calculation may be performed in the same manner as the above equation (10) using only the information of the pixel appropriately selected from the multispectral image information D1, thereby reducing the amount of calculation.

  When the multispectral image information D4 reconstructed from the RGB image information D3 is generated as described above, the process proceeds to step S15.

  In step S15, the signal value q (x, x, y) in the pixel (x, y) of the Plus image information D5 including the difference image information between the original multispectral image information D1 and the multispectral image information D4 reconstructed in step S14. y) is obtained by the following equation (11).

here,

Is a value obtained from the above equation (8).

  As is apparent from the above equation (11), the original multispectral image information D1 is obtained by adding the difference image information extracted from the Plus image information D5 to the multispectral image information D4 reconstructed from the RGB image information D3. Can be restored.

  The Plus image information D5 generated by the above-described process is subjected to an encoding process in step S16 to compress the data amount, and the encoded Plus image information D6 is used as spectrum analysis image information as an image information storage unit. 11 in the first storage area 11a.

  In this way, in the image display system 1, the RGB image information D3 is managed as the display color image information in the second storage area 11b of the image information storage unit 11 of the server device 10, and the Plus image information D6 is multispectral. By managing the image information for analysis in the first storage area 11a of the image information storage unit 11, the storage capacity of the image information storage unit 11 can be reduced as compared with the case of simply managing the multispectral image information D1, and the server The amount of image information transmitted from the apparatus 10 to the client apparatus 20 can be reduced.

<Overall Operation of Image Display System 1>
Next, the overall operation of the image display system 1 will be described.

  Specifically, the image display system 1 has a system configuration in which image processing based on multispectral image information, which will be described later, is mainly performed on the client device 20 side (hereinafter referred to as client-side system), and mainly on the server device 10 side. It can be realized by two types of system configurations, i.e., a system configuration to be performed (hereinafter referred to as a server side system). In the image display system 1 according to the present embodiment, each unit of the server device 10 and the client device 20 has a function that realizes one of the two types of system configurations of the client side system and the server side system. What is necessary is just to have it.

  First, an operation example according to the client side system will be described with reference to FIG.

  In step S <b> 21, the control unit 26 of the client device 20 receives instruction information for displaying a color image corresponding to an instruction such as a viewing position and a magnification from the user from the operation command input unit 25.

  In step S <b> 22, the control unit 26 of the client device 20 transmits the instruction information input in step S <b> 21 to the server device 10 through the communication unit 21.

  In step S23, the control unit 15 of the server device 10 stores the encoded display color image information corresponding to the viewing position and magnification designated by the user in accordance with the instruction information transmitted from the client device 20, as image information storage. Read by referring to the second storage area 11b of the unit 11.

  In step S <b> 24, the control unit 15 of the server device 10 transmits the display color image information read out in step S <b> 23 to the client device 20 through the communication unit 14.

  In step S <b> 25, the control unit 26 of the client device 20 performs a decoding process on the display color image information transmitted from the server device 10 by the image processing unit 22.

  In step S <b> 26, the control unit 26 of the client device 20 adds image information in the vicinity of the viewing position to the display color image information decoded by the image processing unit 22 with reference to the frame memory 23. If the server device 10 manages the Plus image information as the spectrum analysis image information, the image processing unit 22 stores the decoded display color image information in the frame memory 23 as step S26a.

  In step S27, the control unit 26 of the client device 20 causes the display control unit 24 to display on the display device 30 the color image of the display color image information to which the image information in the vicinity of the viewing position is added in step S26.

  In step S <b> 28, the control unit 26 of the client device 20 inputs spectrum analysis instruction information for instructing spectrum analysis according to the display result in step S <b> 27 to the operation command input unit 25.

  In step S29, the control unit 26 of the client device 20 transmits the spectrum analysis instruction information input in step S28 to the server device 10 through the communication unit 21.

  In step S <b> 30, the control unit 15 of the server device 10 displays the spectrum analysis image information associated with the display color image information read in step S <b> 23 according to the spectrum analysis instruction information transmitted from the client device 20. The information is read from the first storage area 11a of the information storage unit 11 by referring to it.

  In step S <b> 31, the control unit 15 of the server device 10 transmits the spectrum analysis image information read out in step S <b> 30 to the client device 20 through the communication unit 14 as image information instructed by the spectrum analysis instruction information.

  In step S <b> 32, the control unit 26 of the client device 20 performs a decoding process on the spectrum analysis image information transmitted from the server device 10 by the image processing unit 22.

  In step S33, the control unit 26 of the client device 20 refers to the decoded spectrum analysis image information, performs an analysis process instructed by the spectrum analysis instruction information input in step S28, and outputs the analysis result. Image information for analysis result display for color display is generated.

  Here, when the server device 10 manages the Plus image information as the spectrum analysis image information, the image processing unit 22 determines the multispectral image information from the display color image information stored in the frame memory 23 in step S26a. Multispectral image information is generated by adding the reconstructed spectral image information and the difference image information extracted from the Plus image information. Then, the image processing unit 22 performs spectrum analysis processing on the generated multispectral image information, and generates analysis result display image information for displaying the analysis result as a color image.

  In step S <b> 34, the control unit 26 of the client device 20 causes the display control unit 24 to display the image of the analysis result display image information generated in step S <b> 23 on the display device 30.

  As described above, in the client side system, the analysis result display image information is transmitted from the server apparatus 10 to the client apparatus 20 as the image information instructed by the spectrum analysis instruction information. The display image information is analyzed by the spectrum analysis instruction information, and the image of the analysis result display image information obtained from the analysis result is displayed on the display device 30.

  Next, an operation example according to the server-side system will be described with reference to FIG.

  In step S <b> 41, the control unit 26 of the client apparatus 20 receives instruction information for displaying a color image corresponding to an instruction such as a viewing position and a magnification, from the user, by the operation command input unit 25.

  In step S <b> 42, the control unit 26 of the client device 20 transmits the instruction information input in step S <b> 41 to the server device 10 through the communication unit 21.

  In step S <b> 43, the control unit 15 of the server device 10 displays display color image information corresponding to the viewing position and magnification designated by the user according to the instruction information transmitted from the client device 20 in the image information storage unit 11. The data is read from the second storage area 11b. If the Plus image information is stored as spectrum analysis image information in the first storage area 11a, the image processing unit 12 stores the read display color image information in the frame memory 13 in step S43a. Keep it.

  In step S <b> 44, the control unit 15 of the server device 10 transmits the display color image information read out in step S <b> 43 to the client device 20 through the communication unit 14.

  In step S <b> 45, the control unit 26 of the client device 20 performs a decoding process on the display color image information transmitted from the server device 10 by the image processing unit 22.

  In step S <b> 46, the control unit 26 of the client device 20 adds image information near the viewing position to the display color image information decoded by the image processing unit 22 with reference to the frame memory 23.

  In step S47, the control unit 26 of the client device 20 causes the display control unit 24 to display on the display device 30 the image of display color image information to which the image information in the vicinity of the viewing position is added in step S46.

  In step S48, the control unit 26 of the client device 20 inputs spectrum analysis instruction information for instructing spectrum analysis according to the display result in step S47 to the operation command input unit 25.

  In step S <b> 49, the control unit 26 of the client apparatus 20 transmits the spectrum analysis image information input in step S <b> 48 to the server apparatus 10 through the communication unit 21.

  In step S50, the control unit 15 of the server device 10 displays the spectrum analysis image information associated with the display color image information read in step S43 in accordance with the spectrum analysis instruction information transmitted from the client device 20. The information is read from the first storage area 11a of the information storage unit 11 by referring to it.

  In step S51, the control unit 15 of the server device 10 controls the image processing unit 12 so that the image processing unit 12 performs decoding processing on the spectrum analysis image information read out in step S50.

  In step S52, the control unit 15 of the server device 10 performs an analysis process instructed by the spectrum analysis instruction information on the decoded spectrum analysis image information, and displays the analysis result for color display. The image processing unit 12 is controlled to generate image information.

  Here, in the case where the Plus image information is stored as spectrum analysis image information in the first storage area 11a, the image processing unit 12 calculates the multi-color from the display color image information stored in the frame memory 13 in step S43a. The spectral image information is reconstructed, and the multispectral image information is generated by adding the reconstructed multispectral image information and the difference image information extracted from the Plus image information. Then, the image processing unit 12 performs spectrum analysis processing on the generated multispectral image information, and generates analysis result display image information for displaying the analysis result in color.

  In step S53, the control unit 15 of the server apparatus 10 controls the image processing unit 12 so that the image processing unit 12 performs the encoding process on the analysis result display image information generated in step S52.

  In step S <b> 54, the control unit 15 of the server device 10 transmits the analysis result display image information encoded in step S <b> 53 to the client device 20 through the communication unit 14 as the image information instructed by the spectrum analysis instruction information.

  In step S <b> 55, the control unit 26 of the client device 20 performs a decoding process on the analysis result display image information transmitted from the server device 10 by the image processing unit 22.

  In step S <b> 56, the control unit 26 of the client device 20 causes the display control unit 24 to display the image of the analysis result display image information decoded in step S <b> 55 on the display device 30.

  As described above, in the client side system, the server apparatus 10 performs the analysis process instructed by the spectrum analysis instruction information, and indicates the analysis result display image information obtained from the analysis result by the spectrum analysis instruction information. Image information to be transmitted to the client device 20.

  As shown in the client-side system and the server-side system described above, in the image display system 1, the spectrum analysis managed by the server device 10 on the image information indicated by the spectrum analysis instruction information corresponding to the display result by the display device 30. The image information specified by the spectrum analysis instruction information is transmitted from the server device 10 to the client device 20 with reference to the image information, and a color image corresponding to the image information transmitted from the server device 10 to the client device 20 Is displayed on the display device 30. In this way, in the image display system 1, among the multispectral image information managed by the server device 10, only the image information instructed by the spectrum analysis instruction information is transmitted from the server device 10 to the client device 20. Therefore, it is possible to reduce the transmission amount of image information. Therefore, in the image display system 1, for example, when applied as a system for observing a huge multispectral image as a color image, it is possible to quickly present a color image of a desired observation region or magnification to a user or the like. In addition, a desired color image that has been spectrally analyzed based on the multispectral image at the request of the user or the like can also be quickly presented.

<System configuration of comparative example>
Next, in order to verify the usefulness of the image display system 1, a system configuration to be compared will be described.

  FIG. 6 is a diagram illustrating an operation example according to the system configuration of the first comparative example (hereinafter referred to as the RGB system 100).

  The RGB system 100 includes a server device 101 that manages only display color image information, and a client device 102 that accesses the server device 101 and displays the display color image information on the display device.

  In the RGB system 100, the client apparatus 102 receives an operation instruction from the user through the graphic user interface (step S101), and receives instruction information for displaying a display color image in accordance with an instruction such as a viewing position and a magnification (step S102). ), And transmits the instruction information to the server apparatus 101 (step S103). In response to the instruction information transmitted from the client apparatus 102, the server apparatus 101 reads the display color image information managed by the server apparatus 101 (step S104), and the read display color image information is read by the client apparatus. (Step S105). The client apparatus 102 decodes the display color image information transmitted from the server apparatus 101 (step S106), buffers the decoded display color image information in the memory (step S107), and uses the buffered information. Then, the image information in the vicinity of the viewing position is added to the display color image information (step S108), and the image of the display color image information is displayed on the display device (step S109).

  FIG. 7 is a diagram illustrating an operation example according to the system configuration of the second comparative example (hereinafter referred to as the MSI client-side system 200).

  The MSI client-side system 200 generates a color image information by performing spectrum analysis processing with reference to the multispectral image information acquired from the server device 201 that manages only the multispectral image information and the server device 101, and displays it on the display device. It is assumed that the client apparatus 202 to be displayed is included.

  In the MSI client-side system 200, the client device 202 receives an operation instruction from the user through the graphic user interface (step S201), and receives instruction information for displaying a display color image corresponding to an instruction such as a viewing position or a magnification ( In step S202), the instruction information is transmitted to the server device 201 (step S203). The server device 201 reads the multispectral image information managed by the server device 201 in accordance with the instruction information transmitted from the client device 202 (step S204), and transmits the read multispectral image information to the client device 102. (Step S205). The client device 202 decodes the multispectral image information transmitted from the server device 201 (step S206), and buffers the decoded multispectral image information in a memory (step S207). Then, the client device 202 converts the multispectral image information into display color image information (step S208), refers to the image information buffered in the memory, and adds the image information in the vicinity of the viewing position to the display color image information. Then, the image of the display color image information is displayed on the display device (step S210). In parallel with the processing in steps S208 to S210, the client device 202 performs analysis by referring to the multispectral image information buffered in the memory based on the spectrum analysis instruction information (step S211) received by the operation input in step S201. Result display image information is generated (step S212), and an image of the analysis result display image information is displayed on the display device (step S213).

  FIG. 8 is a diagram illustrating an operation example according to the system configuration of the third comparative example (hereinafter referred to as the MSI server side system 300).

  The MSI server side system 300 manages only the multispectral image information and generates the display color image information and the analysis result display image information from the multispectral image information, and accesses the server device 301. The client device 302 is configured to display the display color image information and the analysis result display image information on the display device.

  In the MSI server-side system 300, the client apparatus 302 receives an operation information input from the user through a graphic user interface (step S301), and receives instruction information for displaying a display color image corresponding to an instruction such as a viewing position or a magnification ( (Step S302), the information is transmitted to the server device 301 (Step S303), and the spectrum analysis instruction information (Step S304) received by the operation input in Step S301 is transmitted to the server device 201 (Step S305). In response to the instruction information from the client apparatus 302, the server apparatus 301 reads multispectral image information such as a viewing position and a magnification indicated by the instruction information from among the managed multispectral image information (step S306). The image information is decoded (step S307), and the decoded multispectral image information is buffered in the memory (step S308). Then, the server device 301 converts the multispectral image information into display color image information (step S309), encodes the converted display color image information (step S310), and converts the encoded display color image information into the display color image information. The data is transmitted to the client device 302 (step S311). In parallel with the processing according to steps S309 to S311, the server apparatus 301 refers to the multispectral image information buffered in the frame memory based on the spectral analysis instruction information transmitted in step S303, and displays the analysis result display image information. It generates (step S312), encodes the generated analysis result display image information (step S313), and transmits the encoded analysis result display image information to the client device 302 (step S314).

  The client device 302 then decodes the display color image information and the analysis result display image information transmitted from the server device 301 (step S315), buffers them in the memory (step S316), and buffers them in the memory. Image information near the viewing position is added to the display color image information and the analysis result display image information with reference to the image information (step S317), and an image of these image information is displayed on the display device (step S318). .

<Verification results>
Next, the image display system 1 and the system configurations of the first to third comparative examples were evaluated as follows. Table 1 below evaluates the storage capacity of image information managed by the server device and the transmission amount for each operation target for each system configuration. Table 2 below shows the number of necessary processing steps excluding common processing in each system configuration.

  In Table 1 above, <RGB> is a data capacity corresponding to display color image information, and <MSI> is a data capacity corresponding to original spectral image information. Here, since the data capacity changes depending on the image size and the degree of compression, the comparison was performed using these symbols instead of specific numerical values. However, <RGB> is smaller than <MSI>. Further, “Less than <MSI>” indicates that the amount of data of the Plus image information is smaller than that of <MSI>.

  Also, the seven types of system configurations used as comparative controls are as follows. The first system configuration is the RGB system 100 described above, the second system configuration is the MSI client-side system 200 described above, and the third system configuration is the MSI server-side system 300 described above.

  On the other hand, in the fourth system configuration “RGB-MSI client side”, the system configuration is the client side system in the image display system 1 according to the present embodiment, and the server apparatus 10 side is the spectrum analysis image information. The multispectral image information MSI is managed.

  In the fifth system configuration “RGB-MSI server side”, the system configuration is the server side system in the image display system 1 according to the present embodiment, and the server apparatus 10 side is the multispectral image as the spectral analysis image information. Information MSI is managed.

  Further, the sixth system configuration “RGB-Plus client side” has the system configuration as a client side system in the image display system 1 according to the present embodiment, and the server device 10 side has Plus image information as spectrum analysis image information. Is to manage.

  Further, the seventh system configuration “RGB-Plus server side” has the system configuration as the server side system in the image display system 1 according to the present embodiment, and the plus image information as the spectral analysis image information on the server device 10 side. Is to manage.

  Next, based on Table 1 and Table 2, the process relating to viewing of the display color image is evaluated as follows. In the “MSI client side system” of the comparison target system, the transmission amount of <MSI> is required for viewing the display color image, and the operability in viewing the display color image is reduced due to the large amount of transmission. In addition, in the “MSI server side system” of the comparison target system, it is necessary to repeat decoding and encoding of image information in browsing the display color image, and the operability in browsing the display color image is reduced. In comparison with these, in the display of the color image information for display, the image display system 1 has the same transmission amount and processing content as the RGB system 100 in both the transmission amount and the processing. In browsing the information, the same operability as that of the RGB system 100 can be ensured.

  Next, based on Tables 1 and 2, four types of system configurations applied as the image display system 1 are evaluated as follows.

  First, when the “client-side system” that is the first system configuration and the “server-side system” that is the second system configuration are compared, the transmission amount when the spectral image analysis is performed in the “server-side system”. Is smaller than the “client side system”, and further, there is an advantage that it can be used only by, for example, a Web browser without installing “spectrum analysis software” on the “client side”. On the other hand, the “client-side system” has an advantage that the processing related to encoding and decoding in the case of performing spectral image analysis is less than that of the “server-side system”.

  Further, as the spectral analysis image information managed by the server device 10, when the multispectral image information MSI and the Plus image information are compared, Plus is compared to the case where the spectral analysis image information is managed by the multispectral image information MSI. In the case of managing with image information, the storage capacity of the image information managed by the server device 10 is smaller, and the amount of transmission when performing spectral image analysis on the current observation position is smaller. Note that the degree of these differences varies depending on the number of bands of the original multispectral image information MSI and the degree of compression to display color image information.

<About application examples>
Next, specific examples of spectrum analysis processing using the image display system 1 will be described. In the first embodiment, when the multi-spectral pathological image is compressed and encoded separately into the three-band display color image information and the Plus image information, the three-band display color image information and the original Comparison was made with the conventional example in which the multispectral image information MSI is independently compressed and encoded.

  As the target image used in this example, the original multispectral image information is image information obtained by imaging a hepatoxylin & Eosin-stained pathological specimen of the liver with a 16-band microscope. The number of pixels is 2048 × 2048, the wavelength direction is 16 bands, and one pixel is 16 bits. is there. The image data size before compression is 134217728 [Bytes] ≈134.2 [MB].

  In this embodiment, the generation processing and the compression encoding processing of the color image information for three bands are performed as follows. That is, CIEXYZ tristimulus values under D65 illumination light are calculated from the above-described multispectral image information based on Wiener estimation, and converted into sRGB standard RGB signals, thereby generating three-band display color image information. did. The data size of the three-band display color image before compression is 125829112 [Byte] ≈12.6 [MB]. As the compression rate of the color image information for three-band display, the cases of 5%, 20%, and 30% were verified in the range of 5% to 30% considered to be used in the existing system. In addition, JPEG2000 was used as the compression encoding method.

  Further, in the present embodiment, the compression encoding process of the image information for spectrum analysis was performed as follows. That is, compression encoding of Plus image information and multispectral image information was performed as follows. The pre-compression Plus image information and multispectral image information are both expressed by the number of pixels 2048 × 2048, the wavelength direction 16 bands, one pixel 16 bits, and the image data size is 134217728 [Byte] ≈134.2 [MB]. These image information were compressed by JPEG2000 after applying KL conversion in the wavelength direction.

  FIG. 9 shows the relationship between the compression rate of image information for spectrum analysis and the PSNR (Peak Signal to Noise Ratio) of 16-band multispectral image information. It shows that deterioration by compression is so small that PSNR is large. In the case of Plus image information, the multi-spectral image information MSI is restored together with the separately transmitted three-band display color image information, and the result depends on the compression rate of the three-band display color image information. When the compression rate of the 3-band display color image information is as high as 5%, the result of the Plus image information is almost the same as the result of the multispectral image information MSI. On the other hand, when the compression rate such as 20% or 30% is not so high, for example, when Plus image information is used to realize PSNR = about 40 [dB], the original multispectral image information MSI is used. However, when the multispectral image information MSI is used, it is 5%, and it can be seen that the system configuration using the Plus image information only needs to transmit a smaller amount of data. As is clear from this result, although depending on the compression rate of the display color image information, the image display system 1 stores the multispectral image information MSI by storing the Plus image information as the spectrum analysis image information. The amount of image information transmitted between the server apparatus 10 and the client apparatus 20 can be reduced as compared with the case where it is performed. Therefore, in the image display system 1, it is possible to quickly present a color image having a desired observation region or magnification to a user or the like, and a desired spectrum that has been subjected to spectrum analysis based on a multispectral image according to a request from the user or the like. Color images can also be presented quickly.

  As a second embodiment, an application example to spectrum enhancement processing for a hematoxylin-eosin stained pathological specimen image will be described.

  Hematoxylin and eosin staining (HE staining) is called standard staining, and is a standard staining method applied to almost all pathological specimens. However, collagen fibers, which are important indicators for diagnosing liver diseases such as cirrhosis, are stained with the same color as smooth muscle in HE staining. -Trichrome staining (MT staining) is required. However, since MT staining is more laborious than HE staining, if collagen fibers and smooth muscles can be identified by image processing from the pathological specimen image of HE staining, and both can be displayed as different colors, This makes it possible to speed up diagnosis and improve efficiency. So far, it is possible to display collagen fibers and smooth muscles as different colors by emphasizing and displaying a specific band image with respect to an HE-stained image acquired by a 16-band multispectral microscope in the visible range as described below. It is shown in Document 1.

Reference 1: PA Bautista, T. Abe, M. Yamaguchi, N. Ohyama, and Y. Yagi, “Multispectral Image Enhancement for H & E Stained Pathological Tissue Specimens,” Proc. SPIE Medical Imaging 2008, (2008) 691836.
When applying the above spectrum enhancement processing in the image display system 1 according to the present embodiment, the following conditions are recommended.

  N, which is the number of wavelength bands of the spectral image, is set to around 16, and each wavelength band is a band obtained by dividing the entire visible range into N at substantially equal intervals. The maximum magnification of image information and the number of pixels corresponding to the maximum magnification are the same as those in a normal hole slide imaging system. The target specimen is an HE-stained specimen. As a system configuration, it is desirable to use a “server side system” from the following points.

  The procedure for use is as follows. First, a pathologist or the like observes a HE-stained pathological specimen using display color image information while changing the observation position and magnification. When a region where the collagen fiber is suspected to be proliferated is found, the GUI of the application is solved to give a spectrum enhancement instruction. At this time, since the wavelength band to be emphasized and the coefficient representing the degree of enhancement are optimized in advance, it is not necessary to adjust them on the client side. The client device 20 transmits a spectrum enhancement instruction to the server device 10 as spectrum analysis instruction information. The server device 10 decodes the compressed spectral analysis image information corresponding to the current observation position and magnification, generates post-emphasis analysis result display image information, compresses it for transmission, and performs the client device 20. Transmit to. In the client device 20, the received analysis result display image information is decoded and displayed.

  As in this embodiment, when it is not necessary to change the analysis contents and parameters based on the spectrum little by little, the “server side system” is suitable as the system configuration. As a result, when the analysis based on the spectrum is performed, the data volume transmitted from the server device 10 is almost the same as the display color image information, and the client device 20 can be used without installing the spectrum analysis software. . In other applications, when it is not necessary to change the contents and parameters of spectrum analysis little by little as in this example, the “server side system” is suitable as a system configuration.

  As a second embodiment, adjustment of staining density for a hematoxylin / eosin stained pathological specimen image will be described.

  Since the biological tissue is colorless and transparent, the specimen is stained in order to distinguish different tissues at the time of observation. The most standard staining method, hematoxylin and eosin staining (HE staining), mainly dyes the cytoplasm and nucleus in different colors. At this time, if the staining process such as the staining time is not appropriate, the staining density may be too dark or too light, and the quality of the prepared specimen may not be suitable for diagnosis. Furthermore, because the staining process varies depending on the staining facility and the staining engineer, the average staining state differs between the different facilities, and the staining that doctors are accustomed to when diagnosing specimens from other staining facilities in remote pathological diagnosis etc. It may be necessary to diagnose a specimen that is stained differently from the condition. Therefore, if the staining density can be adjusted appropriately or according to preference by digital image processing, it will be possible to reduce the labor of sample preparation and improve the quality of diagnosis. Until now, it is possible to display an image of HE staining acquired by a 16-band multispectral microscope in the visible range by adjusting it to an arbitrary staining state or the same staining state as the target staining specimen. 2.

Reference 2: T. Abe, Y. Murakami, M. Yamaguchi, N. Ohyama, and Y. Yagi, “Color correction of pathological images based on dye amount quantification,” Optical Review, 12 (4), 293-300 (2005 ).
The following conditions are recommended when applying the function of adjusting to an arbitrary staining density in the image display system 1 according to the present embodiment. The number N of wavelength bands of the spectrum image is about 16 to 100, and each wavelength band is a band obtained by dividing the entire visible range into N at almost equal intervals. The maximum magnification of the image and the number of pixels corresponding to the maximum magnification are the same as those in a normal hole slide imaging system. The target specimen is an HE-stained specimen. As a system configuration, it is desirable to use a “client side system” from the following points.

  The procedure for use is as follows. First, an observer such as a pathologist observes a HE-stained pathological specimen using display color image information while changing the observation position and magnification. When an area suspected of some abnormality is found, the observer gives an instruction to adjust the staining density using the application GUI or the like as spectrum analysis instruction information. At this time, the observer designates the concentration adjustment amount of the hematoxylin dye and the eosin dye. The client device 20 transmits a dye density adjustment instruction to the server device 10. In the server device 10, image information for spectrum analysis in a compressed format corresponding to the current observation position and magnification is transmitted to the client device 20. The client device 20 decodes the received spectral analysis image information, stores it in the frame memory 23, and displays the analysis result display image information of the specified or default density adjustment amount by the staining density adjustment processing. Generated and displayed by the processing unit 22. Further, the observer gives an instruction to change the dye density adjustment amount using the application GUI or the like. The client device 20 uses the spectrum analysis image information stored in the buffer to generate and display analysis result display image information of the newly specified adjustment amount.

  As in this embodiment, when it is necessary to change the analysis parameter based on the spectrum little by little, the “client side system” is suitable as the system configuration. As a result, when the analysis parameters are changed little by little, the analysis result image can be generated only by the processing of the client device 20 without newly transmitting data from the server device 10, and therefore the analysis result from the input of the analysis instruction. The time until the image is displayed can be shortened. In other applications, if it is necessary to change the contents and parameters of spectrum analysis little by little as in this embodiment, it can be said that the “client side system” is suitable as a system configuration.

  As a third embodiment, an implementation of a 6-band giant image display system will be described.

  In this example, a 6-band giant image display system was implemented using Flash CS3 and ActionScript 2.0 manufactured by Adobe. The implemented system belongs to the “client side system”.

  In this embodiment, the server includes display color image information calculated from 6-band multispectral image information, first 3-band image information composed of 1 to 3 bands, half of the 6-band image information, and the rest. The second 3-band image information composed of half 4-6 bands is stored. The display color image information is an image used for normal browsing, and the first and second three-band image information are spectrum analysis images. At this time, the display color image information and the first and second three-band image information are stored in association with each other according to a plurality of resolution levels, and the image information at each resolution level is 256 pixels. It is divided into tiles and stored in × 256 JPEG images.

  The display software created using Flash is embedded in HTML, and this display software is operated by clicking each operation button with the mouse. When viewing the color image information for display, enlargement / reduction and movement of the display position are possible. Each time an operation instruction is issued, necessary display color image information stored in JPEG is transmitted from the server side and displayed.

  Also, by clicking the spectral image analysis button, the first and second three-band image information corresponding to the color image information for displaying the resolution and position currently being browsed is transmitted from the server device 10, and the client device 20. Are written in the frame memory 23 and are in a standby state for spectral image analysis. Next, the analysis result is displayed in response to each spectrum image analysis instruction. There are three types of analysis implemented this time.

  As a first type, the single band image display is a function of displaying an image of a specific band in a gray scale. This display is used to observe the characteristics of a specific wavelength band as an image.

  As a second type, the pseudo color image display is a function of allocating a specific band image to each of R, G, and B and displaying it as a color image. This display is used for efficiently observing the characteristics of a plurality of wavelength bands as a color image.

  As a third type, the spectrum graph display is a function of displaying multispectral information, which is a signal value for six bands of a pixel designated by a mouse pointer, in a line graph. This display is used to observe features related to the spectrum of a specific site.

  Since the system according to the present embodiment uses only the FLASH function, the processing time is extremely short and high responsiveness can be ensured.

  As described above, in the image display system 1 according to the present embodiment, in the spectral image analysis process, the spectral image analysis process is implemented on the server device 10 side or the client device 20 side according to various applications. A highly convenient operating environment can be provided to the user.

  In addition, this invention is not limited only to the above embodiment, Of course, a various change is possible in the range which does not deviate from the summary of this invention.

1 is a diagram showing an overall configuration of an image display system to which the present invention is applied. It is a figure explaining the image information managed with a server apparatus. It is a figure for demonstrating the production | generation process which produces | generates the color image information for a display, and difference image information. It is a figure for demonstrating the operation example which concerns on a client side system. It is a figure for demonstrating the operation example which concerns on a client side system. It is a figure which shows the operation example which concerns on a RGB system. It is a figure which shows the operation example which concerns on a MSI client side system. It is a figure which shows the operation example which concerns on a MSI server side system. It is a figure which shows the relationship between the compression rate of the image information for spectrum analysis, and PSNR (Peak Signal to Noise Ratio) of 16 band multispectral image information.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Image display system 10, 101, 201, 301 Server apparatus, 11 Image information storage part, 11a 1st storage area, 11b 2nd storage area, 12, 22 Image processing part, 13, 23 Frame memory, 14, 21 communication unit, 15, 26 control unit, 20, 102, 202, 302 client device, 24 display control unit, 25 operation command input unit, 30 display device, 100 RGB system, 200 client side system, 300 server side system

Claims (7)

N (where N is a natural number greater than 3) band spectral analysis image information for analyzing spectral band image information, and display consisting of spectral components of three primary colors obtained from the image information including the N band spectral components An image information storage unit that stores color image information in association with each other, a first communication unit that transmits image information stored in the image information storage unit, and a first control unit that controls the first communication unit. An image information management device having a control unit;
A second communication unit that receives image information transmitted from the image information management device; a display control unit that displays on the display device a color image corresponding to the image information received by the second communication unit; An instruction information input unit for inputting spectrum analysis instruction information for instructing spectrum analysis according to a display result by the display device, and a display result by the display device and the spectrum analysis instruction information input by the instruction information input unit. A display control device having a second control unit for controlling the second communication unit,
The first control unit transmits display color image information stored in the image information storage unit to the display control device, and then receives spectral image analysis instruction information transmitted from the display control device. Then, the first communication is performed such that the image information instructed by the spectrum image analysis instruction information is transmitted to the display control device with reference to the spectrum analysis image information stored in the image information storage unit. Control the part
The second control unit transmits the spectrum analysis instruction information input to the instruction information input unit to the image information management apparatus, and then indicates the spectrum analysis instruction information transmitted from the image information management apparatus. Controlling the second communication unit to receive the received image information,
The image display system, wherein the display control unit displays a color image corresponding to image information instructed by spectral image analysis instruction information received by the second communication unit on the display device. The image information management device refers to the spectrum analysis image information stored in the image information storage unit, performs an analysis process instructed by spectrum analysis instruction information transmitted from the display control device, and An image information generation unit for generating analysis result display image information for displaying the analysis result in color;
The first control unit transmits the analysis result display image information generated by the image information generation unit to the display control device as image information instructed by the spectrum analysis instruction information. The image display system of Claim 1 which controls a communication part. The display control device refers to the image information transmitted from the image information management device, performs an analysis process instructed by the spectrum analysis instruction information, and displays an analysis result for displaying the analysis result in color. An image information generating unit for generating image information;
The first control unit reads out the spectrum analysis image information from the image information storage unit as image information instructed by the spectrum analysis instruction information transmitted from the display control device, and sends it to the display control device. Controlling the first communication unit to transmit,
The image information generation unit generates the analysis result display image information with reference to spectrum analysis image information transmitted from the image information management device,
The image display system according to claim 1, wherein the display control unit displays an image of the analysis result display image information generated by the image information generation unit on the display device. The image information storage unit includes difference image information between the image information including the N-band spectral component and the image information including the N-band spectral component reconstructed from the three primary color spectral components of the display color image information. Is stored as the image information for spectrum analysis,
The image information generation unit reconstructs image information including N-band spectral components from the display color image information, and the difference image information extracted from the reconstructed image information and the spectrum analysis image information; 4. The image display system according to claim 2, wherein image information composed of N-band spectral components is generated by performing addition processing, and the analysis result display image information is generated from the generated image information. N (where N is a natural number greater than 3) band spectral analysis image information for analyzing spectral band image information, and display consisting of spectral components of three primary colors obtained from the image information including the N band spectral components An image information storage unit for storing color image information in association with each other;
A communication unit that transmits to a display control device that performs display control of a display device that displays a color image corresponding to the image information stored in the image information storage unit;
A control unit for controlling the communication unit,
The control unit receives spectrum analysis instruction information for instructing spectrum analysis according to image display by the display control apparatus from the display control apparatus, and receives image information instructed by the spectrum image analysis instruction information as the image information. An image information management device that controls the communication unit so as to transmit the image information for spectral image analysis stored in the storage unit to the display control device with reference to the image information. N (where N is a natural number greater than 3) band spectral analysis image information for analyzing spectral band image information, and display consisting of spectral components of three primary colors obtained from the image information including the N band spectral components A communication unit that receives image information transmitted from an image information management apparatus that manages color image information in association with each other;
A display control unit for displaying a color image corresponding to the image information received by the communication unit on a display device;
An instruction information input unit for inputting spectrum analysis instruction information for instructing spectrum analysis according to a display result by the display device;
A control unit for controlling the communication unit,
The control unit transmits the spectrum analysis instruction information input to the instruction information input unit to the image information management apparatus, and then the image specified by the spectrum analysis instruction information transmitted from the image information management apparatus. Control the communication unit to receive information,
The display control unit is configured to display a display image corresponding to the image information received by the communication unit on the display device. N (where N is a natural number greater than 3) band spectral analysis image information for analyzing spectral band image information, and display consisting of spectral components of three primary colors obtained from the image information including the N band spectral components A first transmission control step of transmitting the display color image information to a display control device from an image information management device that manages color image information in association with each other;
A first display control step of displaying on the display device an image of the color image information for display transmitted by the first transmission control step and received by the display control device;
An instruction information input step for inputting spectrum analysis instruction information for instructing spectrum analysis according to the display result of the first display control step;
A second transmission control step of transmitting the spectrum analysis instruction information input in the instruction information input step from the display control device to the image information management device;
By referring to the spectrum analysis image information managed by the image information management apparatus in the second transmission control step, the image information instructed by the spectrum analysis instruction information transmitted from the display control apparatus is changed to the image. A third transmission control step for transmitting from the information management device to the display control device;
Image display control comprising: a second display control step for displaying on the display device a display image corresponding to the image information transmitted from the image information management device to the display control device by the third transmission control step. Method.

Images