WO2013100025A1 - 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム - Google Patents
画像処理装置、画像処理システム、画像処理方法および画像処理プログラム Download PDFInfo
- Publication number
- WO2013100025A1 WO2013100025A1 PCT/JP2012/083818 JP2012083818W WO2013100025A1 WO 2013100025 A1 WO2013100025 A1 WO 2013100025A1 JP 2012083818 W JP2012083818 W JP 2012083818W WO 2013100025 A1 WO2013100025 A1 WO 2013100025A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- display
- magnification
- image data
- pixel
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 165
- 238000003672 processing method Methods 0.000 title claims description 16
- 238000003384 imaging method Methods 0.000 claims abstract description 82
- 230000000007 visual effect Effects 0.000 claims abstract description 50
- 238000000034 method Methods 0.000 abstract description 50
- 230000008569 process Effects 0.000 abstract description 38
- 238000000879 optical micrograph Methods 0.000 abstract description 7
- 230000006870 function Effects 0.000 description 25
- 230000000875 corresponding effect Effects 0.000 description 15
- 238000006243 chemical reaction Methods 0.000 description 11
- 238000012937 correction Methods 0.000 description 10
- 230000003287 optical effect Effects 0.000 description 10
- 238000011161 development Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 9
- 230000004044 response Effects 0.000 description 9
- 230000008859 change Effects 0.000 description 7
- 238000005259 measurement Methods 0.000 description 7
- 238000012360 testing method Methods 0.000 description 6
- 238000007906 compression Methods 0.000 description 5
- 230000009467 reduction Effects 0.000 description 5
- 230000006835 compression Effects 0.000 description 4
- 238000005286 illumination Methods 0.000 description 4
- 238000005070 sampling Methods 0.000 description 4
- 238000003745 diagnosis Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 238000010827 pathological analysis Methods 0.000 description 3
- 238000002360 preparation method Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000007170 pathology Effects 0.000 description 2
- 238000004171 remote diagnosis Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 240000004050 Pentaglottis sempervirens Species 0.000 description 1
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 239000006059 cover glass Substances 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000008393 encapsulating agent Substances 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 230000004304 visual acuity Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/368—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements details of associated display arrangements, e.g. mounting of LCD monitor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0007—Image acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/40—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
Definitions
- the present invention relates to an image processing apparatus, an image processing method, an image processing system, and a program.
- the amount of data created by the virtual slide system is enormous. Therefore, it is possible to observe from the micro (detailed enlarged image) to the macro (overall bird's-eye view) by performing the enlargement / reduction processing with the viewer. Provide convenience. By acquiring all necessary information in advance, it is possible to display immediately from the low-magnification image to the high-magnification image at the resolution and magnification required by the user.
- the medical image data is displayed in full size on the display unit to support the diagnosis of the doctor Display devices.
- the size of the field of view is generally different from the image observed with a microscope.
- the observation field of view differs between the optical microscope image and the virtual slide image. there were.
- an object of the present invention is to propose an image processing apparatus capable of generating a virtual slide image equivalent to an observation visual field visible with an optical microscope image.
- one aspect of the present invention provides: An image processing device for processing virtual slide image data to be displayed on an image display device, An image data acquisition unit for acquiring image data obtained by imaging an imaging target; An image data generation unit that generates display image data for displaying the image to be imaged on the image display device at a display magnification corresponding to the number of fields of view of a predetermined microscope. Device.
- An image processing method for processing a virtual slide image An image data acquisition step of acquiring image data obtained by imaging the imaging target; An image data generation step of generating display image data for displaying an image on the image display device at a display magnification corresponding to a predetermined number of fields of view of the microscope.
- An image processing system comprising: the image processing device; and an image display device that displays the image to be imaged at a display magnification corresponding to a number of fields of view of a virtual microscope image processed by the image processing device. is there.
- Another aspect of the present invention is: A program for causing a computer to execute each step of the image processing method.
- an image processing apparatus capable of generating a virtual slide image equivalent to an observation visual field that can be seen with an optical microscope image.
- FIG. 1 is a schematic overall view showing an example of an apparatus configuration of an image processing system using an image processing apparatus of the present invention. It is a functional block diagram which shows an example of a function structure of the imaging device in the image processing system using the image processing apparatus of this invention. It is a functional block diagram which shows an example of a functional block structure of the image processing apparatus of this invention. It is a block diagram which shows an example of the hardware constitutions of the image processing apparatus of this invention. It is a schematic diagram for demonstrating the concept of display magnification. It is a flowchart which shows an example of the flow of the display magnification change process of the image processing apparatus of this invention.
- An image processing apparatus is an image processing apparatus that processes virtual slide image data to be displayed on an image display apparatus, and includes at least an image data acquisition unit and an image data generation unit.
- the image data generation unit preferably generates display image data for displaying an image to be imaged on the image display device at a display magnification corresponding to a predetermined number of fields of the microscope.
- the predetermined microscope visual field is determined based on information stored in advance in the image processing apparatus or the external storage device and / or a user instruction. What microscope field of view is reproduced is preferably stored in advance as the above information.
- the information stored in advance includes initial visual field information (information selected as a microscopic visual field when there is no instruction from the user; hereinafter, also simply referred to as “initial information”), and / or a plurality of specific actual items. It is desirable to include microscope field-of-view information (a plurality of microscope field-of-view information selectable by the user). Note that the initial visual field information may be stored in a format in which one of the visual field information of the plurality of microscopes is selected.
- the field-of-view information of the microscope includes, for example, one or both of the number of fields and the magnification of the objective lens.
- a new observation area determined based on a user instruction may be stored as additional visual field information so that it can be selected as one of visual field information options.
- a new observation area determined based on a user instruction may be managed for each user to be used.
- the image data generation unit can determine the display magnification so that the diameter of the real field of the predetermined microscope matches the length of the long side or the short side of the display screen of the image display device. Further, the image data generation unit can determine the display magnification based on information regarding the field of view of the actual microscope. In addition, the image data generation unit can determine the display magnification by using, as initial information, a predetermined one of a plurality of pieces of information related to the field of view of the actual microscope. Further, the image data generation unit can determine the display magnification using one of a plurality of pieces of information regarding the field of view of the actual microscope based on a user's selection. The image data generation unit can generate display image data in accordance with the number of pixels of the image display device. The image data unit can generate display image data according to the objective lens magnification when the imaging target is imaged. In the following description and accompanying drawings, “display image data” may be abbreviated as “display image data”.
- the image data generation unit preferably generates display image data in which the display magnification is changed by a pixel magnification represented by the following formula.
- Pixel magnification (number of pixels on the long or short side of the display screen of the image display device / (number of fields of a predetermined microscope / pixel pitch of the image sensor)) ⁇ (display magnification / image pickup on the display screen of the image display device) Objective lens magnification)
- a ratio of how many pixels on the display screen of the image display device are used to represent information for one pixel of the image sensor is defined as a pixel magnification.
- pixel equal magnification display In general, displaying one pixel of image data in correspondence with one pixel of the display screen of the image display device is referred to as pixel equal magnification display.
- information acquired by one pixel of the image sensor corresponds to one pixel of image data. In that case, the pixel magnification at the time of pixel equal magnification display is 1.
- the pixel pitch on the side selected in the above “pixel pitch of the image sensor” and “the number of pixels on the long side or the short side of the display screen of the image display device” is selected.
- the pixel magnification is defined using the pixel pitch. Note that here, the terms long side and short side are used assuming a rectangular display screen, but in the case of an elliptical display screen, the long axis is defined as the long side and the short axis is the short side. Defined as an edge.
- Pixel magnification (enlargement magnification) ⁇ (pixel pitch of image sensor) / (pixel pitch on the display screen of the image display device)
- magnification (Display magnification) / (Object lens magnification at the time of imaging) From the above formula, it can be expressed by the following formula.
- Magnification magnification (Display magnification) ⁇ (Pixel pitch on display screen of image display device) / ((Pixel pitch of image sensor) ⁇ (Objective lens magnification during imaging))
- the image processing apparatus can further include a mode selection unit.
- the mode selection unit can select at least one of the following modes (1) to (3) as a mode for selecting an image to be displayed on the image display device.
- An image processing method is an image processing method for processing a virtual slide image, and includes at least an image data acquisition step and an image data generation step.
- image data acquisition step image data obtained by imaging the imaging target is acquired.
- image data generation step display image data for displaying an image at a display magnification corresponding to the number of fields of view of the microscope is generated in order to form an image (observation field of view) close to an image viewed with a microscope.
- Pixel magnification (number of pixels on the long or short side of the display screen of the image display device / (number of fields of a predetermined microscope / pixel pitch of the image sensor)) ⁇ (display magnification / image pickup on the display screen of the image display device) Objective lens magnification)
- the program of the present invention causes a computer to execute each step of the above image processing method.
- the image processing system of the present invention includes an image processing device that processes a virtual slide image, and an image display device that displays the virtual slide image processed by the image processing device. Further, a display unit for displaying the image data generated by the image data generation unit on the image display device may be provided.
- the image data acquisition unit acquires image data obtained by imaging the imaging target.
- the image data generation unit generates display image data for causing the image display device to display the virtual slide image processed by the image processing device at a display magnification corresponding to the number of fields of view of the microscope.
- image display device may be abbreviated as “display device”.
- the aspect described in the image processing apparatus can be reflected.
- the image processing apparatus of the present invention can be used in an image processing system including an imaging device and an image display device. This image processing system will be described with reference to FIG.
- FIG. 1 is a schematic overall view showing an example of an image processing system using an image processing apparatus of the present invention.
- An imaging apparatus (microscope apparatus or virtual slide apparatus) 101, an image processing apparatus 102, and an image display apparatus 103 are shown.
- the imaging apparatus 101 and the image processing apparatus 102 are connected by a dedicated or general-purpose I / F cable 104, and the general-purpose I / F cable is connected between the image processing apparatus 102 and the image display apparatus 103.
- 105 is connected.
- a virtual slide device having a function of imaging a single two-dimensional image or a plurality of two-dimensional images at different positions in a two-dimensional plane direction and outputting a digital image can be suitably used.
- a solid-state imaging device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) is preferably used for acquiring a two-dimensional image.
- a digital microscope apparatus in which a digital camera is attached to an eyepiece part of a normal optical microscope can be used instead of the virtual slide apparatus.
- the obtained image can be divided into an observation area and an outside of the observation area.
- the image processing apparatus 102 generates data to be displayed on the image display apparatus 103 from one or a plurality of original image data acquired from the imaging apparatus 101 in response to a request from the user based on the original image data.
- a device having functions and the like can be preferably used.
- the image processing apparatus 102 an apparatus composed of a general-purpose computer or a workstation having hardware resources such as various I / Fs including a CPU (Central Processing Unit), a RAM, a storage device, and an operation unit is used. be able to.
- a large-capacity information storage device such as a hard disk drive can be suitably used.
- the storage device preferably stores programs and data for realizing each process described later, an OS (operating system), and the like.
- the operation unit 106 includes, for example, a keyboard and a mouse, and is used for an operator to input various instructions.
- the operation unit 106 may be a component of the image processing apparatus 102.
- the image display device 103 in this example is a display that displays an observation image that is a result of the arithmetic processing performed by the image processing device 102, and includes a CRT, a liquid crystal display, or the like.
- a printing device that prints and displays an image may be used as the image display device.
- the image display device may be referred to as a display.
- the imaging system is configured by the three devices of the imaging device 101, the image processing device 102, and the image display device 103, but the configuration of the present invention is not limited to this configuration.
- an image processing device integrated with the image display device may be used, or the function of the image processing device may be incorporated in the imaging device.
- the functions of the imaging device, the image processing device, and the image display device can be realized by a single device.
- the function of each device such as an image processing device may be divided and realized by a plurality of devices.
- FIG. 2 is a functional block diagram illustrating an example of a functional configuration of the imaging apparatus 101.
- the image pickup apparatus 101 of this example is roughly shown in the illumination unit 201, stage 202, stage control unit 205, imaging optical system 207, image pickup unit 210, development processing unit 219, pre-measurement unit 220, main control system 221, and data output unit. (I / F) 222.
- the illumination unit 201 in this example is a means for uniformly irradiating light to the preparation 206 disposed on the stage 202, and preferably includes a light source, an illumination optical system, and a light source drive control system. .
- the stage 202 of this example is driven and controlled by a stage control unit 205, and can move in three directions of XYZ.
- the preparation 206 of this example is a member in which a tissue section or smeared cells to be observed are pasted on a slide glass, and the tissue section or smeared cells are fixed under a cover glass together with an encapsulating agent.
- the stage control unit 205 in this example includes a drive control system 203 and a stage drive mechanism 204.
- the drive control system 203 receives the instruction from the main control system 221 and controls the drive of the stage 202.
- the moving direction, moving amount, and the like of the stage 202 are based on the position information and thickness information (distance information) of the sample measured by the pre-measurement unit 220 and an instruction from the user that is input as necessary. It is determined.
- the stage drive mechanism 204 in this example drives the stage 202 in accordance with instructions from the drive control system 203.
- the imaging optical system 207 of this example is a lens group for forming an optical image of the specimen of the preparation 206 on the image sensor 208.
- the imaging unit 210 of this example includes an imaging sensor 208 and an analog front end (AFE) 209.
- the imaging sensor 208 of this example is a one-dimensional or two-dimensional image sensor that changes a two-dimensional optical image into an electrical physical quantity by photoelectric conversion.
- As the image sensor 208 for example, a CCD or a CMOS device is used.
- a one-dimensional sensor is used, a two-dimensional image can be obtained by scanning the one-dimensional sensor in the scanning direction.
- the imaging sensor 208 of this example outputs an electrical signal having a voltage value corresponding to the light intensity.
- a color image is desired as the captured image, for example, a single-plate image sensor to which a Bayer color filter is attached can be used as the image sensor.
- the imaging unit 210 of this example can capture a divided image of the specimen by moving the stage 202 in the XY axis direction and capturing an image.
- the AFE 209 in this example is a circuit that converts an analog signal output from the image sensor 208 into a digital signal.
- the AFE 209 is preferably configured by an H / V driver, a CDS (Correlated double sampling), an amplifier, an AD converter, and a timing generator, which will be described later.
- the H / V driver of this example converts a vertical synchronization signal and a horizontal synchronization signal for driving the image sensor 208 into potentials necessary for driving the sensor.
- the CDS of this example is a double correlation sampling circuit that removes fixed pattern noise.
- the amplifier is an analog amplifier that adjusts the gain of an analog signal from which noise has been removed by CDS.
- the AD converter of this example converts an analog signal into a digital signal.
- the AD converter converts the analog signal into digital data quantized from about 10 bits to about 16 bits and outputs in consideration of subsequent processing.
- the converted sensor output data is referred to as RAW data.
- the RAW data is developed by the subsequent development processing unit 219.
- the timing generator of this example generates a signal for adjusting the timing of the image sensor 208 and the timing of the development processing unit 219 in the subsequent stage.
- the above AFE 209 is usually essential.
- the function of the AFE 209 is usually included in the sensor.
- the development processing unit 219 in this example includes a black correction unit 211, a white balance adjustment unit 212, a demosaicing processing unit 213, an image composition processing unit 214, a resolution conversion processing unit 215, a filter processing unit 216, a ⁇ correction unit 217, and a compression process. Part 218.
- the black correction unit 211 of this example performs a process of subtracting the black correction data obtained at the time of shading from each pixel of the RAW data.
- the white balance adjustment unit 212 of this example performs a process of reproducing a desired white color by adjusting the gain of each RGB color according to the color temperature of the light of the illumination unit 201. Specifically, white balance correction data is added to the RAW data after black correction. When handling a monochrome image, the white balance adjustment process is not necessary.
- the development processing unit 219 of the present example generates hierarchical image data, which will be described later, from the divided image data of the specimen imaged by the imaging unit 210.
- the demosaicing processing unit 213 in this example performs processing for generating image data of each color of RGB from RAW data in the Bayer array.
- the demosaicing processing unit 213 of this example calculates the values of each RGB color of the target pixel by interpolating the values of peripheral pixels (including pixels of the same color and other colors) in the RAW data.
- the demosaicing processing unit 213 also executes defective pixel correction processing (interpolation processing). Note that when the image sensor 208 of this example does not have a color filter and a single color image is obtained, the demosaicing process is not necessary.
- the image composition processing unit 214 of this example performs processing for generating large-capacity image data in a desired imaging range by connecting image data acquired by dividing the imaging range by the imaging sensor 208.
- one piece of two-dimensional image data is generated by joining the divided image data. For example, assuming that a 10 mm square area on the slide 206 is imaged with a resolution of 0.25 ⁇ m, the number of pixels on one side is 40,000 pixels of 10 mm / 0.25 ⁇ m, and the total number of pixels is 1.6 billion, which is the square of the number of pixels. It becomes a pixel.
- the resolution conversion processing unit 215 of this example performs processing for generating a magnification image corresponding to the display magnification in advance by resolution conversion in order to display the large-capacity two-dimensional image generated by the image composition processing unit 214 at high speed.
- a plurality of stages of image data from low magnification to high magnification are generated and configured as image data having a hierarchical structure.
- the image data acquired by the imaging device 101 is desired to be high-resolution and high-resolution imaging data for the purpose of diagnosis. However, when a reduced image of image data consisting of billions of pixels is displayed as described above, if the resolution conversion is performed each time in accordance with a display request, the processing may be slow.
- the hierarchical image data for display is generated by reducing the resolution using a resolution conversion method based on image data having the highest resolution.
- bilinear which is a two-dimensional linear interpolation process
- bicubic using a cubic interpolation equation can be used as a resolution conversion method.
- the filter processing unit 216 of this example is a digital filter that realizes suppression of high frequency components included in an image, noise removal, and enhancement of resolution.
- the gamma correction unit 217 of the present example executes processing for adding an inverse characteristic to an image in accordance with the gradation expression characteristic of a general display device, or performs human vision through gradation compression or dark part processing of a high luminance part. Perform gradation conversion according to the characteristics.
- gradation conversion suitable for the subsequent display processing is applied to the image data.
- the compression processing unit 218 of this example is a compression encoding process performed for the purpose of improving the efficiency of transmission of large-capacity 2D image data and reducing the capacity when storing the data.
- standardized encoding methods such as JPEG (Joint Photographic Experts Group) and JPEG 2000 and JPEG XR improved and evolved from JPEG can be used.
- the pre-measurement unit 220 of this example is a unit that performs pre-measurement to calculate the position information of the specimen on the slide 206, the distance information to the desired focal position, and the parameter for adjusting the amount of light caused by the specimen thickness. .
- the pre-measurement unit 220 of this example grasps the position of the sample on the XY plane from the acquired image. For obtaining distance information and thickness information, a laser displacement meter or a Shack-Hartmann measuring instrument can be used.
- the main control system 221 of this example controls various units described so far.
- Control of the main control system 221 and the development processing unit 219 can be realized by a control circuit having a CPU, a ROM, and a RAM.
- the functions of the main control system 221 and the development processing unit 219 are realized by storing programs and data in the ROM in advance and executing the programs using the RAM as a work memory.
- a device such as an EEPROM or a flash memory can be used as the ROM.
- the RAM for example, a DRAM device such as DDR3 can be used.
- the function of the development processing unit 219 may be replaced with an ASIC implemented as a dedicated hardware device.
- the data output unit 222 in this example is an interface for sending the RGB color image generated by the development processing unit 219 to the image processing apparatus 102.
- the imaging apparatus 101 and the image processing apparatus 102 in this example are connected by an optical communication cable. Instead of this cable, a general-purpose interface such as USB or Gigabit Ethernet (registered trademark) may be used.
- FIG. 3 is a functional block diagram illustrating an example of a functional configuration of the image processing apparatus 102 according to the present invention.
- the image processing apparatus 102 includes an outline, an image data acquisition unit 301, a storage holding unit (memory) 302, a user input information acquisition unit 303, a display device information acquisition unit 304, a pixel magnification setting unit 305, and display image data acquisition. 306, a display data generation unit 307, and a display image data output unit 308.
- the image data acquisition unit 301 in this example acquires image data captured by the imaging device 101.
- the image data referred to in this example is based on RGB color divided image data obtained by dividing and imaging a specimen, one piece of two-dimensional image data obtained by combining the divided image data, and two-dimensional image data. Or at least one of the image data hierarchized for each display magnification.
- the divided image data may be monochrome image data.
- the storage holding unit 302 of this example takes in image data acquired from an external device via the image data acquisition unit 301, stores it, and holds it. In addition, it is desirable that the memory holding unit 302 holds the above-described specific real-time field-of-view information of a plurality of microscopes and information on which of the field-of-view information is initially used.
- the user input information acquisition unit 303 of the present example via an operation unit such as a mouse or a keyboard, updates the display image data such as display position change, enlarged / reduced display, display mode selection, observation region specification ( For example, input information by the user such as selecting one of a plurality of microscope visual field information held by the memory holding unit) is acquired.
- the display mode in this example includes a mode for reproducing the microscope observation field and a mode for not reproducing. Specifying the display mode may be considered synonymous with specifying the display magnification.
- the display device information acquisition unit 304 of this example acquires display magnification information of the currently displayed image, in addition to display area information (screen resolution, display size) of the display held by the image display device 103.
- the pixel magnification setting unit 305 of this example generates control data for setting the display magnification according to the instruction from the user acquired by the user input information acquisition unit 303. In addition, based on the set pixel magnification, the display image data size is calculated and notified to the display image data acquisition unit 306.
- the control data and / or display image data size output from the pixel magnification setting unit 305 of this example reflects either the above-described initial visual field information or observation area information specified by the user.
- the observation area information specified by the user is specified by the user by revising a part of the actual microscope field-of-view information selected by the user or by partially revising the actual microscope field-of-view information.
- Information on the observation region specified by the user regardless of the field of view information of the microscope.
- the initial visual field information may be information obtained by reading out the initial visual field information held by the storage holding unit 302 from the storage holding unit 302.
- control data and / or display image data size output by the pixel magnification setting unit 305 of the present example includes the objective lens magnification at the time of image acquisition, information at the time of imaging such as the pixel pitch of the image sensor, and image display. It is desirable that information of the image display device such as the pixel pitch of the display screen of the device and the number of pixels of the display screen is also reflected.
- the display image data acquisition unit 306 in this example acquires image data necessary for display from the storage unit 302 in accordance with the control instruction of the pixel magnification setting unit 305.
- the display data generation unit 307 of this example displays display data to be displayed on the image display device 103 from the image data acquired by the display image data acquisition unit 306 according to the display mode and pixel magnification set by the pixel magnification setting unit. Generate by scaling.
- the display data generation will be described later with reference to the flowchart of FIG.
- the display data output unit 308 of this example outputs the display data generated by the display data generation unit 307 to the image display device 103 which is an external device.
- FIG. 4 is a block diagram illustrating an example of a hardware configuration of the image processing apparatus according to the present invention.
- a PC Personal Computer
- FIG. 4 is a block diagram illustrating an example of a hardware configuration of the image processing apparatus according to the present invention.
- a PC Personal Computer
- FIG. 4 is a block diagram illustrating an example of a hardware configuration of the image processing apparatus according to the present invention.
- a PC Personal Computer
- FIG. 4 is a block diagram illustrating an example of a hardware configuration of the image processing apparatus according to the present invention.
- a PC Personal Computer
- the PC of this example includes a CPU (Central Processing Unit) 401, a RAM (Random Access Memory) 402, a storage device 403, a data input / output I / F 405, and an internal bus 404 that connects them to each other.
- a CPU Central Processing Unit
- RAM Random Access Memory
- storage device 403 a data input / output I / F 405, and an internal bus 404 that connects them to each other.
- the CPU 401 in this example accesses the RAM 402 and the like as appropriate, and performs overall control of the entire block of the PC while performing various arithmetic processes.
- the RAM 402 is used as a work area for the CPU 401, and various data to be processed such as an OS, various programs being executed, and generation of display data that reproduces the microscope observation field of view that is a feature of the present invention. (Including visual field information etc.) etc. temporarily.
- the storage device 403 in this example is an auxiliary storage device that records and reads information in which firmware such as an OS, a program, and various parameters that are executed by the CPU 401 is fixedly stored.
- a semiconductor device using a magnetic disk drive or flash memory such as HDD (Hard Disk Drive) or SSD (Solid State Disk) of this example is used.
- the storage device 403 in this example includes various types of data to be processed (view information of a plurality of microscopes, etc.) such as the OS, various programs being executed, and generation of display data that reproduces the microscope observation field of view that is a feature of the present invention. Etc.) are stored.
- the data input / output I / F 405 of this example includes an image server 701 via a LAN I / F 406, an image display device 103 via a graphics board, and a virtual slide device or digital microscope via an external device I / F.
- a representative imaging apparatus 101 is connected to a keyboard 410 and a mouse 411 via an operation I / F 409, respectively.
- the image display apparatus 103 of this example is a display device using, for example, liquid crystal, EL (Electro-Luminescence), CRT (Cathode Ray Tube), or the like.
- the image display device 103 is assumed to be connected as an external device, but a PC integrated with the image display device may be assumed.
- a notebook PC corresponds to this.
- a pointing device such as a keyboard 410 or a mouse 411 is assumed, but a configuration in which the screen of the image display device 103 such as a touch panel is directly used as an input device is also possible. It is. In that case, the touch panel can be integrated with the image display device 103.
- FIG. 5 is a conceptual diagram showing an outline of a display form reproduced on the microscope visual field and the display of the image display apparatus.
- FIG. 5 (a) shows an example of the field of view observed when looking through a microscope.
- the microscope field is uniquely determined by the magnification of the objective lens of the microscope and the number of fields.
- F.I. O. V. (Number of field of view of eyepiece) / ((magnification of objective lens) ⁇ (zoom magnification)).
- an enlarged image of the specimen as the object can be observed in a circular area 501 as shown in the figure. Since the light does not reach outside the circular observation area, the image cannot be confirmed.
- a pathologist Prior to the existence of a virtual slide device, a pathologist as a user made a diagnosis by viewing such an observation image.
- the diameter of the circular microscopic observation field is the number of pixels divided by the pixel pitch of the image sensor 208.
- the height of the letter “A” is equal to the diameter of the microscope visual field.
- FIG. 5B is an example of a display screen at the time of pixel equal magnification display.
- Pixel equal magnification refers to a state in which each pixel sampled from a microscope observation field as digital data and the display element of the display have a one-to-one correspondence.
- the display side also displays using 1000 pixels.
- Reference numeral 503 assumes a display screen of an image display apparatus having a large screen of 4k ⁇ 2k, for example.
- Reference numeral 504 denotes a display screen size in the vertical direction of the display screen 503.
- Reference numeral 505 denotes an image display size when displayed at the same pixel magnification.
- 505 is also 1000 pixels.
- the acquired original image data is displayed at the pixel equal magnification. Therefore, when the size of the display screen 503 is large, image data wider than the microscope observation field of view can be displayed on the screen. It becomes possible.
- FIG. 5C is an example of a display screen in the same pixel display.
- the case of displaying on a display having a smaller size and lower resolution than that in FIG. 5B will be described.
- 506 is a display screen of a relatively small image display device having, for example, 1024 ⁇ 768 pixels.
- 507 is the vertical display screen size of the display screen 506. Here, it is assumed that 768 display pixels are included.
- Reference numeral 508 denotes an image size when displayed at the same pixel size. Since the vertical display size 507 (768 pixels) is smaller than the number of pixels (1000 pixels) obtained by sampling the microscope observation field, the entire microscope field is displayed. Cannot be displayed. As described above, in the same size pixel display, when the size of the display screen 506 is small, only image data in a range narrower than the microscope observation field can be displayed on the screen. Note that, as described above, in the present invention and this specification, the pixel magnification for pixel equal magnification display is defined as 1.
- FIG. 5D is an example of a display screen of the same size display in which the display magnification is changed so that the size of the target image is the same even between displays of different sizes and display resolutions. Even if there are two display screens with different sizes described in FIGS. 5B and 5C, the size of the image (physical) displayed on the display as indicated by the size of 509 exists. The same size) is the same. Note that, as described above, in the present invention and the present specification, the pixel magnification for the same size display is defined by the following equation (1).
- Pixel magnification (Enlargement magnification) ⁇ (Pixel pitch of image sensor) / (Pixel pitch on the display screen of the image display device) Expression (1)
- the same size display is effective in the case where the display size of an object is the same even in different users and places, for example, in remote diagnosis.
- FIG. 5 (e) is an example of a display screen for reproducing the microscope observation field, which combines the observation field of the microscope, which is a feature of the present invention, and the size of the appearance in the display area of the image display device. Even if there are two display screens having different sizes as in FIG. 5D, depending on the specifications and performance of the display, the observation field diameter 502 and the vertical sizes 510 and 511 of each display area are matched. Therefore, it is possible to display a display image in accordance with a microscope observation field familiar to the user.
- Pixel magnification (number of pixels on the long or short side of the display screen of the image display device / (number of visual fields of a predetermined microscope / pixel pitch of the image sensor)) ⁇ (display magnification on the image display device / at the time of image acquisition) Objective lens magnification) (2)
- the number of pixels in the vertical direction of the display screen is the number of pixels on the short side as expressed in Equation (2).
- pixel magnification (number of pixels in the vertical direction of the display screen of the image display device / (number of fields of view of a predetermined microscope / pixel pitch of the image sensor))
- ⁇ display magnification on the image display device / Objective lens magnification during image acquisition
- equation (2) includes the following cases. That is, for example, when some pixels are used to display information other than image display, when some pixels are used as a frame, when some pixels are used to display another image, etc. Then, after excluding those pixels, the “number of pixels on the long side or the short side of the display screen of the image display device” is counted. Further, Expression (2) also allows an error within 10 pixels when the number of pixels on the long side or the short side of the display screen of the image display device is used as a reference.
- step S601 the size information (the number of pixels as the screen resolution) of the display area of the display which is the image display device 103 is acquired from the image display device 103 from the image display device information acquisition unit 304.
- the size information of the display area is used when determining the size of display data to be generated.
- step S ⁇ b> 602 information on the display magnification of the image currently displayed on the image display device 103 is acquired from the display device information acquisition unit 304.
- a specified magnification is set.
- the display magnification is used when selecting any image data from the hierarchical image. It is also used when determining the size of display data to be generated.
- a numerical value of the number of visual fields required in a mode for reproducing a microscope observation visual field, which will be described later, is also acquired as a specified value or acquired by user designation.
- step S603 display mode setting information is acquired.
- the display mode here is large, that is, a microscope observation visual field reproduction display mode and a pixel equal magnification display mode.
- step S604 it is determined whether or not the user has selected the microscope observation visual field reproduction display mode. If the microscope observation visual field reproduction display mode is selected, the process proceeds to step S605, and if the normal magnification visual field display mode is selected, the process proceeds to step S607.
- step S605 image data to be displayed on the image display device 103 is acquired from the storage unit 302 based on the display area size information acquired in step S601 and the display magnification and field-of-view information acquired in step S602.
- step S606 in response to selection of the microscope observation field reproduction display mode, image data for microscope observation field reproduction display is generated. Specifically, scaling processing is performed on the acquired image data based on the pixel magnification calculation formula shown in Formula (2).
- step S607 based on the display area size information acquired in step S601 and the display magnification information acquired in step S602, image data to be displayed on the image display device 103 is acquired from the storage holding unit 302.
- step S608 display image data for the normal observation visual field is generated in response to the selection of the normal magnification visual field display mode.
- resolution conversion processing is applied so that the image data of the close display magnification in the hierarchical image acquired in step S603 has a desired resolution.
- Correction processing is performed according to the characteristics of the image display device 103 as necessary.
- step S609 the display data generated in step S606 or step S608 is output to the image display device 103.
- step S610 the image display device 103 displays the input display data on the screen.
- step S611 it is determined whether the image display is completed. When another sample image is selected by the user, when the operation of the display application is completed, the process ends. If the display screen is continuously updated, the process returns to step S602 and the subsequent processing is repeated.
- the virtual slide image can be displayed in a variable magnification to reproduce the microscope observation field of view in addition to the normal pixel magnification display.
- a zoom display function for performing the same size display is added to the first embodiment.
- a circular visual field region is provided to make it easier to watch the observation.
- the configuration described in the first embodiment can be used except for the configuration different from the first embodiment.
- FIG. 7 is a schematic overall view showing an example of an apparatus constituting an image processing system according to the second embodiment of the present invention.
- An image processing system using the image processing apparatus illustrated in FIG. 7 includes an image server 701, an image processing apparatus 102, an image display apparatus 103, and an image processing apparatus 704 located in a remote place via the network 702, and the network 702. And an image display device 705 connected to the image processing device 704 at a remote location.
- the image processing apparatus 102 of this example can acquire image data obtained by imaging a sample from the image server 701 and generate image data to be displayed on the image display apparatus 103.
- the image server 701 and the image processing apparatus 102 are connected via a network 702 with a general-purpose I / F LAN cable 703.
- the image server 701 of this example is a computer including a large-capacity storage device that stores image data captured by the imaging device 101 that is a virtual slide device.
- the image server 701 of this example may store the image data with different display magnifications as a single unit in a local storage connected to the image server 701, or divide each of them to somewhere on the network.
- the server group (cloud server) may have a separate entity of each divided image data and link information.
- the hierarchical image data itself does not need to be stored on a single server.
- the image processing apparatus 102 and the image display apparatus 103 are the same as the image processing system of the first embodiment. It is assumed that the image processing apparatus 704 is in a remote place via the network 702. The function is the same as that of the image processing apparatus 102.
- the image processing system is configured by the five devices of the image server 701, the image processing devices 102 and 704, and the image display devices 103 and 705, but the present invention is not limited to this configuration.
- the image processing apparatuses 102 and 704 in which the image display apparatuses 103 and 705 are integrated may be used, or some of the functions of the image processing apparatuses 102 and 704 may be incorporated in the image server 701.
- the functions of the image server 701 and the image processing apparatuses 102 and 704 may be divided and realized by a plurality of apparatuses.
- FIG. 8 shows the specifications and performance, such as the resolution, of the image display devices 103 and 705, which are the features of this embodiment, with respect to the processing for generating image data for displaying the microscope observation field of view described in FIG. 6 of the first embodiment.
- 10 is a flowchart illustrating an example of a flow of image data generation processing for microscope visual field display to which a scaling function of the same size display for presenting an image with the same size even when they are different. Except for the process of reproducing the same size display mode and the microscope observation field of view, the process is the same as in FIG.
- step S601 to step S604 The contents of various information acquisition and branching processes necessary for the scaling process accompanying the pixel magnification change from step S601 to step S604 are the same as those described in FIG. 6 of the first embodiment.
- step S801 image data for microscopic observation visual field reproduction display is generated in response to selection of the microscopic observation visual field reproduction display mode.
- the scaling process of the pixel magnification using Expression (2) is the same as that in step S606, but a process of displaying a circular area that simulates the microscope observation field is added. Details will be described with reference to FIG.
- step S802 upon receiving a display mode selection other than the microscope observation visual field reproduction mode, it is determined whether to display in the same size or in the same pixel size.
- the process proceeds to step S803, and when the pixel equal magnification display mode is selected, the process proceeds to step S607.
- step S803 image data to be displayed on the image display device 103 is acquired from the storage unit 302 based on the display area size information, the display pixel pitch size information acquired in step S601, and the display magnification acquired in step S602. To do.
- step S804 image data for the same size display is generated in response to the selection of the same size display mode. Specifically, scaling processing is performed on the acquired image data based on the pixel magnification calculation formula shown in Formula (1).
- step S605 Since the display image data acquisition in step S605 and the processing up to step S611 after the display image data acquisition in step S607 are the same as those in the first embodiment, description thereof will be omitted.
- FIG. 9 is a flowchart showing a detailed flow of display image data generation processing for reproducing the microscope observation field of view shown in step S801 of FIG.
- step S901 mask information is acquired.
- the mask information has information for display pixels constituting the display area of the image display device 103, and can determine for each pixel whether the corresponding image data is displayed with the same luminance value or the luminance value is changed.
- each has a 5-bit value and when the mask information is 0, the value of the image data is used as it is as display data, and when the value is an arbitrary value, the value is used. Accordingly, the luminance value is bit-shifted in the lower direction.
- luminance data of each pixel is assumed as a calculation destination with mask information.
- RGB color image data is a target, it is converted into luminance / color difference signals such as YUV and YCC, The luminance information after the conversion can be the target of the arithmetic processing. Further, a configuration in which a bit shift is applied to each color of RGB may be adopted.
- the bit shift can be arbitrarily set for the display pixels in the display area.
- the mask value in the circular visual field is set to 0, and the mask value in the other area is set.
- the following description will be made assuming that 2 is.
- the luminance value of the acquired image data is reduced to 1 ⁇ 4.
- the luminance of the pixel having a value of 8 bits each and newly calculating the multiplication result of the mask information and each luminance value of the image data Value.
- step S606 in response to selection of the microscope observation field reproduction display mode, image data for microscope observation field reproduction display is generated. Specifically, scaling processing is performed on the acquired image data using the pixel magnification calculation formula shown in Formula (2). The contents here are the same as those described in FIG.
- step S902 it is determined whether or not to set a circular display area that mimics the microscope observation field of view. If a circular display area is set, the process advances to step S903. If an image is displayed on the screen with the microscope visual field reproduction size described in the first embodiment, the process ends.
- step S903 it is determined whether to display the outside of the circular display area as an image with reduced brightness due to the shift process or as an image with reduced brightness in units of display pixels.
- step S904 When the shift process is performed, the process proceeds to step S904, and when the mask information is multiplied by the luminance value of the pixel, the process proceeds to step S907.
- step S904 in response to reproducing the microscope field of view, the value of the mask information acquired and grasped in step S901 is referred between the corresponding pixels. It is determined whether the value of the mask information of the corresponding display pixel referred to is 0, that is, a pixel having normal luminance presented as a gaze area, or a pixel whose luminance is to be reduced outside the microscope observation field. If the mask value is 0, the process proceeds to step S905. If the mask value is other than 0, that is, if the luminance value of the pixel is decreased by bit shift, the process proceeds to step S906.
- step S905 in response to the mask value being 0, the luminance value of the pixel of the acquired image data is directly adopted as the pixel value for display.
- a luminance value may change.
- step S906 in response to the mask value being a value other than 0, the luminance value of the pixel of the acquired image data is bit-shifted in the lower direction according to the value of the mask information acquired in step S901. As a result, it is possible to realize a reduction in luminance according to the mask value.
- step S907 the mask information corresponding to each pixel of the image data is grasped.
- the mask information is, for example, 8-bit information and takes a value from 0 to 255.
- step S908 the brightness value of the corresponding pixel is multiplied by the value of the mask information to calculate a new brightness value.
- the mask information is 255, the same luminance value as before the division is calculated.
- the microscope field of view can also be reproduced by applying the same processing in units of pixels. While the brightness is reduced by bit shift, it can be calculated by multiplication with mask information, and the degree of freedom of brightness setting is further increased.
- the mask information can be changed or newly set by a user instruction even when a predetermined value prepared in advance is used. As a result, it is possible to flexibly cope with shapes other than the circular observation visual field shape imitating the microscope visual field.
- FIG. 10 is an example of a display screen when display data generated by the image processing apparatus 102 of the present invention is displayed on the image display apparatus 103.
- FIG. 10 two display modes simulating a microscope observation field will be described.
- FIG. 10A shows the basic configuration of the screen layout of the image display device 103.
- the display screen includes an information area 1002 indicating the status of display and operation and information of various images, a specimen thumbnail image 1003 to be observed, a detailed display area 1004 indicating a detailed observation area in the thumbnail image, and a detail.
- a display area 1005 for specimen image data for observation and a display magnification 1006 for the display area 1005 are provided.
- Each area and image may have a form in which the display area of the entire window 1001 is divided into functional areas by a single document interface, or each area and image may be constituted by separate windows by a multi-document interface.
- the thumbnail image 1003 displays the position and size of the display area 1005 of the sample image data in the entire image of the sample.
- the position and size can be grasped by the frame of the detailed display area 1004.
- the detailed display area 1004 can be set by, for example, direct setting by a user instruction from an externally connected input device such as a touch panel or a mouse 411, or by moving the display area with respect to the displayed image or by an enlargement / reduction operation. Can be updated.
- specimen image data display area 1005 specimen image data for detailed observation is displayed.
- an enlarged / reduced image is displayed by moving the display area (selecting and moving a partial area to be observed from the entire specimen image) and changing the display magnification.
- the image data acquired by the virtual slide device is prepared as a spliced image of image data obtained by dividing a partial region of the specimen.
- image data and information related to the specimen can be displayed together.
- FIG. 10B is an example of a display screen that reproduces the microscope field of view and performs uniform brightness reduction outside the microscope field of view.
- Reference numeral 1006 denotes a display magnification. Here, it is assumed that the image is displayed at a high magnification of 40 times.
- Reference numeral 1008 denotes an observation area simulating a visual field of a microscope, and an image is displayed with normal luminance in a circular visual field. On the other hand, the luminance of the region outside the microscope field 1007 is reduced at a certain rate.
- the specimen image is displayed in a wide display area, by reducing the brightness of the area other than the microscope observation field to be watched, the microscope observation field familiar to the pathology is reproduced, and the virtual slide is also displayed in the surrounding area.
- FIG. 10C is an example of a display screen in which the microscope observation field is reproduced and the brightness is reduced according to the distance from the center of the microscope field outside the microscope observation field.
- the luminance of the region outside the microscopic observation field 1009 gradually decreases in accordance with the distance from the center of the circular region that reproduces the microscopic field.
- the brightness of the region other than the microscope observation field is reduced according to the distance from the center of the circle that is the gazing point, without changing the presentation of the image in the microscope observation field of view.
- the convenience is increased by making it easier to find the area of interest by increasing the amount of information to the area to be watched.
- the image processing apparatus which can produce
- by preparing a circular mask image it can be made the same as the appearance of the microscope.
- the object of the present invention may be achieved by the following. That is, a recording medium (or storage medium) in which a program code of software that realizes all or part of the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the recording medium. In this case, the program code itself read from the recording medium realizes the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.
- an operating system (OS) operating on the computer performs part or all of the actual processing based on the instruction of the program code.
- OS operating system
- the program code read from the recording medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion card or function expansion unit performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. It can be included in the invention.
- program code corresponding to the flowchart described above is stored in the recording medium.
- the configurations described in the first and second embodiments can be combined with each other.
- three display modes including the same size display mode described in the second embodiment may be selected.
- the image processing apparatus may be connected to both the imaging apparatus and the image server, and an image used for processing may be acquired from any apparatus.
- configurations obtained by appropriately combining various techniques in the above embodiments also belong to the category of the present invention.
- the technical scope of the present invention is defined by each claim in the claims, and should not be construed as limited by the above embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Microscoopes, Condenser (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
- Image Analysis (AREA)
Abstract
Description
画像表示装置に表示させるためのバーチャルスライド画像データを処理する画像処理装置であって、
撮像対象を撮像することにより得られた画像データを取得する画像データ取得ユニットと、
所定の顕微鏡の視野数に応じた表示倍率で、前記撮像対象の画像を前記画像表示装置に表示させるための表示用画像データを生成する画像データ生成ユニットと、を有することを特徴とする画像処理装置である。
バーチャルスライド画像を処理する画像処理方法であって、
撮像対象を撮像することにより得られた画像データを取得する画像データ取得ステップと、
所定の顕微鏡の視野数に応じた表示倍率で画像表示装置に画像を表示させるための表示用画像データを生成する画像データ生成ステップと、を有することを特徴とする。
上記画像処理装置と、前記画像処理装置で処理されたバーチャルスライド画像を 所定の顕微鏡の視野数に応じた表示倍率で、前記撮像対象の画像を表示する画像表示装置と、を備える画像処理システムである。
上記画像処理方法の各ステップをコンピュータに実行させることを特徴とするプログラムである。
ピクセル倍率=(画像表示装置の表示画面の長辺又は短辺の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置の表示画面上での表示倍率/撮像時の対物レンズ倍率)
撮像センサ1画素分の情報を画像表示装置の表示画面の画素を何個用いて表すかという比率をピクセル倍率と定義する。一般に、画像データの1画素を画像表示装置の表示画面の1画素に対応させて表示することをピクセル等倍表示という。本発明書及び本発明においては、撮像センサ1画素で取得した情報を画像データ1画素に対応させることを前提にする。その場合、ピクセル等倍表示の際のピクセル倍率は1となる。
ピクセル倍率=(拡大倍率)×(撮像センサの画素ピッチ)/(画像表示装置の表示画面上での画素ピッチ)
ピクセル倍率=(表示倍率)/(撮像時の対物レンズ倍率)
と上式より、以下の式で表すことができる。
拡大倍率=(表示倍率)×(画像表示装置の表示画面上での画素ピッチ)/((撮像センサの画素ピッチ)×(撮像時の対物レンズ倍率))
(1)下記式で表されるピクセル倍率で生成された表示用画像データを表示するモード
ピクセル倍率=(画像表示装置の表示画面の長辺又は短辺の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置の表示画面上での表示倍率/撮像時の対物レンズ倍率)
(2)ピクセル等倍表示する表示用画像データを表示するモード
(3)下記式で表されるピクセル倍率で生成された表示用画像データを表示するモード
ピクセル倍率=(拡大倍率)×(撮像センサの画素ピッチ)/(画像表示装置の表示画面上での画素ピッチ)
ただし、拡大倍率は、(表示倍率)×(画像表示装置の表示画面上での画素ピッチ)/((撮像センサの画素ピッチ)×(撮像時の対物レンズ倍率))である。
なお、(1)は顕微鏡視野再現モードである。
ピクセル倍率=(画像表示装置の表示画面の長辺又は短辺の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置の表示画面上での表示倍率/撮像時の対物レンズ倍率)
本発明の画像処理装置は、撮像装置と画像表示装置を備えた画像処理システムにおいて用いることができる。この画像処理システムについて、図1を用いて説明する。
図1は、本発明の画像処理装置を用いた画像処理システムの一例を示す模式的な全体図であり、撮像装置(顕微鏡装置、またはバーチャルスライド装置)101、画像処理装置102、画像表示装置103から構成され、撮像対象となる検体(被検試料)の二次元画像を取得し表示する機能を有するシステムである。本例では、撮像装置101と画像処理装置102との間は、専用もしくは汎用I/Fのケーブル104で接続され、画像処理装置102と画像表示装置103の間は、汎用のI/Fのケーブル105で接続されている。
図2は、撮像装置101の機能構成の一例を示す機能ブロック図である。
図3は、本発明の画像処理装置102の機能構成の一例を示す機能ブロック図である。
図4は、本発明の画像処理装置のハードウェア構成の一例を示すブロック図である。情報処理を行う装置として、例えばPC(Personal Computer)が用いられる。
図5は、顕微鏡視野ならびに画像表示装置のディスプレイ上で再現された表示形態の概要を示す概念図である。
ピクセル倍率=(拡大倍率)×(撮像センサの画素ピッチ)/(画像表示装置の表示画面上での画素ピッチ) ・・・式(1)
同一サイズ表示は、例えば遠隔での診断等、異なるユーザーや場所においても対象物の表示サイズを同じにする場合に有効である。
ピクセル倍率=(画像表示装置の表示画面の長辺又は短辺の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置上での表示倍率/画像取得時の対物レンズ倍率) ・・・式(2)
上記のように、縦方向の画素数が縦方向の画素数よりも小さい表示画面を想定した場合には、表示画面の縦方向の画素数が式(2)にいう短辺の画素数になる。そして、式(2)を
ピクセル倍率=(画像表示装置の表示画面の縦方向の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置上での表示倍率/画像取得時の対物レンズ倍率)
として計算することで、表示画面内に顕微鏡視野のすべてが表示される画像データを生成することができる。このように、表示画面内に顕微鏡視野のすべてを表示させようとする場合、短辺の画素数を式(2)に代入することとなる。
本発明の画像処理装置における表示倍率変更処理の流れの一例を図6のフローチャートを用いて説明する。
光学顕微鏡画像で見える観察視野と同等のバーチャルスライド画像を生成することにより、見慣れた顕微鏡観察環境をディスプレイ上でも再現できる。
本発明の第2実施形態に係る画像処理システムについて図を用いて説明する。
図7は、本発明の第2の実施形態に係る画像処理システムを構成する装置の一例を示す模式的な全体図である。
図8は、第1の実施形態の図6で説明した顕微鏡観察視野表示用画像データ生成の処理に対して、本実施例の特徴である、画像表示装置103、705の解像度等の仕様、性能が異なる場合においても同じ大きさで画像を提示する同一サイズ表示の変倍機能を追加した顕微鏡視野表示用画像データ生成処理の流れの一例を示すフローチャートである。同一サイズ表示モードおよび顕微鏡観察視野再現の処理プロセス以外は図6と同様のため、同じ処理の説明については省略する。
図9は、図8のステップS801で示した顕微鏡観察視野を再現する表示用の画像データ生成処理の詳細な流れを示すフローチャートである。
図10は、本発明の画像処理装置102で生成した表示データを画像表示装置103に表示した場合の表示画面の一例である。図10では、顕微鏡観察視野を模した二つの表示モードについて説明する。
本発明によれば、光学顕微鏡画像で見える観察視野と同等のバーチャルスライド画像を生成できる画像処理装置を提供することができる。特に、遠隔地にある画像表示装置の仕様が異なる環境でも同一サイズの画像を表示することができる。また、円形のマスク画像を用意することでさらに顕微鏡の見えと同じにすることができる。
本発明の目的は、以下によって達成されてもよい。すなわち、前述した実施形態の機能の全部または一部を実現するソフトウェアのプログラムコードを記録した記録媒体(または記憶媒体)を、システムあるいは装置に供給する。そして、そのシステムあるいは装置のコンピュータ(またはCPUやMPU)が記録媒体に格納されたプログラムコードを読み出し実行する。この場合、記録媒体から読み出されたプログラムコード自体が前述した実施形態の機能を実現することになり、そのプログラムコードを記録した記録媒体は本発明を構成することになる。
102 画像処理装置
103 画像表示装置
301 画像データ取得部
302 記憶保持部
303 ユーザー入力情報取得部
304 表示装置情報取得部
305 ピクセル倍率設定部
306 表示用画像データ取得部
307 表示データ生成部
308 表示データ出力部
701 画像サーバー
704 ネットワークで接続された遠隔地の画像処理装置
705 画像処理装置と接続される画像表示装置
Claims (19)
- 画像表示装置に表示させるためのバーチャルスライド画像データを処理する画像処理装置であって、
撮像対象を撮像することにより得られた画像データを取得する画像データ取得ユニットと、
所定の顕微鏡の視野数に応じた表示倍率で、前記撮像対象の画像を前記画像表示装置に表示させるための表示用画像データを生成する画像データ生成ユニットと、を有することを特徴とする画像処理装置。 - 前記画像データ生成ユニットは、前記所定の顕微鏡の実視野の直径と前記画像表示装置の表示画面の長辺の長さまたは短辺の長さとが一致するように前記表示倍率を決定することを特徴とする請求項1に記載の画像処理装置。
- 前記画像データ生成ユニットは、実在する顕微鏡の視野に関する情報に基づいて前記表示倍率を決定することを特徴とする請求項1又は2に記載の画像処理装置。
- 前記画像データ生成ユニットは、実在する顕微鏡の視野に関する複数の情報のうちのあらかじめ定められた一つを初期情報として用いて、前記表示倍率を決定することを特徴とする請求項1~3のいずれかに記載の画像処理装置。
- 前記画像データ生成ユニットは、ユーザーの選択に基づいて、実在する顕微鏡の視野に関する複数の情報のうちの一つを用いて、前記表示倍率を決定することを特徴とする請求項1~4のいずれかに記載の画像処理装置。
- 前記画像データ生成ユニットは、前記画像表示装置の画素数に応じて、前記表示用画像データを生成することを特徴とする請求項1~5のいずれかに記載の画像処理装置。
- 前記画像データ生成ユニットは、前記撮像対象を撮像した時の対物レンズ倍率に応じて、前記表示用画像データを生成することを特徴とする請求項1~6のいずれかに記載の画像処理装置。
- 前記画像データ生成ユニットは、前記表示倍率を下記式で表されるピクセル倍率で表示用画像データを生成することを特徴とする請求項1~7のいずれかに記載の画像処理装置。
ピクセル倍率=(画像表示装置の表示画面の長辺又は短辺の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置の表示画面上での表示倍率/撮像時の対物レンズ倍率) - 前記画像データ生成ユニットは、前記表示倍率を下記式で表されるピクセル倍率で表示用画像データを生成することを特徴とする請求項1~7のいずれかに記載の画像処理装置。
ピクセル倍率=(拡大倍率)×(撮像センサの画素ピッチ)/(画像表示装置の表示画面上での画素ピッチ)
ただし、拡大倍率は、(表示倍率)×(画像表示装置の表示画面上での画素ピッチ)/((撮像センサの画素ピッチ)×(撮像時の対物レンズ倍率))である。 - 前記画像処理装置は、更に、モード選択ユニットを有し、
前記モード選択ユニットは、画像表示装置に表示させる画像を選択するためのモードとして以下の(1)~(3)うち少なくとも一つのモードを選択することができることを特徴とする請求項1~7のいずれかに記載の画像処理装置。
(1)下記式で表されるピクセル倍率で生成された表示用画像データを表示するモード
ピクセル倍率=(画像表示装置の表示画面の長辺又は短辺の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置の表示画面上での表示倍率/撮像時の対物レンズ倍率)
(2)ピクセル等倍表示する表示用画像データを表示するモード
(3)下記式で表されるピクセル倍率で生成された表示用画像データを表示するモード
ピクセル倍率=(拡大倍率)×(撮像センサの画素ピッチ)/(画像表示装置の表示画面上での画素ピッチ)
ただし、拡大倍率は、(表示倍率)×(画像表示装置の表示画面上での画素ピッチ)/((撮像センサの画素ピッチ)×(撮像時の対物レンズ倍率))である。 - バーチャルスライド画像を処理する画像処理方法であって、
撮像対象を撮像することにより得られた画像データを取得する画像データ取得ステップと、
所定の顕微鏡の視野数に応じた表示倍率で画像表示装置に画像を表示させるための表示用画像データを生成する画像データ生成ステップと、を有することを特徴とする画像処理方法。 - 前記画像データ生成ステップは、前記所定の顕微鏡の実視野の直径と前記画像表示装置の表示画面の長辺の長さまたは短辺の長さとが一致するように前記表示倍率を決定するステップであることを特徴とする請求項11に記載の画像処理方法。
- 前記画像データ生成ステップは、実在する顕微鏡の視野に関する情報に基づいて前記表示倍率を決定するステップであることを特徴とする請求項11又は12に記載の画像処理方法。
- 前記画像データ生成ステップは、実在する顕微鏡の視野に関する複数の情報のうちのあらかじめ定められた一つを初期情報として用いて、前記表示倍率を決定することを特徴とする請求項11~13のいずれかに記載の画像処理方法。
- 前記画像データ生成ステップは、ユーザーの選択に基づいて、実在する顕微鏡の視野に関する複数の情報のうちの一つを用いて、前記表示倍率を決定するステップであることを特徴とする請求項11~14のいずれかに記載の画像処理方法。
- 前記画像データ生成ステップは、前記表示倍率を下記式で表されるピクセル倍率で変倍し表示用画像データを生成するステップであることを特徴とする請求項11~15のいずれかに記載の画像処理方法。
ピクセル倍率=(画像表示装置の表示画面の長辺又は短辺の画素数/(所定の顕微鏡の視野数/撮像センサの画素ピッチ))×(画像表示装置の表示画面上での表示倍率/撮像時の対物レンズ倍率) - 前記画像データ生成ステップは、前記表示倍率を下記式で表されるピクセル倍率で表示用画像データを生成するステップであることを特徴とする請求項11~15のいずれかに記載の画像処理方法。
ピクセル倍率=(拡大倍率)×(撮像センサの画素ピッチ)/(画像表示装置の表示画面上での画素ピッチ)
ただし、拡大倍率は、(表示倍率)×(画像表示装置の表示画面上での画素ピッチ)/((撮像センサの画素ピッチ)×(撮像時の対物レンズ倍率))である。 - 請求項1~10のいずれかに記載の画像処理装置と、前記画像処理装置で処理されたバーチャルスライド画像を所定の顕微鏡の視野数に応じた表示倍率で表示する画像表示装置と、を備える画像処理システム。
- 請求項11~17のいずれか記載の画像処理方法の各ステップをコンピュータに実行させることを特徴とするプログラム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201280064887.XA CN104011581A (zh) | 2011-12-27 | 2012-12-27 | 图像处理装置、图像处理系统、图像处理方法和图像处理程序 |
DE112012005481.4T DE112012005481T5 (de) | 2011-12-27 | 2012-12-27 | Bildverarbeitungsvorrichtung, Bildverarbeitungssystem, Bildverarbeitungsverfahren und Bildverarbeitungsprogramm |
KR1020147019757A KR20140103171A (ko) | 2011-12-27 | 2012-12-27 | 화상 처리장치, 화상 처리 시스템, 화상 처리방법 및 기억매체 |
US13/910,420 US8947519B2 (en) | 2011-12-27 | 2013-06-05 | Image processing apparatus, image processing system, image processing method, and image processing program |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011-286783 | 2011-12-27 | ||
JP2011286783 | 2011-12-27 | ||
JP2012282784A JP2013152454A (ja) | 2011-12-27 | 2012-12-26 | 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム |
JP2012-282784 | 2012-12-26 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/910,420 Continuation US8947519B2 (en) | 2011-12-27 | 2013-06-05 | Image processing apparatus, image processing system, image processing method, and image processing program |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2013100025A1 true WO2013100025A1 (ja) | 2013-07-04 |
WO2013100025A9 WO2013100025A9 (ja) | 2014-05-30 |
Family
ID=48697504
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/083818 WO2013100025A1 (ja) | 2011-12-27 | 2012-12-27 | 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム |
Country Status (6)
Country | Link |
---|---|
US (1) | US8947519B2 (ja) |
JP (1) | JP2013152454A (ja) |
KR (1) | KR20140103171A (ja) |
CN (1) | CN104011581A (ja) |
DE (1) | DE112012005481T5 (ja) |
WO (1) | WO2013100025A1 (ja) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015038467A (ja) * | 2013-07-18 | 2015-02-26 | パナソニックIpマネジメント株式会社 | 病理診断支援装置及び病理診断支援方法 |
WO2018061951A1 (ja) * | 2016-09-30 | 2018-04-05 | オリンパス株式会社 | 培養観察システム |
US11226476B2 (en) | 2016-09-30 | 2022-01-18 | Olympus Corporation | Specimen observation apparatus |
US11460682B2 (en) | 2017-05-29 | 2022-10-04 | Evident Corporation | Observation device |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013134574A (ja) * | 2011-12-26 | 2013-07-08 | Canon Inc | 画像データ生成装置、画像データ表示システムおよび画像データ生成方法 |
JP6455829B2 (ja) * | 2013-04-01 | 2019-01-23 | キヤノン株式会社 | 画像処理装置、画像処理方法、およびプログラム |
CN104811650A (zh) * | 2014-01-26 | 2015-07-29 | 吴健辉 | 一种图像采集系统 |
JP6363890B2 (ja) * | 2014-07-04 | 2018-07-25 | オリンパス株式会社 | 走査型顕微鏡装置および超解像画像の生成方法 |
JP6627083B2 (ja) * | 2014-08-22 | 2020-01-08 | パナソニックIpマネジメント株式会社 | 画像取得装置および画像形成システム |
US9595086B2 (en) * | 2014-09-04 | 2017-03-14 | Samsung Electronics Co., Ltd. | Image processing device, image processing system and method for image processing |
US9734553B1 (en) | 2014-12-31 | 2017-08-15 | Ebay Inc. | Generating and displaying an actual sized interactive object |
CN105160625A (zh) * | 2015-07-17 | 2015-12-16 | 天脉聚源(北京)科技有限公司 | 图像拼字的方法和装置 |
DE102015121017A1 (de) * | 2015-12-03 | 2017-06-08 | Karl Storz Gmbh & Co. Kg | Beobachtungsvorrichtung, insbesondere medizinische Beobachtungsvorrichtung, mit einer Bedieneinheit sowie Verwendung eines Eingabemoduls |
JP2017114579A (ja) * | 2015-12-21 | 2017-06-29 | 株式会社東芝 | 画像処理装置 |
JP2019532352A (ja) * | 2016-08-28 | 2019-11-07 | オーグメンティクス メディカル リミテッド | 組織標本の組織学的検査のためのシステム |
JP6826455B2 (ja) * | 2017-02-14 | 2021-02-03 | 株式会社日立製作所 | 画像形成装置 |
CN107015356B (zh) * | 2017-03-17 | 2019-08-16 | 中国科学院自动化研究所 | 显微图像的显示方法、显示装置及包含该装置的成像系统 |
JP6962714B2 (ja) * | 2017-06-07 | 2021-11-05 | オリンパス株式会社 | 観察装置 |
JP7165018B2 (ja) | 2018-10-03 | 2022-11-02 | キヤノン株式会社 | 情報処理装置、情報処理方法 |
JP7174318B2 (ja) * | 2019-01-25 | 2022-11-17 | 株式会社エビデント | 情報処理装置、情報処理方法、及びプログラム |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005321657A (ja) * | 2004-05-10 | 2005-11-17 | Nikon Corp | 顕微鏡の光学系、顕微鏡、及びバーチャルスライド作成システム |
JP2008096582A (ja) * | 2006-10-10 | 2008-04-24 | Nikon Corp | カメラ |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002251464A (ja) | 2001-02-22 | 2002-09-06 | Yokogawa Electric Corp | 医療画像表示装置及び医療画像表示方法 |
CN100454078C (zh) * | 2006-06-22 | 2009-01-21 | 北京普利生仪器有限公司 | 一种全息数字化切片的显微图像制作方法 |
JP2011095685A (ja) * | 2009-11-02 | 2011-05-12 | Sony Corp | 顕微鏡システム及び顕微鏡システムの制御方法 |
JP5498129B2 (ja) * | 2009-11-09 | 2014-05-21 | オリンパス株式会社 | バーチャル顕微鏡システム |
JP5658451B2 (ja) * | 2009-11-30 | 2015-01-28 | ソニー株式会社 | 情報処理装置、情報処理方法及びそのプログラム |
JP2012060394A (ja) * | 2010-09-08 | 2012-03-22 | Canon Inc | 画像取得装置 |
US20120127297A1 (en) * | 2010-11-24 | 2012-05-24 | Baxi Vipul A | Digital microscopy with focus grading in zones distinguished for comparable image structures |
JP5825808B2 (ja) * | 2011-03-18 | 2015-12-02 | キヤノン株式会社 | 撮像装置 |
-
2012
- 2012-12-26 JP JP2012282784A patent/JP2013152454A/ja active Pending
- 2012-12-27 DE DE112012005481.4T patent/DE112012005481T5/de not_active Withdrawn
- 2012-12-27 WO PCT/JP2012/083818 patent/WO2013100025A1/ja active Application Filing
- 2012-12-27 KR KR1020147019757A patent/KR20140103171A/ko not_active Application Discontinuation
- 2012-12-27 CN CN201280064887.XA patent/CN104011581A/zh active Pending
-
2013
- 2013-06-05 US US13/910,420 patent/US8947519B2/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005321657A (ja) * | 2004-05-10 | 2005-11-17 | Nikon Corp | 顕微鏡の光学系、顕微鏡、及びバーチャルスライド作成システム |
JP2008096582A (ja) * | 2006-10-10 | 2008-04-24 | Nikon Corp | カメラ |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015038467A (ja) * | 2013-07-18 | 2015-02-26 | パナソニックIpマネジメント株式会社 | 病理診断支援装置及び病理診断支援方法 |
WO2018061951A1 (ja) * | 2016-09-30 | 2018-04-05 | オリンパス株式会社 | 培養観察システム |
JPWO2018061951A1 (ja) * | 2016-09-30 | 2019-07-18 | オリンパス株式会社 | 培養観察システム |
US11226476B2 (en) | 2016-09-30 | 2022-01-18 | Olympus Corporation | Specimen observation apparatus |
US11460682B2 (en) | 2017-05-29 | 2022-10-04 | Evident Corporation | Observation device |
Also Published As
Publication number | Publication date |
---|---|
DE112012005481T5 (de) | 2014-09-04 |
US8947519B2 (en) | 2015-02-03 |
JP2013152454A (ja) | 2013-08-08 |
CN104011581A (zh) | 2014-08-27 |
US20140015954A1 (en) | 2014-01-16 |
WO2013100025A9 (ja) | 2014-05-30 |
KR20140103171A (ko) | 2014-08-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2013100025A1 (ja) | 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム | |
JP6124543B2 (ja) | 画像処理装置、画像処理方法、画像処理システム、及びプログラム | |
JP6091137B2 (ja) | 画像処理装置、画像処理システム、画像処理方法およびプログラム | |
JP5780865B2 (ja) | 画像処理装置、撮像システム、画像処理システム | |
JP5350532B2 (ja) | 画像処理装置、画像表示システム、画像処理方法および画像処理プログラム | |
WO2013100026A9 (ja) | 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム | |
US20140015933A1 (en) | Image processing apparatus, imaging system, and image processing system | |
US20150153559A1 (en) | Image processing apparatus, imaging system, and image processing system | |
JP2014130221A (ja) | 画像処理装置、その制御方法、画像処理システム、及びプログラム | |
JP2013200640A (ja) | 画像処理装置、画像処理システム、画像処理方法、およびプログラム | |
WO2013100029A1 (ja) | 画像処理装置、画像表示システム、画像処理方法および画像処理プログラム | |
JP2015203704A (ja) | 画像処理装置、画像処理方法、画像処理システム | |
US20160042122A1 (en) | Image processing method and image processing apparatus | |
JP2016038542A (ja) | 画像処理方法および画像処理装置 | |
JP5832281B2 (ja) | 画像処理装置、画像処理システム、画像処理方法、およびプログラム | |
JP6338730B2 (ja) | 表示データを生成する装置、方法、及びプログラム | |
JP2013250400A (ja) | 画像処理装置、画像処理方法、および画像処理プログラム | |
JP2016206228A (ja) | 合焦位置検出装置、合焦位置検出方法、撮像装置、撮像システム | |
JP2013250574A (ja) | 画像処理装置、画像表示システム、画像処理方法および画像処理プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12861666 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1120120054814 Country of ref document: DE Ref document number: 112012005481 Country of ref document: DE |
|
ENP | Entry into the national phase |
Ref document number: 20147019757 Country of ref document: KR Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 12861666 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 12861666 Country of ref document: EP Kind code of ref document: A1 |