JP2006118899A - Particle image analytical system, computer program for displaying particle image, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a particle image analytical system capable of observing a flow of a particle under imaging on a real time. <P>SOLUTION: A particle image processor 1 of this particle image analytical system 100 includes an image processing substrate 1b for generating a partial image containing a particle image extracted from the picked-up whole image, and image information containing positional information of the partial image, and a USB interface 62 for transmitting the partial image and the image information. A data analyzer 2 of the particle image analytical system 100 includes also an image data processing part 2b for receiving the partial image and the image information, and for generating the simulated whole image, based on the partial image and the image information, to be displayed. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a particle image analysis system, a particle image display computer program, and a recording medium, and in particular, a particle image analysis system including an image processing unit for performing image processing on a captured particle image, and a particle image display The present invention relates to a computer program and a recording medium.

  2. Description of the Related Art Conventionally, a particle image analysis system (particle image analyzer) for managing the quality of fine ceramic particles, pigments, cosmetic powders and other powders (particles) is known (see, for example, Patent Document 1).

  The conventional particle image analyzer disclosed in Patent Document 1 includes an imaging unit including a video camera that images particles in a liquid, and an image processing unit for performing image processing on the particle image captured by the imaging unit. And an image processing apparatus including Patent Document 1 discloses a technique for confirming particle morphology and aggregation state by collectively displaying processing result data (image data) stored in an image processing apparatus on a monitor television after analysis processing. Yes.

JP-A-8-136439

  However, the conventional particle image analyzer disclosed in Patent Document 1 has a function of collectively displaying stored processing result data (image data) on a monitor television after analysis processing, while capturing captured particle images. The function of displaying on the display screen in real time was not considered. For this reason, it was difficult to observe the flow of particles during imaging in real time.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide a particle image analysis system capable of observing the flow of particles during imaging in real time.

Means for Solving the Problems and Effects of the Invention

  In order to achieve the above object, a particle image analysis system according to a first aspect of the present invention includes a particle image processing device and an image data analysis device that displays a captured image transmitted from the particle image processing device. An image analysis system, wherein the particle image processing apparatus includes a flow cell that forms a flow of a particle suspension, an imaging unit that captures an entire image of the flow including the particles of the particle suspension, and an entire captured image. An image processing unit for generating a partial image including the extracted particle image, image information including at least partial image position information, and a transmission unit for transmitting the partial image and the image information to the image data analysis apparatus. The image data analysis device receives the simulated whole image on the display screen based on the receiving means for receiving the partial image and the image information, and the partial image and the image information received by the receiving means. And an image generating means for form the display.

  In the particle image analysis system according to the first aspect, as described above, the partial image including the particle image extracted from the captured whole image and the image information including at least the position information of the partial image are imaged by the transmission unit. Sending to the data analysis device and receiving and displaying it by the image data analysis device, sending all of the captured whole image to the image data analysis device, compared to the case of displaying by the image data analysis device, Since the amount of data transmitted to the image data analyzer can be greatly reduced, the transmission time can be greatly shortened. Thus, the particle image captured by the particle image processing apparatus can be displayed on the image data analysis apparatus in real time during the imaging. As a result, the flow of particles during imaging can be observed in real time. In addition, by transmitting not only the partial image but also the position information of the partial image by the transmission unit, the position of the partial image in the simulated whole image can be easily grasped. Thus, a simulated whole image can be easily generated. In addition, since the particle image processing apparatus includes the image processing unit, the standard of the personal computer evolves in a short time, unlike the case where the image data analysis apparatus including the personal computer includes the image processing unit. Further, it is possible to prevent the inconvenience that it is difficult to attach the image processing unit (image processing board) to the evolved personal computer (image processing apparatus).

  In the particle image analysis system according to the first aspect, preferably, the image processing unit of the particle image processing apparatus outputs a partial image for one frame and image information as one processing result when there is a particle image in one frame. Generate as data. With this configuration, since one processing result data includes a partial image for one frame and image information corresponding to the partial image, the image data analyzer can easily receive one processing result data. The simulated whole image for one frame can be generated by the image generation means of the image data analysis apparatus.

  In this case, preferably, the image information includes information on the storage position of the partial image in the processing result data. If comprised in this way, it can recognize easily that the partial image is stored in the processing result data with image information.

  In the configuration in which the image processing unit of the particle image processing apparatus generates the processing result data, preferably, the transmission unit of the particle image processing apparatus sequentially transmits the processing result data for one frame to the image data analysis apparatus. . According to this configuration, when the generation of the processing result data for one frame is completed without waiting for the generation of all the processing result data by the image processing unit, the transmission unit immediately transmits the data for the one frame. The processing result data can be transmitted to the image data analysis device.

  In the configuration in which the image processing unit of the particle image processing device generates the processing result data, preferably, the image generation unit of the image data analysis device has, on the display screen, each processing result data for one frame received by the receiving unit. Then, a simulated whole image is generated and displayed sequentially. According to this structure, when the processing result data for one frame is received by the receiving unit, the simulated whole image can be generated and displayed on the display screen by the image generating unit. Thereby, in an image data analyzer, a particle image can be displayed sequentially for every frame.

  In this case, it is preferable that the image generation means of the image data analysis apparatus displays a simulated whole image after displaying the background on the display screen. With this configuration, by adjusting the background of the display screen, the simulated entire image can be displayed on the display screen so as to substantially match the actually captured entire image. Further, by adjusting the background of the display screen, it is possible to display on the display screen so as to emphasize the partial image in the entire simulated image.

  In the configuration in which the image processing unit generates the processing result data, preferably, one processing result data for one frame includes at least particle data having image information corresponding to one partial image. According to this configuration, when at least one particle is included in the entire captured image of one frame, particle data corresponding to at least one particle is stored as one processing result data in the image data analysis apparatus. Can be sent.

  In the particle image analysis system according to the first aspect, the image generation unit of the image data analysis device preferably displays the entire image of the imaging region of the flow including the particles on the display screen while the imaging unit of the particle image processing device captures the entire image of the flow. Display a simulated whole image. If comprised in this way, the flow of the particle under imaging by the imaging part of a particle image processing apparatus can be observed on the display screen of an image data analyzer in real time.

  In the particle image analysis system according to the first aspect, preferably, the position information of the partial image is a minimum X coordinate value, a maximum X coordinate value, a minimum Y coordinate value, and a maximum Y coordinate value of the partial image in XY orthogonal coordinates. Including. If comprised in this way, the position of the partial image containing the particle image in a whole image can be recognized correctly.

  A particle image display computer program according to a second aspect of the present invention is obtained by imaging a flow cell that forms a flow of a particle suspension, an imaging unit that captures an overall image of the flow including particles of the particle suspension, and An image processing unit that generates a partial image including the particle image extracted from the entire image and image information including at least position information of the partial image, and a transmission unit that transmits the partial image and the image information to the image data analysis apparatus. A particle image processing apparatus comprising: a particle image processing apparatus; and a captured image transmitted from the particle image processing apparatus. The particle image analysis apparatus includes: Receiving means for receiving the partial image and the image information from the display means, and the display screen based on the partial image and the image information received by the receiving means. To generate a simulated entire image to function as an image generating means for displaying.

  In the computer program for particle image display according to the second aspect, as described above, the image data analysis is performed on the partial image including the particle image extracted from the entire captured image and the image information including at least the position information of the partial image. The amount of data received by the image data analysis device can be reduced by causing the computer to function as reception means that receives and displays the image data, as compared to the case where all of the captured whole image is received and displayed by the image data analysis device. Since it can be greatly reduced, the reception time can be greatly shortened. Thus, the particle image captured by the particle image processing apparatus can be displayed in real time by the image data analysis apparatus during imaging. As a result, the flow of particles during imaging can be observed in real time. Further, by receiving not only the partial image but also the positional information of the partial image by the image data analyzing device by the receiving means, the image data analyzing device can easily grasp the position of the partial image in the entire image, A simulated whole image can be easily generated.

  In the particle image display computer program, preferably, the receiving means sequentially receives the processing result data including the partial image and the image information for each frame of processing result data from the particle image processing device, The image generation means sequentially generates a simulated entire image for each frame of processing result data and displays it on the display screen. According to this structure, when the processing result data for one frame is received by the receiving unit, the simulated whole image can be generated and displayed on the display screen by the image generating unit. Thereby, in an image data analyzer, a particle image can be displayed sequentially for every frame.

  In this case, it is preferable to use a computer-readable recording medium in which the particle image display computer program according to the second aspect is recorded.

  A particle image analysis system according to a third aspect of the present invention is a particle image analysis system including a particle image treatment device and an image data analysis device that analyzes a captured image transmitted from the particle image processing device. The image processing apparatus includes a flow cell that forms a flow of a particle suspension, an imaging unit that captures an entire image of the flow including particles of the particle suspension, and a portion that includes a particle image extracted from the captured entire image An image processing unit for generating an image, and a transmission unit for transmitting the partial image to the image data analysis device, the image data analysis device based on the partial image, a reception unit for receiving the partial image, Image analysis means for extracting analysis parameters of the particle image.

  In the particle image analysis system according to the third aspect, as described above, the partial image including the particle image extracted from the entire captured image is transmitted to the image data analysis device by the transmission unit, and the image data analysis device By receiving and analyzing, all the captured whole images are transmitted to the image data analysis device, and the amount of data transmitted to the image data analysis device is reduced as compared with the case of analyzing by the image data analysis device. Therefore, the transmission time can be greatly reduced. Thus, the particle image captured by the particle image processing apparatus can be analyzed in real time by the image data analysis apparatus during imaging. As a result, the time from the start of measurement until the measurement result is output can be greatly shortened. In addition, when the particle image processing apparatus includes the image processing unit, the image data analysis apparatus including a personal computer or the like includes an image processing unit. Further, it is possible to prevent the inconvenience that it is difficult to attach the image processing unit (image processing board) to the evolved personal computer (image processing apparatus).

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a perspective view showing an overall configuration of a particle image analysis system according to an embodiment of the present invention, and FIG. 2 is a schematic diagram of the particle image analysis system according to the embodiment shown in FIG. 3 and 4 are diagrams showing the configuration of the imaging unit in the particle image processing apparatus of the particle image analysis system according to the embodiment shown in FIG. FIG. 5 is a block diagram showing the configuration of the particle image processing apparatus of the particle image analysis system according to the embodiment shown in FIG. First, an overall configuration of a particle image analysis system 100 according to an embodiment of the present invention will be described with reference to FIG. 1, FIG. 2, and FIG. This particle image analysis system 100 is used to manage the quality of fine ceramic particles, powders (particles) such as pigments and cosmetic powders. In addition, as shown in FIGS. 1 and 2, the particle image analysis system 100 includes a particle image processing apparatus 1, and an electric signal line (USB (Universal Serial Bus) 2. 0 cable) 3 and an image data analysis device 2 electrically connected.

  The particle image processing apparatus 1 is provided for imaging particles in a liquid and performing image processing on the captured particle image. Examples of the particles imaged by the particle image processing apparatus 1 include fine ceramic particles, pigments, and powders (particles) such as cosmetic powders. The image data analysis device 2 is provided for automatically calculating and displaying the size and shape of particles by storing and analyzing the data of the particle image processed by the particle image processing device 1. ing.

  Here, in the present embodiment, as shown in FIGS. 1, 2, and 5, the particle image processing apparatus 1 includes an imaging unit 1a that captures the flow of the particle suspension, and a partial image (particle image) from the entire image. ) And a CPU substrate 1c for controlling the particle image processing apparatus 1 are provided.

  2 and 3, the imaging unit 1a includes a sample liquid container 11, a transparent quartz sheath flow cell 12, a strobe lamp 13 as a light source, a CCD camera 14, a sheath liquid container 15, Syringe pumps 16, 17 and 18 (see FIG. 3), drive mechanism portions 19 and 20 (see FIG. 3), and a drainage container 21 are included.

  The sample liquid container 11 has a funnel shape with an open top, and is configured to be able to store a sample liquid (particle suspension) therein. A valve 41 is provided in the flow path 31 between the sample liquid container 11 and the sheath flow cell 12 as shown in FIG. The sample solution container 11 is provided with a stirring device 22 for stirring the sample solution (particle suspension) stored in the sample solution container 11.

  The sheath flow cell 12 has a function of converting the flow of the particle suspension into a flat flow by sandwiching the flow of the particle suspension with the flow of the sheath liquid flowing on both sides of the particle suspension. As shown in FIGS. 2 and 4, the sheath flow cell 12 has a vertically long concave portion 12 a in the vicinity of the center position of the outer surface. The particle suspension flowing in the sheath flow cell 12 is configured to be imaged by the CCD camera 14 through the recess 12 a of the sheath flow cell 12. As shown in FIG. 3, the sheath flow cell 12 is connected to the syringe pump 16 via a flow path 32. The sheath flow cell 12 is connected to the syringe pump 18 via the flow paths 33 and 34. The sheath flow cell 12 is connected to the drainage liquid container 21 through flow paths 33 and 35. Valves 42 and 43 are provided in the flow paths 32 and 33, respectively. The channels 34 and 35 are provided with valves 44 and 45, respectively.

  The sheath liquid container 15 is configured to be able to store the sheath liquid therein. The sheath liquid container 15 is connected to syringe pumps 16 and 17 via flow paths 36 and 37. Valves 46 and 47 are provided in the flow paths 36 and 37, respectively. The syringe pump 17 is connected to the syringe pump 18 via the flow path 38.

  The drive mechanism 19 is provided to drive the two syringe pumps 16 and 18 in conjunction with each other. The drive mechanism unit 19 includes a stepping motor 19a and a drive transmission unit 19b that converts the rotational motion of the stepping motor 19a into a linear motion and transmits the linear motion to the syringe pumps 16 and 18. The drive mechanism 20 is provided to drive the syringe pump 17. The drive mechanism unit 20 includes a stepping motor 20a and a drive transmission unit 20b that converts the rotational motion of the stepping motor 20a into a linear motion and transmits the linear motion to the syringe pump 17.

  In addition, an objective lens 23 is provided between the sheath flow cell 12 and the CCD camera 14 for enlarging a light image of particles in the particle suspension irradiated by the strobe lamp 13. The objective lens 23 is configured to be exchangeable with another objective lens 23 having a different magnification. This widens the measurable particle size range. That is, if the magnification of the objective lens 23 is increased, an imaging area by the CCD camera 14 is reduced, while small particles can be imaged larger. Further, if the magnification of the objective lens 23 is reduced, the imaging area by the CCD camera 14 is increased, which is suitable for imaging large particles.

  Next, the configuration of the image processing substrate 1b will be described with reference to FIGS. As shown in FIG. 5, the image processing board 1b includes a CPU 51, a ROM 52, a main memory 53, an image processing processor 54, a frame buffer 55, a filter test memory 56, and a background correction data memory 57. , Prime code data storage memory 58, vertex data storage memory 59, result data storage memory 60, image input interface 61, and USB interface 62. The CPU 51, the ROM 52, the main memory 53, and the image processor 54 are connected by a bus (BUS) so that data can be transmitted and received among them. The image processor 54 also includes a frame buffer 55, a filter test memory 56, a background correction data memory 57, a prime code data storage memory 58, a vertex data storage memory 59, a result data storage memory 60, and an image input. Each interface 61 is connected to each other by an individual bus (BUS). Thereby, from the image processor 54 to the frame buffer 55, the filter test memory 56, the background correction data memory 57, the prime code data storage memory 58, the vertex data storage memory 59, and the result data storage memory 60, Data can be read and written, and data can be input from the image input interface 61 to the image processor 54. The CPU 51 of such an image processing board 1b is connected to the USB interface 62 via the PCI bus. The USB interface 62 is connected to the CPU board 1c via a USB / RS-232c converter (not shown).

  The CPU 51 has a function of executing a computer program stored in the ROM 52 and a computer program loaded in the main memory 53. The ROM 52 is configured by a mask ROM, PROM, EPROM, EEPROM, or the like. The ROM 52 stores computer programs executed by the CPU 51, data used for the computer programs, and the like. The main memory 53 is configured by SRAM or DRAM. The main memory 53 is used to read out the computer program recorded in the ROM 52 and is used as a work area for the CPU 51 when the CPU 51 executes the computer program.

  The image processor 54 is configured by an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), or the like. The image processor 54 is an image including hardware capable of executing image processing, such as a median filter processing circuit, a Laplacian filter processing circuit, a binarization processing circuit, an edge trace processing circuit, an overlap check processing circuit, and a result data creation circuit. It is a processor dedicated to processing. The frame buffer 55, filter test memory 56, background correction data memory 57, prime code data storage memory 58, vertex data storage memory 59, and result data storage memory 60 are each configured by SRAM, DRAM, or the like. ing. These frame buffer 55, filter test memory 56, background correction data memory 57, prime code data storage memory 58, vertex data storage memory 59 and result data storage memory 60 are processed by the image processor 54. Used to store data when executing

  The image input interface 61 includes a video digitizing circuit (not shown) including an A / D converter. The image input interface 61 is electrically connected to the CCD camera 14 by a video signal cable 4 as shown in FIG. As a result, the video signal input from the CCD camera 14 is A / D converted by the image input interface 61 (see FIG. 5). The digitized image data (particle image) is configured to be stored in the frame buffer 55. The USB interface 62 is connected to the CPU board 1c via a USB / RS-232c converter (not shown). The USB interface 62 is connected to the image data analysis device 2 by an electric signal line (USB 2.0 cable) 3. The CPU substrate 1c is configured by a CPU, a ROM, a RAM, and the like, and has a function of controlling the particle image processing apparatus 1.

  As shown in FIGS. 1 and 2, the image data analysis device 2 includes an image display unit 2a, an image data processing unit 2b as a device body including a CPU, a ROM, a RAM, and a hard disk, and an input device such as a keyboard. 2c and a personal computer (PC). The hard disk of the image data processing unit 2b is installed with an application program for performing image data analysis processing and statistical processing based on the processing result in the particle image processing device 1 by communicating with the particle image processing device 1. Yes. This application program is configured to be executed by the CPU of the image data processing unit 2b.

  FIG. 6 is a schematic diagram for explaining an image processing operation of the particle image analysis system according to the embodiment shown in FIG. Next, an operation of the particle image analysis system 100 according to the embodiment of the present invention will be described with reference to FIGS.

  First, before the imaging of the particles by the imaging unit 1a of the particle image processing apparatus 1 shown in FIGS. 1 to 3 is started, the fluid path is cleaned with the sheath liquid stored in the sheath liquid container 15. Specifically, as shown in FIG. 3, the syringe pump 16 is brought into a state in which the piston is pulled out from the cylinder (discharge operation is possible), and the syringe pumps 17 and 18 are pushed into the cylinder. Set to the state (a state in which suction is possible). This state is the initial state. In the initial state, all the valves 41 to 47 are closed (blocked state).

  Next, the valves 42, 43, 45 and 46 are opened from the initial state described above. At this time, since a positive pressure is applied to the sheath fluid container 15 in advance, the sheath fluid contained in the sheath fluid container 15 is the valve 46, syringe pump 16, valve 42, sheath flow cell 12, valve 43 and It passes through the valve 45 and is discharged into the drainage container 21. Thereby, the fluid path from the sheath liquid container 15 to the drained liquid container 21 through the valve 46, the syringe pump 16, the valve 42, the sheath flow cell 12, the valve 43, and the valve 45 is washed with the sheath liquid. Then, the valves 42, 43, 45 and 46 are closed again. Thereby, the sheath liquid is filled in the syringe pump 16.

  Next, valves 44, 45 and 47 are opened. As a result, the sheath liquid accommodated in the sheath liquid container 15 passes through the valve 47, the syringe pump 17, the syringe pump 18, the valve 44 and the valve 45 and is discharged into the discharge liquid container 21. Thereby, the fluid path from the sheath liquid container 15 to the drainage liquid container 21 via the valve 47, the syringe pump 17, the syringe pump 18, the valve 44, and the valve 45 is washed with the sheath liquid. Then, the valves 44, 45 and 47 are closed again.

  Next, in the present embodiment, imaging of a background correction image for generating background correction data is performed. Specifically, in a state where only the sheath liquid is supplied to the sheath flow cell 12, pulse light is emitted from the strobe lamp 13 and an image is taken by the CCD camera 14. That is, the valves 42 to 44 are opened, and the stepping motor 19a of the drive mechanism unit 19 is driven. Thereby, the syringe pump 16 performs the discharge operation of the sheath liquid at the flow rate Q, and the syringe pump 18 performs the suction operation of the sheath liquid at the flow rate Q. As a result, the sheath liquid of the flow rate Q flows from the syringe pump 16 into the sheath flow cell 12. At this time, since the valve 41 is in a shut-off state, the sample solution (particle suspension) in the sample solution container 11 does not flow into the sheath flow cell 12. Then, the sheath liquid flows in the sheath flow cell 12 from the upper side to the lower side. Then, the sheath liquid having the flow rate Q is discharged from the sheath flow cell 12 and sucked into the syringe pump 18.

  At this time, pulsed light is periodically irradiated from the strobe lamp 13 every 1/60 seconds with respect to the flow of the sheath liquid in the sheath flow cell 12. Thereby, a still image (background correction image) every 1/60 seconds in a state where particles are not passing through the sheath flow cell 12 is imaged by the CCD camera 14 via the objective lens 23. Then, a plurality of background correction images in a state where no particles are captured are taken into the image processing substrate 1b. Thereby, as shown in FIG. 6, one background correction data is generated. In the image processing board 1b, the background correction data is stored in the background correction data memory 57 (see FIG. 5) and the image of the image data analysis device 2 is connected via the electric signal line (USB 2.0 cable) 3. The data is transmitted to the data processing unit 2b. Then, on the image data analysis device 2 side, the received background correction data is stored in a memory in the image data processing unit 2b. The process of generating the background correction data is executed only once before the start of particle imaging.

  Next, imaging of particles by the imaging unit 1a (see FIG. 2) is started. Specifically, the valves 41 to 44 shown in FIG. 3 are opened, and the stepping motors 19a and 20a of the drive mechanisms 19 and 20 are driven. Thereby, the syringe pump 16 performs the discharge operation of the sheath liquid having the flow rate Q, and the syringe pumps 18 and 17 perform the suction operation of the flow rate Q and the flow rate Qs. As a result, the sheath liquid of the flow rate Q flows from the syringe pump 16 into the sheath flow cell 12 and the sample liquid (particle suspension) of the flow rate Qs flows from the sample liquid container 11. Then, as shown in FIG. 4, the sample liquid (particle suspension) moves from the upper side to the lower side in the sheath flow cell 12 in a state where the both sides of the sample liquid are sandwiched between the sheath liquid and hydrodynamically flattened. Flowing. Then, a mixed liquid having a flow rate (Q + Qs) obtained by mixing the sample liquid (particle suspension) and the sheath liquid is discharged from the sheath flow cell 12 and sucked into the syringe pumps 18 and 17 shown in FIG.

  At this time, the pulsed light is periodically emitted from the strobe lamp 13 every 1/60 seconds with respect to the flow of the particle suspension narrowed flat in the sheath flow cell 12. The irradiation of the pulsed light from the strobe lamp 13 is performed for 60 seconds. As a result, a still image of a total of 3600 particles is captured by the CCD camera 14 via the objective lens 23.

  When imaging translucent particles, a staining solution bottle that contains staining solution in the apparatus and a reaction chamber for staining the particles with the staining solution are provided to the particles before imaging. It is preferable to perform appropriate dyeing. Further, it is preferable to select a solvent for suspending the particles according to the characteristics (particle size and specific gravity) of the particles. Further, it is preferable to change the viscosity and specific gravity of the sheath liquid according to the characteristics of the particle suspension (for example, the viscosity and specific gravity of the solvent). Thereby, it is possible to easily narrow the flow of the particle suspension to be flat.

  Further, by imaging the flat surface of the particle suspension flow with the CCD camera 14, the distance between the center of gravity of the imaged particle and the imaging surface of the CCD camera 14 can be made substantially constant. is there. Thereby, it is possible to always obtain a focused particle image regardless of the size of the particle.

  The still image (particle image) captured by the CCD camera 14 is output as a video signal to the image processing substrate 1b (see FIG. 5) via the video signal cable 4. The image input interface 61 of the image processing board 1b generates digitized image data by A / D converting the video signal from the CCD camera 14 (see FIG. 2). Image data output from the image input interface 61 shown in FIG. 5 is transferred and stored in the frame buffer 55. Then, for the frame data stored in the frame buffer 55, as shown in FIG. 6, a partial image (particle image) cut-out process from the image data by the image processing board 1b and an image to the image data processing unit 2b Processing result data is transmitted. In this case, first, the following image processing is executed by the image processing processor 54 (see FIG. 5) of the image processing board 1b.

  FIG. 7 is a flowchart showing a processing procedure of the image processor of the particle image processing apparatus according to the embodiment shown in FIG. 8 to 14 are diagrams for explaining the processing method of the image processor of the particle image processing apparatus according to the embodiment shown in FIG. 5 to 14, as image processing by the image processor 54, in step S <b> 1, the image processor 54 performs noise removal processing on the particle image (image data) stored in the frame buffer 55. Execute. In other words, the image processor 54 is provided with a median filter processing circuit as described above. By applying the median filter processing by the median filter processing circuit, noise such as dust in the particle image is removed. In this median filter processing, the luminance values (pixel values) of a total of nine pixels including the target pixel and its neighboring eight pixels are arranged in order of numerical value (or small), and the median (intermediate value) of the nine pixels is obtained. Value) is the pixel value of the target pixel.

  Next, in step S <b> 2, the image processor 54 executes a background correction process for correcting unevenness in the intensity of irradiation light with respect to the flow of the particle suspension. That is, the image processor 54 is provided with a Laplacian filter processing circuit as described above. In the background correction processing, the Laplacian filter processing circuit performs a comparison operation between the background correction data acquired in advance and stored in the background correction data memory 57 and the particle image after the median filter processing. A corrected image in which most of the background image is removed from is generated.

Next, in step S3, the image processor 54 executes contour enhancement processing. In this edge enhancement process, a Laplacian filter process is performed by a Laplacian filter processing circuit. This Laplacian filter process multiplies each luminance value by a corresponding predetermined coefficient for a total of nine pixels including the target pixel and its neighboring eight pixels, and uses the sum of the multiplication results as the pixel value of the target pixel. It is processing. As shown in FIG. 8, in this embodiment, the coefficient corresponding to the target pixel X (i, j) is “2”, and the four pixels X (i, j−1) adjacent to the target pixel in the vertical and horizontal directions. ), X (i, j + 1), X (i−1, j), and the coefficient corresponding to X (i + 1, j) are “−1/4”, and the four pixels adjacent to the target pixel in an oblique direction The coefficients corresponding to X (i−1, j−1), X (i + 1, j−1), X (i + 1, j + 1), and X (i−1, j + 1) are set to “0”. Then, the pixel value Y (i, j) of the target pixel after the Laplacian filter processing is calculated by the following equation (1). Note that 255 is output when the result of the calculation according to the following expression (1) is greater than 255, and 0 is output when the result of the calculation according to the expression (1) is a negative number.
Y (i, j) = 2 × X (i, j) −0.25 × (X (i, j−1) + X (i−1, j) + X (i, j + 1) + X (i + 1, j)) +0.5 (1)

Next, in step S <b> 4, the image processor 54 sets a binarization threshold level (binarization threshold) based on the data after the contour enhancement process. In other words, the Laplacian filter circuit of the image processor 54 is provided with a luminance histogram unit that executes a binarization threshold setting process. First, the image processor 54 creates a luminance histogram from the image data after the Laplacian filter processing, and performs a predetermined smoothing process on the luminance histogram. And after calculating | requiring the most frequent luminance value from the luminance histogram after a smoothing process, a binarization threshold value is calculated by the following formula | equation (2) using this most frequent luminance value.
Binarization threshold = most frequent luminance value × A + B (2)
In the above formula (2), A and B are settable parameters, and in this embodiment, the default values (default values) of A and B are “90%” and “0”, respectively. .

  Next, in step S5, the image processor 54 performs binarization processing on the image after the Laplacian filter processing at the threshold level (binarization threshold) set in the binarization threshold setting processing. In step S6, the prime code and the multipoint information are acquired for each pixel of the image subjected to the binarization process. That is, the image processing processor 54 is provided with a binarization processing circuit. By this binarization processing circuit, binarization processing and prime code / multipoint information acquisition processing are executed. The prime code is a binarized code obtained for a total of nine pixels including the target pixel and eight pixels in the vicinity thereof, and is defined as follows. As shown in FIG. 9, the prime code data storage memory 58 includes two areas of a prime code storage area 58a and a multiple point storage area 58b in one word (11 bits). The prime code storage area 58a is an 8-bit area indicated by bit0 to bit7 in FIG. 9, and the multiple score area 58b is a 3-bit area indicated by bit8 to bit10 in FIG. Next, the definition of the prime code will be described. As shown in FIG. 10, the pixel values of P1 to P3 are 0 for the 9 pixels P0 to P8 of the binarized image data, and the pixel values of P0 and P4 to P8 are 1. Yes. When the luminance values corresponding to the nine pixels P0 to P8 are equal to or greater than the binarization threshold, the pixel values P0 to P8 are 1, and the luminance values corresponding to the nine pixels P0 to P8 are binary. If it is less than the threshold value, the pixel values of P0 to P8 are 0. The prime code in this case will be described. Eight pixels P0 to P7 other than the target pixel P8 correspond to bit0 to bit7 of the prime code storage area 58a, respectively. That is, the prime code storage area 58a is configured to store the pixel values of the eight pixels P0 to P7 from the lower bit (bit0) to the upper bit (bit7). Thus, the prime code is 11110001 in binary notation and F1 in hexadecimal notation. Note that the pixel value of the target pixel P8 is not included in the prime code.

  In addition, when the region constituted by the pixel of interest and the 8 pixels in the vicinity thereof is a part of the boundary of the particle image, that is, when the prime code is other than 00000000 in binary notation, the multipoint information is obtained. It is done. The multi-point is a code indicating how many times there is a possibility of passing during the edge trace described later, and multi-point information corresponding to all patterns is stored in advance in a lookup table (not shown). Yes. Then, the number of multiple points is obtained by referring to this lookup table. Referring to FIG. 11, when the pixel values of the four pixels P2 and P5 to P8 are 1, and the pixel values of the four pixels P0, P1, P3, and P4 are 0, the arrow A in FIG. As indicated by B and B, there is a possibility of passing through the pixel of interest P8 twice during edge tracing. Accordingly, the pixel of interest P8 has two priority points, and the number of multiple points is two. This multiple point number is stored in the multiple point number storage area 58b.

Next, in step S7, the image processor 54 creates vertex data. This vertex data creation processing is also executed by a binarization processing circuit provided in the image processor 54, similarly to the above-described binarization processing and prime code / multiple point information acquisition processing. The vertex data is data indicating the coordinates where the edge trace described later is to be started. A region of a total of 9 pixels including the target pixel and its neighboring 8 pixels is determined to be a vertex only when all of the following three conditions (condition (1) to condition (3)) are satisfied.
Condition (1)... The pixel value of the target pixel P8 is 1.
Condition (2): Pixel values of three pixels (P1 to P3) above the target pixel P8 and one pixel (P4) adjacent to the left of the target pixel P8 are zero.
Condition (3): The pixel value of at least one of the one pixel (P0) right adjacent to the target pixel P8 and the three pixels (P5 to P7) below the target pixel P8 is 1.
The image processor 54 searches for the pixel corresponding to the vertex from all the pixels, and stores the created vertex data (coordinate data indicating the position of the vertex) in the vertex data storage memory 59.

  Next, in step S8, the image processor 54 executes edge trace processing. As described above, the image processor 54 is provided with the edge trace processing circuit, and the edge trace processing circuit executes the edge trace processing. In this edge tracing process, first, the coordinates for starting edge tracing are specified from the vertex data, and based on the prime code and the code for determining the traveling direction stored in advance, the edge of the particle image is determined. Perform a trace. Then, the image processor 54 calculates the area value, the direct count number, the skew count number, the corner count number, and the position of each particle image during edge tracing. Here, the area value of the particle image means the total number of pixels constituting the particle image, that is, the total number of pixels included inside the region surrounded by the edges. Further, the direct count number is the total number of edge pixels excluding edge pixels at both ends of the straight line section when three or more edge pixels of the particle image are arranged in a straight line in the vertical direction or the horizontal direction. That is, the direct count number is the total number of edge pixels constituting a linear component extending in the vertical direction or the horizontal direction among the edges of the particle image. The skew count number is the total number of edge pixels excluding edge pixels at both ends of a straight line section in the oblique direction when three or more edge pixels of the particle image are arranged in a straight line in the oblique direction. In other words, the skew count number is the total number of edge pixels constituting a linear component extending in the oblique direction among the edges of the particle image. The corner count is a number of adjacent edge pixels of the particle image that touch each other in different directions (for example, one edge pixel is adjacent to the upper side and the other edge pixel is to the left This is the total number of edge pixels. In other words, the corner count number is the total number of edge pixels constituting the corner among the edges of the particle image. In this embodiment, the position of the particle image is determined by the coordinates of the right end, the left end, the upper end, and the lower end of the particle image. The image processor 54 stores the calculation result data in an internal memory (not shown) built in the image processor 54.

Next, in step S9, the image processor 54 executes a particle overlap check process. As described above, the image processor 54 is provided with the overlap check circuit, and the overlap check circuit executes the overlap check process. In this particle overlap check process, first, the image processor 54, based on the analysis result of the particle image by the edge trace process described above, includes another particle image (inner particle image) in one particle image (outer particle image). It is determined whether or not a particle image is included. When the inner particle image exists in the outer particle image, the inner particle image is excluded from the partial image cut-out targets in the result data creation process described later. Next, the principle of determining whether or not an inner particle image exists will be described. First, as shown in FIG. 12, two particle images G1 and G2 are selected, the maximum value G1 _XMAX and the minimum value G1 _XMIN of the X coordinate of one particle image G1, and the maximum value G1 _YMAX and the minimum value of the Y coordinate. _Specify G1 _YMIN . Next, the maximum value G2 _XMAX and minimum value G2 _XMIN of the X coordinate of the other particle image G2 and the maximum value G2 _YMAX and minimum value G2 _{YMIN of} the Y coordinate are specified. When all of the following four conditions (condition (4) to condition (7)) are satisfied, it is determined that the particle image G1 includes the particle image G2, and it is determined that the inner particle image exists. The
Condition (4) the maximum value _{G1 XMAX} of the X-coordinate of ... particle image G1 is larger than the maximum value _{G2 XMAX} of the X coordinate of the particle image G2.
Condition (5): The X-coordinate minimum value G1 _XMIN of the particle image G1 is smaller than the X-coordinate minimum value G2 _{XMIN of the} particle image G2.
Maximum value _{G1 YMAX} of the Y coordinate of the condition (6) ... particle image G1 is larger than the maximum value _{G2 YMAX} of the Y coordinate of the particle image G2.
Condition (7) ... minimum value _{G1 YMIN} of Y coordinate particle image G1 is smaller than the minimum value _{G2 YMIN} the Y coordinate of the particle image G2.
The result data of the overlap check process described above is stored in an internal memory (not shown) of the image processor 54.

  Next, in step S10, the image processor 54 cuts out a partial image that individually includes the individual particle images identified by the processing in steps S1 to S9 described above, and creates image processing result data. As described above, the image processor 54 is provided with a result data creation circuit, and the result data creation process is executed by the result data creation circuit. The partial image created by the result data creation processing is an image obtained by cutting out a rectangular region including one particle and a region around the particle determined by a preset margin value from the particle image. Note that the rectangular area according to the present embodiment is an area R1 determined by the upper end coordinate (YMIN), the lower end coordinate (YMAX), the left end coordinate (XMIN), and the right end coordinate (XMAX) of the particle image shown in FIG. In other words, the region R2 is wider by three pixels in the vertical and horizontal directions.

  Here, as shown in FIG. 14, the image processing result data includes partial image data, area values (number of pixels) of particle images, and direct count numbers for all particle images recognized by the image processing in step S10 described above. In addition to the data such as the skew count number and the corner count number, the position data (XMIN, XMAX, YMIN and YMAX) of the partial image including the particle image and the data of the storage position of the image data are included. This image processing result data is generated for each frame. The size of one frame of image processing result data (one frame data) is a fixed length of 64 kilobytes. Therefore, the size of one frame data does not change depending on the size of one particle data. One frame data is generated by overwriting the previous frame data. In the 1-frame data shown in FIG. 14, since each 1-particle data is very large, only 4 particle data are embedded. When the length of one particle data is small or when the number of one particle data is small, the previous frame data may remain at the end of one frame data because the data is embedded from the beginning of the one frame data. However, since the transfer destination image data processing unit recognizes one particle data in one frame data based on the total number of particles in one frame stored in one particle data, the previous frame data remaining at the end is recognized. It will never be done. The image processor 54 stores the image processing result data created by the result data creating process in the result data storage memory 60. In this way, the image processing by the image processor 54 is completed. Note that the image processor 54 repeatedly executes the above-described series of image processing by pipeline processing, and generates a partial image for each frame for 3600 frames. When there is no particle image in one frame, the top data of one particle data in one frame shown in FIG. 14 is overwritten and the particle information between the header and the footer is filled with “0”.

  Here, in the present embodiment, the image processing result data stored in the result data storage memory 60 is sequentially transmitted via the electric signal line (USB 2.0 cable) 3 every frame as shown in FIG. It is transmitted to the image data processing unit 2b of the image data analysis device 2. The image data processing unit 2b stores the received image processing result data for one frame in a memory (not shown) of the image data processing unit 2b. The image processing result data stored in the memory of the image data processing unit 2b can be extracted from the memory after the analysis processing of the image data processing unit 2b and displayed on the image display unit 2a.

  In the present embodiment, as shown in FIG. 6, the image data processing unit 2 b of the image data analysis device 2 sequentially receives from the particle image processing device 1 in parallel with the above-described image processing result data storage operation. A partial image included in each frame of image processing result data is displayed on the image display unit 2a in real time. The display of the partial image is executed by an image display module (not shown) of the image data processing unit 2b. FIG. 15 is a flowchart showing an operation procedure of the image display module of the image data processing unit according to the embodiment shown in FIG. FIG. 16 is a diagram showing a simulated entire image displayed on the image display unit of the image data processing unit according to the embodiment shown in FIG. Hereinafter, a partial image display operation by the image data processing unit 2b of the image data analyzing apparatus 2 will be described with reference to FIGS. Before performing the partial image display operation in the image data analysis device 2, the personal computer constituting the image data analysis device 2 stores in advance an FD in which a program for executing the partial image display operation is stored. It is necessary to install a program from a recording medium such as a CD. In this partial image display operation, first, in step S11, the image data processing unit 2b receives image processing result data (partial image and image information) for one frame. In step S12, the number of particles contained in the received image processing result data for one frame is acquired. By obtaining the number of particles, it is recognized how many partial images in one frame need to be processed.

  Here, in step S13, the image data processing unit 2b draws a background color (gray in the present embodiment) on the display screen of the image display unit 2a (see FIG. 16). In step S14, the display coordinates of one particle are acquired from the position information of the partial image included in the image processing result data. In step S15, a rectangular partial image including one particle is drawn on the display screen of the image display unit 2a based on the display coordinates of one particle. In step S16, it is determined whether or not all rectangular partial images including one particle included in the image processing result data for one frame have been drawn. If it is determined in step S16 that all the rectangular partial images including one particle included in the image processing result data for one frame are not drawn, the process returns to step S14, and the image processing result data Display coordinates of a rectangular partial image including another particle are acquired from position information of the included partial image. On the other hand, if it is determined in step S16 that all rectangular partial images including one particle included in the image processing result data for one frame have been drawn, the process proceeds to step S17. In step S17, it is determined whether image processing result data (partial image and image information) has been received for all (3600) frames. If it is determined in step S17 that the image processing result data (partial image and image information) has not been received for all (3600) frames, the process returns to step S11 and another one frame of image is returned. Process result data (partial image and image information) is received. On the other hand, if it is determined in step S17 that the image processing result data (partial image and image information) has been received for all (3600) frames, the processing ends. Thereby, the real-time display on the image display unit 2a of the simulated whole image corresponding to the whole image of 3600 frames obtained by imaging the particles for 60 seconds is completed.

  In addition, an application program for performing partial image analysis processing (image processing) and statistical processing based on image processing result data in the particle image processing apparatus 1 is installed in the hard disk of the image data processing unit 2b. That is, the image processing unit 2b includes software capable of executing analysis processing and statistical processing. As a result, as shown in FIG. 6, the image data processing unit 2b receives the image processing result data storing operation and the simulated whole image on the image display unit 2a in parallel with the real-time display operation. Image processing similar to that of the image processing processor 54 of the image processing substrate 1b described above is performed on the partial image, thereby calculating the particle size (equivalent circle diameter) and the circularity of each particle image. When this image processing is performed, background correction data that is transmitted in advance from the particle image processing apparatus 1 and stored in the memory of the image data processing unit 2b is used. The image data processing unit 2b of the image data analyzing apparatus 2 performs image processing different from that of the image processing processor 54 of the image processing substrate 1b on the received partial image, whereby the particle size of each particle image. It is also possible to calculate (equivalent circle diameter) and circularity. Then, after the analysis process is completed, the partial image is taken out from the memory of the image data processing unit 2b and displayed side by side in a matrix on the image display unit 2a, and the particle size and circularity of the selected partial image are displayed. Is displayed.

  Next, the operation of the partial image analysis processing by the image data processing unit 2b of the image data processing apparatus 2 will be described. As described above, an application program (image analysis processing module) for performing partial image analysis processing is installed in the hard disk of the image data processing unit 2b. Then, the partial image analysis processing is executed by the image analysis processing module. FIG. 17 is a flowchart showing an operation procedure of the image analysis processing module of the image data processing unit according to the embodiment shown in FIG. In the partial image analysis processing operation, first, in step S21 shown in FIG. 17, the image data processing unit 2b receives image processing result data (including a partial image) for one frame. In step S22, the number of particles contained in the received image processing result data for one frame is acquired.

  Here, in step S23, the image data processing unit 2b extracts a partial image from the image processing result data for one frame based on the image data storage position (see FIG. 14). In steps S24, S25, S26, S27, and S28, noise removal processing, background correction processing, binarization threshold setting processing, binarization processing, and edge trace processing are executed. Each process executed in steps S24 to S28 corresponds to each process in steps S1, S2, S4, S5, and S8 in the processing procedure flow of the image processor shown in FIG. Further, the processing in the image processing processor 54 is performed by hardware, whereas the processing in the image data processing unit 2b is processed by software.

  Next, in step S29, it is determined whether or not all partial images for one frame have been analyzed. If it is determined in step S29 that all partial images for one frame have not been analyzed, the process returns to step S23, and one frame's worth is obtained based on the image data storage position (see FIG. 14). Another partial image is extracted from the image processing result data. On the other hand, if it is determined in step S29 that all partial images for one frame have been analyzed, the process proceeds to step S30. In step S30, it is determined whether image processing result data has been received for all (3600) frames. If it is determined in step S30 that image processing result data has not been received for all frames, the process returns to step S21, and image processing result data for another frame is received. On the other hand, if it is determined in step S30 that the image processing result data has been received for all the frames, the processing ends. Thereby, the real-time image analysis processing of the particle image corresponding to the partial image for 3600 frames obtained by imaging the particles for 60 seconds is completed.

  In the present embodiment, as described above, the partial image including the particle image extracted from the entire captured image and the image processing result data including the position information of the partial image are sent to the image data analysis apparatus 2 by the USB interface 62. The image data analyzing apparatus sequentially transmits every frame, and receives and displays the image data processing unit 2b of the image data analyzing apparatus 2 sequentially for each frame, thereby displaying the entire captured image. Since the amount of data transmitted to the image data analysis device 2 can be greatly reduced as compared with the case where the image data processing unit 2b displays the image data, the transmission time can be greatly shortened. Thus, the particle image captured by the particle image processing apparatus 1 can be displayed on the image data analysis apparatus 2 in real time during imaging. As a result, the flow of particles during imaging can be observed in real time. Further, by transmitting not only the partial image but also the position information of the partial image by the USB interface 62, the position of the partial image in the simulated whole image can be easily grasped. A simulated whole image can be easily generated by the image display module of the data processing unit 2b.

  Further, in the present embodiment, unlike the case where the image processing substrate 1b is attached to the image data analysis device 2 composed of a personal computer by installing the image processing substrate 1b in the particle image processing device 1 as described above, the image data Due to the evolution of the standards of the analysis device (personal computer) 2 in a short period of time, it is difficult to attach the image processing substrate 1b to the evolved image data analysis device (personal computer) 2. Can be prevented.

  In the present embodiment, as described above, the image processing result data includes the data of the storage position of the image data, thereby easily recognizing that the partial image data is stored in the image processing result data. Can do.

  In this embodiment, as described above, the partial image position data includes the minimum X coordinate value (XMIN), the maximum X coordinate value (XMAX), the minimum Y coordinate value (YMIN), and the maximum Y coordinate of the partial image. By including the value (YMAX), the position of the partial image including the particle image in the entire captured image can be accurately recognized.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description of the embodiments but by the scope of claims for patent, and further includes all modifications within the meaning and scope equivalent to the scope of claims for patent.

  For example, in the above-described embodiment, an example in which the present invention is applied to a particle image analysis system for managing the quality of powder (particles) such as fine ceramic particles, pigments, and cosmetic powders has been described. However, the present invention is not limited to this, and the present invention may be applied to a particle image analysis system for managing the quality of fine ceramic particles, particles other than powders (particles) such as pigments and cosmetic powders.

  Moreover, although the example which draws a gray background color on an image display part was demonstrated in the said embodiment, this invention is not restricted to this, You may draw background colors other than gray on an image display part. At this time, the simulated whole image is displayed on the display screen so as to substantially match the actual whole image by drawing the background color of the image display unit so as to match the color of the region other than the particle image of the partial image. It becomes possible to do.

1 is a perspective view showing an overall configuration of a particle image analysis system according to an embodiment of the present invention. It is the schematic which showed the whole structure of the particle image analysis system by one Embodiment shown in FIG. It is the schematic which showed the structure of the imaging part in the particle image processing apparatus of the particle image analysis system by one Embodiment shown in FIG. It is sectional drawing for demonstrating the flow of the particle suspension and sheath liquid in the sheath flow cell of the imaging part by one Embodiment shown in FIG. It is the block diagram which showed the structure of the particle image processing apparatus of the particle image analysis system by one Embodiment shown in FIG. It is the schematic for demonstrating the image processing operation | movement of the particle image analysis system by one Embodiment shown in FIG. It is the flowchart which showed the process sequence of the image processor of the particle | grain image processing apparatus by one Embodiment shown in FIG. FIG. 6 is a schematic diagram for explaining set values of coefficients used in Laplacian filter processing by a Laplacian filter processing circuit of the image processor according to the embodiment shown in FIG. 5. FIG. 6 is a schematic diagram showing the contents of a prime code data storage memory used in the prime code / multipoint information acquisition process by the binarization processing circuit of the image processor according to the embodiment shown in FIG. 5. FIG. 6 is a schematic diagram for explaining a definition of a prime code used in a prime code / multipoint information acquisition process by a binarization processing circuit of the image processor according to the embodiment shown in FIG. 5. FIG. 6 is a schematic diagram for explaining the concept of multiple points used in the prime code / multipoint information acquisition process by the binarization processing circuit of the image processor according to the embodiment shown in FIG. 5. FIG. 6 is a schematic diagram for explaining the principle of determining whether or not there is an inner particle image used in the overlap check process by the overlap check circuit of the image processor according to the embodiment shown in FIG. 5. It is the schematic diagram which showed the structure of 1 particle data in 1 frame data transmitted to the image data process part from the image processing board | substrate by one Embodiment shown in FIG. It is a figure for demonstrating the rule at the time of cutting out a partial image from the whole image of particle | grains with the image processing board | substrate by one Embodiment shown in FIG. It is the flowchart which showed the operation | movement procedure of the image display module of the image data processing part by one Embodiment shown in FIG. It is the figure which showed the simulation whole image displayed on the image display part of the image data processing part by one Embodiment shown in FIG. It is the flowchart which showed the operation | movement procedure of the image analysis processing module of the image data processing part by one Embodiment shown in FIG.

Explanation of symbols

1 Particle Image Processing Device 1b Image Processing Board (Image Processing Unit)
2 Image data analyzer 2a Image display unit (display screen)
2b Image data processor 12 Sheath flow cell (flow cell)
14 CCD camera (imaging part)
62 USB interface (transmission means)
100 particle image analysis system

Claims (13)

A particle image analysis system comprising: a particle image processing device; and an image data analysis device that displays a captured image transmitted from the particle image processing device,
The particle image processing apparatus includes:
A flow cell forming a flow of particle suspension;
An imaging unit that captures an overall image of the flow including particles of the particle suspension;
An image processing unit that generates a partial image including a particle image extracted from the captured whole image and image information including at least position information of the partial image;
Transmission means for transmitting the partial image and the image information to the image data analysis device,
The image data analysis device comprises:
Receiving means for receiving the partial image and the image information;
A particle image analysis system comprising: image generation means for generating and displaying a simulated whole image on a display screen based on the partial image and the image information received by the reception means.   2. The particle according to claim 1, wherein the image processing unit of the particle image processing device generates the partial image and the image information for one frame as one processing result data when there is a particle image in one frame. Image analysis system.   The particle image analysis system according to claim 2, wherein the image information includes information on a storage position of the partial image in the processing result data.   4. The particle image analysis system according to claim 2, wherein the transmission unit of the particle image processing apparatus sequentially transmits the processing result data for one frame to the image data analysis apparatus. 5.   The image generation unit of the image data analysis device sequentially generates and displays the simulated entire image for each processing result data for one frame received by the reception unit on the display screen. The particle image analysis system of any one of -4.   The particle image analysis system according to claim 5, wherein the image generation unit of the image data analysis apparatus displays the simulated entire image after displaying a background on the display screen.   The particle image analysis system according to any one of claims 2 to 6, wherein the one processing result data for one frame includes at least particle data having image information corresponding to one partial image.   2. The simulated entire image is displayed on the display screen by an image generation unit of the image data analysis device while an entire image of an imaging region including the particles is captured by an imaging unit of the particle image processing device. The particle image analysis system of any one of -7.   9. The position information of the partial image includes a minimum X coordinate value, a maximum X coordinate value, a minimum Y coordinate value, and a maximum Y coordinate value of the partial image in XY orthogonal coordinates. The described particle image analysis system. A flow cell that forms a flow of a particle suspension; an imaging unit that captures an entire image of a flow including particles of the particle suspension; a partial image including a particle image extracted from the captured entire image; and at least the portion A particle image processing apparatus including: an image processing unit that generates image information including position information of an image; and a transmission unit that transmits the partial image and the image information to the image data analysis apparatus, and the particle image processing apparatus. A computer of the image data analysis device in a particle image analysis system including an image data analysis device including a computer and displaying a captured image transmitted from
Receiving means for receiving the partial image and the image information from the particle image processing device;
A particle image display computer program for functioning as image generation means for generating and displaying a simulated whole image on a display screen based on the partial image and the image information received by the reception means. The receiving means sequentially receives processing result data including the partial image and the image information for each processing result data for one frame from the particle image processing device,
The particle image display computer program according to claim 10, wherein the image generation unit sequentially generates a simulated whole image for each processing result data for one frame and displays it on the display screen.   The computer-readable recording medium which recorded the computer program of Claim 10 or 11. A particle image analysis system comprising a particle image treatment device and an image data analysis device that analyzes a captured image transmitted from the particle image processing device,
The particle image processing apparatus includes:
A flow cell forming a flow of particle suspension;
An imaging unit that captures an overall image of the flow including particles of the particle suspension;
An image processing unit that generates a partial image including a particle image extracted from the entire captured image;
Transmission means for transmitting the partial image to the image data analysis device,
The image data analysis device comprises:
Receiving means for receiving the partial image;
A particle image analysis system including image analysis means for extracting an analysis parameter of the particle image based on the partial image.

Images