JP2016015944A - Colony detection system, colony detection method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a colony detection system or the like capable of accurately detecting a colony even in the case where a specimen contains residue or dirt.SOLUTION: A hygiene control system S of the embodiment has a constitution whereby it extracts color feature quantity regarding the color of pixels which constitute an imaged culture medium image, searches in a database 400 of previously recording model data of non-colony pixels therein based on the color feature quantity of each of the extracted pixels, determines pixels having color feature quantity which matches the recorded model data as non-colony pixels, removes the pixels determined as non-colony pixels from the culture medium image, detects colony pixels constituting a colony having a predetermined condition out of each pixel of the culture medium image from which the pixels were removed, and detects a colony based on the detected colony pixels.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a colony detection system for detecting colonies cultured in a medium.

  In recent years, due to the growth of fast food and other food service industries and the increase in easy processed foods, the opportunity to eat food prepared by others has increased remarkably. On the other hand, when foods such as processed foods and processed foods are mixed with dangerous substances such as poisons or microorganisms, it directly affects the human body. When handling processed foods, not only the safety of raw materials but also the production There is a need for food safety that strictly controls the hygiene of the process and covers the entire production and processing of food.

  In particular, food poisoning incidents that have occurred in various places are the starting point, and it is a proposition to further improve the safety of foods. In addition to complying with the Food Sanitation Law, “HACCP (Hazard Analysis Critical) The number of companies introducing “Control Point System” and “FSSC (Food Safety System Certification) 22000” is also increasing.

  As a system for detecting microorganisms mixed in such foods, a detection system for culturing microorganisms collected from foods on a petri dish or film and counting colonies is known, thereby confirming safety. It has become. In this type of detection system, a colony counting method based on image processing has been proposed in order to increase the efficiency of inspection (for example, Patent Document 1), and a grayscale image of an inspection result is binarized with a threshold value to obtain a colony region. Cutting and counting are performed.

JP 2006-345750 A

  However, in the system of Patent Document 1 as described above, when a sample contains a residue such as food or a non-colony such as garbage, there is a possibility that the non-colony is erroneously detected as a colony. I can't deny it. In particular, in the system of Patent Document 1 as described above, when the non-colony color feature quantity and the colony color feature quantity are close to each other, such as luminance values and RGB color components when imaged, the distinction is made. In many cases, the non-colony is erroneously detected as a colony.

  The present invention has been made to solve the above-described problems, and its purpose is to accurately detect a colony even when a residue or dust is contained in a sample. The purpose is to provide a colony detection system and the like.

  In order to solve the above-described problem, the colony detection system and the like according to the present invention acquire medium image data imaged by imaging a medium in which a specimen is placed and the colony is cultured, as medium image data. Based on the data acquisition means, the extraction means for extracting the color feature quantity relating to the color of the pixels constituting the culture medium image of the acquired culture medium image data, and the colony based on the color feature quantity of each of the extracted pixels A database in which a plurality of color feature values of non-colony pixels constituting different non-colony pixels are previously recorded as model data is searched, and pixels having color feature values that match the recorded model data are non-colony Determining means for determining a pixel; and removing the pixel determined to be the non-colony pixel from the medium image; A detection means for detecting a colony pixel constituting a colony having a predetermined condition from each pixel of the medium image from which the cell is removed, and detecting a colony based on the detected colony pixel. ing.

  The colony detection system or the like according to the present invention determines a pixel having a color feature amount that matches data modeled as a non-colony pixel constituting a non-colony as a non-colony pixel in the pixels constituting the medium image. Therefore, even if the sample contains residues or dust on the medium image, colonies can be detected accurately.

It is a lineblock diagram showing the composition of one embodiment of the hygiene management system concerning the present invention. It is an example of the film type culture medium used for the sanitary management system of one Embodiment. It is a block diagram which shows the structure of the image reading apparatus used for the sanitary management system of one Embodiment. It is a block diagram which shows the structure of the server apparatus used for the sanitary management system of one Embodiment. In one Embodiment, it is a figure which shows the example of the colony and residue which are expressed by a film type culture medium. It is a figure for demonstrating the principle (convex hull) which produces the model data performed in one Embodiment. It is a figure for demonstrating the principle (Euclidean distance on color space) which produces | generates the model data performed in one Embodiment. It is a flowchart which shows the operation | movement of the culture medium information registration process in the image reading device of one Embodiment. It is a flowchart which shows the operation | movement of the culture medium information registration process in the server apparatus of one Embodiment.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In the following embodiment, a colony detection system according to the present invention, a program thereof, for a hygiene management system using a film-type medium in a food production line or an inspection line (hereinafter referred to as “work line”), And it is embodiment at the time of applying a colony detection method. However, the present invention is not limited to the following embodiments within the scope including the technical idea.

[1] Hygiene management system First, the hygiene management system S of this embodiment will be described with reference to FIG. In addition, FIG. 1 is a block diagram which shows the structure of the sanitary management system S of this embodiment.

  The sanitary management system S of the present embodiment uses a film-type culture medium (that is, a film-type culture medium) 60 and performs data management on information on the film-type culture medium 60 (hereinafter referred to as “medium information”). This is a system for inspecting the hygienic state of food production or inspection.

  Specifically, the sanitary management system S of the present embodiment is configured to process a processed or processed food in a work line 80 having a manufacturing process for manufacturing a processed or processed food or an inspection process for inspecting the food. This is a system for data management of the culture situation when a preliminarily specified bacterium such as a general viable microorganism or E. coli contained in the specimen is cultured in the film-type medium 60 extracted as a specimen.

  In addition, the sanitary management system S of the present embodiment manages and determines the sanitary state of food on the data, information related to work in food production or inspection (hereinafter referred to as “work information”), and the extraction. The server device 40 (specifically, the database 400) is associated with the culture medium information of the film-type culture medium 60 acquired by the image reading device 10 before and after culturing the bacteria contained in the sample (colony is formed). ) Can be registered.

  In particular, the hygiene management system S of the present embodiment is recorded using the database 400 in which a plurality of color feature amounts of non-colony pixels constituting a non-colony different from a colony are recorded in advance as model data. A pixel having a color feature amount that matches the existing model data is determined as a non-colony pixel, and a pixel determined to be a non-colony pixel is determined from a medium image in which a medium on which a specimen is placed and the colony is cultured is imaged A pixel that constitutes a colony (hereinafter referred to as “colony pixel”) is detected from each pixel of the medium image that is removed and the pixel is removed, and finally a colony is detected.

  In order to realize such a configuration, the sanitary management system S of the present embodiment, as shown in FIG. 1, includes an image reading device 10 used when registering medium information regarding each film-type medium 60, and the sanitary management. The administrator terminal device 20 that manages the system S, the network 30, and the database 400, and in conjunction with the image reading device 10 or the administrator terminal device 20, performs various processes including registration management of medium information. And a server device 40.

  The image reading apparatus 10 has an ADF (Auto Document Feeder) function for taking in the film-type medium 60, and scans and images the film-type medium 60 according to an application combined with a predetermined process to generate image data. A still imaging device such as an image scanner.

  Specifically, the image reading apparatus 10 images the entire film type culture medium 60 when the film type culture medium 60 is taken in by the ADF or when the film type culture medium 60 is taken in and placed on the mounting table. The captured image data is generated, and the generated captured image data is provided to the server device 40.

  Further, the image reading device 10 has a configuration for transmitting the culture medium information to the server device 40 via the network 30 when transmitting the medium information to the server device 40. However, the image reading apparatus 10 is directly or accessed using a communication standard for short-range wireless such as BLUETOOTH (registered trademark), wireless LAN (WLAN: Wireless Local Area Network), or wireless PAN (WPAN: Wireless Personal Area Network). It may be transmitted to the server device 40 via a point, or may be transmitted to the server device 40 using a public telephone line network via a mobile base station (not shown).

  In addition to the reading operation of the film-type medium 60, the image reading device 10 can also add predetermined information to the generated image data based on the input operation of the operator.

  The administrator terminal device 20 is an information communication terminal device such as a tablet information terminal device, a smartphone, a personal computer, or a workstation. The administrator terminal device 20 manages the administrator identification information (hereinafter referred to as “manager ID”), the administrator password, and the worker identification information (that is, “worker ID”). It functions as a control device capable of performing management of access authority to the device 40, management of the terminal ID of the image reading device 10, and correction and other management of registered medium information.

  In addition, the administrator terminal device 20 has a browser function constructed by a markup language such as XML (extensible Markup Language), and executes an operation input instruction and an operation confirmation of the operator using the browser function. The browser function is used to exchange data with the server device 40, view a report, and the like.

  Furthermore, the administrator terminal device 20 has a remote function that allows remote operation of the image reading device 10.

  Note that the administrator terminal device 20 determines the culture medium information when each operation is interrupted due to a failure of a machine that performs the process or the like in the same lot, or when an error in registration of culture medium information occurs in the operator. It has a configuration that can correct other information.

  The network 30 is, for example, a public telephone line network including a mobile phone network (hereinafter referred to as “long-distance communication network”), an IP (Internet Protocol) network such as a short-range wireless network, or both of them are interconnected. It is configured. However, the configuration of the network 30 is not limited to this.

  The server device 40 has a database 400 for recording predetermined data, and is linked with the image reading device 10 or the administrator terminal device 20 and executes each data process for performing sanitary management of lots and work lines 80. This is a server device used for this purpose.

  Then, the server device 40 operates in conjunction with the image reading device 10 to acquire captured image data and other data transmitted from the image reading device 10, detects colonies in the film-type medium 60 from the acquired data, and It has the structure which registers the information regarding a colony as culture-medium information.

Specifically, when the server device 40 detects a colony,
(1) From the imaged image data, the medium image data imaged by imaging the medium in which the specimen is placed and the colony is cultured is acquired as the medium image data,
(2) Extracting the color feature amount relating to the color of the pixels constituting the medium image of the acquired medium image data,
(3) A database 400 in which a plurality of color feature amounts of non-colony pixels constituting a non-colony that is different from a colony such as residue or dust is preliminarily recorded as model data based on the extracted color feature amount of each pixel. Search the inside, determine that the pixel having a color feature amount matching the recorded model data is a non-colony pixel,
(4) A pixel determined as a non-colony pixel is removed from the medium image, and a colony pixel constituting a colony having a predetermined condition is detected from each pixel of the medium image from which the pixel is removed, and the detected colony Detect colonies based on pixels,
It has a configuration.

  In particular, in the present embodiment, the model data has color feature values of each of a plurality of channels, and the extracted color feature values of each pixel are configured by the color feature values of each of the plurality of channels. .

  In the present embodiment, data of a plurality of models (model data) that are non-colony pixels are recorded in the database 400, and the type of the film-type medium 60, the type of the sample, and the sample are stored in the film type. A plurality of model data to be non-colony pixels may be recorded in a database for each type of diluent used when placed on the medium 60, or for each of two or more types of information among these types.

  In this case, the server device 40 acquires the type of the film-type medium 60, the type of the specimen, the type of the diluent, or two or more types of these information, and stores the model data group of the acquired type information in the database. A configuration is selected from 400, and an extracted pixel having a color feature amount that matches any color feature amount of a recorded non-colony pixel is determined as a non-colony pixel from the selected model data. You may have.

  With such a configuration, in the hygiene management system S of the present embodiment, pixels having color feature values that match data modeled as non-colony pixels constituting non-colony in the pixels constituting the medium image are arranged. Since it can be determined as a non-colony pixel, a colony can be accurately detected even when a sample contains residues or dust on the medium image.

  Further, in the sanitary management system S of the present embodiment, it is possible to save resources as compared with the case where various data analyzes and provisions are performed using physical resources such as paper media, and the culture medium. By registering the culture medium information in the database 400, registration errors can be remarkably reduced and management of difficult culture media can be facilitated, so that resource saving can be achieved without wasteful consumption of culture media. ing.

[2] Film Type Medium Next, the film type medium 60 of the present embodiment will be described with reference to FIG. FIG. 2 is an example of a film-type medium 60 used in this embodiment.

  The film-type medium 60 used in the present embodiment is a medium for culturing bacteria contained in food as a specimen detected from each step of the work line 80 using a film or sheet-like dry medium. The film-type medium 60 is, for example, a medium for culturing general living bacteria, coliform bacteria, Staphylococcus aureus, and the like, and other mediums for culturing various microorganisms such as mold, yeast, Listeria, aquatic bacteria, and lactic acid bacteria. There may be.

  The film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “circular frame”) 62, a culture layer 63 for culturing bacteria provided in the frame, and a cover sheet 64 formed so as to cover the base material sheet including the culture layer 63 And a type ID 66 formed on the right side of the base sheet 61 and indicating the type of the culture medium.

  For example, the type ID 66 is formed of a bar code such as a two-dimensional bar code or an alphanumeric character, and is imaged together when the film-type medium 60 is read, such as a bar code recognition function or an OCR (Optical Character Recognition) function. It is acquired by the administrator terminal device 20 or the server device 40 using the image analysis function. The type ID 66 is, for example, a code that specifies a manufacturer and a product model number.

  The base material sheet 61 is not particularly limited as long as it is a film-like or sheet-like base material, and for example, a plastic film or paper can be used. Preferred examples of plastic films include resin films such as polyethylene, polypropylene, polyethylene terephthalate, polyethylene naphthalate, polymethacrylate, polymethyl methacrylate, polymethyl acrylate, polyester, and polycarbonate. Preferred examples include polyethylene terephthalate and polypropylene synthetic paper. Note that the polypropylene-based synthetic paper is a film synthetic paper whose main raw material is polypropylene.

  In addition, in type ID66 of this embodiment, the culture medium ID which identifies a culture medium separately may be contained in addition to the information which manages the culture medium type of the film type culture medium 60. FIG. In this case, the culture medium ID is acquired in the administrator terminal device 20 or the server device 40 using the image analysis function together with the type ID.

[3] Image Reading Device Next, the configuration of the image reading device 10 of this embodiment will be described with reference to FIG. FIG. 3 is a block diagram illustrating the configuration of the image reading apparatus 10 according to the present embodiment.

  The image reading apparatus 10 of the present embodiment has a data storage unit 100 having a memory function used when various programs are executed, a scanning function (imaging function), image data of the film-type medium 60, and the like. In association with the image data generation unit 110 that generates the image data, and the server device 40, the culture medium information is registered in the server device 40 after initial culture and registration after culture (hereinafter referred to as “medium information registration process”). And an application control unit 120 that executes other processing.

  The image reading device 10 includes a network communication unit 130 that communicates with the server device 40 and other communication devices, an ADF unit 140, a display unit 160, a display control unit 161 that controls the display unit 160, and a user's An operation unit 170 for inputting an operation, a timer 180, and a terminal management control unit 190 for controlling the entire apparatus are provided.

  The data storage unit 100 includes an application storage unit 101 that stores various application programs, an image data storage unit 102 that stores image data read and generated by the image data generation unit 110, and an image reader 10. A program relating to management and control, and a ROM / RAM 103 that is used as a work area during execution of each program and stores data used in each process executed by the image reading apparatus 10 are included.

  In particular, the application storage unit 101 includes an application program (hereinafter referred to as “application”) that is executed by the application control unit 120 in conjunction with the image data generation unit 110, the operation unit 170, the display control unit 161, and the image data storage unit 102. Is recorded).

  The image data storage unit 102 stores imaged captured image data, an image ID for managing each image data, and various metadata corresponding to each image data such as a reading time in association with each other. Is done. The image ID is arbitrary identification information given as appropriate in the image reading apparatus 10.

  The image data generation unit 110 includes an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and image data based on the electrical signal generated by the CCDI sensor. And a generating unit that generates

  In particular, the image data generation unit 110 images the entire image-scanned film-type medium 60 when the bacteria generated in the specimen are cultured or when the film-type medium 60 cultured is imaged. Image data of the entire film type culture medium 60 is generated as captured image data.

  The application control part 120 implement | achieves culture-medium information registration process with a predetermined application. In particular, the application control unit 120 executes various control programs for controlling each unit of the image reading device 10 using the culture medium registration application stored in the application storage unit 101, while performing the network communication unit 130, the display control unit 161, and the operation. Various processes are executed in conjunction with or under control of the unit 170.

  In particular, the application control unit 120 executes the culture medium registration application recorded in the application storage unit 101, acquires the captured image data of the film type culture medium 60 read by controlling the image data generation unit 110, and stores these data in these data The image data is stored in the image data storage unit 102 as medium information together with metadata of each data while giving an image ID.

  Further, the application control unit 120 acquires the current time from the timer 180 when imaging the film-type medium 60, and stores the image data as metadata of the captured image data together with a predetermined image ID using the current time as a reading time. Store in the unit 102.

  On the other hand, the application control unit 120 executes a medium information registration process for registering the medium information stored in the image data storage unit 102 in the server device 40 after acquiring captured image data or at a predetermined timing.

  Note that the application control unit 120 may be realized as a function when the CPU (central processing unit) constituting the terminal management control unit 190 executes an application in terms of implementation.

  The network communication unit 130 establishes a communication line with the server device 40 connected to the network 30 under the control of the application control unit 120 and the terminal management control unit 190, and exchanges various data such as captured image data. .

  The ADF unit 140 has a configuration for realizing ADF functions such as a mechanical structure and a control circuit. In particular, the ADF unit 140 is a mechanism for taking a plurality of film-type culture media 60 placed one by one in the same place into an area (not shown) where scanning is performed. Drive under control.

  The display unit 160 has an image display area of a predetermined size (for example, 5 inches, W480 × H960 pixels), is configured by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 161. A predetermined image is displayed based on the display data. In particular, in this embodiment, the display unit 160 displays various displays and images of the film-type culture medium 60 in conjunction with the operation unit 170 when the culture medium registration application is being executed.

  The display control unit 161 generates drawing data necessary for causing the display unit 160 to draw a predetermined image under the control of the application control unit 120 or the terminal management control unit 190, and the generated drawing data is displayed on the display unit 160. To output.

The operation unit 170 includes various confirmation buttons, operation buttons for inputting operation commands, a number of keys such as a numeric keypad, and a touch sensor provided on the display unit 160, and is used when performing each operation. It has become. Specifically, the operation unit 170 is used when performing operations for executing the various processes described above when the culture medium registration application is activated.
The timer 180 provides the application control unit 120 with the date and time when the image data generation unit 110 reads the film-type medium.

  The terminal management control unit 190 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and provides general functions and information of the image reading device 10. It is designed to control overall functions for executing programs.

[4] Server Device [4.1] Configuration Next, the configuration of the server device 40 of this embodiment will be described with reference to FIG. FIG. 4 is a configuration diagram showing the configuration of the server device 40 of this embodiment.

  As shown in FIG. 4, the server device 40 of the present embodiment communicates with a database 400 in which various information such as work information and medium information is stored, and with the image reading device 10 and the administrator terminal device 20. Unit 410, data processing unit 420 that performs various processes such as determining non-colony pixels and detecting colonies, server management control unit 430 that controls each unit of server device 40, and ROM that is used to control each unit / RAM 440 and timer 450 used for time management. The above-described units are connected to each other by a bus 41, and data transfer is performed between the components.

  The communication control unit 410 is a predetermined network interface, establishes a communication line with the image reading device 10 or the administrator terminal device 20, and exchanges various data with the image reading device 10 or the administrator terminal device 20.

  The database 400 includes an HDD, and a medium information database (hereinafter, abbreviated as “medium information DB”) 401, a database (hereinafter, non-colony pixels) used to determine pixels (that is, non-colony pixels) constituting residues and garbage. A “pixel type determination DB” 402, a work management database (hereinafter abbreviated as “work management DB”) 404, and a profile information database (hereinafter referred to as “profile information DB”) 405.

The medium information DB 401 is extracted for each process of each work line 80, and the medium information regarding the film-type medium 60 of the specimen acquired by scanning by the image reading apparatus 10 is the medium for each type ID 66 and for each medium ID. A database where information is stored. For example, in the culture medium information DB 401,
(1) Type ID 66
(2) Medium ID
(3) Captured image data (4) Medium image data (5) Scanning time (6) Number of colonies (7) Medium determination result (8) Size (number of pixels), barycentric position, feature amount of each pixel, etc. were detected Information about each colony (hereinafter referred to as “colony information”)
(9) Type of profile information (profile ID) used at the time of colony detection
Are recorded in association with each other.

  In addition, the result determined by the data processing unit 420 is stored as the colony information, the number of colonies, and the medium determination result in each medium information. The colony information, the number of colonies, and the medium determination in each medium information may be registered when the medium information is registered, or may be registered at a predetermined timing different from the registration timing of the medium information.

  In the pixel type determination DB 402, a plurality of color feature values modeling non-colony pixels constituting residue and dust are classified into the type (manufacturer or product model number) of the film-type medium 60, the type of specimen, and the specimen as the film-type medium 6 is a database that is recorded as model data in association with various types of information on the type of diluent used when placing on 60. The pixel type determination DB 402 is used when determining whether or not each pixel constituting the culture medium image is a non-colony pixel.

  In particular, in the present embodiment, each model data group is generated and registered for each medium type, specimen type, and diluent type, and for each combination of two or more types among these types. A model data group is generated and registered in the pixel type determination DB 402.

  For example, in the pixel type determination DB 402, the type ID for specifying the type of the film-type medium 60, the sample type registered in association with the medium ID, and the type of dilution liquid are associated with various types of information, A plurality of model data (model data group) in which gradation values for each channel of R (red), G (green), and B (blue) constituting the color of residue or dust are defined, and colony pixel candidates (hereinafter, “ And a plurality of model data constituting “colony candidate pixels”).

  In particular, in the present embodiment, when RGB is defined with 256 gradations, the pixel type determination DB 402 stores non-colonies for 16777216 colors (256 gradations to the third power) for each type of information. Pixel model data or colony candidate pixel model data is defined.

  In the present embodiment, only model data of non-colony pixels may be recorded.

  In the present embodiment, for example, flag information is used for determining whether the model data of the non-colony pixel or the colony candidate pixel, and flag information indicating “0” indicates the colony candidate pixel. Flag information indicating “1” indicates a non-colony pixel.

  Furthermore, in the present embodiment, each model data is generated using several samples, and is configured by the samples and the generated data.

The work management DB 404 is a database that stores various types of information regarding work contents for each culture medium type, and is a database for providing inspection contents for each culture medium type to workers and others by associating with the culture medium information DB 401. For example, in the work management DB 404, (1) medium ID is associated with each medium ID.
(2) Examination type (genus to be detected such as general viable bacteria or E. coli) and color (coloring) information (RGB gradation value or its range) when it is generated on the film-type medium 60
(3) Type of specimen (4) Type of diluent (5) Culture start time (6) Culture time from the start of culture to the elapse of a predetermined time (7) Culture location (for example, incubator number, number of stages in incubator, etc. Position of)
(8) Work date and time (work start time and end time)
(9) Worker ID (and / or worker name)
Are recorded in association with each other.

  Such information is registered by an operator or the like. Moreover, only a single time (that is, an end time for ending the culture of bacteria in the specimen) may be set as the culture test time, or after legal passage from the culture start time or after a predetermined time has elapsed, for example, A plurality of times such as 24 hours from the start of culture, 48 hours, or 72 hours may be set.

The profile information DB 405 is a database that stores a plurality of profile information. For example, in the profile information DB 405, (1) a type ID is associated with each type of ID.
(2) Profile information (3) Template image data (hereinafter referred to as “template image data”)
Are recorded in association with each other.

Specifically, the profile information includes
(2A) the type of color-related feature value (color feature value) when colony pixels are detected from the medium image;
(2B) data for selecting a model data group used in the pixel type determination DB 402 based on the type of medium, the type of specimen, and the type of diluent;
(2C) a threshold value of a color feature amount when specifying a colony pixel, and
(2D) A threshold value for pass / fail when performing medium determination is included.

The data processing unit 420 executes various types of data processing according to the application recorded in the ROM / RAM 440. In particular, the data processing unit 420 executes a predetermined program,
(1) Operation management of the communication control unit 410;
(2) An acquisition process for acquiring medium image data imaged by imaging a medium in which a specimen is placed from the captured image and cultivating the colony;
(3) an extraction process for extracting a color feature amount related to the color of the pixels constituting the medium image of the medium image data;
(4) A determination process for searching the pixel type determination DB 402 based on the extracted color feature amount of each pixel and determining a pixel having a color feature amount that matches the recorded model data as a non-colony pixel. ,
(5) A pixel determined as a non-colony pixel is removed from the medium image, and a colony pixel having a predetermined condition is detected from each pixel of the medium image from which the pixel is removed, and based on the detected colony pixel A detection process for detecting colonies and counting the detected colonies;
(6) Medium information registration processing for registering information on the detected colonies and the counted number of colonies in the database 400 as medium information;
(7) Management and control of the database 400;
(8) generation processing of model data recorded in the pixel type determination DB 402;
I do.

  Specifically, the data processing unit 420 includes a registration processing unit 421 that performs a medium information registration process, an image extraction processing unit 422 that performs an extraction process, a colony detection determination unit 423 that performs a determination process and a detection process, And a model data generation processing unit 424 that executes a generation process for generating model data.

  For example, the registration processing unit 421 of the present embodiment constitutes a data acquisition unit according to the present invention, and the colony detection determination unit 423 constitutes an extraction unit, a determination unit, and a detection unit according to the present invention. Further, the model data generation processing unit 424 of this embodiment constitutes a sample acquisition unit, a calculation unit, and a management unit. Furthermore, details of the registration processing unit 421, the image extraction processing unit 422, the colony detection determination unit 423, and the model data generation processing unit 424 will be described later.

  The server management control unit 430 is mainly configured by a central processing unit (CPU), and integrally controls each unit of the server device 40 by executing a program. Specifically, the server management control unit 430 performs various controls related to data exchange with the image reading apparatus 10.

  Various programs necessary for driving the server device 40 are recorded in the ROM / RAM 440. The ROM / RAM 440 is used as a work area during execution of each program.

  The timer 450 is used to manage the time required when the medium information registration process is executed.

[4.2] Registration Processing Unit Next, details of the registration processing unit 421 in the server device 40 of the present embodiment will be described.

  The registration processing unit 421 according to the present embodiment performs a medium information registration process for the medium information in each film type medium 60 based on an operator's instruction in conjunction with the image reading device 10.

  In particular, the registration processing unit 421 performs image analysis on each captured image data included in each medium information transmitted from the image reading device 10 to acquire the type ID 66, and the acquired type ID 66 is used as the image extraction processing unit. 422 and the colony detection determination unit 423.

  Particularly, when the registration processing unit 421 acquires the culture medium information, the registration processing unit 421 searches the captured image of the captured image data included in the culture medium information, and the type ID 66 configured by the two-dimensional barcode imaged in the captured image. To get. And the registration process part 421 assign | provides culture-medium ID for identifying a culture medium automatically or under an operator's instruction | indication, or when included in classification ID66, culture | cultivation ID is combined with classification ID66. get.

  Further, the registration processing unit 421 associates the colony information, the number of colonies, and the determination result obtained by the colony detection determination process of the colony detection determination unit 423 with the corresponding type ID 66 and medium ID as the medium information, respectively, and the inspection time. At the same time, it is registered in the culture medium information DB 401.

[4.3] Image Extraction Processing Unit Next, the image extraction processing unit 422 in the server device 40 of the present embodiment will be described.

  Usually, when image analysis is performed on a culture medium image, the analysis is performed based on the luminance of pixels constituting the culture medium image and color feature amounts such as RGB. However, if the medium image includes not only an image of a mount (base material) part on which a medium other than the medium is formed, but also an image of a part where characters or marks exist on the mount, the color of the characters or marks May affect the image analysis.

  Therefore, in the present embodiment, an image part (that is, a medium image) used for colony detection is accurately extracted from a captured image using a template image, and colonies are detected based on the extracted image. It has become.

  Specifically, the image extraction processing unit 422 searches the profile information DB 405 based on the type ID 66 acquired by the registration processing unit 421 and acquires corresponding template image data, thereby obtaining a template image. 1 is selected, and the shape of the culture medium (specifically, the shape of the culture layer 63) is specified from the culture medium image acquired using the selected template image. Then, the image extraction processing unit 422 provides the identified shape image to the colony detection determination unit 423 in order to use it as an image for detecting a colony.

  In particular, the image extraction processing unit 422 scans the medium image on the basis of the selected template image, and identifies an area having a predetermined condition as an image part of the medium image. An image part used for colony detection is extracted.

[4.4] Colony Detection Determination Unit Next, details of the colony detection determination unit 423 in the server device 40 of the present embodiment will be described with reference to FIG. FIG. 5 is a diagram showing examples of colonies and residues expressed in the film-type medium 60.

  The colony detection determination unit 423 performs the extraction process of extracting the color feature amount of each pixel of the medium image provided from the image extraction processing unit 422, and based on the color feature amount of each extracted pixel, The determination DB 402 is searched to execute a determination process for determining whether each pixel is a non-colony pixel or a colony pixel.

  Usually, when the specimen is placed on the film-type medium 60 (that is, when the specimen is hung on the film-type medium 60 including the diluent), the residue of the food to be examined is lost on the film-type medium 60. There are many things. In addition, for example, as shown in FIG. 5, this residue often has a similar color to the color of the colony expressed on the film-type medium 60 depending on the type of specimen (the specimen shown in FIG. 5 is chocolate). When a colony is detected based on the color feature amount of a pixel by analysis, the presence of a non-colony that is not a colony such as the residue often affects the analysis result.

  However, when the color feature values of non-colony such as colonies and residues are indicated by gradation values of color components of R (red), G (green), and B (blue), for example, each color component is displayed in a three-dimensional space. Therefore, it is difficult to directly set the boundary between the colony pixel and the non-colony pixel using the respective raw data on the RGB three-axis coordinates. In particular, when the colors of non-colony such as colonies and residues are similar colors, it may be difficult to set the boundary, and in many cases, it cannot be accurately classified.

  On the other hand, medium image data (hereinafter referred to as “medium image data”) is a digital image, and a color can be expressed by a combination of finite integer values. For example, even if each color component of RGB is expressed by 256 gradations, it can be expressed in 16777216 ways.

  Therefore, in the present embodiment, in order to accurately discriminate and classify non-colony pixels, model data obtained by modeling the colors of non-colony pixels with respect to all colors used in the medium image is databased in advance, and the database It is now possible to detect colony pixels from each pixel in the medium image and finally detect colonies while determining whether each pixel constituting the medium image is a non-colony pixel. ing.

  In particular, in this embodiment, the colony detection determination unit 423 removes the non-colon pixels determined by the determination process from the medium image, and the colonies having a predetermined condition from each pixel of the medium image from which the pixels are removed. The colony pixel which comprises is detected, a colony is detected based on the detected colony pixel, and the colony detection process which counts the number is performed. And the colony detection determination part 423 provides the detected colony and the count result to the registration process part 421, respectively.

(Determination process)
The colony detection determination unit 423 acquires, for each film type medium 60, the sample type and the type of diluent based on the medium ID acquired by the registration processing unit 421, and the acquired sample type and type of diluent. The pixel type determination DB 402 is searched based on the type ID 66 acquired by the registration processing unit 421, and the model data group to be searched is specified.

  Then, the colony detection determination unit 423 searches for the specified model data group to be searched for each film-type medium 60 based on the color feature amount of each pixel of the medium image, and matches the color of any model data. A pixel having a feature amount is determined as a non-colony pixel.

  For example, when the gradation value of the color feature amount (R, G, B) of a specific pixel of the medium image is (200, 155, 170), it is recorded in the pixel type determination DB 402 as model data of the non-colony pixel. If the colony is detected, the colony detection determination unit 423 specifies the specific pixel as a non-colony pixel.

  In the present embodiment, as described above, the pixel type determination DB 402 stores the model data of the colony candidate pixels, and the colony detection determination unit 423 performs the culture for each film-type medium 60. In each pixel of the image, it is determined whether it is a non-colony pixel or a colony pixel from the model data group to be searched. However, the determination process may be executed without using the model data of the colony candidate pixels.

(Detection process)
The colony detection determination unit 423 removes the non-colony pixels determined from the medium image for each film type medium 60, and determines various thresholds or parameters for each pixel of the medium image from which the pixels are removed based on the profile information. Are set, colony pixel detection method, colony candidate detection method, and colony identification method are determined, and colony detection processing is executed for each medium image data, and the result is provided to the registration processing unit 421, respectively. To do.

Specifically, the colony detection determination unit 423 is based on the provided profile information.
(1) In order to detect pixels assumed to constitute an imaged colony from the provided medium image (medium image from which non-colony pixels are removed), from among each pixel constituting the medium image , Detect colony pixels having a feature value for a color having a predetermined condition,
(2) Concatenating colony pixels and performing labeling to give an ID, and detecting a connected colony pixel group as one colony candidate,
(3) While identifying colony candidates having predetermined conditions as colonies, the number is counted,
(4) Perform medium determination based on the counted number of colonies.

  In particular, when the type of feature amount is luminance or saturation, the colony detection determination unit 423 includes a value obtained by executing a predetermined calculation based on the gradation value of each RGB channel of each pixel. Colony pixels are detected based on parameters defined in the profile information, colony candidates are identified based on the detected colony pixels, colonies are detected from the identified colony candidates, and the number is counted.

  The colony detection determination unit 423 performs labeling by connecting adjacent colony pixels while performing image filter processing including expansion processing and reduction processing for reducing image filter noise, and assigning an ID. Colony candidates are detected based on the connection method and the parameters based on the profile information.

  That is, the colony detection determination unit 423 is configured to connect the colony pixels with respect to adjacent colony pixels based on a range that should be determined to be the same as the feature amount related to the color of each colony pixel specified by the profile. Concatenate those determined to be.

  Furthermore, the colony detection determination unit 423 connects adjacent colony pixels to form a colony pixel group, and uses the color characteristics for each colony pixel group or the barycentric position on the medium image to form the same colony pixel Connect them together.

  Then, the colony detection determination unit 423 sets, for each detected colony candidate, feature amounts such as color characteristics, roundness, shape, and size determined by the profile information, based on the feature amounts specified in the specified profile information. However, the likelihood indicating the likelihood of colony is calculated based on the set feature amount.

  Finally, based on the profile information, the colony detection determination unit 423 identifies colony candidates having a predetermined condition such as a calculated likelihood equal to or greater than a threshold value as a colony, and counts the number as the number of colonies.

  The colony detection determination unit 423 detects the detected colony pixel (for example, the position on the medium image and the ID of the colony candidate to which the own pixel belongs), the detected colony candidate (for example, the arrangement position of the colony pixel on the medium image, the color characteristic, or (Predetermined information such as the center of gravity position), the identified colony (for example, predetermined information such as the arrangement position of the colony pixel on the medium image, color characteristics, or the position of the center of gravity), and the counted number of colonies via the registration processing unit 421 And stored in the medium information DB 401.

  In addition, the expansion process is one of image filter processes, and is a process of replacing all pixels adjacent to a colony pixel with colony pixels when other colony pixels exist adjacent to each colony pixel. .

  Further, the contraction process is a process of replacing all pixels adjacent to the colony pixel with non-colony pixels when there is a non-detected pixel adjacent to the colony pixel (hereinafter referred to as “non-colony pixel”). .

  On the other hand, the colony detection determination unit 423 of the present embodiment performs medium determination based on the number of colonies counted by the colony detection process. In particular, the colony detection determination unit 423 compares the threshold value set in advance with the detected colony number based on the profile information acquired in the colony detection process as the medium determination process, and the detected colony number is greater than or equal to the threshold value. In this case, it is determined that the sample is abnormal, and if it is smaller than the threshold value, it is determined that the sample is normal, and the medium determination of whether the sample of each film-type medium 60 is abnormal or normal (that is, the sample) ) Is executed.

[4.5] Model Data Generation Processing Unit Next, details of the model data generation processing unit 424 in the server device 40 of the present embodiment will be described with reference to FIGS. 6 and 7. 6 is a diagram for explaining a principle (convex hull) for generating model data executed in the present embodiment, and FIG. 7 is a principle for generating model data executed in the present embodiment (convex hull). It is a figure for demonstrating (Euclidean distance on a color space).

  The model data generation processing unit 424 acquires, in advance, a plurality of sample data of non-colony pixels constituting non-colony such as residue and dust for each medium type, specimen type, and dilution liquid type. Model data is generated from the sample data, and model data of a plurality of models to be each non-colony pixel is acquired and registered in the pixel type determination DB 402 by using the generated model data and the acquired sample data.

  In particular, the model data generation processing unit 424 uses a convex hull when generating model data based on a plurality of acquired sample data. Specifically, the model data generation processing unit 424 distributes sample data in the RGB space, for example, when the color feature amount is an RGB color component, and the ambiguity is based on the distributed sample data. A set (sample data and a set of generated model data) representing the convex figure to be obtained effectively is constructed, and the constructed set is registered in the pixel type determination DB 402 as model data of a plurality of models that are non-colony pixels.

  For example, when 1000 pieces of sample data are used, the model data generation processing unit 424 distributes the samples in the three-dimensional space as shown in FIG. 6 (FIG. 6 shows the two-dimensional space of the RG for explanation. ), A set (frame A) representing a convex figure is constructed based on the distributed samples, and a combination of RGB gradation values existing in the set is generated as model data of non-colony pixels. Then, the model data generation processing unit 424 registers the combination of the tone values of the generated model data and the sample data in the pixel type determination DB 402 as model data of a plurality of models that are non-colony pixels.

  In addition, the model data generation processing unit 424 registers a combination of color feature amounts other than the registered model data in the pixel type determination DB 402 as model data of colony candidate pixels. However, the model data of the colony candidate pixels may not be used when the pixel determination process is performed.

  The model data generation processing unit 424 generates a model data group for each medium type, specimen type, and diluent type, and generates a model data group for each combination of two or more of these types. It is generated and registered in the pixel type determination DB 402.

  The model data generation processing unit 424 may calculate model data based on the Euclidean distance in the space of the color feature amount of each sample data instead of the convex hull. Specifically, as shown in FIG. 7, for example, when the color feature amount is an RGB color component, the model data generation processing unit 424 distributes the sample data in the RGB space, and each of the distributed data A combination of gradation values within a certain Euclidean distance with respect to the sample data is generated as model data, and the generated model data and sample data are registered in the pixel type determination DB 402 as model data of a plurality of models that are non-colony pixels. May be.

[5] Hygiene management system operation process [5.1] Medium information registration process (image reading device)
Next, the operation of the medium information registration process for the film-type medium 60 in the image reading apparatus 10 of the present embodiment will be described with reference to FIG. FIG. 8 is a flowchart showing the registration processing operation of the medium information in the image reading apparatus 10 of the present embodiment.

  In this operation, a plurality of profile information, template image data, and arrangement structure information are stored in advance in the profile information DB 405 based on the type ID.

  In this operation, the plurality of film-type culture media 60 to be registered are assumed to be already placed in a predetermined location of the ADF unit 140, for example, and the number of colonies in each film-type culture media 60 is detected by the culture media. It is assumed that it is executed when information is registered in the database 400.

  In this operation, it is assumed that the image reading apparatus 10 performs calibration for RGB gradation values or luminance values for reading a captured image.

  First, in the image reading apparatus 10, when the application control unit 120 detects an activation instruction for the culture medium registration application via the operation unit 170 (step S <b> 101), the application control unit 120 reads the medium registration application from the application storage unit 101 and activates it (step S <b> 102). ). At this time, the application control unit 120 executes a display for confirming whether or not the plurality of film-type culture media 60 to be registered in the display unit 160 are already placed on the ADF unit 140 in conjunction with the display control unit 161. At the same time, under the control of the terminal management control unit 190, initialization of the work memory and other necessary processes are executed.

  Next, the application control unit 120 causes the display unit 160 to display a screen that prompts the reading start of each film-type medium 60 (hereinafter also referred to as a “reading start confirmation screen”), and in conjunction with the operation unit 170, image data. It waits for reading by the generation unit 110 (step S106).

  Next, when the application control unit 120 detects the start of reading of the film-type medium 60 by the operation unit 170 in cooperation with the image data generation unit 110 and the display control unit 161 (step S107), the application control unit 120 controls the ADF unit 140 to The plurality of film-type culture media 60 set in the ADF unit 140 are sequentially moved to the scanning area, and the image data generation unit 110 scans the plurality of film-type culture media 60 to form an image, and generates each captured image data as an image. The data storage unit 102 stores a predetermined image ID while giving it (step S108).

  When a plurality of film-type culture media 60 are placed on the ADF unit 140, the application control unit 120 continuously images each film-type culture media 60 and stores each of them in the image data storage unit 102. The image ID is stored while being given.

  Next, the application control unit 120 acquires the current time from the timer 180 as the reading time of the captured image data in each film type culture medium 60, and stores it in the image data storage unit 102 as metadata in association with each captured image data. (Step S109).

  Next, the application control unit 120 transmits each captured image data and its metadata as one medium information to the server device 40 via the network communication unit 130 based on the operator's instruction (step S118). The medium information registration process of the reader 10 is finished.

  At this time, when transmitting the culture medium information, the network communication unit 130 executes login for accessing the server device 40 based on the terminal ID and the input ID and password, and the server after the login is completed. A communication line with the apparatus 40 is established, and medium information is transmitted.

[5.2] Medium information registration processing (server device)
Next, operation | movement of the culture medium information registration process of the film type culture medium 60 in the server apparatus 40 of this embodiment is demonstrated using FIG. FIG. 9 is a flowchart showing the culture information registration processing operation in the server device 40 of this embodiment.

  This operation is a process executed in conjunction with the culture medium information registration process executed by the image reading device 10, and the server device 40 picks up each captured image of each film type culture medium 60 transmitted from the image reading device 10. This is a process for registering information corresponding to each data in the culture medium information DB 401 as culture medium information.

  In addition, in the pixel type determination DB 402, all model data of the non-colony pixels generated by the model data generation processing unit 424 in advance is already recorded for each medium type, specimen type, and diluent type. .

  First, in the server device 40, when the communication control unit 410 receives one piece of medium information including one piece of captured image data transmitted from the image reading device 10 (step S300), the registration processing unit 421 uses the captured image data. Image analysis is performed on the configured captured image, the type ID 66 is specified, and provided to the image extraction processing unit 422 and the colony detection determination unit 423 (step S301).

  Next, the registration processing unit 421 acquires the culture medium ID based on the image analysis of the type ID 66 or the operator's instruction (step S302).

  Next, the registration processing unit 421 specifies the culture examination time when registering the culture medium information in the captured image data based on the reading time included in the culture medium information (step S305). At this time, the registration processing unit 421 may be registered by designating the culture examination time for registering the culture medium information in each captured image data in conjunction with the image reading device 10 or included in the received culture medium information. The reading time may be registered as it is as the culture examination time.

  Next, the image extraction processing unit 422 searches the profile information DB 405 based on the type ID 66 specified by the registration processing unit 421, acquires template image data and arrangement structure information (step S306), and provides the provided template. Based on the image and the arrangement structure information, a medium image extraction process for extracting a medium image from the captured image is executed, and the extracted medium image is provided to the colony detection determination unit 423 (step S307).

  An example of the procedure of the medium image extraction process here is shown below. First, the image extraction processing unit 422 acquires template image data and arrangement structure information, and executes a search area determination process that determines a search area in which a culture medium image is assumed to be formed based on the arrangement structure information. .

  Then, the image extraction processing unit 422 starts scanning for generating a composite image in order from the upper right of the determined search area based on the acquired template image. The image extraction processing unit 422 also superimposes the template image on the corresponding search area, generates the composite image, and calculates the color feature amount in the composite image.

  In addition, the image extraction processing unit 422 determines whether scanning of the search area based on the template image has been completed. If the image extraction processing unit 422 determines that scanning of the search area based on the template image has not ended, the image extraction processing unit 422 returns to the process of superimposing the template image on the search area portion described above, and ends the process. If it is determined that there is, the process proceeds to the next process.

  Further, the image extraction processing unit 422 determines a composite image having a predetermined condition for the color feature amount in all the composite images, and a region where the determined composite image is formed is a part of the medium image. And the medium image extraction process is terminated.

  Next, after completion of the medium image extraction process, the colony detection determination unit 423 searches the work management DB 404 and the profile information DB 405 based on the type ID 66 and the medium ID specified by the registration processing unit 421, and the corresponding sample type, The type of dilution liquid and profile information are acquired (step S308), and the color feature values (RGB color components) of each pixel are extracted from the medium image extracted by the image extraction processing unit 422 (step S310).

  Next, the colony detection determination unit 423 specifies a target model data group recorded in the pixel type determination DB 402 based on the acquired specimen type, diluent type and profile information, and the color component of each pixel. (Step S311).

  Next, the colony detection determination unit 423 searches the specified model data group based on the color feature amount of each pixel of the medium image, and determines whether each pixel is a non-colony pixel or a colony candidate pixel. The determination is executed (step S312).

  Next, the colony detection determination unit 423 removes pixels identified as non-colony pixels from the medium image (step S313).

  Next, the colony detection determination unit 423 specifies colony pixels in the medium image based on the medium image from which the corresponding pixel is removed and the provided profile information, and executes colony detection and counting. Colony detection processing is executed (step S321).

  Next, the colony detection determination unit 423 performs medium determination (pass / fail determination) based on the provided profile information (step S322). Note that the colony detection determination unit 423, in the processing of step S321 and step S322, causes the display unit 160 of the image reading device 10 to display the detected number of colonies and the result of the pass / fail determination in conjunction with the image reading device 10, You may make a user browse and confirm.

  In addition, the colony detection determination unit 423 determines pass (normal) when the predetermined condition is satisfied in the medium determination of the process of step S322, and rejects when the predetermined condition is not satisfied. (Abnormal) is determined.

  Next, the registration processing unit 421 uses the imaged image data, the medium image data, the type ID 66, the medium ID, the determined pass / fail, the detected number of colonies, and the culture start time information with the read time included in the medium information as the culture start time. Is registered in the culture medium information DB 401 (step S323), and this operation is terminated.

  The registration processing unit 421 displays line information and information to be registered on the display unit 160 of the image reading device 10 and registers medium information and the like based on a user instruction input via the image reading device 10. You may make it do.

  Moreover, although the above-mentioned operation | movement is performed when culture medium information is acquired by the image reading apparatus 10, the culture medium information acquired by the image reading apparatus 10 may be recorded on culture medium information DB401, and may be performed after that.

  As described above, in the sanitary management system S of the present embodiment, in the pixels constituting the culture medium image, the pixels having the color feature amount that matches the data modeled as the non-colony pixels constituting the non-colony are non-colony pixels. Therefore, the colony can be accurately detected even when the sample contains a residue or dust on the medium image.

[6] Modification [6.1] Modification 1
In this embodiment, instead of performing the registration process of the culture medium information using the image reading device 10 such as an image scanner alone, a portable communication terminal device with an imaging function such as a digital camera, a smartphone, or a portable phone. May be used to image each culture medium to generate captured image data.

[6.2] Modification 2
In this embodiment, instead of performing the medium information registration process using a single image reading device 10 such as an image scanner, an image reading device of a laptop or desktop personal computer and image scanner, or The medium information registration process may be realized by an image input device such as a personal computer and a tablet information terminal device, a digital camera, or a smartphone.

In this case, the personal computer and the image input device may be connected according to a predetermined communication standard, and the registration process of the culture medium information may be realized by using the personal computer and the image input device integrally, or a memory card. The captured image data previously acquired by the image input device may be stored in another physical memory, and the registration process of the culture medium information may be realized while the stored image data is captured by a personal computer.
In this case, the functions of the server device 40 may be provided in a personal computer to execute the various processes described above.

[6.3] Modification 3
In the present embodiment, the image reading device 10, the administrator terminal device 20, and the server device 40 may be installed or used in the same site, each of which is installed in a remote place such as outside the country, or in a remote place. Each process described above may be executed.

  The server device 40 may read and record the medium information and other information using a database connected via a network, or may be formed by one or a plurality of devices.

[6.4] Modification 4
The colony detection determination unit 423 of the present embodiment determines a color feature amount, an inspection method, a parameter, a threshold, and the like for specifying a colony pixel based on profile information. In the first colony detection determination process, Further, under a predetermined condition such as no colony detected, a redetection process may be added in which the sensitivity for detecting the colony pixel or the colony itself is further increased and the colony detection is performed again.

  For example, the execution of the re-detection process may be defined in the profile information in the case of a specific bacterium that fails the pass / fail determination of the medium determination when even one colony such as Escherichia coli or coliform is detected. .

  Note that the profile information is not limited to the re-detection process, and is a notification for notifying the administrator of a specific bacterium under a predetermined condition such as failure of the medium determination in the case of specific bacteria. Execution of various processes such as processes may be defined.

[6.5] Modification 5
In the present embodiment, registration of the medium information in the specimen cultured on the film type medium 60 using the film type medium 60 is performed. However, the bacteria cultured on the agar medium using the agar medium and the bacteria Registration of medium information in a specimen may be executed.

  In this case, each agar medium is imaged by using a portable communication terminal device with an imaging function such as a digital camera, a smart phone, or a mobile phone instead of the image reading device 10, and captured image data is generated.

[6.6] Modification 6
In this embodiment, the model data is generated using the convex hull or the Euclidean distance in the color feature amount space, but an opportunity learning method such as a support vector machine may be used. In this case, each time a non-colony pixel is determined, the model data generation processing unit 424 identifies two classes of a non-colony pixel and a colony pixel in the color feature amount space as the color feature amount used for the determination. A plane is determined and non-colony pixel determination is performed based on the determined identification plane.

[6.7] Modification 7
In this embodiment, the RGB space is used as the color feature amount. However, other color spaces such as HSV space, XYZ space, and La ^* b ^* space may be used, and the generated model data is stored in the administrator. It is also possible to edit manually.

[6.8] Modification 8
In the present embodiment, pixels that are determined to be non-colony pixels are removed from the medium image, and colony pixels are detected from the medium image from which the pixels have been removed, but are recorded in the pixel type determination DB 402. The colony pixel may be directly determined using the model data, and the colony may be detected using the determined colony pixel.

S ... Hygiene management system 10 ... Image reading device 20 ... Administrator terminal device 30 ... Network 40 ... Server device 60 ... Film type culture medium 80 ... Work line 100 ... Data storage unit 101 ... Application storage unit 102 ... Image data storage unit 110 ... Image data generation unit 120 ... application control unit 130 ... network communication unit 140 ... ADF unit 160 ... display unit 170 ... operation unit 180 ... timer 190 ... terminal management control unit 400 ... database 401 ... medium information DB
402 ... Pixel type determination DB
404 ... Work management DB
405 ... Profile information DB
410 ... Communication control unit 420 ... Data processing unit 421 ... Registration processing unit 422 ... Image extraction processing unit 423 ... Colony detection determination unit 424 ... Model data generation processing unit 430 ... Server management control unit

Claims (8)

Data acquisition means for acquiring, as medium image data, data of a medium image imaged by imaging a medium on which a specimen is placed and cultivating colonies;
An extraction means for extracting a color feature amount relating to a color of a pixel constituting the culture medium image of the acquired culture medium image data;
Based on the color feature amount of each extracted pixel, a plurality of color feature amounts of non-colony pixels constituting a non-colony different from the colony are searched in a database in which model data is preliminarily recorded as model data. A determination unit that determines a pixel having a color feature amount that matches the recorded model data as a non-colony pixel;
The pixel determined to be the non-colony pixel is removed from the medium image, and the colony pixel constituting the colony having a predetermined condition is detected from each pixel of the medium image from which the pixel is removed, and the detected colony pixel Detecting means for detecting colonies based on
A colony detection system comprising: In the colony detection system according to claim 1,
The colony detection system, wherein the model data has a color feature amount of each of a plurality of channels, and the color feature amount of each extracted pixel is configured by the color feature amounts of a plurality of channels. In the colony detection system according to claim 1 or 2,
A colony detection system in which model data of a plurality of models to be the non-colony pixels is recorded in the database. In the colony detection system of any one of Claims 1-3,
In the database, a plurality of model data that becomes the non-colony pixel for each type information of at least any one of the type of the culture medium, the type of the specimen, and the type of the diluent used when the specimen is placed on the culture medium Is recorded in a database,
The data acquisition means acquires at least one type information of the type of the medium, the type of the specimen, and the type of the diluent;
The determination unit selects a model data group of the acquired type information, and selects a color feature amount that matches one of the color feature amounts of the recorded non-colony pixels from the selected model data. A colony detection system for determining that the extracted pixel has a non-colony pixel. In the colony detection system of any one of Claims 1-4,
The colony detection system, wherein the model data includes model data having a color feature amount acquired as a sample and model data calculated by executing a predetermined calculation based on the model data of the sample. In the colony detection system according to claim 5,
Sample acquisition means for acquiring the sample;
Based on the acquired model data of the sample, a calculation unit that executes a predetermined calculation and calculates model data to be complemented;
Management means for managing the model data of the acquired sample and the calculated model data;
A colony detection system further comprising: Computer
Data acquisition means for acquiring, as medium image data, data of a medium image formed by imaging a medium in which a specimen is placed and cultivating a colony,
Extraction means for extracting a color feature amount relating to a color of a pixel constituting the medium image of the acquired medium image data;
Based on the color feature amount of each extracted pixel, a plurality of color feature amounts of non-colony pixels constituting a non-colony different from the colony are searched in a database in which model data is preliminarily recorded as model data. A determination unit that determines a pixel having a color feature amount that matches the recorded model data as a non-colony pixel; and
The pixel determined to be the non-colony pixel is removed from the medium image, and the colony pixel constituting the colony having a predetermined condition is detected from each pixel of the medium image from which the pixel is removed, and the detected colony pixel Detection means for detecting colonies based on
A program characterized by functioning as The medium image data obtained by imaging the medium for culturing the colony by placing the specimen is obtained as the medium image data,
Extracting a color feature amount related to the color of the pixel constituting the medium image of the acquired medium image data,
Based on the color feature amount of each extracted pixel, a plurality of color feature amounts of non-colony pixels constituting a non-colony different from the colony are searched in a database in which model data is preliminarily recorded as model data. A pixel having a color feature amount that matches the recorded model data is determined as a non-colony pixel,
The pixel determined to be the non-colony pixel is removed from the medium image, and the colony pixel constituting the colony having a predetermined condition is detected from each pixel of the medium image from which the pixel is removed, and the detected colony pixel Detect colonies based on the
The colony detection method characterized by this.