WO2014171382A1 - Dispositif de détection de colonies, système d'enregistrement d'informations relatives à un milieu de culture, programme et système de gestion d'aseptisation - Google Patents

Dispositif de détection de colonies, système d'enregistrement d'informations relatives à un milieu de culture, programme et système de gestion d'aseptisation Download PDF

Info

Publication number
WO2014171382A1
WO2014171382A1 PCT/JP2014/060317 JP2014060317W WO2014171382A1 WO 2014171382 A1 WO2014171382 A1 WO 2014171382A1 JP 2014060317 W JP2014060317 W JP 2014060317W WO 2014171382 A1 WO2014171382 A1 WO 2014171382A1
Authority
WO
WIPO (PCT)
Prior art keywords
colony
candidate
medium
pixel
colonies
Prior art date
Application number
PCT/JP2014/060317
Other languages
English (en)
Japanese (ja)
Inventor
勇司 都築
竜馬 備瀬
将慶 籠田
累 齋藤
京谷　均
Original Assignee
大日本印刷株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 大日本印刷株式会社 filed Critical 大日本印刷株式会社
Priority to JP2015512458A priority Critical patent/JP6337885B2/ja
Publication of WO2014171382A1 publication Critical patent/WO2014171382A1/fr

Links

Images

Classifications

    • C—CHEMISTRY; METALLURGY
    • C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
    • C12M41/00—Means for regulation, monitoring, measurement or control, e.g. flow regulation
    • C12M41/30—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration
    • C12M41/36—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration of biomass, e.g. colony counters or by turbidity measurements
    • C—CHEMISTRY; METALLURGY
    • C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
    • C12M41/00—Means for regulation, monitoring, measurement or control, e.g. flow regulation
    • C12M41/48—Automatic or computerized control
    • C—CHEMISTRY; METALLURGY
    • C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12Q—MEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
    • C12Q1/00—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
    • C12Q1/02—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving viable microorganisms
    • C12Q1/04—Determining presence or kind of microorganism; Use of selective media for testing antibiotics or bacteriocides; Compositions containing a chemical indicator therefor
    • C12Q1/06—Quantitative determination

Definitions

  • the present invention relates to a food hygiene management system and the like.
  • a film-type medium is used, a specimen cultured in the film-type medium is imaged, and image processing is performed on the image of the imaged medium.
  • detection of colonies that are a mass of bacteria generated in a specimen and counting them are known (for example, Patent Document 1 or 2).
  • a colony detection device that divides a target area for counting colonies and counts the number of colonies by different methods for different areas is also known (for example, Patent Document 3).
  • the present invention has been made in order to solve the above-mentioned problems, and its purpose is to detect colonies while taking into consideration the size of the colonies, the regions in the growth process of the colonies, and the regions affected by them. It is an object of the present invention to provide a medium information registration system and the like that can perform the counting and register medium information including information on the accurately detected colonies and the number thereof in a database.
  • the culture medium information registration system and the like include an acquisition unit that acquires, as culture medium image data, medium data obtained by imaging a culture medium in which a colony is cultured.
  • Extraction means for extracting a color feature amount relating to a color of a pixel constituting the medium image of the culture medium image data, and a pixel having a first condition indicating a predetermined condition for the color feature amount of the extracted pixel.
  • a plurality of types of the colony candidates based on at least one of a specifying means for identifying a colony candidate that is a candidate for the colony, a color feature amount of a pixel belonging to the colony candidate, and a number of pixels belonging to the colony candidate While detecting colonies using different criteria for each type from among the colony candidates and the colony candidates, Detecting means for detecting the number of Ronnie, including the detected colonies has registration means for registering in a database the information on the colony as the medium information, the arrangement comprising a.
  • the culture medium information registration system and the like of the present invention is the size of the colony candidate, the peripheral area where the influence of the color of the colony exists, and the bleeding area which is a low coloring intensity area where the colony is not sufficiently grown, or While considering the bubble area that has the effect of gas generated from bacteria such as bubbles, colonies can be accurately detected, and the area where the colony to be detected by combining with the bleeding area is formed, It is possible to accurately detect the blur area.
  • the culture medium information registration system of the present invention has, for example, a predetermined number of pixels equal to or greater than a predetermined color feature amount based on the color feature amount and the number of pixels belonging to the colony candidate, such as performing statistical calculations. And classifying colony candidates composed of areas that are clearly recognizable as colonies with a narrow component range of the color feature amount, and colony candidates that include bleeding areas or bubble areas, such as colonies with different properties. Since it can classify
  • the culture medium information registration system of the present invention is not limited to the region clearly formed as a colony, but also includes the bleeding region and the bubble region such as the region in the colony growth process and the region affected by the colony.
  • the colony detection and counting can be executed while considering the state of the above, and the medium information including information on the accurately detected colonies and the number thereof can be registered in the database.
  • the culture medium information registration system and the like according to the present invention can save resources as compared with the case where various data analysis and provision are performed using physical resources such as paper media, and the culture medium.
  • registration mistakes can be remarkably reduced and difficult medium management can be facilitated, so that resource saving can be achieved without wastefully consuming the culture medium.
  • the culture medium information registration system and the like according to the present invention include not only areas clearly formed as colonies but also individual areas including bleeding areas and bubble areas such as areas in the colony growth process and areas affected by the colonies. While taking the state into consideration, colony detection and counting can be performed, and medium information including information on accurately detected colonies and the number thereof can be registered in the database.
  • the culture medium information registration system and the like according to the present invention can save resources as compared with the case where various data analysis and provision are performed using physical resources such as paper media, and the culture medium.
  • registration mistakes can be remarkably reduced and difficult medium management can be facilitated, so that resource saving can be achieved without wastefully consuming the culture medium.
  • FIG. (1) for demonstrating the operation principle of the colony detection determination part in the server apparatus of one Embodiment. It is FIG. (2) for demonstrating the operation principle of the colony detection determination part in the server apparatus of one Embodiment. It is a figure for demonstrating the classification conditions set in the colony detection determination part of the server apparatus of one Embodiment. It is a figure for demonstrating the boundary pixel used when producing
  • FIG. (2) for demonstrating the 1st specific process performed in the colony detection determination part of the server apparatus of one Embodiment. It is a figure (the 1) for demonstrating the 2nd specific process performed in the colony detection determination part of the server apparatus of one Embodiment. It is FIG. (2) for demonstrating the 2nd specific process performed in the colony detection determination part of the server apparatus of one Embodiment. It is FIG. (3) for demonstrating the 2nd specific process performed in the colony detection determination part of the server apparatus of one Embodiment. It is a flowchart which shows the operation
  • the following embodiment is a medium information registration system, program, and the like according to the present invention for a hygiene management system using a film-type medium in a food production line or an inspection line (hereinafter referred to as “work line”). It is embodiment at the time of applying a colony detection apparatus and a hygiene management system.
  • the present invention is not limited to the following embodiments within the scope including the technical idea.
  • FIG. 1 is a block diagram which shows the structure of the sanitary management system S of this embodiment.
  • the sanitary management system S of the present embodiment uses a film-type culture medium (that is, a film-type culture medium) and performs data management on information on the culture medium (hereinafter referred to as “medium information”), thereby producing food. Or it is a system for inspecting the sanitary condition on inspection.
  • a film-type culture medium that is, a film-type culture medium
  • medium information information on the culture medium
  • the sanitary management system S of the present embodiment extracts a processed or processed food as a specimen in a work line 80 having a manufacturing process for manufacturing a processed or processed food or an inspection process for inspecting the food.
  • this is a system for managing data on the culture state when a pre-specified bacterium such as a general bacterium or E. coli or the like occurring in a specimen in the film-type medium 60 is cultured.
  • the hygiene management system S of the present embodiment manages and determines the sanitary state of food on the data, information relating to work in food production or inspection (hereinafter referred to as “work information”), and the extracted sample.
  • work information information relating to work in food production or inspection
  • extracted sample are registered in the server device 40 (specifically, the database 400) in association with the culture medium information of the film-type culture medium 60 acquired by the portable communication terminal device 10 before and after culturing the bacteria (colony) generated in It has a possible configuration.
  • the hygiene management system S of the present embodiment uses a colony candidate (hereinafter referred to as “colony candidate”) from data of a medium image obtained by imaging the film-type medium 60 (hereinafter referred to as “medium image data”). While identifying the colony candidates into a plurality of types based on the color feature amount of each pixel belonging to each colony candidate and detecting the colonies using different criteria for each type, It has the structure which counts a number.
  • colony candidate data of a medium image obtained by imaging the film-type medium 60
  • the sanitary management system S of the present embodiment includes a plurality of portable communication terminal devices 10 used when registering culture medium information regarding each film-type culture medium 60.
  • the administrator terminal device 20 that manages the sanitary management system S, the network 30, and the database 400, and in conjunction with the portable communication terminal device 10 or the administrator terminal device 20, registration management of medium information is performed.
  • a server device 40 that executes various types of processing.
  • the work information of this embodiment includes, in addition to various types of information related to the manufacturing process or the inspection process, information regarding the culture of the food extracted from the manufacturing process or the inspection process as a specimen and the colonies generated in the specimen. In addition, it is registered in the database 400 using unique identification information (hereinafter referred to as “work ID”).
  • work ID unique identification information
  • each work information includes (1) Work ID, (2) Identification information (hereinafter referred to as “line ID”) of the work line 80 from which the sample is to be extracted or, if the work line 80 has a plurality of processes, the line ID and process identification information (hereinafter referred to as “line ID”). , Referred to as “process ID”) 71b; (3) Product name of food as a sample, identification information of lot (hereinafter referred to as “lot ID”), lot name, (4) Type of bacteria detected from specimens such as general bacteria or E.
  • test type a sample culture conditions such as dilution factor, type of diluent, culture temperature, culture humidity, and culture time, (6) Specimen culture start time; (7) a time after a predetermined time has elapsed since the start of culture of the specimen (hereinafter also referred to as “culture test time”); (8) Sample incubator location such as incubator number and number of stages in incubator, (9) Work date and time indicating the work start time and end time; (10) Worker identification information (hereinafter referred to as “worker ID (employee ID)”) and worker name; Is included. Each piece of work information is registered in the database 400 for each type and for each work.
  • the portable communication terminal device 10 is, for example, a digital camera having a communication function, a tablet-type information terminal device, a smartphone or a portable telephone, or the like, or an imaging function such as a still image or a recording function (hereinafter simply referred to as “camera function”). And a communication terminal device portable by an operator.
  • the portable communication terminal device 10 uses the camera function to image the film-type medium 60 and generate image data (that is, medium image data), and also generates an instruction sheet image by imaging the work instruction sheet 70. It has a possible configuration.
  • the portable communication terminal device 10 acquires the work ID 71 and the culture medium ID 66 from the image data of the instruction manual image (hereinafter referred to as “instruction data image data”) and the culture medium image data of the film type culture medium 60,
  • the acquired work ID 71 and medium ID 66, medium image data, and metadata of the medium image data can be registered in the database 400 of the server device 40 as medium information.
  • the portable communication terminal device 10 transmits BLUETOOTH (registered trademark), wireless LAN (WLAN: Wireless Local Area Network), or wireless PAN (WPAN: Wireless Personal Area Network).
  • BLUETOOTH registered trademark
  • WLAN Wireless Local Area Network
  • PAN Wireless Personal Area Network
  • the data is transmitted to the server device 40 directly or via the access point 50 using a communication standard for short-range wireless communication or the like, or is transmitted to the server device 40 using a public telephone line network via a mobile base station (not shown). It has a configuration.
  • the portable communication terminal device 10 has a browser function constructed by a markup language such as XML (extensible Markup Language), and executes an operation input instruction and an operation confirmation of an operator using the browser function.
  • the medium information is transmitted to the server device 40 through the browser function.
  • the administrator terminal device 20 is an information communication terminal device such as a tablet information terminal device, a smartphone, a personal computer, or a workstation.
  • the administrator terminal device 20 manages the administrator identification information (hereinafter referred to as “manager ID”), the administrator password, and the worker ID, manages the access authority to the server device 40, and is portable. It functions as a control device capable of performing management of the terminal ID of the communication terminal device 10, correction of registered medium information, and other management.
  • the administrator terminal device 20 has a browser function constructed by a markup language, and uses the browser function to exchange data with the server device 40 and to generate a report. It has a configuration capable of executing browsing and the like.
  • the administrator terminal device 20 determines the culture medium information when each operation is interrupted due to a failure of a machine that performs the process or the like in the same lot, or when an error in registration of culture medium information occurs in the operator. It has a configuration that can correct other information.
  • the network 30 includes, for example, a public telephone line network (hereinafter referred to as “long-distance communication network”) including a mobile phone network, an IP (Internet Protocol) network such as a short-distance wireless network, or both of which are interconnected.
  • long-distance communication network including a mobile phone network, an IP (Internet Protocol) network such as a short-distance wireless network, or both of which are interconnected.
  • IP Internet Protocol
  • the configuration of the network 30 is not limited to this.
  • the server device 40 is a server device used in conjunction with the portable communication terminal device 10 or the administrator terminal device 20 to execute each data process for performing hygiene management of the lot and work line 80.
  • the server device 40 is linked with the portable communication terminal device 10, registers the culture medium information in each film-type medium 60 before the start of culture (hereinafter referred to as “initial registration”), and starts the culture in the database 400. While performing subsequent registration (hereinafter referred to as “post-cultivation registration”), the medium information transmitted from the portable communication terminal device 10 is acquired, and from the medium image formed by the medium image data of the acquired medium information In addition, it has a configuration for detecting colonies generated and cultured in a specimen.
  • the server device 40 (1) Obtaining medium image data from the portable communication terminal device 10, (2) Extracting the color feature amount relating to the color of each pixel constituting the medium image of the acquired medium image data, (3) A colony candidate is specified based on a pixel having a first condition in which the color feature value of each extracted pixel indicates a predetermined condition, (4) Based on the color feature amount of each pixel belonging to each colony candidate, the number of pixels belonging to the colony candidate, or both, the colony candidates are classified into a plurality of types, (5) Detecting the number of colonies while detecting colonies from each colony candidate using different criteria (hereinafter referred to as “colony detection criteria”) for each type of colony candidate, (6) Register information on the colonies including the detected colonies and the number thereof in the database as medium information. It has a configuration.
  • the server device 40 determines the colony candidates as the second condition predetermined for the color feature amount of each pixel belonging to each colony candidate, the number of pixels belonging to each colony candidate, and both. Are classified into colony candidates (hereinafter referred to as “first colony candidates”) and colonies candidates not including the second condition (hereinafter referred to as “second colony candidates”).
  • the server device 40 classifies the colony candidates into a plurality of types by performing a statistical calculation on the color feature amount of each pixel, and specifically, the color feature of each pixel. It has a configuration in which a statistical standard for the quantity is executed to determine a classification standard for classifying the colony candidate, and the colony candidate is classified into a plurality of types according to the determined classification standard.
  • the server device 40 performs the process (4).
  • the first colony candidate has a predetermined number or more of pixels having a predetermined color feature amount or more, and a region in which the color feature amount component range is clearly recognizable as a colony (region where a normal colony exists) ),
  • the second colony candidate has a color component of the same strain as the color of the colony to be detected, and has a color development intensity different (low) from the colony to be detected (hereinafter referred to as “ Similarly to the bleed area, the colouration intensity is different (low) from the colony to be detected, and the area affected by gas generated from bacteria such as bubbles (hereinafter referred to as “bubble area”). It is a region having
  • the size of the colony candidate, the peripheral region where the influence of the color of the colony exists, or the bleeding region which is a region with low color intensity where the colony is not sufficiently grown An area where a colony can be accurately detected while considering a bubble area affected by gas generated from bacteria such as bubbles, and a colony to be detected is formed by combining with the bleeding area. In addition, it is possible to accurately detect the blur region including the bleeding region.
  • a pixel having a predetermined color feature amount or more is predetermined based on the color feature amount and the number of pixels of each pixel belonging to each colony candidate, such as executing a statistical calculation.
  • a colony candidate i.e., a first colony candidate
  • the colony candidates ie, second colony candidates
  • colonies can be detected using different colony detection criteria according to the classified colony candidate types. It has become.
  • a region clearly formed as a colony but also a bleeding region and a bubble region, such as a region in the growth process of a colony and a region affected by the colony, are included. It is possible to perform colony detection and counting while considering individual states, and to register medium information including information on the accurately detected colonies and the number of colonies in the database. ing.
  • the sanitary management system S of the present embodiment it is possible to save resources as compared with the case where various data analyzes and provisions are performed using physical resources such as paper media, and the culture medium.
  • registration mistakes can be remarkably reduced, and management of difficult culture media can be facilitated. Therefore, resource saving can be achieved without consuming wasteful culture media.
  • FIG. 2 is an example of a film-type medium 60 used in this embodiment.
  • the film-type medium 60 used in the present embodiment is a medium for culturing bacteria generated in food as a specimen detected from each step of the work line 80 using a film or sheet-like dry medium.
  • the film-type medium 60 is used as a medium for culturing general live bacteria, coliforms, and Staphylococcus aureus.
  • the film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “circular frame”) 62, a culture layer 63 for culturing bacteria provided in the frame, a cover sheet 64 covering the culture layer 63, and the right side of the base sheet 61.
  • Medium ID66 a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG.
  • circular frame 62
  • a culture layer 63 for culturing bacteria provided in the frame
  • cover sheet 64 covering the culture layer 63
  • right side of the base sheet 61 The film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “
  • the culture medium ID 66 is formed of a barcode such as a two-dimensional barcode or alphanumeric characters, and is imaged together when the film-type culture medium 60 is imaged, such as a barcode recognition function or an OCR (Optical Character Recognition) function. It is acquired in the portable communication terminal device 10 or the server device 40 using the image analysis function.
  • a barcode such as a two-dimensional barcode or alphanumeric characters
  • OCR Optical Character Recognition
  • the substrate sheet 61 is not particularly limited as long as it is a film-like or sheet-like substrate, and for example, a plastic film, paper, or the like can be used.
  • plastic films include resin films such as polyethylene, polypropylene, polyethylene terephthalate, polyethylene naphthalate, polymethacrylate, polymethyl methacrylate, polymethyl acrylate, polyester, and polycarbonate.
  • Preferred examples include polyethylene terephthalate and polypropylene synthetic paper.
  • the polypropylene-based synthetic paper is a film synthetic paper whose main raw material is polypropylene.
  • the film-type culture medium 60 has an IC tag in which a culture medium ID 66 is stored.
  • the short-range wireless communication interface 140 (for example, an IC tag reader) included in the portable communication terminal apparatus 10 causes the medium to be connected to the portable communication terminal apparatus 10. ID66 may be acquired.
  • FIG. 3 is an example of a work instruction sheet 70 used in the present embodiment.
  • the work instruction sheet 70 of the present embodiment includes, for each food group manufactured or inspected under the same conditions, that is, for each lot, work names and contents of one or more manufacturing processes or inspection processes, and work lines 80 to be used. It is an instruction document that describes the name of the food (processed food) to be manufactured or inspected, the quantity, and other information.
  • the work instruction sheet 70 of the present embodiment has an instruction sheet ID 71a formed by printing or other methods on the upper right and a plurality of process IDs 71b formed by printing or other methods on a predetermined area. .
  • the instruction sheet ID 71a and each process ID 71b are used as the work ID 71, and are formed of, for example, a barcode such as a two-dimensional barcode or alphanumeric characters.
  • the instruction ID 71a and each process ID 71b are imaged in the same manner as the film-type medium 60 when the registration of the film-type medium 60 is executed, and analyzed by the portable communication terminal device 10 or the server device 40. Be recognized.
  • the work instruction sheet 70 has an IC tag in which the work ID 71 of the instruction sheet ID 71a or the process ID 71b is stored, like the film type culture medium 60, and has an interface (short distance) that the portable communication terminal device 10 such as a tag reader has.
  • the portable communication terminal device 10 may acquire the work ID 71 by the wireless communication interface 140).
  • the work ID 71 indicates an instruction ID 71a or a process ID 71b.
  • FIG. 4 is a block diagram showing the configuration of the portable communication terminal device 10 of the present embodiment.
  • the portable communication terminal device 10 of the present embodiment has a data storage unit 100 having a memory function used when various programs are executed, an imaging function, image data of the film-type medium 60, and other image data.
  • the image data generation unit 110 that generates the media information the media information is registered in the server device 40 after the initial registration and the post-cultivation registration immediately after the culture in conjunction with the server device 40 (hereinafter referred to as “medium information registration processing”).
  • an application control unit 120 that executes processing.
  • the portable communication terminal device 10 includes a network communication unit 130 that communicates with the server device 40 and other communication devices, a short-range wireless communication interface 140 that exchanges data with an IC tag and other communication interfaces, Controls the current position detection unit 150 that detects the current position, the display unit 160, the display control unit 161 that controls the display unit 160, the operation unit 170 for inputting user operations, the timer 180, and the entire apparatus.
  • a portable terminal management control unit 190 A portable terminal management control unit 190.
  • the portable communication terminal device 10 has various necessary members such as a microphone, a speaker, and an e-mail transmission / reception function when having a mail function such as a telephone function and e-mail. Further, the above-described units are connected to each other by a bus 11 to exchange data.
  • the data storage unit 100 includes an application storage unit 101 that stores various application programs, an image data storage unit 102 that stores image data captured and generated by the image data generation unit 110, and a portable communication terminal device 10 and management / control programs, and a ROM / RAM 103 that is used as a work area during execution of each program and stores data used in each process executed by the portable communication terminal device 10. is doing.
  • the application storage unit 101 includes an application program (hereinafter referred to as “application”) that is executed by the application control unit 120 in conjunction with the image data generation unit 110, the operation unit 170, the display control unit 161, and the image data storage unit 102. Is stored).
  • the application storage unit 101 also stores a browser program for realizing the browsing function described above.
  • the imaged medium image data and instruction sheet image data In the image data storage unit 102, the imaged medium image data and instruction sheet image data, the image ID for managing each image data, various metadata corresponding to each image data such as the imaging time, and the work ID 71
  • the medium ID 66 and various flag information are stored in association with each other.
  • the image ID is arbitrary identification information that is appropriately given in each portable communication terminal device 10.
  • the image data generation unit 110 includes an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and image data based on the electrical signal generated by the CCDI sensor. And a generating unit that generates
  • the image data generation unit 110 images the captured work instruction sheet 70 and generates instruction sheet image data.
  • the image data generation unit 110 images the film-type medium 60 that has been imaged when the bacteria generated in the specimen are cultured or the film-type medium 60 that has been cultured is imaged. 60 pieces of medium image data are generated as medium image data.
  • the application control unit 120 realizes medium information registration processing by a predetermined application.
  • the application control unit 120 executes the network communication unit 130 and the display control unit 161 while executing various control programs for controlling each unit of the portable communication terminal device 10 using the culture medium registration application stored in the application storage unit 101.
  • various processes are executed in conjunction with or controlled by the operation unit 170.
  • the application control unit 120 executes the culture medium registration application recorded in the application storage unit 101, controls the image data generation unit 110, acquires the culture medium image data of the film-type culture medium 60 that is imaged.
  • the image data is stored in the image data storage unit 102.
  • the application control unit 120 acquires the culture medium ID 66 from the imaged culture medium image data, and stores the culture medium image data, the metadata of the culture medium image data, and various flag information together with the acquired culture medium ID 66. Store in the unit 102. Note that the application control unit 120 may execute barcode recognition or OCR recognition in conjunction with another communication device or the database 400 via a communication line.
  • the application control unit 120 performs initial registration for registering the culture medium information in the server device 40 at the start of the culture of the specimen after imaging of the culture medium image data or at a predetermined timing, and registers the culture medium information after the start of the culture of the specimen. Perform registration after incubation.
  • the application control unit 120 identifies whether the registration is initial registration or post-cultivation registration based on the operator's instruction, and includes information (flag information) indicating either registration in the culture medium information in the server device 40. Send.
  • the application control unit 120 acquires the current time from the timer 180 when the film-type medium 60 is imaged, and the image data storage unit as the metadata of the medium image data together with a predetermined image ID using the current time as the imaging time. 102.
  • the medium image data is transmitted to the server device 40, it is transmitted together.
  • the application control unit 120 when the culture medium ID 66 and the work ID 71 that is the instruction ID 71a and the process ID 71b are stored in the IC tag, the operation unit 170, the display control unit 161, and the short-range wireless communication interface The medium ID 66 and the work ID 71 are acquired in conjunction with 140.
  • the application control unit 120 transmits instruction sheet image data in addition to the medium image data as the medium information.
  • the application control unit 120 may be realized as a function when the CPU (central processing unit) constituting the mobile terminal management control unit 190 executes the application in terms of implementation.
  • the network communication unit 130 establishes a communication line with the server device 40 connected to the network 30 under the control of the application control unit 120 and the mobile terminal management control unit 190, and exchanges various data such as culture medium image data. Do.
  • the near field communication interface 140 performs near field communication using an IC tag under the control of the application control unit 120 and the mobile terminal management control unit 190.
  • the current position detection unit 150 recognizes the position of a GPS (Global Positioning System) satellite via the network 30 under the control of the application control unit 120 or the mobile terminal management control unit 190, and a satellite transmitted from the GPS satellite. A signal (GPS signal) is detected.
  • GPS Global Positioning System
  • the current position detection unit 150 calculates (that is, detects) a coordinate value indicated by the latitude and longitude of the current position of the portable communication terminal device 10 based on the detected GPS signal. In addition, the current position detection unit 150 provides the calculated coordinate value to the application control unit 120 as position information.
  • the portable communication terminal device 10 when the portable communication terminal device 10 has a telephone function or a short-range wireless function, the portable communication terminal device 10 is based on the direction and the radio field intensity received by the telephone base station or the like for the radio wave used for the telephone or the short-range radio.
  • the current position of the portable communication terminal device 10 may be calculated (detected).
  • the display unit 160 has an image display area of a predetermined size (for example, 5 inches, W480 ⁇ H960 pixels), is configured by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 161 A predetermined image is displayed based on the display data.
  • a predetermined size for example, 5 inches, W480 ⁇ H960 pixels
  • EL Electro Luminescence
  • a predetermined image is displayed based on the display data.
  • the display unit 160 is linked to the operation unit 170, and various displays, captured work instructions 70 and film-type culture media that have been imaged. 60 is displayed.
  • the display control unit 161 generates drawing data necessary to cause the display unit 160 to draw a predetermined image under the control of the application control unit 120 or the mobile terminal management control unit 190, and the generated drawing data is displayed on the display unit. 160 is output.
  • the operation unit 170 includes various confirmation buttons, operation buttons for inputting operation commands, a number of keys such as a numeric keypad, and a touch sensor provided on the display unit 160, and is used when performing each operation. It has become. Specifically, the operation unit 170 is used when performing operations for executing the various processes described above when the culture medium registration application is activated.
  • the operation unit 170 can also be used when manually inputting the culture medium ID 66 directly.
  • the timer 180 provides the application control unit 120 with the date and time when the image data generation unit 110 images the film-type medium.
  • the portable terminal management control unit 190 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and the overall functions of the portable communication terminal device 10. In addition, overall functions for executing the information providing program are generally controlled.
  • CPU central processing unit
  • FIG. 5 is a configuration diagram showing the configuration of the server device 40 of the present embodiment.
  • the server device 40 communicates with a database 400 in which various information such as work information and culture medium information is stored, and the portable communication terminal device 10 and the administrator terminal device 20.
  • a communication control unit 410 a data processing unit 420 that executes various processes such as a culture medium information registration process, a server management control unit 430 that controls each unit of the server device 40, a ROM / RAM 440 that is used to control each unit, and a time And a timer 450 used for management.
  • the above-described units are connected to each other by a bus 41, and data transfer is performed between the components.
  • the communication control unit 410 is a predetermined network interface, establishes a communication line with the portable communication terminal device 10 or the administrator terminal device 20, and exchanges various data with the portable communication terminal device 10 or the administrator terminal device 20. I do.
  • the database 400 includes an HDD or an SSD, and includes a medium information database (hereinafter abbreviated as “medium information DB”) 401, a line information database (hereinafter abbreviated as “line information DB”) 402, and a lot information database (hereinafter referred to as “line information DB”). , “Lot information DB”) 403 and a work management database (hereinafter abbreviated as “work management DB”) 404.
  • each DB of the present embodiment constitutes a database according to the present invention.
  • the medium information DB 401 is a database in which medium information regarding the film-type medium 60 of the sample extracted for each process of each work line 80 is stored for each work ID 71 and medium ID 66.
  • medium information regarding the film-type medium 60 of the sample extracted for each process of each work line 80 is stored for each work ID 71 and medium ID 66.
  • (1) Medium ID (2) Imaged medium image data (3) Image capture time (4)
  • Other information including flag information (5)
  • Colony candidate imaged Information of each colony candidate (hereinafter referred to as “colony candidate information”) including the feature quantity of the detection pixel used for the detection and the coordinate position of the film-type medium 60 (hereinafter referred to as “colony candidate information”).
  • ID) and the number of colonies (8) Results of medium determination for determining whether the film-type medium 60 (ie, specimen) is normal or abnormal based on the number of colonies (9) Work ID Are recorded in association with each other.
  • the work ID may be a lot ID, and the sample to be extracted is the same lot.
  • the line ID or the process ID 71b is obtained.
  • the number of colonies and the result of medium determination in each medium information may be registered when the medium information is registered, or may be registered at a predetermined timing different from the registration timing of the medium information.
  • the line information DB 402 is a database in which line information regarding each work line 80 is stored for each line ID.
  • the line information DB 402 includes (1) Line ID (2) The process ID 71b of the process included in the work line 80 and the two types of data are recorded in association with each other.
  • As the process type a name for identifying each process such as material input, blending, filling, boiling, packaging, and packaging is used.
  • the lot information DB 403 is a database in which lot information regarding each lot is stored for each lot ID. For example, in the lot information DB 403, (1) Lot ID (instruction ID 71a) (2) Line ID of work line used for production or inspection of lots (3) Lot work start time (4) Lot work end time (5) Five data of the work teams of the workers who perform the lot work are recorded in association with each other.
  • the work management DB 404 is a database that stores various types of information related to work contents.
  • the work management DB 404 includes (1) Work ID (2) Line ID (or line ID and process ID 71b) of the work line from which the sample is to be extracted (3) Type of sample (food) (product name, lot ID and / or lot name) (4) Type of inspection (generic bacteria or bacteria to be detected such as E.
  • Culture conditions (dilution ratio, type of diluent, culture temperature, culture humidity and culture time) (6) Culture start time (7) Time after a predetermined time has elapsed from the start of culture (hereinafter also referred to as “culture test time”) (8) Culture location (for example, the position of the incubator number and the number of steps in the incubator) (9) Work date and time (work start time and end time) (10) Worker ID (and / or worker name) Are recorded in association with each other.
  • only a single time (that is, an end time for ending the culture of the specimen) may be set as the culture examination time, or after the statutory or predetermined time has elapsed from the culture start time, for example, the culture
  • a plurality of times such as 24 hours from the start time, 48 hours, or 72 hours may be set.
  • the data processing unit 420 executes various data processing in accordance with the application recorded in the ROM / RAM 440.
  • the data processing unit 420 executes a predetermined program, (1) Operation management of the communication control unit 410; (2) Medium information registration processing for acquiring various medium information in cooperation with each portable communication terminal device 10 and registering it in the database 400; (3) A colony is detected from each medium image of each film type medium 60 during the medium information registration process or at a predetermined timing after the medium information registration process, the colonies are counted, and the medium is based on the number of colonies A colony detection determination process for executing the determination; (4) lot determination processing for determining a lot based on registered medium information; (5) Report processing for outputting the determination result in a report format; (6) Management and control of the database 400; I do.
  • the data processing unit 420 specifies the colony candidate based on the color feature amount of each pixel constituting the culture medium image of the culture medium image data, and the color feature of each pixel belonging to each colony candidate. Based on the amount and the number of pixels belonging to the colony candidate, the colony candidates are classified into a first colony candidate (a colony candidate that can be detected as a normal colony region) and a second colony candidate (a colony candidate that is assumed to have a bleeding region). And the number of the said colonies is detected, detecting a colony from each colony candidate using a different colony detection reference
  • the data processing unit 420 executes a first specifying process for executing colony detection and counting for the first colony candidate, and a second specifying process for executing colony detection and counting for the second colony candidate.
  • the data processing part 420 is as a 1st specific process, (1A) Calculate the amount of change of pixels belonging to the boundary of the first colony candidate, (1B) Based on the calculated pixel change amount, pixels belonging to the first colony candidate (hereinafter referred to as “colony candidate pixels”) constitute a colony image (hereinafter referred to as “colony pixels”). ) Is set to determine whether or not (1C) While identifying the colony pixel from the colony candidate pixels belonging to the first colony candidate based on the set determination condition, executing colony detection and counting the number of colonies based on the identified colony pixel; It has a configuration.
  • the data processing unit 420 performs the second specifying process as follows: (2A) Two or more smoothing processes are executed with different parameters on the color feature amount of the colony candidate pixel belonging to the second colony candidate, (2B) For each smoothed image obtained by each smoothing process that has been performed, while specifying a colony candidate pixel having a color feature amount having a predetermined search condition as a target pixel, for each smoothed image Identify colony pixels based on the target pixel, (2C) Based on the identified colony pixel, the colony is detected and the number of the colonies is counted.
  • the data processing unit 420 includes a registration processing unit 421 that executes a medium information registration process including management and control of the database 400, a colony detection determination unit 422 that executes a colony detection determination process, and a lot determination process.
  • the registration processing unit 421 of the present embodiment constitutes an acquisition unit and a registration unit according to the present invention
  • the colony detection determination unit 422 of the present embodiment includes the extraction unit, the identification unit, and the detection unit of the present invention. Constitute. Further, details of the registration processing unit 421, the colony detection determination unit 422, the lot determination processing unit 424, and the report processing unit 425 of this embodiment will be described later.
  • the server management control unit 430 is mainly configured by a central processing unit (CPU), and integrally controls each unit of the server device 40 by executing a program. Specifically, the server management control unit 430 performs login processing for each user and various other controls based on a login request from the portable communication terminal device 10 by a user operation.
  • CPU central processing unit
  • ROM / RAM 440 Various programs necessary for driving the server device 40 are recorded in the ROM / RAM 440.
  • Each information such as information (hereinafter also referred to as “medium determination criterion information”) is stored.
  • the ROM / RAM 440 is used as a work area during execution of each program.
  • the timer 450 is used for managing the time required when the medium information registration process and the lot determination process are executed.
  • the registration processing unit 421 executes a medium information registration process for registering each medium information in the medium information DB 401 while being associated with the work ID 71 in conjunction with the portable communication terminal device 10.
  • the registration processing unit 421 executes different medium information registration processing based on flag information indicating whether the registration is initial registration or post-culture registration included in the culture medium information.
  • the registration processing unit 421 performs a culture medium information registration process based on the initial registration.
  • the registration processing unit 421 acquires the culture medium information via the communication control unit 410
  • the registration processing unit 421 identifies the culture medium ID 66 and the work ID 71 included in the culture medium information.
  • the registration processing unit 421 searches the work management DB 404 based on the specified work ID 71, specifies the corresponding work information, and associates the acquired medium image data and imaging time with the specified work information. Is registered in the culture medium information DB 401.
  • the registration processing unit 421 specifies the lot ID including the work line 80 from which the sample is extracted based on the acquired work ID 71, the line ID of the work line 80, the process ID 71b from which the sample is extracted, and the specification.
  • the medium image data and the imaging time included in the medium information are registered in the medium information DB 401 in association with the lot ID, the line ID, and the process ID 71b.
  • the registration processing unit 421 registers the imaging time in the culture medium information DB 401 as the culture start time.
  • a preset time may be used instead of the imaging time on the assumption that the medium information registration process is executed at the time.
  • the registration processing unit 421 performs a registration process based on post-cultivation registration.
  • the registration processing unit 421 when acquiring the culture medium information via the communication control unit 410, specifies the culture medium ID 66 and the work ID 71 included in the culture medium information as in the initial registration. Then, the registration processing unit 421 searches the work management DB 404 based on the identified work ID 71, identifies the corresponding work information, and registers the imaging time in the culture medium information DB 401 in association with the identified work information. To do.
  • the culture examination time may be a preset time instead of the imaging time on the assumption that the culture information registration process is executed at the same time as the culture start time.
  • the registration processing unit 421 registers the acquired medium image data in the medium information DB 401 together with the analysis result or without analysis while causing the colony detection determination unit 422 to perform image analysis.
  • the colony detection determination unit 422 performs colony detection, colony count, and medium determination by image analysis, and details of the image analysis will be described later.
  • FIG. 6 is a diagram illustrating an example of a histogram of the color feature amounts of the normal colony region and the blur region
  • FIGS. 7 and 8 are for explaining the operation principle of the colony detection determination unit 422 in the present embodiment.
  • colonies formed on the film-type medium 60 are bacterial species such as general bacteria and Escherichia coli, culture conditions such as culture time and dilution factor, differences in camera functions of the portable communication terminal device 10, and illuminance during imaging.
  • culture conditions such as culture time and dilution factor
  • differences in camera functions of the portable communication terminal device 10 and illuminance during imaging.
  • the imaging conditions such as the above, not only the size and shape, but also the size and shape of the bleeding region and the bonding state with the colony vary for each film type medium 60. Therefore, when performing image processing for uniformly detecting colonies, it is often impossible to accurately detect and count colonies.
  • colony pixels the components of the pixels belonging to the normal colony region and the bleeding region (hereinafter referred to as “colony pixels”) are significantly different, so the threshold value and other parameters for detecting a colony are fixed. In many cases, accurate colony detection and counting cannot be performed.
  • the colony detection determination unit 422 of the present embodiment specifies a colony candidate for each film type medium 60 from the medium image, and selects a colony candidate based on the color feature amount of each pixel belonging to each colony candidate. The number of colonies is detected while classifying into a plurality of types and detecting colonies using different criteria for each type.
  • colony detection determination unit 422 of the present embodiment acquires the medium image shown in FIG. 7A and extracts a plurality of colony candidates (outlined portions in the figure) shown in FIG. As shown in FIG. 7C, while the colony candidate A and the colony candidate B are classified as second colony candidates, colony candidates other than the colony candidates A and B including the colony candidate C are set as the first colony candidates. Classification and colony detection and counting are performed using different colony detection criteria for each type of colony candidate.
  • a region clearly formed as a colony but also a bleeding region and a bubble region, such as a region in the growth process of a colony and a region affected by the colony, are included. It is possible to perform colony detection and counting while considering individual states, and to register medium information including information on the accurately detected colonies and the number of colonies in the database. ing.
  • the colony detection determination unit 422 classifies the color feature amount or the number of pixels of each pixel belonging to each colony candidate into a colony candidate that has a predetermined second condition and a colony candidate that does not have a predetermined second condition. Although it is possible, in order to classify more accurately, it is preferable to classify based on both the color feature amount or the number of pixels of each pixel belonging to each colony candidate.
  • FIG. 9 is a diagram for explaining the classification conditions set in the colony detection determination unit 422 of the server device 40 according to the present embodiment.
  • FIG. 10 illustrates the colony detection determination unit of the server device 40 according to the present embodiment.
  • FIG. 422 is a diagram for describing boundary pixels used when generating a histogram at 422;
  • FIG. 11 is a figure for demonstrating the histogram produced
  • FIG.12 and FIG.13 is the colony detection of the server apparatus 40 of this embodiment. It is a figure for demonstrating the 1st specific process performed in the determination part 422.
  • FIGS. 14 to 16 are diagrams for explaining the second specifying process executed in the colony detection determination unit 422 of the server device 40 of the present embodiment.
  • the colony detection determination unit 422 is controlled by the registration processing unit 421, and the medium image data included in the medium information transmitted from the portable communication terminal device 10 at the time of registration of the medium information in the medium information DB 401 or at a predetermined timing. Obtain media images from
  • the colony detection determination unit 422 (1) Extracting the color feature amount of each pixel constituting the acquired medium image such as RGB gradation value, luminance value or saturation, and binarizing the extracted color feature amount of each pixel in advance A process of specifying adjacent colony candidates by specifying adjacent pixels while specifying a pixel having one value (hereinafter referred to as “colony candidate specification process”), (2) Generate a histogram of the color feature amount of each pixel belonging to the identified colony candidate, and determine the condition for classifying the colony candidate (hereinafter referred to as “classification condition”) from the generated histogram.
  • colony candidate classification processing Processing for classifying colony candidates into first colony candidates and second colony candidates based on the classification conditions (hereinafter referred to as “colony candidate classification processing”); (3) a first identification process for performing colony detection and counting for the first colony candidate; and (4) A second specifying process for executing colony detection and counting for the second colony candidate is executed.
  • the colony detection determination unit 422 identifies the region to be processed (the region of the culture layer 63) from the medium image based on the position of the medium ID 66 and the like, and determines the luminance value, brightness, saturation, or sub for each pixel constituting the region. A preset color feature amount such as a gradation value of a pixel (RGB) is extracted. For example, when using a luminance value, the colony detection determination unit 422 binarizes each extracted luminance value based on a predetermined threshold while extracting the luminance value of each pixel constituting the medium image. To extract a pixel having a predetermined condition.
  • the colony detection determination unit 422 binarizes each luminance value into black or white with reference to a predetermined value as a pixel candidate indicating a black gradation value. Extract as pixels.
  • the colony detection determination part 422 performs the image filter process for reducing image filter noise, connects the colony candidate pixel which adjoins, performs labeling, and the colony candidate comprised from one or more colony candidate pixels Is identified.
  • the colony detection determination unit 422 expands to replace all the pixels adjacent to the colony candidate pixels with the colony candidate pixels when there is another colony candidate pixel adjacent to each colony candidate pixel as the image filter processing. While performing processing and contraction processing that replaces all adjacent pixels with non-colony pixels when there is a pixel that is not a colony candidate pixel (hereinafter referred to as “non-colony pixel”) adjacent to the colony candidate pixel, Identify candidates.
  • the colony detection determination unit 422 generates a histogram of the color feature amount of each pixel belonging to the identified colony candidate (that is, the colony candidate pixel), and executes a statistical calculation from the generated histogram to thereby calculate the pixel. Together with the number, a threshold value as a color feature amount for classification into two types is determined as a classification condition for classifying the first colony candidate and the second colony candidate.
  • the colony detection determination unit 422 determines the luminance value (a temporary reference value assuming classification) from the maximum luminance value to the minimum luminance value in the colony candidate pixel. (Brightness value) is changed, and the value of inter-class variance for the intra-class variance when the colony candidate is classified for each changed luminance value is calculated, and the luminance value with the maximum value is calculated as the first luminance value. It determines as a classification condition for classifying a colony candidate and a 2nd colony candidate.
  • the luminance value a temporary reference value assuming classification
  • the colony detection determination unit 422 performs the first class (that is, the black class) according to (Equation 1) for each luminance value pn from the maximum luminance value to the minimum luminance value in the histogram of colony candidate pixels. ) And second class (that is, white class) inter-class variance ⁇ w and intra-class variance ⁇ b according to (Equation 2), and calculation of inter-class variance value Z for intra-class variance is performed according to (Equation 3) However, the maximum value Zmax of the value Zpn in each luminance value is calculated, and the luminance value that becomes the maximum value Zmax is determined as the classification condition.
  • “ ⁇ 1”, “ ⁇ 2”, and “ ⁇ t” respectively indicate the number of pixels of the first class, the second class, and the entire image when classified by the luminance value pn
  • “m1”, “m2” And “mt” indicate the average of the first class, the second class, and the entire image, respectively, when classified by the luminance value pn
  • “ ⁇ 1”, “ ⁇ 2”, and “ ⁇ t” indicate the variances of the first class, the second class, and the entire image, respectively, when classified by the luminance value pn.
  • the colony detection determination unit 422 determines whether the size of the colony candidate (the number of colony candidate pixels) is greater than or equal to a certain value for each colony candidate. And the inter-class variance for the intra-class variance in the colony candidate pixel of the corresponding colony candidate based on the classification condition (threshold value t) is calculated, and based on the result, the first colony candidate or the second colony candidate Categorize.
  • the normal colony area has a small dispersion of color feature values
  • the colony including a blur area or a bubble area has a large dispersion of color feature values.
  • a colony including a bleeding region or a bubble region has a large intra-class variance and a small inter-class variance.
  • the colony detection determination unit 422 calculates the inter-class variance for the intra-class variance in the colony candidate pixel of the corresponding colony candidate based on the classification condition, and classifies it as the first colony candidate when the value is a certain value or more. If it is smaller than the certain value, it is classified as a second colony candidate.
  • the classification condition includes the number of pixels. If the number of colony candidate pixels is equal to or smaller than a certain number (classification condition), the colony detection determination unit 422 performs calculation of inter-class variance corresponding to intra-class variance. The colony candidate is classified into the normal colony region.
  • the colony detection determination unit 422 calculates the amount of change using the gradient strength of the color feature amount centered on the pixel at the boundary of the first colony candidate (hereinafter referred to as “boundary pixel”). Based on the calculated gradient strength, the colony pixel specified based on the determination condition is detected and counted while the determination condition for specifying the colony pixel is set. Yes.
  • the colony detection determination unit 422 (1) Based on the color feature amount (for example, luminance value) between the pixels constituting the boundary for each first colony candidate and the pixels around the pixel, the color feature amount of the boundary pixel for each identified colony candidate Calculate the gradient strength as the amount of change, (2) Based on the calculated gradient strength of each color feature amount, a determination condition is set, (3) Specify colony pixels from the first colony candidates based on the set determination conditions, (4) Based on the identified colony pixel, colony detection and count of the number of the colonies are executed.
  • the color feature amount for example, luminance value
  • the colony detection determination unit 422 has a colony in the central portion of the area in a part of the medium image area (for example, an arbitrary 3 ⁇ 3 area).
  • the center pixel is set as a boundary pixel, as shown in FIGS. 10B and 10C.
  • the pixels of the central portion are not set as boundary pixels.
  • the colony detection determination unit 422 calculates the gradient strength in the color feature value of the boundary pixel that forms the boundary for each first colony candidate based on (Equation 4), and the color feature value as illustrated in FIG. A histogram showing an average value of each gradient feature for each color feature amount (hereinafter referred to as “average gradient strength”) is generated.
  • FIG. 11 is a histogram when the color feature amount is luminance.
  • the colony detection determination part 422 sets the color feature-value (point A of FIG. 11) from which the gradient intensity
  • a colony candidate pixel is identified as a colony pixel.
  • the colony detection determination unit 422 executes image filter processing including expansion processing and reduction processing for reducing image filter noise, connects adjacent colony pixels, performs labeling, and executes the labeling from one or more colony pixels. Identify the configured colonies.
  • the colony detection determination part 422 is for each detected colony. (1) Various information of colony pixels included in the colony, such as the position of the colony pixel included in each colony, the feature amount relating to the color, and the arrangement position on the medium image, and (2) Specify information related to colonies such as the position of the center of gravity of each colony on the medium image or the color feature amount (average).
  • the colony detection determination unit 422 provides various types of information including the number of colonies to the registration processing unit 421 together with the result based on the second specifying process.
  • FIG.12 and FIG.13 the colony detection result in the culture medium image based on the threshold value used as judgment conditions is shown.
  • the color feature amount that maximizes the gradient intensity is set to the threshold value that is the determination condition determined by the histogram shown in FIG. 11 for the input medium image shown in FIG. : FIG. 12 (B)
  • a color feature amount with a lower gradient value than the gradient strength of the color feature amount with the maximum gradient intensity is set (point B: FIG. 13 (A)
  • point C FIG. 13B
  • FIG.12 and FIG.13 is a result at the time of performing a 1st specific process, without classifying a colony candidate.
  • the colony detection determination unit 422 may set the color feature amount in the vicinity of the maximum value as a threshold value as a determination condition instead of the maximum gradient intensity in the generated histogram.
  • the colony detection determination unit 422 may set the threshold value as a determination condition using a value obtained by adding a certain value to a color feature amount having a maximum gradient intensity or a value obtained by subtracting a certain value.
  • the constant value to be added to or subtracted from the maximum value is determined empirically, and for example, a color feature amount that has a gradient intensity 10% lower than the maximum gradient intensity can be used.
  • the colony detection determination unit 422 uses a smoothing degree (that is, a window size) as a parameter as the second specifying process, and a plurality of smoothing processes from a smoothing process with a low smoothing degree to a smoothing process with a high smoothing degree.
  • the colony pixel is specified by executing the conversion process and adding the results.
  • the colony detection determination unit 422 (1) A plurality of smoothing processes are executed with different parameters (window sizes) for each color feature amount of colony candidate pixels included in the second colony candidate, (2) For each smoothed image obtained by each smoothing process, target colony candidate pixels having a target pixel search condition that is a predetermined search condition from among colony candidate pixels belonging to each smoothed image Identified as pixels, (3) Identify colony pixels in the second colony candidate based on the target pixel for each smoothed image, (4) Based on the identified colony pixel, colony detection and colony count are executed.
  • the colony detection determination unit 422 executes the smoothing process on the second colony candidate using each Gaussian filter whose window size is changed.
  • the colony detection determination unit 422 executes the smoothing process 64 times with a Gaussian filter in which the window size is changed from 1 ⁇ 1 pixel having a low smoothing degree to 64 ⁇ 64 pixels having a high smoothing degree.
  • a Gaussian filter in which the window size is changed from 1 ⁇ 1 pixel having a low smoothing degree to 64 ⁇ 64 pixels having a high smoothing degree.
  • Each of 64 smoothed images as illustrated in FIG. 14 (three examples in FIG. 14) are acquired.
  • the colony detection determination unit 422 may use a filter other than a Gaussian filter, such as a moving average filter or a median filter.
  • each pixel candidate pixel which belongs to each smoothed image for every acquired smoothed image has an object pixel search condition, ie, each It is determined whether or not the colony candidate pixel is an extreme value within a predetermined region (within a 3 ⁇ 3 window centered on each colony candidate pixel), and the colony candidate pixel that is the extreme value is specified as a target pixel. .
  • the colony detection determination unit 422 in the 3 ⁇ 3 window centered on each colony candidate pixel, as shown in FIG. 15A, only the center pixel has a maximum value, that is, an extreme value. While the center pixel is identified as the target pixel, as shown in FIG. 15B, when the center pixel is not the maximum value, and as shown in FIG. If these pixels have the same value, the center pixel is not determined as an extreme value.
  • numbers in the 3 ⁇ 3 window indicate component values (gradation values) of color feature amounts (for example, luminance values).
  • the colony detection determination part 422 will complete
  • the pixels on the medium image in which the number of target pixels is a predetermined number of pixels (for example, 10) or more are specified as colony pixels.
  • the target pixel number of the pixel at the first position on the culture medium image is “3”
  • the target pixel number of the pixel at the second position on the culture medium image is “3”. 2
  • the number of target pixels of the pixel at the third position on the medium image is“ 1 ”.
  • the total number of target pixels is “3” or more, it indicates that the colony pixel is specified on the medium image.
  • the colony detection determination unit 422 executes image filter processing including expansion processing and reduction processing for reducing image filter noise, and connects adjacent colony pixels to perform labeling.
  • image filter processing including expansion processing and reduction processing for reducing image filter noise, and connects adjacent colony pixels to perform labeling.
  • a colony composed of one or more colony pixels is specified.
  • the colony detection determination part 422 is (1) the position of the colony pixel contained in each colony, the feature-value regarding a color, the arrangement position on a culture medium image, etc. for every detected colony similarly to a 1st specific process.
  • the colony detection determination unit 422 aggregates various information including the number of colonies together with the result based on the first identification process, and provides the total to the registration processing unit 421.
  • the colony detection determination unit 422 performs medium determination (that is, determination of pass / fail of the specimen) as to whether the specimen of each film type culture medium 60 is abnormal or normal. For example, the colony detection determination unit 422 determines pass / fail of each sample based on a threshold value of the number of bacteria set in advance according to the bacterial species to be detected from the sample (that is, the determination criterion), and the result is the registration processing unit 421. To provide.
  • the registration processing unit 421 obtains the medium determination criterion information from the ROM / RAM 440 based on the criteria used when cultivating the specimen and the bacterial species. Read out and perform medium determination.
  • Each criterion information is specified in association with the medium ID 66. That is, since the type of the film-type medium 60 is different for each bacterial species detected from the specimen, the bacterial species to be detected can be specified by specifying the medium ID 66. Therefore, in this embodiment, the determination reference information specified based on the culture medium ID 66 can be read out by setting the dilution rate and the like in advance.
  • the pass / fail determination of each film type medium 60 is used in the process determination, the line determination, and the lot determination, the medium determination is executed in association with these determinations.
  • the method of pass / fail determination of each film type culture medium 60 in process determination, line determination, and lot determination will be described later.
  • the lot determination processing unit 424 of the present embodiment analyzes data on hygiene management in the designated lot, work line 80 or process based on the instructions of the administrator input to the administrator terminal device 20 (ie, pass / fail determination). Execute.
  • the lot determination processing unit 424 for each lot, line information of the work line 80 used for the corresponding lot, and medium information registered in association with the corresponding work line 80 (at least the number of colonies). Based on the above, it is determined whether the food group manufactured or inspected under the same condition has a predetermined condition.
  • the lot determination processing unit 424 determines whether the work line 80 included in the corresponding lot and the processes belonging to the work line 80 are abnormal or normal in terms of hygiene management. 80 line determinations (that is, pass / fail determination for hygiene management) and process determinations for each process (that is, determination of pass / fail for hygiene management) are performed, and lot determination is performed using the process determination and line determination.
  • the lot determination processing unit 424 for example, the number of colonies of the film-type medium 60 in the medium information that has passed a predetermined culture inspection time such as 24 hours or 48 hours from the start of culture, Based on the medium information of the pass / fail determination of the specimen, the pass / fail of hygienic management of the process is determined, and the pass / fail of hygiene management of the work line 80 is determined based on the pass / fail determination of the process included in the corresponding work line 80. Based on the pass / fail determination of the work line 80 included in the corresponding lot, the pass / fail in sanitary management of the lot is determined.
  • lot determination processing unit 424 of the present embodiment may execute not only lot determination but also process determination or line determination as data analysis.
  • the lot determination processing unit 424 has a culture start time at the same timing, a culture examination time at the same timing, a culture start time having a time within a preset time from the first time to the second time, or a preset first time.
  • the culture start time or the culture test time has a predetermined condition, such as having a culture test time having a time within the time from the first time to the second time, and is registered in association with the same process in the same lot.
  • Each process determination is performed based on the culture medium information of the plurality of film-type culture media 60 that has been performed. That is, the lot determination processing unit 424 executes each process determination by comprehensive determination based on each medium determination result of the plurality of film-type mediums 60.
  • the lot determination processing unit 424 displays the medium determination results of the corresponding film-type medium 60 (that is, all the medium determination results registered in the medium information having the process ID 71b of the process to be subjected to the process determination).
  • the process judgment of the process to be judged is judged to be acceptable, and if not, the judgment should be made The process judgment of the process is judged as rejected.
  • the lot determination processing unit 424 determines that the conditions for all the film-type culture media 60 when the acceptable film-type culture media 60 are a predetermined ratio (60%) or more in the individual film-type culture media 60 in the corresponding process ( The number of colonies is equal to or less than a certain number), or the condition that the number of colonies of each film-type medium 60 corresponds (the average number of colonies of a single film-type medium 60 is equal to or less than a certain number). In this case, the corresponding process is determined to be acceptable.
  • the lot determination processing unit 424 of the present embodiment can change conditions depending on the type of specimen, the type of bacteria to be detected, etc., and can be set by an administrator or provided as part of a program.
  • the lot determination processing unit 424 performs line determination for each work line 80 based on the pass / fail determination for hygiene management of a plurality of processes that are determined at a predetermined timing and registered in association with the corresponding line information. To do. That is, the lot determination processing unit 424 performs line determination by comprehensive determination based on the determination results of a plurality of processes of the same lot determined at a predetermined timing.
  • the lot determination processing unit 424 is determined at the same timing or a timing satisfying a predetermined condition, and has the line ID of the work line 80 to be subjected to line determination as described above.
  • the line determination of the work line 80 to be determined is determined to be acceptable, and the condition is not satisfied
  • the line determination of the work line 80 to be determined is determined to be unacceptable.
  • the lot determination processing unit 424 determines that the line determination of the work line 80 to be determined is acceptable.
  • the lot determination processing unit 424 executes the lot determination for each lot based on the hygiene management pass / fail determination of the plurality of work lines 80 that are determined at a predetermined timing and registered in association with the corresponding lot information. To do. That is, the lot determination processing unit 424 executes lot determination by comprehensive determination based on the determination results of the plurality of work lines 80.
  • the lot determination processing unit 424 performs lot determination based on the pass / fail determination in the work line 80 having the lot ID of the lot for which lot determination is to be performed.
  • the lot determination processing unit 424 determines that the lot determination of the lot to be determined is acceptable when the line determination is successful in 60% of the work lines 80 having the lot ID, and the three work lines 80 determine the lot to be determined. Assume that a lot ID is included. In this case, when the first work line 80 is “pass”, the second work line 80 is “pass”, and the third work line 80 is “fail”, the lot determination processing unit 424 determines the lot to be determined. It is determined that the lot determination is acceptable.
  • the lot may be determined by dividing the time every predetermined time (for example, 8 hours or 12 hours). In this case, when the lot determination is performed while the work is suspended, a dummy result may be used, or it may be determined that the work is being suspended.
  • the lot determination processing unit 424 can perform determinations and data analysis other than those described above using the culture medium information, line information, lot information, and work management DB 404, and the determination result or data analysis via the report processing unit 425.
  • the result can be provided to the administrator terminal device 20 so that the administrator can view the result.
  • the lot determination processing unit 424 checks the reliability of the sample cultured in each film-type medium 60, that is, checks whether or not an inspection error has occurred.
  • the medium information in the medium ID is subjected to a predetermined analysis of the medium information or the medium image data in time series from the culture start time to the end of the culture.
  • the lot determination processing unit 424 has a specific culture medium ID (same culture medium ID) 66 based on an instruction from the administrator received via the administrator terminal device 20, and starts from the culture start time to a predetermined time. Are extracted together with the medium image data. Then, the lot determination processing unit 424 performs a predetermined analysis on each medium information and each image data along a predetermined time series, or aggregates each medium information and each image data along a time series. In addition, the lot determination processing unit 424 causes the report processing unit 425 to generate the analysis result or the aggregation result as browsing data having a predetermined data format, and allows the administrator to browse the generated browsing data. 20 to provide.
  • a specific culture medium ID standard culture medium ID
  • the lot determination processing unit 424 causes the report processing unit 425 to generate the analysis result or the aggregation result as browsing data having a predetermined data format, and allows the administrator to browse the generated browsing data. 20 to provide.
  • the lot determination processing unit 424 is linked to the report processing unit 425, and at this time, based on an instruction from the manager terminal device 20, each medium information in one medium ID 66 is used for legal hygiene management reporting. May be made individually viewable.
  • the lot determination processing unit 424 may have a search function for medium information, line information, lot information, or work management information. Specifically, the lot determination processing unit 424 uses the lot ID (instruction ID 71a), the work line ID, the process ID 71b, the work ID 71, the culture start time, the lot work date and time, the culture medium ID 66, the specimen type, and the like as search keys.
  • the database 400 may be searched, and the report processing unit 425 may be linked to generate data that allows the administrator to view the corresponding medium information and various types of information.
  • the report processing unit 425 is configured to search for medium information (medium image data, number of colonies and medium determination result), process information, and line specified by a search based on an instruction from the administrator received via the administrator terminal device 20. It is also possible to provide information or information on lots in a predetermined report format. That is, the report processing unit 425 is configured to be able to provide various information as evidence or reports in legal inspection reports and other cases.
  • the report processing unit 425 performs data analysis related to hygiene management in the designated lot, work line 80 or process based on the administrator's instruction input to the administrator terminal device 20 and template data having a predetermined report format.
  • An analysis result (that is, a determination result of pass / fail determination) is generated as report data, and the generated report data is provided to the administrator terminal device 20 so as to be viewable by the administrator via the communication control unit 410.
  • the report processing unit 425 extracts necessary information from the medium information, the line information, and the lot information such as the medium image data, the number of colonies, or the medium determination result, and the extracted information and the lot determination processing unit 424. Based on the analysis result obtained by the above, report data is generated while assigning each information to the template data. Then, the report processing unit 425 provides the administrator terminal device 20 with report data having an image of a medium in which the processing such as rotation is not executed and the identity is ensured.
  • the report processing unit 425 is configured to generate predetermined report data or browsing data in accordance with various analyzes or searches and provide the data to the administrator terminal device 20. .
  • the report processing unit 425 can also provide medium information, process information, line information, or lot-related information specified by the search in a predetermined report format based on the received administrator's instruction.
  • it is configured so that various information can be provided as evidence or reports in statutory inspection reports and other cases.
  • FIG. 17 is a flowchart showing the culture information registration processing operation in the portable communication terminal device 10 of the present embodiment.
  • the medium ID 66 or the instruction ID 71a is attached to the film-type medium 60 and the work instruction sheet 70 by a two-dimensional barcode.
  • the number of colonies in each film-type medium 60 is detected at the time of registration in the medium information database 400, and the portable communication terminal device 10 uses RGB for capturing a medium image. It is assumed that calibration for the gradation value or the luminance value is performed.
  • the application control unit 120 detects an activation instruction for the culture medium registration application via the operation unit 170 (step S101)
  • the application control unit 120 reads the culture medium registration application from the application storage unit 101 and activates it (Ste S102).
  • the application control unit 120 performs initialization of the work memory and other necessary processes under the control of the mobile terminal management control unit 190.
  • the application control unit 120 displays an image for interlocking with the display control unit 161 to select whether the initial registration of the film-type medium 60 or the post-culture registration after a predetermined time has elapsed from the start of the culture. It is displayed on the unit 160 and waits for its input (step S103).
  • step S104 when detecting an input of a selection instruction by the operation unit 170 (step S104), the application control unit 120 determines whether the registration is initial registration or post-culture registration, and sets the result in flag information (step S105).
  • the application control unit 120 causes the display unit 160 to display a screen that prompts the imaging of the film-type medium 60, and waits for imaging by the image data generation unit 110 in conjunction with the operation unit 170 (step S106). At this time, the application control unit 120 causes a predetermined image to be superimposed on the display unit 160 in order to align the medium image to be acquired.
  • the image data generation unit 110 causes the medium ID 66 to be detected.
  • the imaged medium image data of the film type medium 60 is acquired and stored in the image data storage unit 102 while giving a predetermined image ID (step S108).
  • the application control unit 120 acquires the current time as the imaging time of the medium image data from the timer 180, and stores it in the image data storage unit 102 as metadata in association with the medium image data (step S109).
  • the application control unit 120 analyzes the two-dimensional barcode formed in a predetermined area of the acquired imaged culture medium image data, acquires the culture medium ID 66, and stores the image data in association with the culture medium image data.
  • the information is stored in the unit 102 (step S110).
  • the application control unit 120 causes the display unit 160 to display a screen for acquiring the instruction sheet image data together with the instruction sheet ID 71a and the process ID 71b in conjunction with the display control unit 161, and waits for acquisition of the instruction sheet image data. (Step S111).
  • step S112 when the application control unit 120 detects imaging by the image data generation unit 110 in cooperation with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S112), an instruction in which the work ID 71 is imaged.
  • the book image data is acquired and stored in the image data storage unit 102 in association with the culture medium image data acquired in step S108 (step S113).
  • the application control unit 120 when acquiring the process ID 71b as the work ID 71, or when acquiring the one process ID 71b from the plurality of process IDs 71b, the application control unit 120 operates in conjunction with the display control unit 161 and the operation unit 170, and the user The process ID 71b to be acquired is displayed, and the corresponding process ID 71b is acquired.
  • the application control unit 120 analyzes the two-dimensional barcode formed in a predetermined area of the imaged instruction sheet image data and the culture medium image data, acquires the work ID 71, and associates it with the instruction sheet image data. And stored in the image data storage unit 102 (step S114).
  • the application control unit 120 acquires the current time as the imaging time of the medium image data from the timer 180, and in conjunction with the display control unit 161 and the operation unit 170, the application control unit 120 acquires the acquired instruction image data, work ID 71, The medium image data, medium ID 66, and imaging time are confirmed (step S115).
  • the application control unit 120 may re-acquire the culture image data based on an instruction from the operator when the acquired medium information is confirmed by the operator. At this time, the application control unit 120 may be able to correct the medium image data by the operator in conjunction with the display control unit 161 and the operation unit 170.
  • the application control unit 120 based on the operator's instruction, together with flag information indicating whether it is initial registration or post-culture registration, terminal ID, and work ID 71, the acquired medium image data, its metadata, and whether it is initial registration.
  • Flag information indicating whether it is registered after culture is transmitted as medium information to the server device 40 via the network communication unit 130 (step S116), and the registration process of the portable communication terminal device 10 is terminated.
  • the network communication unit 130 executes login for accessing the server device 40 based on the terminal ID or the input ID and password, and the server device 40 is completed after the login is completed. Communication line is established and medium information is transmitted.
  • FIG. 18 is a flowchart showing the operation of registering medium information in the server device 40 of this embodiment.
  • movement is a process performed in conjunction with the culture medium information registration process performed by the portable communication terminal device 10, and the server apparatus 40 is based on the culture medium information transmitted from the portable communication terminal device 10. The following processing is executed.
  • the registration processing unit 421 is based on the flag information included in the received culture medium information. Whether the registration is initial registration or post-culture registration is determined (step S301).
  • step S302 If the registration processing unit 421 determines that it is not initial registration, that is, if it is determined to be post-culture registration, step S304 is performed. Move on to processing.
  • the registration processing unit 421 determines initial registration
  • the registration processing unit 421 extracts and specifies the work ID 71 included in the culture medium information (step S302).
  • the registration processing unit 421 registers the culture medium information in the culture medium information DB 401 based on the identified work ID 71 (step S303), and ends this operation.
  • the culture start time is stored in advance in the work management DB 404
  • the registration processing unit 421 registers the imaging time included in the received medium information as the culture start time in the work management DB 404 in the process of step S303. Also good.
  • the registration processing unit 421 determines that the registration is after culture, it extracts and specifies the work ID 71 included in the culture medium information (step S304), and registers the culture medium information based on the imaging time included in the culture medium information.
  • the culture examination time to be specified is specified (step S305).
  • the registration processing unit 421 may be registered by designating a culture examination time for registering the culture medium information in conjunction with the portable communication terminal device 10, or the imaging time included in the received culture medium information.
  • the culture examination time may be registered as it is.
  • the registration processing unit 421 manages the culture medium registration at the culture test time that has already been performed, and specifies the culture test time based on the timing at which the culture medium information is received and the culture test time that has already been used to register the culture medium information. May be. That is, the registration processing unit 421 may specify the culture examination time by rewriting the execution flag each time the medium information is registered and comparing the received imaging time with reference to the information of the flag.
  • the registration processing unit 421 causes the colony detection determination unit 422 to perform image analysis on the received medium image data, and the feature amount (luminance value) of each pixel constituting the region of the culture layer 63 in the medium image. And the number of colonies generated in the specimen imaged based on the feature quantity of each pixel constituting the region of the culture layer 63 is identified and counted (step S307).
  • the colony detection determination unit 422 reads out the medium determination criterion based on the type of the sample specified based on the work ID 71 and the fungus species to be detected, and detects the number of colonies detected based on the read sample determination criterion. It is determined whether or not satisfies a predetermined condition (step S308). That is, the colony detection determination unit 422 determines that it is acceptable (normal) when the predetermined condition is satisfied, and determines that it is unacceptable (abnormal) when the predetermined condition is not satisfied.
  • the colony detection determination unit 422 is linked to the portable communication terminal device 10 instead of the automatic registration described above, and displays the detected number of colonies and the result of the pass / fail determination on the display unit 160 of the portable communication terminal device 10. The user may be allowed to view and confirm.
  • the registration processing unit 421 specifies culture start time information using the culture image data, the recognized medium ID 66, the determined pass / fail, the number of detected colonies, and the imaging time included in the medium information as the culture start time. In association with the work ID 71, it is registered in the culture medium information DB 401 (step S309), and this operation is terminated.
  • the registration processing unit 421 displays line information and information to be registered on the display unit 160 of the portable communication terminal device 10, and based on a user instruction input via the portable communication terminal device 10, the culture medium Information or the like may be registered.
  • the registration processing unit 421 receives the reception in the process of step S301.
  • the medium ID 66 imaged on each predetermined area of the medium image data thus obtained is analyzed, and the medium ID 66 is recognized and acquired.
  • the server device 40 also recognizes the work ID 71 in the instruction image data.
  • FIG. 19 is a flowchart showing the operation of colony detection processing in the server device 40 of this embodiment.
  • This operation is a process executed in the colony detection determination unit 422 under the control of the registration processing unit 421 in the process of step S307 of the culture medium registration process shown in FIG.
  • the colony detection determination unit 422 executes a color feature amount extraction process for extracting a color feature amount (for example, a luminance value) of each pixel constituting the medium image acquired from the medium image data (step S401).
  • a color feature amount for example, a luminance value
  • the colony detection determination unit 422 binarizes each extracted color feature amount based on a predetermined threshold value and extracts pixels having predetermined conditions as colony candidate pixels (step S402) and adjacent to each other.
  • a colony candidate pixel is connected and labeling is performed, and the colony candidate comprised from one or more colony candidate pixels is specified (step S403).
  • the colony detection determination unit 422 generates a histogram based on the color feature amount of the colony candidate pixel belonging to the specified colony candidate, and determines it as the classification condition for classifying the first colony candidate and the second colony candidate. (Step S404).
  • the colony detection determination unit 422 determines the interclass variance ⁇ w of (Equation 1) and (Equation 2) for each luminance value from the maximum luminance value to the minimum luminance value in the colony candidate pixel histogram. ) Within the class, and calculating the maximum value Zmax of the value Zpn in each luminance value while calculating the intra-class variance value Z for the inter-class variance according to (Equation 3). The luminance value that becomes Zmax is determined as the classification condition.
  • the colony detection determination unit 422 executes the following steps S410 to S415 for each colony candidate.
  • the colony detection determination unit 422 extracts a corresponding colony candidate (step S410). For example, the colony detection determination unit 422 extracts unclassified colony candidates that are colony candidates in the order of IDs given when extracting colony candidates.
  • the colony detection determination unit 422 determines whether or not the number of pixels of the identified colony candidate is a certain number or more (step S411). At this time, if the colony detection determination unit 422 determines that the number of pixels of the identified colony candidate is not equal to or greater than a certain number, the colony detection determination unit 422 classifies the corresponding colony candidate as the first colony candidate (step S412) and performs step S421. Transition to processing.
  • the colony detection determination unit 422 determines that the number of pixels of the corresponding colony candidate pixel is equal to or greater than a certain number, the colony detection determination unit 422 calculates the inter-class variance of the intra-class variance in the colony candidate pixel of the corresponding colony candidate. (Step S413).
  • the colony detection determination unit 422 determines whether or not the value of the inter-class variance for the intra-class variance in the colony candidate pixel of the corresponding colony candidate is greater than or equal to a certain value (step S414).
  • the colony detection determination unit 422 determines that the value of the inter-class variance for the intra-class variance in the colony candidate pixel of the corresponding colony candidate is not a certain level or more, the corresponding colony candidate is set as the second colony candidate. If classification is performed (step S415), the process proceeds to step S421, and if it is determined that the value of inter-class variance for the intra-class variance in the colony candidate pixel of the corresponding colony candidate is greater than or equal to a certain value, the corresponding colony candidate Are classified as first colony candidates (step S412), and the process proceeds to step S421.
  • the colony detection determination unit 422 determines whether or not all colony candidates have been classified (step S421), and if it is determined that there is a colony candidate that has not yet been classified, the process proceeds to step S411. If it is determined that all colony candidates have been classified, the process proceeds to step S431.
  • the colony detection determination unit 422 executes the first specifying process for each first colony candidate to detect and count the colonies in each first colony candidate (step S431).
  • the colony detection determination unit 422 includes, as the first specifying process, (1) A change amount of the color feature amount of each boundary pixel of each first colony candidate is calculated, (2) Based on the calculated change amount of each color feature amount, a determination condition is set, (3) Specify colony pixels from the first colony candidates based on the set determination conditions, (4) Based on the identified colony pixel, a colony is detected from the first colony candidates and the number of the colonies is counted.
  • the colony detection determination unit 422 executes the second specifying process for each second colony candidate, and executes colony detection and counting for each second colony candidate (step S432).
  • the colony detection determination unit 422 includes, as the second specifying process, (1) A plurality of smoothing processes are executed with different parameters (window sizes) for each color feature amount of colony candidate pixels included in the second colony candidate, (2) For each smoothed image obtained by each smoothing process, target colony candidate pixels having a target pixel search condition that is a predetermined search condition from among colony candidate pixels belonging to each smoothed image Identified as pixels, (3) Identify colony pixels in the second colony candidate based on the target pixel for each smoothed image, (4) Based on the identified colony pixel, colony detection and count of the number of the colonies are executed.
  • the colony detection determination unit 422 adds the number of colonies of the first candidate colony and the second candidate colony (step S433), and ends this operation.
  • a portable communication terminal device 10 such as a tablet information terminal device, a smartphone, or a mobile phone
  • a laptop or desktop personal computer is used.
  • the registration process of the culture medium information may be realized by a computer and an image input device such as a scanner, a digital camera, or a smartphone.
  • the personal computer and the image input device may be connected according to a predetermined communication standard, and the registration process of the culture medium information may be realized by using the personal computer and the image input device integrally, or a memory card.
  • the medium image data and instruction sheet image data previously acquired by the image input device are stored in other physical memory, and the registration process of the medium information is realized while the stored image data is captured by the personal computer. May be.
  • the portable communication terminal device 10, the administrator terminal device 20, and the server device 40 may be installed or used in the same site, or each may be installed in a remote place such as outside the country or remotely. It may be used on the ground and each process described above may be executed. However, it is assumed that the portable communication terminal device 10 is used in the same lot.
  • Modification 4 In the present embodiment, registration of medium information in a specimen cultured in the film-type medium 60 using the film-type medium 60 is executed, but the medium in the specimen cultured in the agar medium using an agar medium. Information registration may be executed.
  • the culture medium ID 66 may be input by an operator's operation input.
  • the application control unit 120 interlocks with the display control unit 161 and the operation unit 170, and allows the operator to manually input the culture medium ID 66 directly using the operation unit 170.
  • the application control unit 120 controls the display control unit 161 and the operation unit 170 to select a display item such as a pull-down menu by clicking or touch selection, and causes the operator to input the medium ID 66.
  • Modification 6 In the present embodiment, various processes are executed by the single server device 40, but various processes may be executed by a server system including a plurality of server devices 40.
  • the colony detection determination unit 422 generates a color feature amount histogram, and sets the value that is the maximum value of the inter-class variance for the intra-class variance as the classification condition for classifying the colony candidates. And classify each colony candidate, (1) Based on either edge component in boundary pixel of each colony candidate (2) Histogram based on color feature amount of each pixel belonging to each colony candidate or (3) Moment feature obtained by quantifying the shape of each colony candidate Each colony candidate may be classified into a first colony candidate and a second colony candidate.
  • the colony detection determination unit 422 classifies the colony candidates based on the edge components, the response value of the edge detection filter at each boundary pixel of each colony candidate using a Laplacian filter as illustrated in FIG. An average value (one-dimensional value) is calculated, and colony candidates whose average value is equal to or greater than a predetermined value are classified as first colony candidates, and colony candidates whose average value is equal to or greater than a predetermined value are classified Classify as 2 colony candidates.
  • the colony detection determination unit 422 uses a luminance value as a color feature amount and n-dimensionally (based on the number of pixels for each gradation value (0 to 255). 256-dimensional) histogram is generated, colony candidates belonging to a predetermined threshold plane or higher in the n-dimensional histogram are classified as first colony candidates, and colony candidates lower than the threshold plane are classified as second colony candidates. To do.
  • the colony detection determination unit 422 classifies colony candidates using the moment feature, the shape change having symmetry in the translation direction, point-symmetric shape, similarity shape, and mirror-symmetric shape (line symmetry). And calculating a Hu moment that indicates an invariant value for the colony, classifying a colony candidate having the constant Hu moment as a first colony candidate, and classifying a colony candidate that does not have the condition as a second colony candidate To do.
  • the colony detection determining unit 422 calculates the Hu moment using the following (Expression 7) to (Expression 13) as the Hu moment.
  • ⁇ (ij) is a value obtained by normalizing the color feature quantity I at the position of the pixel belonging to the colony candidate as a scalar value, and is represented by (Expression 14) to (Expression 17).
  • the colony detection determination unit 422 generates a histogram of color feature values (luminance values) and classifies colony candidates while classifying two classes (white class and black class).
  • SVM Serial Vecot Machine
  • the colony detection determination unit 422 generates a histogram of color feature values (luminance values) and classifies each colony candidate based on the generated histogram. Based on the gradient intensity (for example, luminance gradient intensity) of the color feature amount used in the first specifying process, the normal colony area and the bleeding area (that is, the bleeding area in a narrow sense), and colony candidates belonging to the bubble area in addition to these areas May be classified.
  • the gradient intensity for example, luminance gradient intensity
  • the histograms generated by calculating the luminance gradient strength of each colony candidate pixel for typical examples of the normal colony region, the bleeding region, and the bubble region are the same for each region. It can be seen that it has a shape.
  • the histogram of luminance gradient intensity is widely distributed, and in the blurred region, the histogram of luminance gradient intensity is classified narrowly. Further, in the bubble area, the histogram of the intensity gradient intensity is classified by a width that is approximately between the normal colony area and the bleeding area.
  • the colony detection determination unit 422 classifies each colony candidate based on the histogram of the gradient strength of the color feature amount and the characteristics of the histogram of each region.
  • the gradient strength of the color feature amount is used for each colony candidate pixel, not the boundary pixel.
  • 20 to 22 are diagrams showing examples of histograms of gradient strengths of color feature amounts in the normal colony region, the bleeding region, and the bubble region, respectively.
  • the colony detection determination unit 422 (1) The gradient intensity m (x, y) of the color feature amount for each colony candidate pixel in the colony candidate is calculated using (Equation 18) to (Equation 20), (2) A histogram is generated by counting the number of pixels for each gradient intensity calculated for each colony candidate pixel (that is, for each gradation value of luminance gradient intensity), (3) Each colony candidate may be classified based on its shape by normalizing each element of the histogram (number of pixels for each gradient intensity) (ie, dividing by all the pixels of the medium image).
  • m indicates “gradient strength” in each colony candidate
  • x and y indicate coordinate positions of the boundary pixels on the medium image.
  • fx and fy are expressed by (Expression 19) and (Expression 20), and “L” in (Expression 19) and (Expression 20) indicates the color feature amount of the colony candidate pixel.
  • the colony can be accurately detected in consideration of the bubble area affected by the gas generated from the bacteria such as, and the area where the colony to be detected by combining with the bleeding area is also formed. It is possible to accurately detect the blur area.
  • a region clearly formed as a colony but also a bleeding region and a bubble region, such as a region in the growth process of a colony and a region affected by the colony are included. While considering individual states, colony detection and counting can be performed, and medium information including information on accurately detected colonies and the number thereof can be registered in a database.
  • the sanitary management system S of the present embodiment it is possible to save resources as compared with the case where various data analyzes and provisions are performed using physical resources such as paper media, and the culture medium.
  • registration mistakes can be remarkably reduced and difficult medium management can be facilitated, so that resource saving can be achieved without wastefully consuming the culture medium.
  • the present invention is not limited to the food, and can be applied to products that are provided to all living organisms including drugs and drugs. .
  • the present invention can be used for food and other hygiene management systems.

Landscapes

  • Chemical & Material Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Organic Chemistry (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Wood Science & Technology (AREA)
  • Zoology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Analytical Chemistry (AREA)
  • Microbiology (AREA)
  • Biotechnology (AREA)
  • Biochemistry (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Genetics & Genomics (AREA)
  • Proteomics, Peptides & Aminoacids (AREA)
  • Sustainable Development (AREA)
  • Biomedical Technology (AREA)
  • Computer Hardware Design (AREA)
  • Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Toxicology (AREA)
  • Immunology (AREA)
  • Molecular Biology (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)

Abstract

Le système (S) de gestion de l'aseptisation selon l'invention présente une configuration dans laquelle : (1) sur la base des valeurs de caractéristiques de pixels formant une région cible prescrite d'une image de milieu de culture dans laquelle est produite une image d'un milieu de culture (60) de type film, on identifie des pixels hors colonies, qui diffèrent des pixels de colonies utilisés pour produire une image des colonies, et on identifie les valeurs des caractéristiques de couleur les concernant ; et (2) sur la base des valeurs des caractéristiques de couleur des pixels hors colonies identifiés, on détecte les pixels de colonies dans l'image du milieu de culture et on détecte les colonies.
PCT/JP2014/060317 2013-04-17 2014-04-09 Dispositif de détection de colonies, système d'enregistrement d'informations relatives à un milieu de culture, programme et système de gestion d'aseptisation WO2014171382A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2015512458A JP6337885B2 (ja) 2013-04-17 2014-04-09 コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013-087001 2013-04-17
JP2013087001 2013-04-17

Publications (1)

Publication Number Publication Date
WO2014171382A1 true WO2014171382A1 (fr) 2014-10-23

Family

ID=51731325

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/060317 WO2014171382A1 (fr) 2013-04-17 2014-04-09 Dispositif de détection de colonies, système d'enregistrement d'informations relatives à un milieu de culture, programme et système de gestion d'aseptisation

Country Status (2)

Country Link
JP (1) JP6337885B2 (fr)
WO (1) WO2014171382A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11010590B2 (en) 2017-09-25 2021-05-18 Olympus Corporation Image processing device, cell-cluster recognition apparatus, cell-cluster recognition method, and cell-cluster recognition program for binarizing and segmenting smoothed cell image in which gap between cells in each cell cluster is filled in

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08510123A (ja) * 1993-05-14 1996-10-29 ミネソタ・マイニング・アンド・マニュファクチュアリング・カンパニー 微生物増殖の迅速な定量化の方法
JPH09187270A (ja) * 1996-01-11 1997-07-22 Nishi Nippon Shinku Tank Kk 細菌類の分析方法および同分析装置
JP2003116593A (ja) * 2001-10-17 2003-04-22 Hakuju Inst For Health Science Co Ltd 微生物の判定方法およびその装置
JP2011103786A (ja) * 2009-11-13 2011-06-02 Hitachi High-Technologies Corp 細菌コロニー釣菌装置及びその方法
WO2011115218A1 (fr) * 2010-03-17 2011-09-22 株式会社エルメックス Procédé d'essai bactériologique au moyen d'un milieu de culture de type film, et outil de capture d'images utilisé lors de ce procédé d'essai bactériologique
JP2011229413A (ja) * 2010-04-23 2011-11-17 Nagoya Univ 細胞評価装置、インキュベータ、プログラム、および、培養方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8831313B2 (en) * 2010-06-23 2014-09-09 Kabushiki Kaisha N-Tech Method for detecting microorganisms, device for detecting microorganisms and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08510123A (ja) * 1993-05-14 1996-10-29 ミネソタ・マイニング・アンド・マニュファクチュアリング・カンパニー 微生物増殖の迅速な定量化の方法
JPH09187270A (ja) * 1996-01-11 1997-07-22 Nishi Nippon Shinku Tank Kk 細菌類の分析方法および同分析装置
JP2003116593A (ja) * 2001-10-17 2003-04-22 Hakuju Inst For Health Science Co Ltd 微生物の判定方法およびその装置
JP2011103786A (ja) * 2009-11-13 2011-06-02 Hitachi High-Technologies Corp 細菌コロニー釣菌装置及びその方法
WO2011115218A1 (fr) * 2010-03-17 2011-09-22 株式会社エルメックス Procédé d'essai bactériologique au moyen d'un milieu de culture de type film, et outil de capture d'images utilisé lors de ce procédé d'essai bactériologique
JP2011229413A (ja) * 2010-04-23 2011-11-17 Nagoya Univ 細胞評価装置、インキュベータ、プログラム、および、培養方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11010590B2 (en) 2017-09-25 2021-05-18 Olympus Corporation Image processing device, cell-cluster recognition apparatus, cell-cluster recognition method, and cell-cluster recognition program for binarizing and segmenting smoothed cell image in which gap between cells in each cell cluster is filled in

Also Published As

Publication number Publication date
JPWO2014171382A1 (ja) 2017-02-23
JP6337885B2 (ja) 2018-06-06

Similar Documents

Publication Publication Date Title
JP5998744B2 (ja) コロニー検出装置、培地情報登録システム、衛生管理システム、及びプログラム
JP5522333B1 (ja) 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム
JP5850205B2 (ja) 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム
JP5971391B2 (ja) 衛生管理システム、プログラム及びフィルム型培地
JP5910417B2 (ja) 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム
JP5928586B2 (ja) 培地情報登録システム、通信端末装置、プログラム、衛生管理システム及びフィルム型培地
JP2017035042A (ja) コロニー検出システム、コロニー検出方法、及び、プログラム
JP2014140335A (ja) 培地画像解析装置、培地情報登録システム、プログラム及び衛生管理システム
JP5962330B2 (ja) コロニー検出装置、培地情報登録システム、衛生管理システム、及びプログラム
JP6471689B2 (ja) コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム
JP6337885B2 (ja) コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム
JP6135268B2 (ja) コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム
JP2014135949A (ja) 培地情報登録システム、培地画像解析装置、プログラム及び衛生管理システム
JP6277718B2 (ja) 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム
JP2014135948A (ja) 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム
JP6036201B2 (ja) 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム
JP6291717B2 (ja) コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム
JP5880715B2 (ja) 培地情報登録システム、衛生管理システム、及び、プログラム
JP2017201992A (ja) 培地情報登録システム、コロニー検出装置、衛生管理システム、プログラム、及び、フィルム型培地
JP6286999B2 (ja) 培地情報登録システム、コロニー検出装置、衛生管理システム、及び、プログラム
JP6287000B2 (ja) 培地情報登録システム、コロニー検出装置、衛生管理システム、及び、プログラム
JP6287140B2 (ja) 培地情報登録システム、コロニー検出装置、衛生管理システム、プログラム、及び、フィルム型培地
JP5605529B1 (ja) 培地検査装置、培地情報登録システム、衛生管理システム、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14784807

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2015512458

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14784807

Country of ref document: EP

Kind code of ref document: A1