JPWO2015080001A1 - Medium information registration system, colony detection device, program and hygiene management system - Google Patents

Abstract

Even if the culture medium has changed from its original color due to the mixing of color components (residues) derived from specimens such as food, colony detection and colony counting can be performed accurately and accurately detected. A medium information registration system and the like capable of registering medium information including information on colonies and the number thereof in a database. The medium information registration system calculates a statistical standard based on the color feature amount of a plurality of pixels constituting the medium image of the medium image data obtained by imaging the film type medium on which the colony is formed, and the predetermined condition The pixel having the above is specified as a pixel constituting the colony, and the colony is detected and counted.

Description

  The present invention relates to a culture medium information registration system and its program, a colony detection device and its program, and a food hygiene management system.

  In recent years, due to the growth of fast food and other food service industries and the increase in easy processed foods, the opportunity to eat food prepared by others has increased remarkably. On the other hand, when foods such as processed foods and processed foods are mixed with dangerous substances such as poisons or microorganisms, it directly affects the human body. When handling processed foods, not only the safety of raw materials but also the production There is a need for food safety that strictly controls the hygiene of the process and covers the entire production and processing of food.

  In particular, food poisoning incidents that have occurred in various places are the starting point, and it is a proposition to further improve the safety of foods. In addition to complying with the Food Sanitation Law, “HACCP (Hazard Analysis Critical Control) An increasing number of companies have introduced “Point System” and “FSSC (Food Safety System Certification 22000)”.

  As a system for detecting microorganisms mixed in such processed foods, a film-type medium is used, a specimen cultured in the film-type medium is imaged, and image processing is performed on the imaged medium image. Detection of colonies that are bacterial clumps generated in a specimen and counting them are known (for example, Patent Document 1 or 2). In addition, recently, a colony detection device that recognizes a change in the state of a colony while changing the threshold value stepwise and counts the number of colonies based on the recognized change in the state of the colony is also known ( For example, Patent Document 3).

JP 2011-2112013 A JP 2012-135240 A JP 2012-75409 A

  However, in the system described in Patent Document 3 described above, since the colony is detected mainly in the dark portion, the culture medium is colored due to the mixture of color components (residues) derived from a sample such as food. In such a case, the accuracy of the colony count may be reduced due to the influence of residues when image processing is performed.

  The present invention has been made in order to solve the above-described problems, and the purpose of the present invention is to provide a colony even if the medium is changed from the original color due to mixing of color components (residues) derived from a sample such as food. And a medium information registration system capable of registering medium information including information on accurately detected colonies and the number thereof in a database, and the like. There is.

  In order to solve the above-described problems, the culture medium information registration system and the like according to the present invention have acquired an acquisition unit that acquires data of a culture medium image obtained by imaging a culture medium in which colonies are formed as culture medium image data. Extracting means for extracting color feature amounts of a plurality of pixels constituting the medium image of the medium image data, calculation means for calculating a statistical reference based on the extracted color feature amounts of the plurality of pixels, and the calculated statistics A pixel having a predetermined condition is identified as a colony pixel on the basis of a general criterion, and detection means for detecting the colony based on the identified colony pixel; and information on the detected colony in the database as information on the culture medium And a registration means for registration.

  The culture medium information registration system according to the present invention accurately executes colony detection and colony counting even if the culture medium is changed from the original color due to mixing of color components (residues) derived from a sample such as food. In addition, the culture medium information including information on the accurately detected colonies and the number thereof can be registered in the database.

It is a lineblock diagram showing the composition of one embodiment of the hygiene management system concerning the present invention. It is an example of the film type culture medium used for the sanitary management system of one Embodiment. It is an example of the work instruction used for the sanitary management system of one embodiment. It is a block diagram which shows the structure of the portable communication terminal device used for the sanitary management system of one Embodiment. It is a block diagram which shows the structure of the server apparatus used for the sanitary management system of one Embodiment. In one embodiment, (A) an image of a film-type medium without residue, and (B) an example of a diagram in which all pixels constituting the image are distributed with R and B gradation values. In one embodiment, (A) an image of a film-type medium in which a mango juice specimen is dropped, and (B) an example of a diagram in which all pixels constituting the image are distributed with R and B tone values. . In one embodiment, an example of a diagram in which (A) an image of a film-type medium in which a green tea sample is dropped, and (B) all pixels constituting the image are distributed with gradation values of R and B is shown. In one embodiment, (A) an image of a film-type medium in which a chocolate specimen is dropped, and (B) an example of a diagram in which all pixels constituting the image are distributed with gradation values of R and B are shown. In one embodiment, (A) an image of a film-type medium without residue, (B) a diagram in which all the pixels constituting the image are distributed with R and B gradation values, and (C) (B). An example of a background color model that is modeled by applying the distribution map in FIG. In one embodiment, (A) an image of a film-type medium in which a chocolate specimen is dropped, (B) a diagram in which all pixels constituting the image are distributed with gradation values of R and B, and (C) An example of a background color model modeled by applying the distribution diagram of (B) with the definition of normal distribution is shown. In one embodiment, (A) an image of a film-type medium in which colonies are formed by dropping a chocolate specimen and culturing, (B) a color feature amount of pixels constituting the color of the film-type medium containing the residue An example of a background color model that is modeled by applying the variation in the normal distribution and (C) a pixel that is out of the model range is identified as a colony pixel. It is a flowchart which shows the operation | movement of the registration process of the culture medium information in the portable communication terminal device of one Embodiment. It is a flowchart which shows the operation | movement of the registration process of the culture medium information in the server apparatus of one Embodiment. It is a flowchart which shows the operation | movement of the colony detection determination process in the server apparatus of one Embodiment.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In the following embodiment, the medium information registration system and the program thereof according to the present invention for a hygiene management system using a film-type medium in a food production line or an inspection line (hereinafter referred to as “work line”). , A colony detection device and its program, and an embodiment in the case of applying a hygiene management system. However, the present invention is not limited to the following embodiments within the scope including the technical idea.

[1] Hygiene management system First, the hygiene management system S of this embodiment will be described with reference to FIG. In addition, FIG. 1 is a block diagram which shows the structure of the sanitary management system S of this embodiment.

  The sanitary management system S of the present embodiment uses a film-type culture medium (that is, a film-type culture medium) and performs data management on information on the culture medium (hereinafter referred to as “medium information”), thereby producing food. Or it is a system for inspecting the sanitary condition on inspection.

  In particular, the sanitary management system S of the present embodiment extracts a processed or processed food as a specimen in a work line 80 having a manufacturing process for manufacturing a processed or processed food or an inspection process for inspecting the food. In addition, this is a system for managing data on the culture state when a preliminarily specified bacterium such as general viable bacteria or coliform bacteria contained in the specimen is cultured in the film-type medium 60.

  The hygiene management system S of the present embodiment manages and determines the sanitary state of food on the data, information relating to work in food production or inspection (hereinafter referred to as “work information”), and the extracted sample. The server device 40 (specifically, the database 400) is associated with the culture medium information of the film-type culture medium 60 acquired by the portable communication terminal device 10 before and after culturing bacteria contained in the colony (formation of colonies). ) Can be registered.

  Specifically, the hygiene management system S of the present embodiment includes a plurality of medium images constituting medium image data (hereinafter referred to as “medium image data”) obtained by imaging the film-type medium 60 on which colonies are formed. A statistical standard is calculated based on the color feature amount of the pixel, and a pixel having a predetermined condition based on the statistical standard is specified as a pixel constituting the colony (hereinafter referred to as “colony pixel”). The colony is detected and counted.

  In order to realize such a configuration, the sanitary management system S of the present embodiment, as shown in FIG. 1, includes a plurality of portable communication terminal devices 10 used when registering culture medium information regarding each film-type culture medium 60. In addition, the administrator terminal device 20 that manages the sanitary management system S, the network 30, and the database 400, and in conjunction with the portable communication terminal device 10 or the administrator terminal device 20, registration management of medium information is performed. And a server device 40 that executes various types of processing.

  The work information of this embodiment includes, in addition to various information related to the manufacturing process or the inspection process, information regarding the culture of the foods extracted from the manufacturing process or the inspection process as the specimen and the bacteria contained in the specimen. In addition, it is registered in the database 400 using unique identification information (hereinafter referred to as “work ID”).

Specifically, each work information includes
(1) Work ID,
(2) Identification information (hereinafter referred to as “line ID”) of the work line 80 from which the sample is to be extracted or, if the work line 80 has a plurality of processes, the line ID and process identification information (hereinafter referred to as “line ID”). , "Process ID"),
(3) Product name of food as a sample, identification information of lot (hereinafter referred to as “lot ID”), lot name,
(4) the type of bacteria to be detected from the specimen, such as general live bacteria or coliform bacteria (hereinafter referred to as “test type”);
(5) Culture conditions of the sample, such as the type of medium, the type of diluent for the sample, the dilution rate, the culture temperature, the culture humidity, and the culture time;
(6) Specimen culture start time;
(7) a time after a predetermined time has elapsed since the start of culture of the specimen (hereinafter also referred to as “culture test time”);
(8) Sample culture location such as incubator number and position within the incubator, and (9) work date and time indicating work start time and end time;
(10) Worker ID (employee ID) and worker name;
Is included. Each piece of work information is registered in the database 400 for each type and for each work.

  The portable communication terminal device 10 is, for example, a digital camera having a communication function, a tablet-type information terminal device, a smartphone or a portable telephone, or the like, or an imaging function such as a still image or a recording function (hereinafter simply referred to as “camera function”). And a communication terminal device portable by an operator.

  In particular, the portable communication terminal device 10 generates an image data (hereinafter referred to as “medium image data”) by imaging the film-type culture medium 60 by the camera function, and also images the work instruction sheet 70 and displays the instruction sheet. It has a configuration capable of generating an image.

  Then, the portable communication terminal device 10 determines the work ID and the medium identification information (hereinafter referred to as “instruction image data”) from the imaged instruction image data (hereinafter referred to as “instruction sheet image data”) and the medium image data of the film type culture medium 60. And the obtained work ID and medium ID, medium image data, and metadata of the medium image data are registered in the database 400 of the server device 40 as medium information. It has a possible configuration.

  On the other hand, when the portable communication terminal device 10 transmits the culture medium information to the server device 40, BLUETOOTH (registered trademark), wireless LAN (WLAN: Wireless Local Area Network), or wireless PAN (WPAN: Wireless Personal Area Network). The data is transmitted to the server device 40 directly or via the access point 50 using a communication standard for short-range wireless communication or the like, or is transmitted to the server device 40 using a public telephone line network via a mobile base station (not shown). It has a configuration.

  The portable communication terminal device 10 has a browser function constructed by a markup language such as XML (extensible Markup Language), and executes an operation input instruction and an operation confirmation by the operator using the browser function. The culture medium information is transmitted to the server device 40 via the browser function.

  The administrator terminal device 20 is an information communication terminal device such as a tablet information terminal device, a smartphone, a personal computer, or a workstation. The administrator terminal device 20 manages the administrator identification information (hereinafter referred to as “manager ID”), the administrator password, and the worker identification information (hereinafter referred to as “worker ID”). It functions as a control device capable of performing management of access authority to the server device 40, management of the terminal ID of the portable communication terminal device 10, correction of registered medium information, and other management.

  Similarly to the portable communication terminal device 10, the administrator terminal device 20 has a browser function constructed by a markup language, and uses the browser function to exchange data with the server device 40 and to generate a report. It has a configuration capable of executing browsing and the like.

  Note that the administrator terminal device 20 determines the culture medium information when each operation is interrupted due to a failure of a machine that performs the process or the like in the same lot, or when an error in registration of culture medium information occurs in the operator. It has a configuration that can correct other information.

  The network 30 includes, for example, a public telephone line network (hereinafter referred to as “long-distance communication network”) including a mobile phone network, an IP (Internet Protocol) network such as a short-distance wireless network, or both of which are interconnected. Has been. However, the configuration of the network 30 is not limited to this.

  The server device 40 is a server device used in conjunction with the portable communication terminal device 10 or the administrator terminal device 20 to execute each data process for hygiene management of the lot and work line 80.

  Then, the server device 40 is linked with the portable communication terminal device 10, registers the culture medium information in each film-type medium 60 before the start of culture (hereinafter referred to as “initial registration”), and starts the culture in the database 400. While performing subsequent registration (hereinafter referred to as “post-cultivation registration”), the medium information transmitted from the portable communication terminal device 10 is acquired, and the image of the medium formed by the medium image data of the acquired medium information (Hereinafter referred to as “medium image”) to detect colonies formed by culturing the specimen.

Specifically, the server device 40
(1) Obtain image data of the film-type medium 60 in which colonies are formed from the portable communication terminal device 10,
(2) Extracting color feature values of a plurality of pixels constituting the medium image of the acquired medium image data,
(3) calculating a statistical standard based on the color feature values of the extracted pixels;
(4) Based on the calculated statistical criteria, identify a pixel having a predetermined condition as a colony pixel,
(5) Execute colony detection and count of the number of colonies based on the identified colony pixel,
(6) It has the structure which registers the information regarding the said colony containing the detected colony and the number in the database as culture-medium information.

It should be noted that the number of pixels from which color feature values are extracted in (2) is the number of pixels in which the average value of the color feature values of a plurality of pixels constitutes the color of a medium containing color components (residues) derived from a sample such as food If it is included in the range of the actual color feature amount, there is no particular limitation.
In other words, the number of pixels constituting the medium image other than the colony pixels usually occupies most (for example, about 90% or more) of all the pixels constituting the medium image. The number of pixels to be extracted may be, for example, 50% or more with respect to the total number of pixels constituting the medium image, and the colony pixel can be accurately specified in (4).

In addition, when the ratio of the number of colony pixels to the total number of pixels constituting the medium image can be determined in advance by empirical rules or machine learning described later, the number of pixels from which the color feature amount is extracted in (2) The ratio of the number of colony pixels to the total number of pixels constituting the medium image may be 10 times or more with respect to the total number of pixels constituting the medium image, and the colony pixel can be specified more accurately in (4).
For example, if the ratio of the number of colony pixels to the total number of pixels constituting the medium image is 5%, the number of pixels from which the color feature amount is extracted in (2) is the number of all pixels constituting the medium image. It may be 50% or more.
In some of the following embodiments, all the pixels constituting the medium image are used as pixels for extracting color feature values in (2) so that colony pixels can be accurately identified.

  The statistical standard of (3) may be, for example, an average value or a deviation value of the color feature amounts of a plurality of extracted pixels, or the number of pixels having the same color feature amount in the plurality of extracted pixels may be The maximum value may be used. In addition, the distance from the average value may be used.

  With such a configuration, in the sanitary management system S of the present embodiment, a statistical reference is calculated based on the color feature amounts of a plurality of pixels constituting the medium image of the medium image data, and is derived from a sample such as food. It is possible to grasp the variation in the color feature amount of the pixels constituting the color of the medium including the color component (residue).

  That is, in the sanitary management system S of the present embodiment, a statistical standard is calculated, and a variation in the color feature amount of pixels constituting the color of the culture medium is grasped, whereby the background color of the culture medium image including the residue (the original culture medium). The ideal distribution range of the color of the image) can be modeled based on a probability distribution such as a normal distribution, and the ideal distribution of the background color of a pixel image having a predetermined condition, for example, a medium image including residues Pixels existing outside the range can be specified as colony pixels.

  Since many pixels of the image of the film-type medium 60 including colonies are pixels of the medium (that is, pixels constituting the background color), an ideal distribution range of the background color (hereinafter referred to as “background color model”). When calculating colonies, the influence of the number of pixels (ie, the number of colony pixels) is very small in modeling, and the entire medium image including colonies is calculated. Even a model using the can be used for colony detection.

  Therefore, in the sanitary management system S of the present embodiment, the influence of the residue can be ignored even if the medium is changed from the original color due to the mixture of the color component (residue) derived from the sample such as food. Since the colony pixel can be specified, the colony can be detected based on the specified colony pixel.

  As a result, in the sanitary management system S of the present embodiment, even when the culture medium is changed from the original color due to mixing of color components (residues) derived from a sample such as food, colony detection and counting are accurately performed. In addition, it is possible to register medium information including information on accurately detected colonies and the number thereof in a database.

  Further, in the sanitary management system S of the present embodiment, it is possible to save resources as compared with the case where various data analyzes and provisions are performed using physical resources such as paper media, and the culture medium. By registering the culture medium information in the database 400, registration errors can be remarkably reduced and management of difficult culture media can be facilitated, so that resource saving can be achieved without wasteful consumption of culture media. ing.

[2] Film Type Medium Next, the film type medium 60 of the present embodiment will be described with reference to FIG. FIG. 2 is an example of a film-type medium 60 used in this embodiment.

  The film-type medium 60 used in the present embodiment is a medium for culturing bacteria contained in food as a specimen detected from each step of the work line 80 using a film or sheet-like dry medium. The film-type medium 60 is, for example, a medium for culturing general live bacteria, coliform bacteria, Staphylococcus aureus, and the like. In addition, it may be a medium for culturing various microorganisms such as mold, yeast, Listeria monocytogenes, aquatic bacteria, and lactic acid bacteria.

  The film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “circular frame”) 62, a culture layer 63 for culturing bacteria provided in the frame, a cover sheet 64 covering the culture layer 63, and the right side of the base sheet 61. Medium ID66.

  For example, the culture medium ID 66 is formed of a barcode such as a two-dimensional barcode or alphanumeric characters, and is imaged together when the film-type culture medium 60 is imaged, such as a barcode recognition function or an OCR (Optical Character Recognition) function. It is acquired in the portable communication terminal device 10 or the server device 40 using the image analysis function.

  The base material sheet 61 is not particularly limited as long as it is a film-like or sheet-like base material, and for example, a plastic film or paper can be used. Preferred examples of plastic films include resin films such as polyethylene, polypropylene, polyethylene terephthalate, polyethylene naphthalate, polymethacrylate, polymethyl methacrylate, polymethyl acrylate, polyester, and polycarbonate. Preferred examples include polyethylene terephthalate and polypropylene synthetic paper. Note that the polypropylene-based synthetic paper is a film synthetic paper whose main raw material is polypropylene.

  The film-type medium 60 has an IC tag in which the medium ID 66 is stored, and the medium ID 66 is connected to the portable communication terminal device 10 by a short-range wireless communication interface (for example, an IC tag reader) included in the portable communication terminal device 10. May be acquired.

[3] Work instruction sheet Next, the work instruction sheet 70 of this embodiment will be described with reference to FIG. FIG. 3 is an example of a work instruction sheet 70 used in the present embodiment.

  The work instruction sheet 70 of the present embodiment includes, for each food group manufactured or inspected under the same conditions, that is, for each lot, work names and contents of one or more manufacturing processes or inspection processes, and work lines 80 to be used. It is an instruction document that describes the name of the food (processed food) to be manufactured or inspected, the quantity, and other information.

  Further, the work instruction sheet 70 of the present embodiment has an instruction sheet ID 71a formed by printing or other methods on the upper right and a plurality of process IDs 71b formed by printing or other methods on a predetermined area. . The instruction sheet ID 71a and each process ID 71b are used as the work ID 71, and are formed of, for example, a barcode such as a two-dimensional barcode or alphanumeric characters. The instruction ID 71a and each process ID 71b are imaged in the same manner as the film-type medium 60 when the registration of the film-type medium 60 is executed, and analyzed by the portable communication terminal device 10 or the server device 40. Be recognized.

  The work instruction sheet 70 has an IC tag in which the work ID 71 of the instruction sheet ID 71a or the process ID 71b is stored, like the film type culture medium 60, and has an interface (short distance) that the portable communication terminal device 10 such as a tag reader has. The portable communication terminal apparatus 10 may acquire the work ID 71 through a wireless communication interface. In the following description, unless otherwise specified, the work ID 71 indicates an instruction ID 71a or a process ID 71b.

[4] Portable Communication Terminal Device Next, the configuration of the portable communication terminal device 10 of the present embodiment will be described using FIG. FIG. 4 is a block diagram showing the configuration of the portable communication terminal device 10 of the present embodiment.

  The portable communication terminal device 10 of the present embodiment has a data storage unit 100 having a memory function used when various programs are executed, an imaging function, image data of the film-type medium 60, and other image data. In addition to the image data generation unit 110 that generates the media information, the media information is registered in the server device 40 after the initial registration and the post-cultivation registration immediately after the culture in conjunction with the server device 40 (hereinafter referred to as “medium information registration processing”). And an application control unit 120 that executes processing.

  The portable communication terminal device 10 includes a network communication unit 130 that communicates with the server device 40 and other communication devices, a short-range wireless communication interface 140 that exchanges data with an IC tag and other communication interfaces, Controls the current position detection unit 150 that detects the current position, the display unit 160, the display control unit 161 that controls the display unit 160, the operation unit 170 for inputting user operations, the timer 180, and the entire apparatus. A portable terminal management control unit 190.

  And the portable communication terminal device 10 has various necessary members such as a microphone, a speaker, and an e-mail transmission / reception function when having a mail function such as a telephone function and e-mail. Further, the above-described units are connected to each other by a bus 11 to exchange data.

  The data storage unit 100 includes an application storage unit 101 that stores various application programs, an image data storage unit 102 that stores image data captured and generated by the image data generation unit 110, and a portable communication terminal device 10 and management / control programs, and a ROM / RAM 103 that is used as a work area during execution of each program and stores data used in each process executed by the portable communication terminal device 10. doing.

  In particular, the application storage unit 101 includes an application program (hereinafter referred to as “application”) that is executed by the application control unit 120 in conjunction with the image data generation unit 110, the operation unit 170, the display control unit 161, and the image data storage unit 102. Is recorded). The application storage unit 101 also stores a browser program for realizing the above browsing function.

  In the image data storage unit 102, the imaged medium image data and instruction sheet image data, the image ID for managing each image data, various metadata corresponding to each image data such as the imaging time, and the work ID 71 The medium ID 66 and various flag information are stored in association with each other. The image ID is arbitrary identification information that is appropriately given in each portable communication terminal device 10.

  The image data generation unit 110 includes an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and image data based on the electrical signal generated by the CCDI sensor. And a generating unit that generates

  In particular, when the work instruction sheet 70 is imaged, the image data generation unit 110 converts the imaged work instruction sheet 70 into an image and generates instruction sheet image data. In addition, when the bacteria included in the specimen are cultured or when the film type culture medium 60 that has been cultured is imaged, the image data generation unit 110 images the film type culture medium 60 that has been imaged. 60 pieces of medium image data are generated as medium image data.

  The application control part 120 implement | achieves culture-medium information registration process with a predetermined application. In particular, the application control unit 120 executes the network communication unit 130 and the display control unit 161 while executing various control programs for controlling each unit of the portable communication terminal device 10 using the culture medium registration application stored in the application storage unit 101. In addition, various processes are executed in conjunction with or controlled by the operation unit 170.

  Specifically, the application control unit 120 executes the medium registration application recorded in the application storage unit 101, controls the image data generation unit 110, acquires the medium image data of the film-type medium 60 captured. The image data is stored in the image data storage unit 102.

  Then, the application control unit 120 acquires the culture medium ID 66 from the imaged culture medium image data, and stores the culture medium image data, the metadata of the culture medium image data, and various flag information together with the acquired culture medium ID 66. Store in the unit 102. Note that the application control unit 120 may execute barcode recognition or OCR recognition in conjunction with another communication device or the database 400 via a communication line.

  In addition, the application control unit 120 performs initial registration for registering the culture medium information in the server device 40 at the start of the culture of the specimen after imaging of the culture medium image data or at a predetermined timing, and registers the culture medium information after the start of the culture of the specimen. Perform registration after incubation. In particular, the application control unit 120 identifies whether the registration is initial registration or post-cultivation registration based on the operator's instruction, and includes information (flag information) indicating either registration in the culture medium information in the server device 40. Send.

  The application control unit 120 acquires the current time from the timer 180 when the film-type medium 60 is imaged, and the image data storage unit as the metadata of the medium image data together with a predetermined image ID using the current time as the imaging time. 102. When the medium image data is transmitted to the server device 40, it is transmitted together.

  In addition, the application control unit 120, when the culture medium ID 66 and the work ID 71 that is the instruction ID 71a and the process ID 71b are stored in the IC tag, the operation unit 170, the display control unit 161, and the short-range wireless communication interface The medium ID 66 and the work ID 71 are acquired in conjunction with 140.

  When the server device 40 recognizes the medium ID 66 and the work ID 71 from the medium image data and the instruction sheet image data, the application control unit 120 transmits instruction sheet image data in addition to the medium image data as the medium information.

  Furthermore, the application control unit 120 may be realized as a function when the CPU (central processing unit) constituting the mobile terminal management control unit 190 executes the application in terms of implementation.

  The network communication unit 130 establishes a communication line with the server device 40 connected to the network 30 under the control of the application control unit 120 and the mobile terminal management control unit 190, and exchanges various data such as culture medium image data. Do.

  The short-range wireless communication interface 140 performs short-range wireless communication using an IC tag under the control of the application control unit 120 and the mobile terminal management control unit 190.

  The current position detection unit 150 recognizes the position of a GPS (Global Positioning System) satellite via the network 30 under the control of the application control unit 120 or the mobile terminal management control unit 190, and transmits a satellite transmitted from the GPS satellite. A signal (GPS signal) is detected.

  Then, the current position detection unit 150 calculates (that is, detects) coordinate values indicated by the latitude and longitude of the current position of the portable communication terminal device 10 based on the detected GPS signal. In addition, the current position detection unit 150 provides the calculated coordinate value to the application control unit 120 as position information.

  In addition, when the portable communication terminal device 10 has a telephone function or a short-range wireless function, the portable communication terminal device 10 is based on the direction and the radio field intensity received by the telephone base station or the like for the radio wave used for the telephone or the short-range radio. The current position of the portable communication terminal device 10 may be calculated (detected).

  The display unit 160 has an image display area of a predetermined size (for example, 5 inches, W480 × H960 pixels), is configured by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 161. A predetermined image is displayed based on the display data. In particular, in the present embodiment, when the culture medium registration application is being executed, the display unit 160 is linked to the operation unit 170, and various displays, captured work instructions 70 and film-type culture media that have been imaged. 60 is displayed.

  The display control unit 161 generates display data necessary to display a predetermined image on the display unit 160 under the control of the application control unit 120 or the mobile terminal management control unit 190, and the generated display data is displayed on the display unit 160 160 is output.

  The operation unit 170 includes various confirmation buttons, operation buttons for inputting operation commands, a number of keys such as a numeric keypad, and a touch sensor provided on the display unit 160, and is used when performing each operation. It has become. Specifically, the operation unit 170 is used when performing operations for executing the various processes described above when the culture medium registration application is activated.

  In the present embodiment, the operation unit 170 can also be used when manually inputting the culture medium ID 66 directly.

  The timer 180 provides the application control unit 120 with the date and time when the image data generation unit 110 images the film type culture medium 60.

  The portable terminal management control unit 190 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and the overall functions of the portable communication terminal device 10. In addition, overall functions for executing the information providing program are generally controlled.

[5] Server Device [5.1] Configuration of Server Device Next, the configuration of the server device 40 of this embodiment will be described with reference to FIG. FIG. 5 is a configuration diagram showing the configuration of the server device 40 of the present embodiment.

  As shown in FIG. 5, the server device 40 of the present embodiment communicates with a database 400 in which various information such as work information and culture medium information is stored, and the portable communication terminal device 10 and the administrator terminal device 20. A communication control unit 410, a data processing unit 420 that executes various processes such as a culture medium information registration process, a server management control unit 430 that controls each unit of the server device 40, a ROM / RAM 440 that is used to control each unit, and a time And a timer 450 used for management. The above-described units are connected to each other by a bus 41, and data transfer is performed between the components.

  The communication control unit 410 is a predetermined network interface, establishes a communication line with the portable communication terminal device 10 or the administrator terminal device 20, and exchanges various data with the portable communication terminal device 10 or the administrator terminal device 20. I do.

  The database 400 includes an HDD or an SSD, and includes a medium information database (hereinafter abbreviated as “medium information DB”) 401, a line information database (hereinafter abbreviated as “line information DB”) 402, and a lot information database (hereinafter referred to as “line information DB”). , “Lot information DB”) 403 and a work management database (hereinafter abbreviated as “work management DB”) 404. For example, each DB of the present embodiment constitutes a database according to the present invention.

The medium information DB 401 is a database in which medium information regarding the film-type medium 60 of the sample extracted for each process of each work line 80 is stored for each work ID 71 and medium ID 66. For example, in the culture medium information DB 401,
(1) Medium ID
(2) Imaged medium image data (3) Image capture time (4) Other information including flag information (5) Identifier of each pixel in medium image (hereinafter referred to as “pixel ID”)
(6) Position information (XY coordinate value) in the image of each pixel ID
(7) Color feature amount data (for example, RGB gradation values) of each pixel (8) The probability of becoming the color feature amount of each pixel in the probability distribution function of the color feature amount of the pixels constituting the medium image Response value f (xi) data (9) Result of medium determination for determining whether film-type medium 60 (ie, specimen) is normal or abnormal based on the number of colonies (10) Work ID
Are recorded in association with each other.

  When the sample to be extracted is always extracted from the same process on the same work line 80 in the same lot, the work ID may be a lot ID, and the sample to be extracted is the same lot. However, when extracting from a different work line 80 or a different process, the line ID or the process ID 71b is obtained.

  The number of colonies and the result of medium determination in each medium information may be registered when the medium information is registered, or may be registered at a predetermined timing different from the registration timing of the medium information.

  Furthermore, when a plurality of imaging times of medium information of the same film type culture medium 60 are registered (that is, when there are a plurality of culture examination times described later), in the same culture medium ID 66, the culture medium at each culture examination time. Each medium information of an image, imaging time, the number of colonies, and medium determination is stored.

The line information DB 402 is a database in which line information regarding each work line 80 is stored for each line ID. For example, the line information DB 402 includes
(1) Line ID
(2) The process ID 71b of the process included in the work line 80 and the two types of data are recorded in association with each other. As the process type, a name for identifying each process such as material input, blending, filling, boiling, packaging, and packaging is used.

The lot information DB 403 is a database in which lot information regarding each lot is stored for each lot ID. For example, in the lot information DB 403,
(1) Lot ID (instruction ID 71a)
(2) Line ID of work line used for production or inspection of lots
(3) Lot work start time (4) Lot work end time (5) Five data of the work teams of the workers who perform the lot work are recorded in association with each other.

The work management DB 404 is a database that stores various types of information related to work contents. For example, the work management DB 404 includes
(1) Work ID
(2) Line ID (or line ID and process ID 71b) of the work line from which the sample is to be extracted (3) Type of sample (food) (product name, lot ID and / or lot name)
(4) Inspection type (general bacteria or bacterial species to be detected such as coliforms)
(5) Culture conditions (type of medium, type of specimen dilution, dilution rate, culture temperature, culture humidity and culture time)
(6) Culture start time (7) Time after a predetermined time has elapsed from the start of culture (hereinafter also referred to as “culture test time”)
(8) Culture location (for example, the position of the incubator number and the number of steps in the incubator)
(9) Work date and time (work start time and end time)
(10) Worker ID (and / or worker name)
Are recorded in association with each other.

  In addition, only a single time (that is, an end time for ending the culture of the specimen) may be set as the culture examination time, or after the statutory or predetermined time has elapsed from the culture start time, for example, the culture A plurality of times such as 24 hours from the start time, 48 hours, or 72 hours may be set.

The data processing unit 420 executes various data processing in accordance with the application recorded in the ROM / RAM 440. In particular, the data processing unit 420 executes a predetermined program,
(1) Operation management of the communication control unit 410;
(2) Medium information registration processing for acquiring various medium information in cooperation with each portable communication terminal device 10 and registering it in the database 400;
(3) A colony is detected from each medium image of each film type medium 60 during the medium information registration process or at a predetermined timing after the medium information registration process, the colonies are counted, and the medium is based on the number of colonies A colony detection determination process for executing the determination;
(4) lot determination processing for determining a lot based on registered medium information;
(5) Report processing for outputting the determination result in a report format;
(6) Management and control of the database 400;
I do.

  In particular, in the colony detection determination process, the data processing unit 420 calculates a statistical reference based on the color feature amounts of a plurality of pixels constituting the culture medium image of the culture medium image data, and determines a predetermined value based on the calculated statistical reference. A pixel having the above condition is specified as a colony pixel constituting an image of a colony, and the number of colonies is counted while detecting the colony based on the specified colony pixel.

  Specifically, the data processing unit 420 includes a registration processing unit 421 that executes a medium information registration process including management and control of the database 400, a colony detection determination unit 422 that executes a colony detection determination process, and a lot determination process. A lot determination processing unit 424 that executes and a report processing unit 425 that executes reporting processing.

  For example, the registration processing unit 421 of the present embodiment constitutes an acquisition unit and a registration unit according to the present invention, and the colony detection determination unit 422 of the present embodiment includes the extraction unit, the calculation unit, the specifying unit, and the present invention. The detection means is configured. Further, details of the registration processing unit 421, the colony detection determination unit 422, the lot determination processing unit 424, and the report processing unit 425 of this embodiment will be described later.

  The server management control unit 430 is mainly configured by a central processing unit (CPU), and integrally controls each unit of the server device 40 by executing a program. Specifically, the server management control unit 430 performs login processing for each user and various other controls based on a login request from the portable communication terminal device 10 by a user operation.

  Various programs necessary for driving the server device 40 are recorded in the ROM / RAM 440. In particular, in the ROM / RAM 440, information for defining the reference characteristics, medium determination (pass / fail determination) of each film type medium 60, determination criteria used when executing each determination of process determination, line determination, and lot determination. Each information such as information (hereinafter also referred to as “medium determination criterion information”) is stored. The ROM / RAM 440 is used as a work area during execution of each program.

  The timer 450 is used for managing the time required when the medium information registration process and the lot determination process are executed.

[5.2] Registration Processing Unit Next, details of the registration processing unit 421 in the server device 40 of the present embodiment will be described.

  The registration processing unit 421 according to the present embodiment performs a medium information registration process for registering each medium information in the medium information DB 401 while being associated with the work ID 71 in conjunction with the portable communication terminal device 10. In particular, the registration processing unit 421 executes different medium information registration processing based on flag information indicating whether the registration is initial registration or post-culture registration included in the culture medium information.

(Initial registration)
When the flag information indicating initial registration is included in the culture medium information transmitted from the portable communication terminal device 10, the registration processing unit 421 performs a culture medium information registration process based on the initial registration.

  Specifically, when the registration processing unit 421 acquires the culture medium information via the communication control unit 410, the registration processing unit 421 specifies the culture medium ID 66 and the work ID 71 included in the culture medium information. In addition, the registration processing unit 421 searches the work management DB 404 based on the specified work ID 71, specifies the corresponding work information, and associates the acquired medium image data and imaging time with the specified work information. Is registered in the culture medium information DB 401.

  In particular, the registration processing unit 421 specifies the lot ID including the work line 80 from which the sample is extracted based on the acquired work ID 71, the line ID of the work line 80, the process ID 71b from which the sample is extracted, and the specification. The medium image data and the imaging time included in the medium information are registered in the medium information DB 401 in association with the lot ID, the line ID, and the process ID 71b.

  Then, the registration processing unit 421 registers the imaging time in the culture medium information DB 401 as the culture start time. As the culture start time, a preset time may be used instead of the imaging time on the assumption that the medium information registration process is executed at the time.

(Registration after culture)
When the flag information indicating post-cultivation registration is included in the culture medium information transmitted from the portable communication terminal device 10, the registration processing unit 421 performs a registration process based on post-cultivation registration.

  Specifically, when acquiring the culture medium information via the communication control unit 410, the registration processing unit 421 identifies the culture medium ID 66 and the work ID 71 included in the culture medium information, as in the initial registration. Then, the registration processing unit 421 searches the work management DB 404 based on the identified work ID 71, identifies the corresponding work information, and registers the imaging time in the culture medium information DB 401 in association with the identified work information. To do. Note that the culture examination time may be a preset time instead of the imaging time on the assumption that the culture information registration process is executed at the same time as the culture start time.

  On the other hand, the registration processing unit 421 registers the acquired medium image data in the medium information DB 401 together with the analysis result or without analysis while causing the colony detection determination unit 422 to perform image analysis. The colony detection determination unit 422 performs colony detection, colony count, and medium determination by image analysis, and details of the image analysis will be described later.

[5.3] Colony Detection Determination Unit [5.3.1] Operation Principle of Colony Detection Determination Unit Next, the operation principle of the colony detection determination unit 422 in the server device 40 of the present embodiment will be described with reference to FIGS. Will be described.

  6 shows an example of (A) an image of a film-type medium without residue, and (B) an example of a diagram in which all pixels constituting the image are distributed with gradation values of R and B. FIG. 9 shows (A) an image of a dropped film type medium and (B) gradation values of R and B for all the pixels constituting the image for mango juice, matcha tea, and chocolate samples, respectively. An example of a diagram distributed in FIG.

  FIG. 10 shows (A) an image of a film-type medium without residue, (B) a diagram in which all pixels constituting the image are distributed with gradation values of R and B, and (C) (B FIG. 11 shows an example of a background color model that is modeled by applying the distribution map of () with the definition of normal distribution. FIG. 11 shows (A) an image of a film-type medium in which a chocolate sample is dropped, and (B) constitutes the image. An example of a background color model in which all pixels are respectively distributed with gradation values of R and B, and (C) and (B) are applied by the definition of normal distribution and modeled.

  Usually, colony detection and colony counting are performed by dropping a sample such as food on the film-type medium 60 and culturing. At this time, the culture medium may be colored by mixing color components (ie, residues) derived from a sample such as food. Therefore, the original color of the medium becomes unrecognizable, or the color of the medium itself becomes similar to or similar to the color of the colony to be detected, so that there is no difference in color features on the image with the colony. When performing the processing, the accuracy of the colony count may be reduced. Therefore, if the color of the residue can be specified in advance, colonies can be counted with high accuracy. However, the color of the residue varies depending on the specimen, and the color is very diverse. Therefore, it is almost impossible to specify in advance the color of the medium colored by the residue derived from each food.

  In addition, the color of the medium colored by the residue varies in density from place to place due to the influence of irregularities and bubbles on the surface of the medium. Therefore, if there is no information regarding the variation in the color feature quantity of the pixels constituting the color of the film-type medium containing the residue, it cannot be differentiated from the color feature quantity that becomes the residue, and as a result, the influence cannot be suppressed.

  On the other hand, for example, the image of the film-type medium 60 itself in FIG. 6 and the probability distribution of each pixel, and the medium image and the probability of each pixel when using mango, matcha, or chocolate shown in FIGS. Comparing with the distribution, it can be seen that in the medium image in the case where the residue is mixed, more pixels are distributed outside the range in which many pixels are distributed than the medium image in which the residue is not mixed.

  In addition, since the pixels constituting the background color occupy most of the pixels constituting the medium image, the characteristics of the variation in the color feature amount of each pixel are grasped, and the range in which many pixels are distributed belongs to the background color. If the distribution range of the pixel group constituting the background color can be specified and the specified range can be modeled as a background color model, pixels that do not belong to the background color model, that is, specification Pixels distributed outside the distribution range can be assumed to be colony pixels.

  Therefore, in the present embodiment, a statistical reference is calculated based on the color feature amounts of a plurality of pixels constituting the image of the film-type medium 60 including the residue, and the background color of the image of the film-type medium 60 including the residue is calculated. The ideal pixel distribution range is applied to the definition of a probability distribution such as a normal distribution and modeled as a background color model, and a pixel that does not belong to the modeled background color model as a pixel having a predetermined condition, that is, Pixels that exist outside the ideal distribution range of the background color are specified as colony pixels.

  For example, in this embodiment, there are two color feature amounts, and in the medium image in the film-type medium 60 without residue shown in FIG. All the pixels constituting the image are distributed as shown in FIG. 10B, and when the definition of the normal distribution is applied in the distribution, the distribution of each pixel is changed to the background color as shown in FIG. It can be modeled as a model.

  Further, in the present embodiment, similarly, in the case of two color feature amounts, in the medium image using the film type medium 60 with residue when the chocolate shown in FIG. FIG. 11C shows that all pixels constituting the medium image based on the gradation values of R and G are distributed as shown in FIG. 11B, and the definition of normal distribution is applied in the distribution. As shown in FIG. 5, the distribution of each pixel can be modeled as a background color model. Certainly, the medium changes from the original color due to the mixing of the residue compared to the medium image without residue, and the range of the background color model changes on the probability distribution, but in this embodiment, in that case Even so, the ideal distribution range of the background color can be modeled as a background color model.

  This is the same even when the RGB gradation values of a plurality of pixels vary, that is, when there are three color feature amounts.

  As described above, in this embodiment, assuming that each pixel has a predetermined probability distribution such as a normal distribution, the predetermined range in the probability distribution is a range to which a pixel having a color feature amount of the background color belongs. This range is modeled as a background color model.

  In this embodiment, pixels belonging to the background color model, that is, pixels belonging to the distribution range of the background color model specified as the background color, occupy a high ratio with respect to all the pixels constituting the medium image. The color feature amount of each pixel in the probability distribution function of the color feature amount of the pixels constituting the medium image becomes closer to the background color of the film-type medium 60, that is, closer to the center of the ideal distribution range of the background color. A value indicating the probability (that is, a response value f (xi) of a color feature amount of a pixel described later) becomes high. Therefore, a pixel having a small response value f (xi) (for example, a pixel having a response value equal to or smaller than a certain value) is a pixel having a color that is out of the ideal background color model distribution range of the background color of the medium image. As a result, it can be determined that the pixel is a colony pixel.

  Therefore, in the present embodiment, as described above, the ideal background color model of the background color of the medium image is modeled, and by specifying pixels whose predetermined response value has a predetermined condition, It is specified as a pixel of a color out of the distribution range of the background color model, specifically, a pixel having a response value equal to or less than a predetermined threshold is specified, and the specified pixel is specified as a colony pixel It has become.

  In the present embodiment, the threshold value of the response value for specifying the colony pixel is determined by an empirical rule.

  As described above, in the sanitary management system S of the present embodiment, even if the medium is changed from the original color due to the mixing of the color component (residue) derived from the sample such as food, the influence of the residue may be ignored. In addition, since the colony pixel can be specified, the colony can be detected based on the specified colony pixel.

  Therefore, in the sanitary management system S of the present embodiment, even when the culture medium is changed from the original color due to mixing of color components (residues) derived from a sample such as food, colony detection and counting are accurately performed. In addition, it is possible to register medium information including information on accurately detected colonies and the number thereof in a database. Details of each process of the colony detection determination unit 422 will be described below.

[5.3.2] Details of Each Process of Colony Detection Determination Unit Next, details of each process of the colony detection determination unit 422 in the server device 40 of the present embodiment will be described using FIG. FIG. 12 shows (A) an image of a film-type medium in which colonies are formed by dropping and culturing a chocolate specimen, and (B) color characteristics of pixels constituting the color of the film-type medium containing the residue. An example of a background color model that is modeled by applying the variation in the quantity with the definition of a normal distribution and (C) a pixel that is out of the model range is identified as a colony pixel.

  The colony detection determination unit 422 is controlled by the registration processing unit 421, and the medium image data included in the medium information transmitted from the portable communication terminal device 10 at the time of registration of the medium information in the medium information DB 401 or at a predetermined timing. Obtain media images from

The colony detection determination unit 422
(1) Color feature values of a plurality of pixels constituting the acquired culture medium image (feature values of one or more colors such as preset brightness value, brightness, saturation, sub-pixel (RGB) gradation value, etc.) ) And calculating a statistical reference based on the extracted color feature values of a plurality of pixels (hereinafter referred to as “statistical reference calculation process”),
(2) Based on the calculated statistical criteria, a process for specifying a pixel having a predetermined condition as a colony pixel (hereinafter referred to as a “colony pixel specifying process”), and
(3) A colony detection process for executing colony detection and counting based on the identified colony pixel is executed.

(Statistical standard calculation process)
The colony detection determination unit 422 identifies the region to be processed (the region of the culture layer 63) from the medium image based on the position of the medium ID 66 and the like, and determines the luminance value, brightness, saturation, sub, and the like for each pixel constituting the region. A preset color feature amount such as a gradation value of a pixel (RGB) is extracted. For example, when using RGB gradation values, the colony detection determination unit 422 extracts the RGB gradation values of a plurality of pixels constituting the culture medium image, and positions each pixel ID and the pixel ID in the image. RGB gradation value data is recorded in the culture medium information DB 401 in association with information (XY coordinate values predetermined on the image).

  Then, the colony detection determination unit 422 calculates a statistical reference based on the color feature values of the extracted pixels. For example, the colony detection determination unit 422 calculates an average value μ of RGB gradation values of a plurality of extracted pixels and a variance S.

  In addition, the average value of r, g, and b in (Expression 1) is calculated using (Expression 3) to (Expression 5), and each component of the matrix S in (Expression 2) is expressed by (Expression 6) to Calculation is performed using (Equation 11). However, “N” in (Expression 3) to (Expression 11) indicates the total number of pixels.

(Colony pixel identification process)
The colony detection determination unit 422 determines the range of the response value f (x) of the color feature amount that becomes the background color model by applying it to a probability distribution such as a normal distribution, and uses the statistical reference calculated by the statistical reference calculation process. On the basis of the response value f (xi) of each pixel, the pixel corresponding to the response value satisfying the predetermined condition, that is, the range of the response value f (x) of the color feature amount serving as the determined background color model A pixel having a response value that falls outside is identified as a colony pixel.

  The response value of the present embodiment indicates the probability of becoming the color feature amount of each pixel in the probability distribution function of the color feature amount of the pixels constituting the medium image. For example, the color feature amount of each pixel is normal. When the distribution is assumed, it can be expressed by (Equation 12).

  In addition, “xi” in (Expression 12) indicates an RGB gradation value of an arbitrary pixel, and is expressed by xi = [ri, gi, bi], and [i] in (Expression 1) is a medium. Indicates the pixel ID in the image, and “m” indicates the number of dimensions.

  Specifically, the colony detection determination unit 422, based on the average value μ and the variance S calculated as described above, the response value f () of the color feature amount of each pixel shown in (Equation 12). xi) is calculated and recorded in the culture medium information DB 401 in association with the pixel ID, position information in the image of the pixel ID, and RGB gradation value data.

  In addition, the colony detection determination unit 422 calculates the background color model by applying the RGB gradation value distribution of the extracted pixels to the model by applying the definition of the probability distribution such as the normal distribution, and the calculation is performed as described above. It is determined whether or not the response value belongs to the background color model. Specifically, the colony detection determination unit 422 assumes that the distribution of RGB gradation values of a plurality of extracted pixels is a normal distribution, and the response value calculated as described above is a threshold value determined by an empirical rule. Determine if greater than.

  Then, the colony detection determination unit 422 identifies, as colony pixels, pixels for which the response value f (xi) has a predetermined condition, for example, pixels for which the response value f (xi) is equal to or less than a threshold determined by an empirical rule. .

  For example, in the case where there are two color feature amounts, a probability distribution of gradation values of R and G of all pixels constituting the image of the film-type medium 60 in which the colonies shown in FIG. If it is determined, the colony detection determination unit 422 performs the above-described calculation to model the background color model by applying the normal distribution definition as shown in FIG. The range (threshold value) of the response values belonging to is determined. As shown in FIG. 12B, the darkness of the color (white in the drawing) in each color feature amount corresponds to the strength of the response value.

  Then, the colony detection determination unit 422 calculates the R and G response values f (xi) of each pixel and, as a result of the calculation, a pixel whose response value is equal to or less than a certain value (for example, 1 × 10−18), for example, A pixel having a color deviating from the ideal distribution range of the background color of the image [FIG. 12C] [portion surrounded by a broken line in FIG. 12C] is specified as a colony pixel.

(Colony detection process)
The colony detection determination unit 422 performs colony detection and count of the number of colonies based on the identified colony pixel with reference to the culture medium information DB 401 as a colony detection process. Specifically, the colony detection determination unit 422 executes colony detection and count of the number of colonies based on position information in the image of the pixel recorded in association with the identified colony pixel. Then, the colony detection determination unit 422 provides the registration processing unit 421 with various information such as position information and the number of colonies in the colony pixel image.

(Sample pass / fail judgment)
The colony detection determination unit 422 performs medium determination (that is, determination of pass / fail of the specimen) as to whether the specimen of each film type culture medium 60 is abnormal or normal. For example, the colony detection determination unit 422 determines pass / fail of each sample based on a preset number of bacteria (that is, determination criterion) based on the type of bacteria detected from the sample, and the result is a registration processing unit. 421.

  In particular, in this embodiment, since the determination criteria are different based on the type of bacteria and the dilution ratio of the specimen, the registration processing unit 421 uses the criteria for culturing the specimen and the medium judgment reference information based on the type of bacteria. Reading from the ROM / RAM 440 and performing medium determination.

  Each criterion information is specified in association with the culture medium ID 66. That is, since the type of the film-type medium 60 is different for each type of bacteria detected from the specimen, the type of bacteria to be detected can be specified by specifying the medium ID 66. Therefore, in this embodiment, the determination reference information specified based on the culture medium ID 66 can be read out by setting the dilution rate and the like in advance.

  Moreover, in this embodiment, since the pass / fail determination of each film type culture medium 60 is used in the process determination, the line determination, and the lot determination, the medium determination is executed in association with these determinations. In addition, the method of pass / fail determination of each film type culture medium 60 in process determination, line determination, and lot determination will be described later.

[5.4] Lot Determination Processing Unit Next, details of the lot determination processing unit 424 in the server device 40 of the present embodiment will be described.

  The lot determination processing unit 424 of the present embodiment analyzes data on hygiene management in the designated lot, work line 80 or process based on the instructions of the administrator input to the administrator terminal device 20 (ie, pass / fail determination). Execute.

  Specifically, the lot determination processing unit 424, for each lot, line information of the work line 80 used for the corresponding lot, and medium information registered in association with the corresponding work line 80 (at least the number of colonies). Based on the above, it is determined whether the food group manufactured or inspected under the same condition has a predetermined condition.

  In addition, when the lot determination is instructed, the lot determination processing unit 424 determines whether the work line 80 included in the corresponding lot and the processes belonging to the work line 80 are abnormal or normal in terms of hygiene management. 80 line determinations (that is, pass / fail determination for hygiene management) and process determinations for each process (that is, determination of pass / fail for hygiene management) are performed, and lot determination is performed using the process determination and line determination.

In particular, when the lot determination is instructed, the lot determination processing unit 424, for example, the number of colonies of the film-type medium 60 in the medium information that has passed a predetermined culture inspection time such as 24 hours or 48 hours from the start of culture, Based on the medium information of the pass / fail determination of the specimen, the pass / fail of hygienic management of the process is determined, and the pass / fail of hygienic management of the work line 80 is determined based on the pass / fail determination of the process included in the work line 80 Based on the pass / fail determination of the work line 80 included in the corresponding lot, the pass / fail in sanitary management of the lot is determined.
Note that the lot determination processing unit 424 of the present embodiment may execute not only lot determination but also process determination or line determination as data analysis.

(Process judgment)
The lot determination processing unit 424 has a culture start time at the same timing, a culture examination time at the same timing, a culture start time having a time within a preset time from the first time to the second time, or a preset first time. The culture start time or the culture test time has a predetermined condition, such as having a culture test time having a time within the time from the first time to the second time, and is registered in association with the same process in the same lot. Each process determination is performed based on the culture medium information of the plurality of film-type culture media 60 that has been performed. That is, the lot determination processing unit 424 executes each process determination by comprehensive determination based on each medium determination result of the plurality of film-type mediums 60.

  Specifically, the lot determination processing unit 424 displays the medium determination results of the corresponding film-type medium 60 (that is, all the medium determination results registered in the medium information having the process ID 71b of the process to be subjected to the process determination). In addition to obtaining, if the number of pass / fail of the judgment result satisfies a predetermined condition, the process judgment of the process to be judged is judged to be acceptable, and if not, the judgment should be made The process judgment of the process is judged as rejected.

  For example, the lot determination processing unit 424 determines that the conditions for all the film-type culture media 60 when the acceptable film-type culture media 60 are a predetermined ratio (60%) or more in the individual film-type culture media 60 in the corresponding process ( The number of colonies is equal to or less than a certain number), or the condition that the number of colonies of each film-type medium 60 corresponds (the average number of colonies of a single film-type medium 60 is equal to or less than a certain number). In this case, the corresponding process is determined to be acceptable.

  Note that the lot determination processing unit 424 of the present embodiment can change conditions depending on the type of specimen, the type of bacteria to be detected, etc., and can be set by an administrator or provided as part of a program Is done.

(Line judgment)
The lot determination processing unit 424 performs line determination for each work line 80 based on the pass / fail determination for hygiene management of a plurality of processes that are determined at a predetermined timing and registered in association with the corresponding line information. To do. That is, the lot determination processing unit 424 performs line determination by comprehensive determination based on the determination results of a plurality of processes of the same lot determined at a predetermined timing.

  Specifically, the lot determination processing unit 424 is determined at the same timing or a timing satisfying a predetermined condition, and has the line ID of the work line 80 to be subjected to line determination as described above. When the determination result of the determination is acquired and the number of pass / fail of the determination result satisfies a predetermined condition, the line determination of the work line 80 to be determined is determined to be acceptable, and the condition is not satisfied The line determination of the work line 80 to be determined is determined to be unacceptable.

  For example, a case is assumed in which three processes have the line ID of the work line 80 to be determined, and the predetermined condition is that the work line 80 is configured from a process that has passed “60%”. In this case, if the first step is “pass”, the second step is “pass”, and the third step is “fail”, the lot determination processing unit 424 determines that the line determination of the work line 80 to be determined is acceptable. To do.

(Lot judgment)
The lot determination processing unit 424 executes the lot determination for each lot based on the hygiene management pass / fail determination of the plurality of work lines 80 that are determined at a predetermined timing and registered in association with the corresponding lot information. To do. That is, the lot determination processing unit 424 executes lot determination by comprehensive determination based on the determination results of the plurality of work lines 80.

  Specifically, the lot determination processing unit 424 executes the lot determination based on the pass / fail determination in the work line 80 having the lot ID of the lot for which the lot determination is to be performed.

  For example, when 60% of the work lines 80 having lot IDs pass the lot judgment to be judged when the line judgment is passed, the three work lines 80 have lot IDs of the lots to be judged. Is assumed. In this case, if the first work line 80 is “pass”, the second work line 80 is “pass”, and the third work line 80 is “fail”, the lot determination processing unit 424 determines the lot to be determined. The lot judgment is accepted.

  When the lot work time is long, the lot determination may be executed by dividing the time every predetermined time (for example, 8 hours or 12 hours). In this case, when the lot determination is performed while the work is suspended, a dummy result may be used, or it may be determined that the work is being suspended.

(Other)
The lot determination processing unit 424 can perform determinations and data analysis other than those described above using the culture medium information, line information, lot information, and work management DB 404, and the determination result or data analysis via the report processing unit 425. The result can be provided to the administrator terminal device 20 so that the administrator can view the result.

  Specifically, the lot determination processing unit 424 checks the reliability of the sample cultured in each film-type medium 60, that is, checks whether or not an inspection error has occurred. The medium information in the medium ID is subjected to a predetermined analysis of the medium information or the medium image data in time series from the culture start time to the end of the culture.

  For example, the lot determination processing unit 424 has a specific culture medium ID (same culture medium ID) 66 based on an instruction from the administrator received via the administrator terminal device 20, and starts from the culture start time to a predetermined time. Are extracted together with the medium image data. Then, the lot determination processing unit 424 performs a predetermined analysis on each medium information and each image data along a predetermined time series, or aggregates each medium information and each image data along a time series. In addition, the lot determination processing unit 424 causes the report processing unit 425 to generate the analysis result or the aggregation result as browsing data having a predetermined data format, and allows the administrator to browse the generated browsing data. 20 to provide.

  Note that the lot determination processing unit 424 is linked to the report processing unit 425, and at this time, based on an instruction from the manager terminal device 20, each medium information in one medium ID 66 is used for legal hygiene management reporting. May be made individually viewable.

  Further, the lot determination processing unit 424 may have a search function for medium information, line information, lot information, or work management information. Specifically, the lot determination processing unit 424 uses the lot ID (instruction ID 71a), the work line ID, the process ID 71b, the work ID 71, the culture start time, the lot work date and time, the culture medium ID 66, the specimen type, and the like as search keys. The database 400 may be searched, and the report processing unit 425 may be linked to generate data that allows the administrator to view the corresponding medium information and various types of information.

  Note that the report processing unit 425 is configured to search for medium information (medium image data, number of colonies and medium determination result), process information, and line specified by a search based on an instruction from the administrator received via the administrator terminal device 20. It is also possible to provide information or information on lots in a predetermined report format. That is, the report processing unit 425 is configured to be able to provide various information as evidence or reports in legal inspection reports and other cases.

[5.5] Report Processing Unit Next, details of the report processing unit 425 in the server device 40 of the present embodiment will be described.

  The report processing unit 425 performs data analysis related to hygiene management in the designated lot, work line 80 or process based on the administrator's instruction input to the administrator terminal device 20 and template data having a predetermined report format. An analysis result (that is, a determination result of pass / fail determination) is generated as report data, and the generated report data is provided to the administrator terminal device 20 so as to be viewable by the administrator via the communication control unit 410.

  Specifically, the report processing unit 425 extracts necessary information from the medium information, the line information, and the lot information such as the medium image data, the number of colonies, or the medium determination result, and the extracted information and the lot determination processing unit 424. Based on the analysis result obtained by the above, report data is generated while assigning each information to the template data. Then, the report processing unit 425 provides the administrator terminal device 20 with report data including a culture image in which identity is ensured without performing processing such as rotation.

  Note that, as described above, the report processing unit 425 is configured to generate predetermined report data or browsing data in accordance with various analyzes or searches and provide the data to the administrator terminal device 20. . In other words, the report processing unit 425 can also provide medium information, process information, line information, or lot-related information specified by the search in a predetermined report format based on the received administrator's instruction. In addition, it is configured so that various information can be provided as evidence or reports in statutory inspection reports and other cases.

[6] Hygiene management system operation process [6.1] Medium information registration process (portable communication terminal device)
Next, operation | movement of the culture medium information registration process in the portable communication terminal device 10 of this embodiment is demonstrated using FIG. FIG. 13 is a flowchart showing the culture information registration processing operation in the portable communication terminal device 10 of the present embodiment.

  In this operation, it is assumed that corresponding lot information and line information associated with the work instruction sheet 70 are already stored in the line information DB 402 and the lot information DB 403.

  Further, it is assumed that the medium ID or instruction ID is attached to the film-type medium 60 and the work instruction sheet 70 by a two-dimensional barcode.

  Further, in this operation, the number of colonies in each film-type medium 60 is detected at the time of registration in the medium information database 400, and the portable communication terminal device 10 uses RGB for capturing a medium image. It is assumed that calibration for the gradation value or the luminance value is performed.

  First, in the portable communication terminal device 10, when the application control unit 120 detects an activation instruction for the culture medium registration application via the operation unit 170 (step S101), the application control unit 120 reads the culture medium registration application from the application storage unit 101 and activates it ( Step S102). At this time, the application control unit 120 performs initialization of the work memory and other necessary processes under the control of the mobile terminal management control unit 190.

  Next, the application control unit 120 displays an image for interlocking with the display control unit 161 to select whether the initial registration of the film-type medium 60 or the post-culture registration after a predetermined time has elapsed from the start of the culture. It is displayed on the unit 160 and waits for its input (step S103).

  Next, when detecting an input of a selection instruction from the operation unit 170 (step S104), the application control unit 120 determines whether initial registration or post-cultivation registration and sets the result in flag information (step S105).

  Next, the application control unit 120 causes the display unit 160 to display a screen that prompts the imaging of the film-type medium 60, and waits for imaging by the image data generation unit 110 in conjunction with the operation unit 170 (step S106). At this time, the application control unit 120 causes a predetermined image to be superimposed on the display unit 160 in order to align the medium image to be acquired.

  Next, when the application control unit 120 detects imaging by the image data generation unit 110 in conjunction with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S107), the image data generation unit 110 causes the medium ID 66 to be detected. At the same time, the imaged medium image data of the film type medium 60 is acquired and stored in the image data storage unit 102 while giving a predetermined image ID (step S108).

  Next, the application control unit 120 acquires the current time from the timer 180 as the imaging time of the medium image data, and stores it in the image data storage unit 102 as metadata in association with the medium image data (step S109).

  Next, the application control unit 120 analyzes the two-dimensional barcode formed in a predetermined area of the acquired imaged culture medium image data, acquires the culture medium ID 66, and stores the image data in association with the culture medium image data. The information is stored in the unit 102 (step S110).

  Next, the application control unit 120 causes the display unit 160 to display a screen for acquiring the instruction sheet image data together with the instruction sheet ID 71a and the process ID 71b in conjunction with the display control unit 161, and waits for acquisition of the instruction sheet image data. (Step S111).

  Next, when the application control unit 120 detects imaging by the image data generation unit 110 in cooperation with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S112), an instruction in which the work ID 71 is imaged. The book image data is acquired and stored in the image data storage unit 102 in association with the culture medium image data acquired in step S108 (step S113).

  In addition, when acquiring the process ID 71b as the work ID 71, or when acquiring the one process ID 71b from the plurality of process IDs 71b, the application control unit 120 operates in conjunction with the display control unit 161 and the operation unit 170, and the user The process ID 71b to be acquired is displayed, and the corresponding process ID 71b is acquired.

  Next, the application control unit 120 analyzes the two-dimensional barcode formed in a predetermined area of the imaged instruction sheet image data and the culture medium image data, acquires the work ID 71, and associates it with the instruction sheet image data. And stored in the image data storage unit 102 (step S114).

  Next, the application control unit 120 acquires the current time as the imaging time of the medium image data from the timer 180, and in conjunction with the display control unit 161 and the operation unit 170, the application control unit 120 acquires the acquired instruction image data, work ID 71, The medium image data, medium ID 66, and imaging time are confirmed (step S115).

  Note that the application control unit 120 may re-acquire the culture image data based on an instruction from the operator when the acquired medium information is confirmed by the operator. At this time, the application control unit 120 may be able to correct the medium image data by the operator in conjunction with the display control unit 161 and the operation unit 170.

  Next, the application control unit 120, based on the operator's instruction, together with flag information indicating whether it is initial registration or post-culture registration, terminal ID, and work ID 71, the acquired medium image data, its metadata, and whether it is initial registration. Flag information indicating whether it is registered after culture is transmitted as medium information to the server device 40 via the network communication unit 130 (step S116), and the registration process of the portable communication terminal device 10 is terminated.

  At this time, when transmitting the culture medium information, the network communication unit 130 executes login for accessing the server device 40 based on the terminal ID or the input ID and password, and the server device 40 is completed after the login is completed. Communication line is established and medium information is transmitted.

[6.2] Medium information registration processing (server device)
Next, the culture information registration processing operation in the server device 40 of the present embodiment will be described with reference to FIG. FIG. 14 is a flowchart showing the culture information registration processing operation in the server device 40 of this embodiment.

  In addition, this operation | movement is a process performed in conjunction with the culture medium information registration process performed by the portable communication terminal device 10, and the server apparatus 40 is based on the culture medium information transmitted from the portable communication terminal device 10. The following processing is executed.

  First, in the server device 40, when the communication control unit 410 receives the culture medium information transmitted from the portable communication terminal device 10 (step S300), the registration processing unit 421 is based on the flag information included in the received culture medium information. Whether the registration is initial registration or post-culture registration is determined (step S301).

  At this time, if the registration processing unit 421 determines initial registration, the process proceeds to step S302. If the registration processing unit 421 determines that it is not initial registration, that is, if it is determined to be post-culture registration, step S304 is performed. Move on to processing.

  Next, when it is determined as initial registration, the registration processing unit 421 extracts and specifies the work ID 71 included in the culture medium information (step S302).

  Next, the registration processing unit 421 registers the culture medium information in the culture medium information DB 401 based on the identified work ID 71 (step S303), and ends this operation. Although the culture start time is stored in advance in the work management DB 404, the registration processing unit 421 registers the imaging time included in the received medium information as the culture start time in the work management DB 404 in the process of step S303. Also good.

  On the other hand, if the registration processing unit 421 determines that the registration is after culture, it extracts and specifies the work ID 71 included in the culture medium information (step S304), and registers the culture medium information based on the imaging time included in the culture medium information. The culture examination time to be specified is specified (step S305).

  At this time, the registration processing unit 421 may be registered by designating a culture examination time for registering the culture medium information in conjunction with the portable communication terminal device 10, or the imaging time included in the received culture medium information. The culture examination time may be registered as it is. In addition, the registration processing unit 421 manages the culture medium registration at the culture test time that has already been performed, and specifies the culture test time based on the timing at which the culture medium information is received and the culture test time that has already been used to register the culture medium information. May be. That is, the registration processing unit 421 may specify the culture examination time by rewriting the execution flag each time the medium information is registered and comparing the received imaging time with reference to the information of the flag.

  Next, the registration processing unit 421 causes the colony detection determination unit 422 to perform image analysis on the received medium image data, and extract color feature amounts of a plurality of pixels constituting the region of the culture layer 63 in the medium image. And calculating a statistical reference based on the color feature values of a plurality of pixels constituting the region of the culture layer 63, and specifying the number of colonies in the medium image based on the calculated statistical reference. Count (step S307).

  Details of the colony identification and counting process in the process of step S307 will be described later.

  Next, the colony detection determination unit 422 reads out the medium determination standard based on the type of the specimen specified based on the work ID 71 and the type of bacteria to be detected, and detects the colony detected based on the read sample determination standard. It is determined whether or not the number satisfies a predetermined condition (step S308). That is, the colony detection determination unit 422 determines that it is acceptable (normal) when the predetermined condition is satisfied, and determines that it is unacceptable (abnormal) when the predetermined condition is not satisfied.

  The colony detection determination unit 422 is linked to the portable communication terminal device 10 instead of the automatic registration described above, and displays the detected number of colonies and the result of the pass / fail determination on the display unit 160 of the portable communication terminal device 10. The user may be allowed to view and confirm.

  Next, the registration processing unit 421 specifies culture start time information using the culture image data, the recognized medium ID 66, the determined pass / fail, the number of detected colonies, and the imaging time included in the medium information as the culture start time. The work ID 71 is associated and registered in the culture medium information DB 401 (step S309), and this operation ends.

  The registration processing unit 421 displays line information and information to be registered on the display unit 160 of the portable communication terminal device 10, and based on a user instruction input via the portable communication terminal device 10, the culture medium Information or the like may be registered.

  Further, when the culture medium image data is transmitted from the portable communication terminal apparatus 10 and the medium ID 66 is recognized by analyzing each image data by the server apparatus 40, the registration processing unit 421 receives the reception in the process of step S301. The medium ID 66 imaged on each predetermined area of the medium image data thus obtained is analyzed, and the medium ID 66 is recognized and acquired. Similarly, the server device 40 also recognizes the work ID 71 in the instruction image data.

[6.3] Colony Detection Process Next, the operation of the colony detection process in the server device 40 of the present embodiment will be described with reference to FIG. FIG. 15 is a flowchart showing the operation of the colony detection process in the server device 40 of this embodiment.
This operation is a process executed in the colony detection determination unit 422 under the control of the registration processing unit 421 in the process of step S307 of the medium information registration process illustrated in FIG.

  First, the colony detection determination unit 422 executes a color feature amount extraction process for extracting the color feature amounts of a plurality of pixels constituting the medium image acquired from the medium image data (step S401).

  Next, the colony detection determination unit 422 calculates a statistical reference based on the extracted color feature values of the plurality of pixels (step S402), and based on the calculated statistical reference, determines that the pixel having a predetermined condition is a colony. The pixel is specified (step S403).

  Specifically, as described above, the colony detection determination unit 422 calculates and calculates the average value μ and the variance S of the color feature amounts of the plurality of pixels extracted based on the color feature amount of the plurality of pixels extracted. Using the average value μ and the variance S, the response value f (xi) of the color feature amount of each pixel is calculated. And the colony detection determination part 422 specifies the pixel which has predetermined conditions, for example, the pixel below the threshold value (for example, response value is 1 * 10-18) defined beforehand as a colony pixel.

  Next, the colony detection determination unit 422 refers to the culture medium information DB 401 to detect colonies based on the identified colony pixels (step S404), measure the number of colonies (step S405), and perform this operation. Terminate.

[7] Modification [7.1] Modification 1
In the above-described embodiment, the culture medium information registration process and the colony detection determination process are executed at the same timing, but the colony detection determination process may be executed at an arbitrary timing.

[7.2] Modification 2
In this embodiment, instead of performing the culture information registration process using a portable communication terminal device 10 such as a tablet information terminal device, a smartphone, or a mobile phone, a laptop or desktop personal computer is used. The registration process of the culture medium information may be realized by a computer and an image input device such as a scanner, a digital camera, or a smartphone.

  In this case, the personal computer and the image input device may be connected according to a predetermined communication standard, and the registration process of the culture medium information may be realized by using the personal computer and the image input device integrally, or a memory card. The medium image data and instruction sheet image data previously acquired by the image input device are stored in other physical memory, and the registration process of the medium information is realized while the stored image data is captured by the personal computer. May be.

[7.3] Modification 3
In the present embodiment, the portable communication terminal device 10, the administrator terminal device 20, and the server device 40 may be installed or used in the same site, or each may be installed in a remote place such as outside the country or remotely. It may be used on the ground and each process described above may be executed. However, it is assumed that the portable communication terminal device 10 is used in the same lot.

[7.4] Modification 4
In the present embodiment, registration of medium information in a specimen cultured in the film-type medium 60 using the film-type medium 60 is executed, but the medium in the specimen cultured in the agar medium using an agar medium. Information registration may be executed.

[7.5] Modification 5
In the present embodiment, instead of obtaining the culture medium ID 66 by imaging the film-type culture medium 60 by the image data generation unit 110, the culture medium ID 66 may be input by an operator's operation input.

  In this case, the application control unit 120 interlocks with the display control unit 161 and the operation unit 170 to allow the operator to manually input the culture medium ID 66 directly using the operation unit 170.

  In addition, the application control unit 120 controls the display control unit 161 and the operation unit 170 to select a display item such as a pull-down menu by clicking or touch selection, and causes the operator to input the culture medium ID 66.

[7.6] Modification 6
In the present embodiment, various processes are executed by the single server device 40, but various processes may be executed by a server system including a plurality of server devices 40.

[7.7] Modification 7
In the present embodiment, the colony detection determination unit 422 calculates a statistical standard for each image of the medium on which the colonies are formed. For each, a statistical criterion may be calculated.

[7.8] Modification 8
In the present embodiment, the colony detection determination unit 422 calculates a statistical reference based on the color feature values of a plurality of pixels constituting the extracted culture medium image. If the percentage of pixels with high probability (estimated colony pixels) is higher than usual, the statistical criterion may be calculated by excluding pixels with high probability of colonies from a plurality of pixels.

  More specifically, the colony detection determination unit 422 removes in advance a pixel satisfying a predetermined condition, for example, a condition that the R gradation value of the pixel is 100 or more from the extracted pixels as an estimated colony pixel. Then, a statistical reference is calculated based on the color feature amount of the remaining pixels.

  In this way, by removing the estimated colony pixels in advance, it is possible to narrow the ideal distribution range of the background color of the medium image including the residue, that is, to reduce the width of the pixel color feature amount class in the normal distribution. Therefore, the colony detection determination unit 422 can improve the accuracy of the colony count.

  Examples of the estimated colony pixel include a pixel that is very close to the color of a typical colony, a pixel that has a response value f (xi) of a predetermined value or more on a once estimated model, and the like.

[7.9] Modification 9
In the present embodiment, the colony detection determination unit 422 performs modeling of the background color in the image of the medium containing the residue and specifies the outside of the range as the colony pixel, but the background is excluded except for the specified colony pixel. Colony pixels may be re-specified after narrowing down the color modeling range.

  The process of narrowing the background color modeling range by excluding the identified colony pixels from the pixels used for the background color modeling may be performed a predetermined number of times, or until the statistical standard does not change. You may carry out repeatedly.

  Specifically, after the colony detection determination unit 422 specifies the colony pixel, the color feature amount of the remaining pixels obtained by removing the specified colony pixel from the plurality of extracted pixels (pixels used for modeling the background color) Recalculate statistical criteria based on And the colony detection determination part 422 re-specifies the pixel which comprises predetermined conditions as a colony pixel based on the recalculated said statistical reference | standard. The recalculation of the statistical reference and the re-specification of the colony pixel are repeatedly performed a predetermined number of times or until the statistical reference does not change, and the colony is finally detected based on the specified colony pixel.

  By removing colony pixels in advance, the statistical reference can be narrowed down, that is, the response value of the normal distribution equation can be increased, so that the colony detection determination unit 422 improves the accuracy of the colony count. Will be able to.

[7.10] Modification 10
In the present embodiment, the colony detection determination unit 422 identifies the pixel as a colony pixel when the response value of the color feature amount of each pixel is equal to or greater than a set threshold value. A pixel having a predetermined condition may be specified as a colony pixel based on a multi-dimensional feature value obtained by combining the response value and another color feature value. Further, identification of colony pixels may be performed by constructing a discrimination method obtained by a machine learning algorithm such as AdaBoost, support vector machine (SVM), or artificial neural network (ANN).

  As described above, the colony detection determination unit 422 accurately specifies the colony pixel by combining the response value of the color feature amount of each pixel with another color feature amount or constructing a determination method using machine learning or the like. As a result, the accuracy of colony counting can be improved.

[7.11] Modification 11
In the present embodiment, an example in which the distribution of color feature values of a plurality of pixels is modeled by applying the definition of a normal distribution has been described. However, the present invention is not limited to this and the present invention is not limited thereto. The distribution of the color feature quantity may be modeled by applying a definition of a distribution other than the normal distribution that can model the distribution, such as a logarithmic normal distribution and a gamma distribution.

  In addition, when there are many bubbles in the culture medium, or when a lump of food is injected into the culture medium, the background color of the culture medium is divided into a plurality of distributions (for example, the color is dark and the color is light due to bubbles, etc.) Part). When the background color of the medium is divided into a plurality of distributions, it is preferable to specify a colony pixel by modeling a background color model by applying a definition of a mixed normal distribution obtained by adding a plurality of normal distributions as a statistical criterion. .

  The parameters of the mixed normal distribution model can be calculated by alternately repeating the expected value step and the maximization step by using, for example, an EM algorithm that is a technique for estimating the parameters of the probability model based on the maximum likelihood. it can.

[7.12] Modification 12
In the present embodiment, the case where the color feature amount of the pixel is two or three different color feature amounts has been described. However, the color feature amount of the pixel is a luminance value, brightness, saturation, sub-pixel (RGB). Of these gradation values, one color feature amount or four or more different color feature amounts may be used.

  As described above, by increasing the types of color feature amounts, the colony detection determination unit 422 can accurately specify the colony pixel, and can improve the accuracy of the colony count.

  As described above, in the sanitary management system S of the present embodiment, the influence of the residue can be ignored even if the medium is changed from the original color due to the mixture of the color component (residue) derived from the sample such as food. Since the colony pixel can be specified, the colony can be detected based on the specified colony pixel.

  Therefore, in the sanitary management system S of the present embodiment, even when the culture medium is changed from the original color due to mixing of color components (residues) derived from a sample such as food, colony detection and counting are accurately performed. In addition, the culture medium information including information on the accurately detected colonies and the number thereof can be registered in the database.

  Further, in the sanitary management system S of the present embodiment, it is possible to save resources as compared with the case where various data analyzes and provisions are performed using physical resources such as paper media, and the culture medium. By registering the culture medium information in the database, registration mistakes can be remarkably reduced and difficult medium management can be facilitated, so that resource saving can be achieved without wastefully consuming the culture medium.

  In the sanitary management system S of the present embodiment, the description has been made using food. However, the present invention is not limited to the food, and can be applied to products that are provided to all living organisms including drugs and drugs. .

  INDUSTRIAL APPLICABILITY The present invention can be used for a medium information registration system and its program, a colony detection device and its program, and a food hygiene management system.

DESCRIPTION OF SYMBOLS S ... Hygiene management system 10 ... Portable communication terminal device 20 ... Manager terminal device 30 ... Network 40 ... Server device 60 ... Film type culture medium 70 ... Work instruction sheet 80 ... Work line 100 ... Data storage part 101 ... Application storage part 102 ... Image data storage unit 103 ... ROM / RAM
DESCRIPTION OF SYMBOLS 110 ... Image data generation part 120 ... Application control part 130 ... Network communication part 140 ... Near field communication interface 150 ... Current position detection part 160 ... Display part 170 ... Operation part 180 ... Timer 190 ... Portable terminal management control part 400 ... Database 401 ... Medium information DB
402 ... Line information DB
403 ... Lot information DB
404 ... Work management DB
410 ... Communication control unit 420 ... Data processing unit 421 ... Registration processing unit 422 ... Colony detection determination unit 424 ... Lot determination processing unit 425 ... Report processing unit 430 ... Server management control unit 440 ... ROM / RAM
450… Timer

Claims (11)

An acquisition means for acquiring the medium image data obtained by imaging the image of the medium in which the colony is formed as medium image data;
Extraction means for extracting color feature amounts of a plurality of pixels constituting the culture medium image of the acquired culture medium image data;
A calculation means for calculating a statistical standard based on the color feature values of the extracted pixels;
Based on the calculated statistical criteria, a pixel having a predetermined condition is identified as a colony pixel, and detection means for detecting the colony based on the identified colony pixel;
Registration means for registering information on the detected colonies in the database as information on the medium;
A culture medium information registration system comprising: In the culture medium information registration system according to claim 1,
The statistical standard is an average value or deviation value of color feature values of a plurality of extracted pixels, or a value that maximizes the number of pixels having the same color feature value among a plurality of extracted pixels. system. In the culture medium information registration system according to claim 1 or 2,
The detection means calculates a value indicating a probability of becoming a color feature amount of each pixel in a probability distribution function of a color feature amount of pixels constituting the medium image based on the statistical criterion, and the value is A culture medium information registration system that identifies a pixel having a predetermined condition as the colony pixel. In the culture medium information registration system according to any one of claims 1 to 3,
The medium information registration system, wherein the calculation means calculates a statistical reference based on color feature amounts of remaining pixels obtained by removing pixels satisfying a predetermined condition from a plurality of extracted pixels based on the color feature amount of pixels. In the culture medium information registration system according to any one of claims 1 to 4,
(1) The calculation means recalculates a statistical reference based on the color feature amount of the remaining pixels obtained by removing the colony pixels detected by the detection means from the extracted pixels, and
(2) The detection means, based on the recalculated statistical criteria, re-specification processing to re-specify a pixel having a predetermined condition as a colony pixel,
Is repeated a predetermined number of times or until the statistical criteria no longer changes,
The detection unit is a culture medium information registration system that detects the colony based on a finally specified colony pixel. In the culture medium information registration system according to any one of claims 1 to 5,
The detection unit specifies a pixel having the predetermined condition as a colony pixel based on a multi-dimensional feature amount obtained by combining the calculated statistical reference and another color feature amount in the pixel. system. In the culture medium information registration system according to any one of claims 1 to 6,
The culture medium information registration system, wherein the detection unit specifies the colony pixel using a determination unit obtained by machine learning. Computer
An acquisition means for acquiring, as medium image data, medium image data in which a medium in which a colony is formed is imaged.
Extraction means for extracting color feature quantities of a plurality of pixels constituting the culture medium image of the acquired culture medium image data;
A calculation means for calculating a statistical reference based on the color feature values of a plurality of extracted pixels;
Based on the calculated statistical criteria, a pixel having a predetermined condition is identified as a colony pixel, and detection means for detecting the colony based on the identified colony pixel; and
Registration means for registering information on the detected colonies in the database as information on the medium,
A program characterized by functioning as An acquisition means for acquiring the medium image data obtained by imaging the image of the medium in which the colony is formed as medium image data;
Extraction means for extracting color feature amounts of a plurality of pixels constituting the culture medium image of the acquired culture medium image data;
A calculation means for calculating a statistical standard based on the color feature values of the extracted pixels;
Based on the calculated statistical criteria, a pixel having a predetermined condition is identified as a colony pixel, and detection means for detecting the colony based on the identified colony pixel;
A colony detection apparatus comprising: Computer
An acquisition means for acquiring, as medium image data, medium image data in which a medium in which a colony is formed is imaged.
Extraction means for extracting color feature quantities of a plurality of pixels constituting the culture medium image of the acquired culture medium image data;
A calculation means for calculating a statistical reference based on the extracted color feature values of a plurality of pixels; and
Based on the calculated statistical criteria, a pixel having a predetermined condition is identified as a colony pixel, and detection means for detecting the colony based on the identified colony pixel;
A program characterized by functioning as A communication terminal device that generates a medium image obtained by imaging a medium for culturing bacteria contained in a specimen as medium image data;
A server device that detects colonies formed in the medium based on the medium image data and registers them in a database;
With
The server device is
An acquisition means for acquiring the medium image data obtained by imaging the image of the medium in which the colony is formed as medium image data;
Extraction means for extracting color feature amounts of a plurality of pixels constituting the culture medium image of the acquired culture medium image data;
A calculation means for calculating a statistical standard based on the color feature values of the extracted pixels;
Based on the calculated statistical criteria, a pixel having a predetermined condition is identified as a colony pixel, and detection means for detecting the colony based on the identified colony pixel;
Registration means for registering information on the detected colonies in the database as information on the medium;
Hygiene management system characterized by comprising.

Images