JP6036201B2 - Medium information registration system, colony detection device, program and hygiene management system - Google Patents

Description

  The present invention relates to a hygiene management system for a product provided to a human body such as food or other living organisms.

  In recent years, due to the growth of fast food and other food service industries and the increase in easy processed foods, the opportunity to eat food prepared by others has increased remarkably. On the other hand, when foods such as processed foods and processed foods are mixed with dangerous substances such as poisons or microorganisms, it directly affects the human body. When handling processed foods, not only the safety of raw materials but also the production There is a need for food safety that strictly controls the hygiene of the process and covers the entire production and processing of food. In addition to foods, safety is also required for products that are provided to living organisms such as medicines and drugs.

  In particular, food poisoning incidents that have occurred in various places are the starting point, and it is a proposition to further improve the safety of foods. In addition to complying with the Food Sanitation Law, “HACCP (Hazard Analysis Critical Control) An increasing number of companies have introduced “Point System” and “FSSC (Food Safety System Certification 22000)”.

  As a system for detecting microorganisms mixed in such processed foods, a film-type medium is used, a specimen cultured in the film-type medium is imaged, and image processing is performed on the image of the imaged medium. To detect and count colonies is known (for example, Patent Document 1). In particular, this system detects colonies by analyzing the medium image based on the luminance of each pixel constituting the medium image.

JP 2011-2112013 A

  However, in the system described in the above-mentioned patent document, since the colony is detected based on the pixel value (luminance value) of each pixel, even the pixel value is determined to be the same as or the same as the reference value. Within the range, even non-objects other than colonies are detected as colonies.

  That is, in the system described in the above-mentioned patent document, the luminance value of the pixel is used as a determination material, and is influenced by the influence of the imaging environment of the medium image serving as the reference, the state of the medium, and the state of the cultured colony. It is easy to deny that false detection occurs.

  The present invention has been made in order to solve the above-mentioned problems, and its purpose is to eliminate non-objects other than colonies such as dust and improve the accuracy in colony detection, thereby detecting false colonies. It is possible to provide a medium information registration system and the like that can prevent information and accurately register information about a medium including colony detection.

  In order to solve the above-described problems, the medium information registration system and the like according to the present invention provides information on the medium based on the medium image data including the medium image obtained by imaging the medium for culturing the bacteria generated in the specimen. A medium information registration system for registering as medium information, the first medium image data having a first medium image obtained by imaging the medium at a first timing which is a given timing, and a given medium after the first timing Acquisition means for acquiring second image data having a second medium image obtained by imaging the medium at a second timing which is a timing, and the color of each pixel constituting the first medium image and the second medium image An extracting means for extracting each feature amount; a feature amount for each pixel of the extracted first medium image; and a feature for each pixel of the extracted second medium image. Detection means for detecting a change occurring in the second medium image based on the amount, and identifying a colony as the bacterial mass based on the change occurring in the second medium image, It has a configuration comprising counting means for counting the number, and registration means for registering information on the medium including at least the counted number of colonies in the database as medium information.

  Since the culture medium information registration system and the like according to the present invention can identify non-objects other than colonies such as dust that already existed in the culture medium before the culture, the culture image after the culture (that is, the second culture medium) by the identification It is possible to count while specifying a colony as an object by changing the image.

  Therefore, the culture medium information registration system and the like according to the present invention can eliminate non-objects other than colonies, improve the accuracy in colony detection and prevent erroneous colony detection, and include colony detection. Media information can be registered accurately.

It is a lineblock diagram showing the composition of one embodiment of the hygiene management system concerning the present invention. It is an example of the film type culture medium used for the sanitary management system of one Embodiment. It is an example of the work instruction used for the sanitary management system of one embodiment. It is a block diagram which shows the structure of the portable communication terminal device used for the sanitary management system of one Embodiment. It is a block diagram which shows the structure of the server apparatus used for the sanitary management system of one Embodiment. It is a figure for demonstrating the principle of the colony detection process in the server apparatus of one Embodiment. It is a figure for demonstrating the 1st colony specific count process in the server apparatus of one Embodiment. It is a figure (I) for demonstrating the 2nd colony specific count process (the 1) in the server apparatus of one Embodiment. It is a figure (II) for demonstrating the 2nd colony specific count process (the 1) in the server apparatus of one Embodiment. It is a figure (I) for demonstrating the 2nd colony specific count process (the 2) in the server apparatus of one Embodiment. It is a figure (II) for demonstrating the 2nd colony specific count process (the 2) in the server apparatus of one Embodiment. It is FIG. (III) for demonstrating the 2nd colony specific count process (the 2) in the server apparatus of one Embodiment. It is a figure for demonstrating the 3rd colony specific count process in the server apparatus of one Embodiment. It is FIG. (1) for demonstrating the process determination in the server apparatus of one Embodiment. It is a figure (the 2) for demonstrating the process determination in the server apparatus of one Embodiment. It is FIG. (3) for demonstrating the process determination in the server apparatus of one Embodiment. It is a flowchart which shows the operation | movement of the registration process of the culture medium information in the portable communication terminal device of one Embodiment. It is a flowchart which shows the operation | movement of the registration process including the 1st colony specific count process of the culture medium information in the server apparatus of one Embodiment. It is a flowchart which shows the operation | movement of the registration process including the 2nd colony specific count process of the culture medium information in the server apparatus of one Embodiment. It is a flowchart which shows the operation | movement of the registration process including the 3rd colony specific count process of the culture medium information in the server apparatus of one Embodiment. It is a flowchart which shows the operation | movement of the lot determination process in the server apparatus of one Embodiment.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In addition, the following embodiment is a medium information registration system, program, and the like according to the present invention for a hygiene management system using a film-type medium in a food production line or an inspection line (hereinafter referred to as “work line”). It is embodiment at the time of applying a colony detection apparatus and a hygiene management system. However, the present invention is not limited to the following embodiments within the scope including the technical idea.

[1] Hygiene management system First, the hygiene management system S of this embodiment will be described with reference to FIG. In addition, FIG. 1 is a block diagram which shows the structure of the sanitary management system S of this embodiment.

  The sanitary management system S of the present embodiment uses a film-type culture medium (that is, a film-type culture medium) 60 and manages data on information related to the culture medium (hereinafter referred to as “medium information”), thereby producing food. It is a system for inspecting the hygienic condition on or above.

  In addition, the sanitary management system S of the present embodiment extracts a food during or after manufacture as a specimen in a work line 80 having a manufacturing process for manufacturing a processed or processed food or an inspection process for inspecting the food. In addition, it is a system for managing data on the culture state when a preliminarily specified bacterium such as E. coli or Escherichia coli generated in a specimen is cultured in the film-type medium 60.

  Then, the hygiene management system S generates information on the work in the manufacture or inspection of food (hereinafter referred to as “work information”) and the extracted sample in order to manage and determine the sanitary state of the food on the data. The culture medium information of the film-type culture medium 60 acquired by the portable communication terminal device 10 before and after culturing the fungus (colony) to be registered can be associated and registered in the server device 40 (specifically, the database 400). It has a possible configuration.

  Specifically, the hygiene management system S of the present embodiment, for a medium image in which the film-type medium 60 is imaged after a lapse of a predetermined time from the start of culturing, such as the luminance value of each pixel constituting the medium image A feature amount related to color is extracted, and based on the feature amount of each pixel, a colony that is a mass of bacteria imaged by one or more pixels is detected and counted. The hygiene management system S has a configuration for storing in the database 400 medium information including at least the detected number of colonies.

  In particular, the hygiene management system S eliminates non-objects other than colonies such as dust when performing detection of colonies (that is, objects) that are bacterial clumps, and improves the accuracy of the detection. It has a configuration capable of preventing erroneous detection of colonies and accurately registering information on the medium including colony detection.

  Usually, the feature quantity related to the color such as luminance, brightness, or gradation value of the pixel that constitutes the image of the colony and the pixel group constituted by connecting the pixel, and the count other than the colony such as dust cannot be counted. In the case where the feature quantity related to the color of the pixel constituting the image of the non-object and the pixel group formed by connecting the pixels is similar, the non-target image processing is performed from the culture medium image after the culture. It is difficult to distinguish between an object and an object colony.

  Therefore, in this embodiment, non-objects other than colonies such as dust are eliminated to improve the accuracy in colony detection to prevent erroneous colony detection, and medium information including colony detection is accurately registered. Therefore, a change in a culture medium image after culturing (hereinafter referred to as “second medium image”) is detected based on a culture image before culture (hereinafter referred to as “first medium image”), and the change is detected. The count is performed while identifying colonies based on the above.

  In order to realize such a configuration, the sanitary management system S of the present embodiment, as shown in FIG. 1, includes a plurality of portable communication terminal devices 10 used when registering culture medium information regarding each film-type culture medium 60. In addition, the administrator terminal device 20 that manages the sanitary management system S, the network 30, and the database 400, and in conjunction with the portable communication terminal device 10 or the administrator terminal device 20, registration management of medium information is performed. And a server device 40 that executes various types of processing.

  Further, the work information of the present embodiment includes, in addition to various types of information related to the manufacturing process or the inspection process, information regarding the culture of the food extracted from the manufacturing process or the inspection process as a specimen and the colonies generated in the specimen, Each work is registered in the database 400 using unique identification information (hereinafter referred to as “work ID”).

Specifically, each work information includes
(1) Work ID,
(2) Identification information (hereinafter referred to as “line ID”) of the work line 80 from which the sample is to be extracted or, if the work line 80 has a plurality of processes, the line ID and process identification information (hereinafter referred to as “line ID”). , Referred to as “process ID”) 71b;
(3) Product name of food as a sample, identification information of lot (hereinafter referred to as “lot ID”), lot name,
(4) Type of bacteria detected from specimens such as general bacteria or E. coli (hereinafter referred to as “test type”);
(5) Sample culture conditions such as dilution factor, type of diluent, culture temperature, culture humidity, and culture time,
(6) Specimen culture start time;
(7) a time after a predetermined time has elapsed since the start of culture of the specimen (hereinafter also referred to as “culture test time”);
(8) Sample incubator location such as incubator number and number of steps in the incubator,
(9) Work date and time indicating the work start time and end time;
(10) Worker ID (employee ID) and worker name;
Is included. Each piece of work information is registered in the database 400 for each type and for each work.

  The portable communication terminal device 10 is, for example, a digital camera having a communication function, a tablet-type information terminal device, a smartphone or a portable telephone, or the like, or an imaging function such as a still image or a recording function (hereinafter simply referred to as “camera function”). And a communication terminal device portable by an operator.

  In particular, the portable communication terminal device 10 generates an image data (hereinafter referred to as “medium image data”) by imaging the film-type culture medium 60 by the camera function, and also images the work instruction sheet 70 and displays the instruction sheet. It has a configuration capable of generating an image. Then, the portable communication terminal device 10 acquires the work ID 71 and the culture medium ID 66 from the image data of the instruction manual image (hereinafter referred to as “instruction data image data”) and the culture medium image data of the film type culture medium 60, The acquired work ID 71 and medium ID 66, medium image data, and metadata of the medium image data can be registered in the database 400 of the server device 40 as medium information.

  In addition, when the portable communication terminal device 10 transmits the culture medium information to the server device 40, the BLUETOOTH (registered trademark), the wireless LAN (WLAN: Wireless Local Area Network), or the wireless PAN (WPAN: Wireless Personal Area Network). The data is transmitted to the server device 40 directly or via the access point 50 using a communication standard for short-range wireless communication or the like, or is transmitted to the server device 40 using a public telephone line network via a mobile base station (not shown). It has a configuration. The portable communication terminal device 10 has a browser function constructed by a markup language such as XML (extensible Markup Language), and executes an operation input instruction and an operation confirmation by the operator using the browser function. The culture medium information is transmitted to the server device 40 via the browser function.

  The administrator terminal device 20 is an information communication terminal device such as a tablet information terminal device, a smartphone, a personal computer, or a workstation. The administrator terminal device 20 manages the administrator identification information (hereinafter referred to as “manager ID”), the administrator password, and the worker identification information (hereinafter referred to as “worker ID”). It functions as a device capable of managing the access authority to the server device 40, managing the terminal ID of the portable communication terminal device 10, and correcting the registered medium information.

  Similarly to the portable communication terminal device 10, the administrator terminal device 20 has a browser function constructed by a markup language, and uses the browser function to exchange data with the server device 40 and to generate a report. It has a configuration capable of executing browsing and the like.

  Note that the administrator terminal device 20 determines the culture medium information when each operation is interrupted due to a failure of a machine that performs the process or the like in the same lot, or when an error in registration of culture medium information occurs in the operator. It has a configuration that can correct other information.

  The network 30 includes, for example, a public telephone line network (hereinafter referred to as “long-distance communication network”) including a mobile phone network, an IP (Internet Protocol) network such as a short-distance wireless network, or both of which are interconnected. Has been. However, the configuration of the network 30 is not limited to this.

  The server device 40 is a server device used in conjunction with the portable communication terminal device 10 or the administrator terminal device 20 and used to execute each data process for performing hygiene management of the lot and work line 80. 400, registration of medium information in each film-type medium 60 before the start of culture (hereinafter referred to as “initial registration”) and registration after the start of culture (hereinafter referred to as “post-culture registration”). It has a possible configuration.

Specifically, the server device 40 uses the film-type medium based on the medium image data including the medium image obtained by imaging the film medium 60 for culturing the bacteria generated in the specimen (food in the present embodiment). A device for registering information about 60 as medium information,
(1) For example, a film-type medium before the start of culturing of bacteria (specifically, only a specimen is placed immediately after the start of culturing of the bacterium and no bacterium is started to be cultured (first timing)). Medium image data having a first medium image obtained by imaging 60 (hereinafter referred to as “first medium image data”) and, for example, the film type at a predetermined timing (second timing) after the start of cultivation of the bacteria. Image data having a second medium image obtained by imaging the medium 60 (hereinafter referred to as “second image data”);
(2) Extracting feature quantities relating to the colors of the respective pixels constituting the first medium image and the second medium image,
(3) Based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image, a change occurring in the second medium image is detected,
(4) Based on the change that occurred in the second medium image, while identifying the colony as a bacterial mass, count the number of the colony,
(5) It has the structure which registers the information regarding the culture medium containing at least the number of counted colonies in the database 400 as culture medium information.

  And the server apparatus 40 of this embodiment detects the change which arose in the 2nd culture medium image by the following three specific processes (henceforth "colony identification counting process"), and specifies a colony, It has the structure which counts the number.

  In the present embodiment, the first medium image obtained by imaging the film-type medium 60 before the start of culturing the bacteria is not a medium image at the time of initial registration, but is carried immediately after the specimen is placed on the film-type medium 60. The culture medium image imaged by the communication terminal device 10 for an object is shown.

  Further, in this embodiment, as “before the start of culturing the fungus”, only the specimen is placed immediately after the start of the culture of the fungus, and the explanation is made using the timing when none of the fungi has been started. Although it has been cultured, it includes a state where it cannot be visually recognized, that is, it cannot recognize bacteria when imaged. In this embodiment, “before the start of culturing bacteria” is described as the first timing and “predetermined timing after the start of culturing bacteria” is described as the second timing. However, the second timing is after the first timing. If there is, it is not limited to this.

(First colony identification counting process)
As the first colony identification counting process, the server device 40 detects, as the first feature pixel, a pixel of the first medium image having a feature amount that has a predetermined condition, and the feature amount that has the condition. Is detected as a second feature pixel, and a change occurring in the second media image is detected based on the detected first feature pixel and second feature pixel.

  And the server apparatus 40 is based on the detected 1st feature pixel, The target object (henceforth "non-colony") assumed not to be colonies, such as the imaged garbage on the said 1st culture medium image, is said. While specifying, the target object (henceforth a "colony candidate") which becomes a colony candidate containing the imaged non-colony on the said 2nd culture medium image based on the detected 2nd feature pixel, It has the structure which detects the change of the number of the objects respectively specified by the 1st culture medium image and the 2nd culture medium image as a change which arose in the 2nd culture medium image.

  Further, in this case, the server device 40 calculates the difference in the number of detected objects identified in the first medium image and the second medium image, that is, the difference in the number of colony candidates and the number of non-colonies. It has a configuration that counts as a number.

(Second colony identification counting process)
As the second colony identification counting process, the server device 40
(A) A pixel of a first medium image having a feature amount satisfying a predetermined second condition is detected as a first feature pixel, and a pixel of the second medium image having a feature amount satisfying the second condition As a second feature pixel,
(B) Based on the detected first feature pixel, the imaged first object (non-colony) on the first medium image is specified, and on the basis of the detected second feature pixel, the second Identify the imaged second object (colony candidate) on the medium image,
(E) Compare at least one of the coordinate position on the culture medium between the first object and the second object, the feature amount relating to the color, and the characteristics of the feature pixel used when imaging each object. ,
(D) Based on the comparison result, non-identity between the first object and the second object is determined, and changes in the object respectively identified in the first medium image and the second medium image Detect as a change that occurred in the medium image,
It has a configuration.

  And the server apparatus 40 has the structure which detects the change of the number of the objects respectively specified by the 1st culture medium image and the 2nd culture medium image as a change which arose in the 2nd culture medium image,

In particular, the server device 40, in the process (E),
(E11) Specify the first object existing in the same coordinate position or the same range on the culture medium as the second object,
(E12) The identity of the second object and the identified first object is determined based on the characteristics of the characteristic pixels used when imaging each of the second object and the identified first object. ,
(E13) As a result of determination, when it is determined that the second object is not identical to the first object, the second object is specified as the colony.
It is like that.

In addition, in the process of (E), the server device 40 replaces the above (E21) by comparing the feature quantity relating to the color of the first object in each second object, and the same as the first object. Judging gender,
(E22) As a result of determination, the second object determined to be non-identical with the first object is identified as a colony.
It may be like this.

  In this embodiment, the characteristics of the feature pixels used when imaging the first object and the second object include the number of each feature pixel, the coordinate position of each feature pixel on the medium, and , At least one of the feature quantities related to the color of each feature pixel is included.

(Third colony identification counting process)
As the third colony identification counting process, the server device 40 extracts the feature amount extracted from each pixel of the second medium image whose coordinates on the medium of the extracted pixel are the same for each pixel of the extracted first medium image. The difference can be detected as a change in the feature amount of the pixel generated in the second medium image.

  In this case, the server device 40 has a configuration in which the number of colonies is specified while specifying the colonies based on the difference between the detected feature amounts of the pixels.

  With such a configuration, in the sanitary management system S of the present embodiment, non-objects other than colonies such as dust already existing in the film-type medium 60 can be identified before culturing. By changing the medium image (that is, the second medium image), it is possible to count while specifying the colonies as the objects.

  Therefore, in the sanitary management system S of the present embodiment, non-objects other than colonies can be excluded, the accuracy in colony detection can be improved, and erroneous colony detection can be prevented, and colony detection is included. The medium information can be registered accurately.

  In particular, in the first colony identification counting process, the sanitary management system S of the present embodiment is configured so that the first feature pixel and the second feature pixel are respectively cultured before and after culturing based on the first condition that is the same condition. Since it can detect from an image, the pixel which comprises the non-object which has a color characteristic similar to a colony in the culture medium image before culture | cultivation can be detected now.

  Therefore, the sanitary management system S of the present embodiment can identify non-objects other than colonies such as dust already existing in the film-type medium 60 before the culture.

  In the sanitary management system S of the present embodiment, in the second colony identification counting process, a first object (that is, a non-colony) having a color characteristic similar to a colony in a culture medium image before culture is used. Since it can be detected, if the non-identity between the imaged first object before culturing and the second object imaged after culturing is determined, it is already present in the film-type medium 60 before the culturing. It is possible to specify a second object (that is, a colony candidate) other than a colony such as trash as a colony.

  Further, in the sanitary management system S of the present embodiment, in the third colony identification counting process, by generating a difference image from the culture medium images before and after the culture, an image indicating the change that has occurred in the second culture image is generated. Since the colony can be specified based on the image, the colony can be specified while excluding non-objects other than the colony such as dust already existing in the film-type medium 60 before the culture. It has become.

  And in the sanitary management system S of this embodiment, since the culture medium information can be managed, it is possible to save data as compared with the case where various data analysis and provision are performed using physical resources such as paper media. In addition to being able to recycle resources, registering medium information about the medium in the database significantly reduces registration errors and facilitates difficult medium management. Resources can be made available.

[2] Film Type Medium Next, the film type medium 60 of the present embodiment will be described with reference to FIG. FIG. 2 is an example of a film-type medium 60 used in this embodiment.

  The film-type medium 60 used in the present embodiment is a medium for culturing bacteria generated in food as a specimen detected from each step of the work line 80 using a film or sheet-like dry medium. For example, the film-type culture medium 60 is used as a culture medium for cultivating general live bacteria, coliform bacteria, and Staphylococcus aureus. In addition, you may use as a culture medium which culture | cultivates various bacteria, substances, or microorganisms, such as mold | fungi, yeast, a Listeria bacterium, a microorganism for water quality, lactic acid bacteria, and a protein.

  The film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “circular frame”) 62, a culture layer 63 for culturing bacteria provided in the frame, a cover sheet 64 covering the culture layer 63, and the left side of the base sheet 61. Medium ID66.

  For example, the culture medium ID 66 is formed of a barcode such as a two-dimensional barcode or alphanumeric characters, and is imaged together when the film-type culture medium 60 is imaged, such as a barcode recognition function or an OCR (Optical Character Recognition) function. It is acquired in the portable communication terminal device 10 or the server device 40 using the image analysis function.

  The base material sheet 61 is not particularly limited as long as it is a film-like or sheet-like base material, and for example, a plastic film or paper can be used. Preferred examples of plastic films include resin films such as polyethylene, polypropylene, polyethylene terephthalate, polyethylene naphthalate, polymethacrylate, polymethyl methacrylate, polymethyl acrylate, polyester, and polycarbonate. Preferred examples include polyethylene terephthalate and polypropylene synthetic paper. Note that the polypropylene-based synthetic paper is a film synthetic paper whose main raw material is polypropylene.

  The film-type culture medium 60 has an IC tag in which a culture medium ID 66 is stored. The short-range wireless communication interface 140 (for example, an IC tag reader) included in the portable communication terminal apparatus 10 causes the medium to be connected to the portable communication terminal apparatus 10. ID66 may be acquired.

[3] Work instruction sheet Next, the work instruction sheet 70 of this embodiment will be described with reference to FIG. FIG. 3 is an example of a work instruction sheet 70 used in the present embodiment.

  The work instruction sheet 70 of the present embodiment includes, for each food group manufactured or inspected under the same conditions, that is, for each lot, work names and contents of one or more manufacturing processes or inspection processes, and work lines 80 to be used. It is an instruction document that describes the name of the food (processed food) to be manufactured or inspected, the quantity, and other information.

  In addition, the work instruction sheet 70 of the present embodiment has an instruction sheet ID 71a formed by printing or other methods on the upper left, and a plurality of process IDs 71b formed by printing or other methods on a predetermined area. . The instruction sheet ID 71a and each process ID 71b are used as the work ID 71, and are formed of, for example, a barcode such as a two-dimensional barcode or alphanumeric characters. The instruction ID 71a and each process ID 71b are imaged in the same manner as the film-type medium 60 when the registration of the film-type medium 60 is executed, and analyzed by the portable communication terminal device 10 or the server device 40. Be recognized.

  The work instruction sheet 70 has an IC tag in which the work ID 71 of the instruction sheet ID 71a or the process ID 71b is stored, like the film type culture medium 60, and has an interface (short distance) that the portable communication terminal device 10 such as a tag reader has. The portable communication terminal device 10 may acquire the work ID 71 by the wireless communication interface 140). In the following description, unless otherwise specified, the work ID 71 indicates an instruction ID 71a or a process ID 71b.

[4] Portable Communication Terminal Device Next, the configuration of the portable communication terminal device 10 of the present embodiment will be described using FIG. FIG. 4 is a block diagram showing the configuration of the portable communication terminal device 10 of the present embodiment.

  The portable communication terminal device 10 of the present embodiment has a data storage unit 100 having a memory function used when various programs are executed, an imaging function, image data of the film-type medium 60, and other image data. In addition to the image data generation unit 110 that generates the media information, the media information is registered in the server device 40 after the initial registration and the post-cultivation registration immediately after the culture in conjunction with the server device 40 (hereinafter referred to as “medium information registration processing”). And an application control unit 120 that executes processing.

  The portable communication terminal device 10 includes a network communication unit 130 that communicates with the server device 40 and other communication devices, a short-range wireless communication interface 140 that exchanges data with an IC tag and other communication interfaces, Controls the current position detection unit 150 that detects the current position, the display unit 160, the display control unit 161 that controls the display unit 160, the operation unit 170 for inputting user operations, the timer 180, and the entire apparatus. A portable terminal management control unit 190.

  And the portable communication terminal device 10 has various necessary members such as a microphone, a speaker, and an e-mail transmission / reception function when having a mail function such as a telephone function and e-mail. Further, the above-described units are connected to each other by a bus 11 to exchange data.

  The data storage unit 100 includes an application storage unit 101 that stores various application programs, an image data storage unit 102 that stores image data captured and generated by the image data generation unit 110, and a portable communication terminal device 10 and management / control programs, and a ROM / RAM 103 that is used as a work area during execution of each program and stores data used in each process executed by the portable communication terminal device 10. doing.

  In particular, the application storage unit 101 includes an application program (hereinafter referred to as “application”) that is executed by the application control unit 120 in conjunction with the image data generation unit 110, the operation unit 170, the display control unit 161, and the image data storage unit 102. Is recorded). The application storage unit 101 also stores a browser program for realizing the above browsing function.

  In the image data storage unit 102, the imaged medium image data and instruction sheet image data, the image ID for managing each image data, various metadata corresponding to each image data such as the imaging time, and the work ID 71 The medium ID 66 and various flag information are stored in association with each other. The image ID is arbitrary identification information that is appropriately given in each portable communication terminal device 10.

  The image data generation unit 110 includes an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and image data based on the electrical signal generated by the CCDI sensor. And a generating unit that generates

  In particular, when the work instruction sheet 70 is imaged, the image data generation unit 110 converts the imaged work instruction sheet 70 into an image and generates instruction sheet image data. The image data generation unit 110 images the film-type medium 60 that has been imaged when the bacteria generated in the specimen are cultured or the film-type medium 60 that has been cultured is imaged. 60 pieces of medium image data are generated as medium image data.

  The application control part 120 implement | achieves culture-medium information registration process with a predetermined application. In particular, the application control unit 120 executes the network communication unit 130 and the display control unit 161 while executing various control programs for controlling each unit of the portable communication terminal device 10 using the culture medium registration application stored in the application storage unit 101. In addition, various processes are executed in conjunction with or controlled by the operation unit 170.

  The application control unit 120 executes the medium registration application recorded in the application storage unit 101, controls the image data generation unit 110 to acquire the medium image data of the film-type medium 60 captured and the image data storage unit 102. To remember.

  Then, the application control unit 120 acquires the medium ID 66 from the imaged medium image data, and together with the acquired medium ID 66, the image data storage unit displays the medium image data, the metadata of the medium image data, and various flag information. 102. Note that the application control unit 120 may execute barcode recognition or OCR recognition in conjunction with another communication device or the database 400 via a communication line.

  In addition, the application control unit 120 performs initial registration for registering the culture medium information in the server device 40 at the start of the culture of the specimen after imaging of the culture medium image data or at a predetermined timing, and registers the culture medium information after the start of the culture of the specimen. Perform registration after incubation. In particular, the application control unit 120 specifies whether the registration is initial registration or post-cultivation registration based on the operator's instruction, and includes information (flag information) indicating either of the registrations in the culture medium information. Send to.

  The application control unit 120 acquires the current time from the timer 180 when the film-type medium 60 is imaged, and the image data storage unit as the metadata of the medium image data together with a predetermined image ID using the current time as the imaging time. 102. When the medium image data is transmitted to the server device 40, it is transmitted together.

  In addition, the application control unit 120, when the culture medium ID 66 and the work ID 71 that is the instruction ID 71a and the process ID 71b are stored in the IC tag, the operation unit 170, the display control unit 161, and the short-range wireless communication interface The medium ID 66 and the work ID 71 are acquired in conjunction with 140.

  When the server device 40 recognizes the medium ID 66 and the work ID 71 from the medium image data and the instruction sheet image data, the application control unit 120 transmits instruction sheet image data in addition to the medium image data as the medium information.

  Furthermore, the application control unit 120 may be realized as a function when the CPU (central processing unit) constituting the mobile terminal management control unit 190 executes an application in terms of implementation.

  The network communication unit 130 establishes a communication line with the server device 40 connected to the network 30 under the control of the application control unit 120 and the mobile terminal management control unit 190, and exchanges various data such as culture medium image data. Do.

  The short-range wireless communication interface 140 performs short-range wireless communication using an IC tag under the control of the application control unit 120 and the mobile terminal management control unit 190.

  The current position detection unit 150 recognizes the position of GPS (Global Positioning System) hygiene via the network 30 under the control of the application control unit 120 or the mobile terminal management control unit 190, and the satellite transmitted from the GPS satellite. A signal (GPS signal) is detected.

  Then, the current position detection unit 150 calculates (that is, detects) coordinate values indicated by the latitude and longitude of the current position of the portable communication terminal device 10 based on the detected GPS signal. In addition, the current position detection unit 150 provides the calculated coordinate value to the application control unit 120 as position information.

  In addition, when the portable communication terminal device 10 has a telephone function or a short-range wireless function, the portable communication terminal device 10 is based on the direction and the radio field intensity received by the telephone base station or the like for the radio wave used for the telephone or the short-range radio. The current position of the portable communication terminal device 10 may be calculated (detected).

  The display unit 160 has an image display area of a predetermined size (for example, 5 inches, W480 × H960 pixels), is configured by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 161. A predetermined image is displayed based on the display data. In particular, in the present embodiment, when the culture medium registration application is being executed, the display unit 160 is linked to the operation unit 170, and various displays, captured work instructions 70 and film-type culture media that have been imaged. 60 is displayed.

  The display control unit 161 generates drawing data necessary to cause the display unit 160 to draw a predetermined image under the control of the application control unit 120 or the mobile terminal management control unit 190, and the generated drawing data is displayed on the display unit. 160 is output.

  The operation unit 170 includes various confirmation buttons, operation buttons for inputting operation commands, a number of keys such as a numeric keypad, and a touch sensor provided on the display unit 160, and is used when performing each operation. It has become. Specifically, the operation unit 170 is used when performing operations for executing the various processes described above when the culture medium registration application is activated.

  In the present embodiment, the operation unit 170 can also be used when manually inputting the culture medium ID 66 directly.

  The timer 180 provides the application control unit 120 with the date and time when the image data generation unit 110 images the film-type medium.

  The portable terminal management control unit 190 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and the overall functions of the portable communication terminal device 10. In addition, overall functions for executing the information providing program are generally controlled.

[5] Server Device [5.1] Configuration of Server Device Next, the configuration of the server device 40 of this embodiment will be described with reference to FIG. FIG. 5 is a configuration diagram showing the configuration of the server device 40 of the present embodiment.

  As shown in FIG. 8, the server device 40 of the present embodiment communicates with a database 400 in which various types of information such as work information and medium information are stored, and the portable communication terminal device 10 and the administrator terminal device 20. A communication control unit 410, a data processing unit 420 that executes various processes such as a culture medium information registration process, a server management control unit 430 that controls each unit of the server device 40, a ROM / RAM 440 that is used to control each unit, and a time And a timer 450 used for management. The above-described units are connected to each other by a bus 41, and data transfer is performed between the components.

  The communication control unit 410 is a predetermined network interface, establishes a communication line with the portable communication terminal device 10 or the administrator terminal device 20, and exchanges various data with the portable communication terminal device 10 or the administrator terminal device 20. I do.

  The database 400 includes an HDD, a medium information database (hereinafter abbreviated as “medium information DB”) 401, a line information database (hereinafter abbreviated as “line information DB”) 402, and a lot information database (hereinafter “ Lot information DB ”) 403 and a work management database (hereinafter abbreviated as“ work management DB ”) 404. For example, each DB of the present embodiment constitutes a database according to the present invention.

The medium information DB 401 is a database in which medium information regarding the film-type medium 60 of the sample extracted for each process of each work line 80 is stored for each work ID 71 and medium ID 66. For example, in the culture medium information DB 401,
(1) Medium ID
(2) Imaged medium image data (3) Image capture time (4) Other information including flag information (5) Types of medium image, number of objects (including non-objects) and characteristics of object color Specific information such as an object including quantity (6) Characteristic pixel characteristic information used for imaging an object (including non-objects) (7) Number of colonies (8) Medium determination result (9) Work ID
Are recorded in association with each other.

  When the sample to be extracted is always extracted from the same process on the same work line 80 in the same lot, the work ID may be a lot ID, and the sample to be extracted is the same lot. However, when extracting from a different work line 80 or a different process, the line ID or the process ID 71b is obtained.

  The number of colonies and the result of medium determination in each medium information may be registered when the medium information is registered, or may be registered at a predetermined timing different from the registration timing of the medium information.

  Furthermore, when a plurality of imaging times of medium information of the same film type culture medium 60 are registered (that is, when there are a plurality of culture examination times described later), in the same culture medium ID 66, the culture medium at each culture examination time. Each medium information of an image, imaging time, the number of colonies, and medium determination is stored.

The line information DB 402 is a database in which line information regarding each work line 80 is stored for each line ID. For example, the line information DB 402 includes
(1) Line ID
(2) The process ID 71b of the process included in the work line 80 and the two types of data are recorded in association with each other. As the process type, a name for identifying each process such as material input, blending, filling, boiling, packaging, and packaging is used.

The lot information DB 403 is a database in which lot information regarding each lot is stored for each lot ID. For example, in the lot information DB 403,
(1) Lot ID (instruction ID 71a)
(2) Line ID of work line used for production or inspection of lots
(3) Lot work start time (4) Lot work end time (5) Five pieces of data of a work team of workers who perform lot work are recorded in association with each other.

The work management DB 404 is a database that stores various types of information related to work contents. For example, the work management DB 404 includes
(1) Work ID
(2) Line ID of the work line from which the sample is to be extracted (or line ID and process ID 71b)
(3) Type of sample (food) (product name, lot ID and / or lot name)
(4) Type of inspection (generic bacteria or bacteria to be detected such as E. coli)
(5) Culture conditions (dilution ratio, type of diluent, culture temperature, culture humidity and culture time)
(6) Culture start time (7) Time after a predetermined time has elapsed from the start of culture (hereinafter also referred to as “culture test time”)
(8) Culture location (for example, the position of the incubator number and the number of steps in the incubator)
(9) Work date and time (work start time and end time)
(10) Worker ID (and / or worker name)
Are recorded in association with each other.

  In addition, only a single time (that is, an end time for ending the culture of the specimen) may be set as the culture examination time, or after the statutory or predetermined time has elapsed from the culture start time, for example, the culture A plurality of times such as 24 hours from the start time, 48 hours, or 72 hours may be set.

The data processing unit 420 executes various data processing in accordance with the application recorded in the ROM / RAM 440. In particular, the data processing unit 420 executes a predetermined program,
(1) Operation management of the communication control unit 410;
(2) Medium registration processing executed in conjunction with each portable communication terminal device 10;
(3) Colony detection determination processing for detecting colonies and the number thereof based on the feature amount of each pixel constituting the medium image;
(4) lot determination processing for determining a lot based on registered medium information;
(5) Report processing for outputting the determination result in a report format;
(6) Management and control of the database 400;
I do. Specifically, the data processing unit 420 includes a registration processing unit 421, a colony detection determination unit 423, a lot determination processing unit 424, and a report processing unit 425.

  For example, the registration processing unit 421 of the present embodiment constitutes an acquisition unit and a registration unit according to the present invention, and the colony detection determination unit 423 of the present embodiment includes the extraction unit, the detection unit, and the counting unit of the present invention. Configure. Furthermore, details of the registration processing unit 421, the colony detection determination unit 423, the lot determination processing unit 424, and the report processing unit 425 of this embodiment will be described later.

  The server management control unit 430 is mainly configured by a central processing unit (CPU), and integrally controls each unit of the server device 40 by executing a program. Specifically, the server management control unit 430 performs login processing for each user and various other controls based on a login request from the portable communication terminal device 10 by a user operation.

  Various programs necessary for driving the server device 40 are recorded in the ROM / RAM 440. In particular, the ROM / RAM 440 includes information on determination criteria (hereinafter referred to as “medium determination criterion information”) used in performing each determination of medium determination (pass / fail determination), process determination, line determination, and lot determination of each film type medium 60. Etc.) is stored. The ROM / RAM 440 is used as a work area during execution of each program.

  The timer 450 is used for managing the time required when the medium information registration process and the lot determination process are executed.

[5.2] Registration Processing Unit Next, details of the registration processing unit 421 in the server device 40 of the present embodiment will be described.

  The registration processing unit 421 according to the present embodiment performs a medium information registration process for registering each medium information in the medium information DB 401 while being associated with the work ID 71 in conjunction with the portable communication terminal device 10. In particular, the registration processing unit 421 executes different medium information registration processing based on flag information indicating whether the registration is initial registration or post-culture registration included in the culture medium information.

(Initial registration)
When the flag information indicating initial registration is included in the culture medium information transmitted from the portable communication terminal device 10, the registration processing unit 421 performs a culture medium information registration process based on the initial registration.

  Specifically, when the registration processing unit 421 acquires the culture medium information via the communication control unit 410, the registration processing unit 421 specifies the culture medium ID 66 and the work ID 71 included in the culture medium information. In addition, the registration processing unit 421 searches the work management DB 404 based on the specified work ID 71, specifies the corresponding work information, and associates the acquired medium image data and imaging time with the specified work information. Is registered in the culture medium information DB 401.

  In particular, the registration processing unit 421 specifies the lot ID including the work line 80 from which the sample is extracted based on the acquired work ID 71, the line ID of the work line 80, the process ID 71b from which the sample is extracted, and the specification. The medium image data and the imaging time included in the medium information are registered in the medium information DB 401 in association with the lot ID, the line ID, and the process ID 71b.

  Then, the registration processing unit 421 registers the imaging time in the culture medium information DB 401 as the culture start time. As the culture start time, a preset time may be used instead of the imaging time on the assumption that the medium information registration process is executed at the time.

(Registration after culture)
When the flag information indicating post-cultivation registration is included in the culture medium information transmitted from the portable communication terminal device 10, the registration processing unit 421 performs a registration process based on post-cultivation registration.

  Specifically, when acquiring the culture medium information via the communication control unit 410, the registration processing unit 421 identifies the culture medium ID 66 and the work ID 71 included in the culture medium information, as in the initial registration. Then, the registration processing unit 421 searches the work management DB 404 based on the identified work ID 71, identifies the corresponding work information, and registers the imaging time in the culture medium information DB 401 in association with the identified work information. To do. Note that the culture examination time may be a preset time instead of the imaging time on the assumption that the culture information registration process is executed at the same time as the culture start time.

  On the other hand, the registration processing unit 421 causes the colony detection determination unit 423 to perform image analysis on the acquired medium image data and extract the feature amount in each pixel of the medium image, and based on the extracted feature amount of each pixel. Colony detection and counting are executed, and the pass / fail determination of the specimen of each film-type medium 60 is made based on the number of colonies. The registration processing unit 421 also includes a type of medium image indicating the first medium image and the second medium image, the number of first objects (non-colonies), a feature amount regarding the color of the first object, and the number of colonies detected. The medium information including the determination result of the synthetic leather is registered in the medium information DB 401 in association with the specified work ID 71.

[5.3] Colony Detection Determination Unit [5.3.1] Principle of Colony Detection Processing Next, the principle of colony detection processing in the server device 40 of the present embodiment will be described using FIG. In addition, FIG. 6 is a figure for demonstrating the principle of the colony detection process in the server apparatus 40 of this embodiment.

  The colony detection determination unit 423 according to the present embodiment uses a medium image immediately after culture from the medium image data included in the medium information transmitted from the portable communication terminal device 10 at a predetermined timing under the control of the registration processing unit 421. Specifically, two culture media, a first culture image) and a culture image to be subjected to colony detection (specifically, a culture media image after culturing and a second culture image taken at a predetermined timing) While acquiring an image, the acquired two culture medium images are image-analyzed, the detection of the colony in a 2nd culture medium image, and the count of the number are performed, and it provides to the registration process part 421.

  Usually, it is assumed that colonies are not generated in the first medium image before culturing (specifically, immediately after the start of culturing), and what is specified as an object in the first medium image is not a colony. A non-target object (that is, “non-colony”) such as dust contained in the culture medium or the like when the dust attached to the film-type medium 60 from the beginning or a specimen is placed. In addition, in the case where bacteria are cultured in a state where non-objects are present and colonies that are lumps of bacteria are specified and counted, the count results include non-objects such as dust. .

  For example, as shown in FIG. 6, when a non-colony exists in the medium image immediately after the start of culture (ie, the first medium image) (FIG. 6A), the medium image (ie, the second medium image) at a predetermined timing after the culture. In the case where colonies are detected, there is no difference in the feature values regarding the colors of the colonies and non-colony, and the colonies cannot be accurately identified and counted (FIG. 6B).

  Therefore, the colony detection determination unit 423 of the present embodiment detects a change in the second medium image based on the first medium image, and counts the number while identifying the colony based on the detected change. It has become.

  In particular, the colony detection determination unit 423 has a culture image at the same time as the culture examination time (or includes a range determined to be the same time (eg, ± 5 minutes)), or flag information for post-culture registration, And the culture medium image which has the earliest time of imaging time or registration time is specified as a 1st culture medium image, and the specified 1st culture medium image is used for colony specific count processing.

  In addition, the colony detection determination unit 423 extracts feature amounts relating to the colors of the pixels constituting the two acquired medium images such as the luminance value, the S value, or the RGB gradation values, and extracts each of the extracted medium images. A change occurring in the second medium image is detected on the basis of the feature amount of each pixel in, and a colony is identified and counted based on the detected change.

  In this embodiment, when the colony detection determination unit 423 acquires the first medium image and the second medium image, the colony detection determination unit 423 uses the acquired first medium image and the second medium image, and A change generated in the second medium image by the colony identification counting process is detected, and counting is performed while specifying the colony based on the detected change.

[5.3.2] Colony identification counting process Next, the colony identification counting process in the server device 40 of the present embodiment will be described with reference to FIGS. 7 to 13.

  7 is a diagram for explaining the first colony identification counting process in the server device 40 of the present embodiment, and FIGS. 8 and 9 illustrate the second colony identification in the server device 40 of the present embodiment. It is a figure for demonstrating a counting process (the 1). Moreover, FIGS. 10-12 is a figure for demonstrating the 2nd colony specific count process (the 2) in the server apparatus 40 of this embodiment, FIG. 13 is the figure in the server apparatus 40 of this embodiment. It is a figure for demonstrating 3 colony specific count processing.

(First colony identification counting process)
As the first colony identification counting process, the colony detection determination unit 423 of the present embodiment includes:
(1) Each of the medium image immediately after culture (that is, the first medium image) and the medium image that performs colony detection (that is, the second medium image) have the same conditions, that is, relate to the same color. Extracting feature pixels having features,
(2) In each image, either one of the feature pixels or a group of feature pixels connected by the feature pixels is identified and counted as an object,
(3) subtracting the number of objects specified in the medium image immediately after culture (first medium image) from the number of objects specified in the medium image (second medium image) for performing colony detection;
Detect the number of colonies.

  Specifically, the colony detection determination unit 423 reads the medium determination criterion information stored in the ROM / RAM 440, and performs a predetermined first condition (for example, luminance value, S value, RGB) included in the medium determination criterion information. And detecting a pixel of the first medium image having a feature amount (that is, a threshold value such as a gradation value of HSV or a value of HSV) (that is, a pixel having one value after binarization) as a first feature pixel. Then, a pixel of the second medium image having a feature amount that satisfies the first condition (that is, under the same condition) (that is, a pixel that is binarized and has one value) is detected as a second feature pixel.

  In addition, the colony detection determination unit 423 specifies the imaged object on the first medium image, which is the first feature pixel group connected to the detected first feature pixel or the first feature pixel, as a non-colony. The imaged object on the second medium image that is the second feature pixel group connected to the detected second feature pixel or the first feature pixel is identified as a colony candidate, and the identified non-colony and colony candidate are identified. Count each.

  Then, the colony detection determination unit 423 calculates the number of objects (that is, non-colony) imaged on the second medium image from the number of objects (that is, colony candidates) imaged on the second medium image. The value calculated by subtraction is specified as the number of colonies and provided to the registration processing unit 421.

  For example, the colony detection determination unit 423 uses the maximum preset as the first condition in each of the R, G, and B subpixels of each pixel of the first medium image and the second medium image acquired from each medium image data. The pixel value and the minimum pixel value are read out, and the pixels included in the range of the pixel values read out by the respective sub-pixels are detected.

  Note that the maximum pixel value and the minimum pixel value in each of the R, G, and B sub-pixels may be determined in advance by, for example, an administrator, or may be determined in advance by the bacterial species and the dilution factor.

  In addition, the colony detection determination unit 423 performs image filter processing for reducing noise in each of the first medium image and the second medium image, and specifically, for the detected feature pixel. If there is another feature pixel pixel adjacent to the feature pixel, there is an expansion process that replaces all pixels adjacent to the feature pixel with the feature pixel, and there is a non-detected pixel adjacent to the feature pixel. In some cases, the feature pixels of the first medium image and the second medium image are specified while executing a contraction process in which all pixels adjacent to the feature pixel are replaced with non-feature pixels.

  Then, as shown in FIG. 7, the colony detection determination unit 423 selects a single feature pixel or a feature pixel connected to the feature pixel in each of the first medium image and the second medium image as the first object (non-colony). ) Or the second target object (colony candidate) while labeling and specifying the number of the first target object (“3” in the example of FIG. 7A) and the second target object (“8” in the example of FIG. 7B) Then, the number of colonies (“5” in the example of FIG. 7) is counted by subtracting the number of first objects from the counted number of second objects.

(Second colony identification counting process (1))
Unlike the first colony identification counting process, the colony detection determination unit 423 of the present embodiment is identical to the target object (colony candidate and non-colony) specified in each medium image, unlike the first colony identification counting process. While determining sex, the number of colonies is counted based on the identity determination result.

In particular, the colony detection determination unit 423
(1) A colony candidate is detected from a second medium image that is a medium image for executing colony detection based on a feature amount relating to the color of each pixel, and a non-colony is detected from the first medium image that is a medium image immediately after culture. Detect
(2) Specify the coordinate positions on the film-type medium 60 of the colony candidate and the non-colony, respectively,
(3) In a colony candidate having the same coordinate position on the non-colony and the film-type medium 60, the colony candidate and the non-colony are identical based on the characteristics of each feature pixel used to image the non-colony and the colony candidate. (4) Counting the number of identified colonies while identifying non-colony and non-colony candidates as colonies.

  In the second colony identification counting process, the colony detection determination unit 423 detects a change in the appearance of a colony candidate specified in the second medium image as a change occurring in the second medium image, and the change Is detected as the number of colonies.

  Specifically, the colony detection determination unit 423 reads the medium determination criterion information stored in the ROM / RAM 440 and performs the predetermined second included in the medium determination criterion information, as in the first colony identification counting process. While detecting the pixel of the 1st culture image which has the feature-value which has conditions (for example, threshold values, such as a luminance value, S value, RGB gradation value, or HSV value) as the 1st feature pixel, A pixel of the second medium image having a feature amount having two conditions (that is, under the same condition) is detected as a second feature pixel.

  Then, the colony detection determination unit 423 labels the imaged object on the first medium image based on the detected first feature pixel or the first feature pixel group connected to the first feature pixel. While specifying as a non-colony, for example, as shown in FIG. 8A, the coordinate position (x, y) of the non-colony film type medium 60 such as the center of gravity of each non-colony, or the film as shown in FIG. 8B When the mold medium 60 is imaged, the position of the first object on the film medium 60 is specified by the row and column numbers of the rectangular area provided in advance on the medium image.

  At this time, as shown in FIG. 9A (when the coordinate position of the non-colony is the center of gravity) and FIG. 9B (when the coordinate position of the non-colony is a rectangular area), the colony detection determination unit 423, for example, The RGB gradation values of the feature pixels used for imaging and the arrangement positions of the feature pixels on the medium image (dot positions determined by the rows and columns) are specified as the characteristics of the feature pixels.

  Further, the colony detection determination unit 423 labels the imaged object on the second medium image based on the detected second feature pixel or the second feature pixel group connected to the second feature pixel. While specifying as a non-colony, the position on the film type culture medium 60 of a 2nd target object is specified similarly to a 1st target object.

  At this time, similarly to the first object, the colony detection determination unit 423 uses the RGB gradation value of the feature pixel and the arrangement position of the feature pixel used when imaging the second object as the characteristic of the feature pixel. Identify.

  Further, the colony detection determination unit 423, for each colony candidate, defines the same coordinate position (x, y) or the same coordinate range (x ± n pixels) on the film-type medium 60 when the center of gravity position is defined. , Y ± n pixels: For example, n is “3”), or in the case of being defined by the matrix number of the rectangular area, it is determined whether or not there is a non-colony in the same number.

  At this time, if there is no non-colony, the colony detection determination unit 423 identifies the corresponding colony candidate as a colony. If there is the non-colony, the colony detection determination unit 423 Based on the characteristics, the identity is determined, and only colony candidates determined to be non-identical are specified as colonies.

In particular, the colony detection determination unit 423 determines the identity between a colony candidate and a non-colony whose coordinate position on the film-type medium 60 matches.
(A) whether the number of colony candidate and non-colony feature pixels match (or is within a predetermined range),
(B) If the number of feature pixels of the colony candidate and the non-colony match, whether or not the pixel arrangement position on the culture medium image matches in each feature pixel (or is within a predetermined range),
(C) When the pixel arrangement position on the culture medium image is the same for each feature pixel, whether or not the feature quantities related to the colors based on the corresponding feature pixels match,
Determine.

  Note that the colony detection determination unit 423 generates a three-dimensional color histogram for the RGB tone values of each feature pixel used when imaging the corresponding non-colony or colony candidate in the process (C), The identity is determined by determining whether the color histogram of the generated colony candidate is within a predetermined range with respect to the color histogram of the non-colony.

  And the colony detection determination part 423 is the case where the number of the feature pixels of a colony candidate and a non-colony corresponds, and the feature-value based on each feature pixel in the non-colony corresponding to a colony candidate is the same (or the same range). The colony candidate is specified as a non-colony, otherwise the colony candidate is specified as a colony.

  When the colony detection determination unit 423 determines the identity between the colony candidate and the non-colony, the feature amounts (luminance values and RGB gradation values) of all the feature pixels corresponding to the non-colony corresponding to the colony candidate are used. Etc.), or even when all feature pixels do not match, for example, when feature pixels of a predetermined ratio or more such as 85% match, they may be specified as colonies. Furthermore, when the colony detection determination unit 423 determines the identity between the colony candidate and the non-colony, even if the number of feature pixels of the non-colony corresponding to the colony candidate does not match, the predetermined range If the difference is within the range (for example, ± 2), it may be determined that there is identity.

  The colony detection determination unit 423 determines the identity of the non-colony and the colony candidate by the feature amount based on RGB in each feature pixel. Alternatively, a multi-dimensional histogram based on two or more feature quantities or two or more feature quantities including RGB gradation values in these may be generated, and the identity may be determined on the histogram.

  Further, the colony detection determination unit 423 determines the identity of the colony candidate and the non-colony whose coordinate position on the film-type medium 60 matches based on the color-related feature amount in the corresponding feature pixel. The identity of the colony candidate and the non-colony corresponding to the colony candidate may be determined based only on the coincidence and the identity of the coordinate position on the film-type medium 60 (that is, without considering the color-related feature amount).

  Further, the colony detection determination unit 423 determines the identity based on the coordinate positions of the non-colony and colony candidates on the film-type medium 60, but for each colony candidate, Colony candidates that are determined to be non-identical with the feature values of any non-colony by comparing the feature values related to colors may be specified as colonies.

  Moreover, said 2nd conditions may be the same as the 1st conditions of a 1st colony specific count process, and may differ.

(Second colony identification counting process (2))
Unlike the second colony identification counting process described above, the colony detection determination unit 423 of the present embodiment is not identical to any non-colony without using the coordinate position on the film-type medium 60 in the colony candidate and non-colony. A certain colony candidate may be specified as a colony.

That is, the colony detection determination unit 423
(1) Based on the feature amount relating to the color of each pixel, the non-colony is detected from the first medium image that is a medium image for executing colony detection, and the second medium image is a medium image immediately after the culture. Detect colony candidates from
(2) Determine the identity of each colony candidate with a non-colony based on the color-related feature quantity based on each feature pixel used to image a colony candidate and a non-colony. (3) Not identical to a non-colony Colony candidates determined to be present may be specified as colonies, and the number of specified colonies may be counted.

  Specifically, for example, as shown in FIG. 10, the colony detection determination unit 423 binarizes each pixel (FIG. 10A) of the second medium image based on a predetermined condition based on a predetermined condition (FIG. 10B). The histogram of the average values of the feature values (luminance values) relating to the color of the first pixel group (non-colony) connected with the first feature pixels (FIG. 10C), and statistical methods such as maximum value, minimum value, standard deviation, etc. The object section (non-colony section: brightness: 0.6438 to 0.9556) in the histogram of brightness values of non-colony is used.

  Similarly to the first medium image, the colony detection determination unit 423 binarizes each pixel (FIG. 11A) of the medium image based on a predetermined condition based on a predetermined condition as shown in FIG. 11B), an average value of the feature values (luminance values) relating to the color of the second pixel group (colony candidates) connected with the second feature pixels is histogrammed (FIG. 11C), and the non-colony is displayed on the histogram of the luminance values of the colony candidates. Identify colony candidates outside the section.

  In addition, the colony detection determination unit 423 uses the maximum value, the minimum value, and the standard deviation in the histogram of the first medium image to calculate the upper limit value and the lower limit value of the object section as follows (Expression 1) and (Expression 2). ). “SD” indicates a standard deviation, and “α” indicates a predetermined count.

  And the colony detection determination part 423 recognizes the position on the film type | mold culture medium 60 of a colony candidate based on the information at the time of labeling the colony candidate outside a non-colony area on a histogram, as shown in FIG. However, the colony candidate is specified as a colony, and the colony candidates specified as the colony are counted.

  In the example of FIG. 12, the colony detection determination unit 423 counts 15 colonies. In the colony identification counting process described above, the colony detection determination unit 423 generates the histograms of the first medium image and the second medium image using the luminance value of the target object. Tone, saturation, or hue may be used, and together with these, the size of the object (number of feature pixels), the roundness of the object, or the curvature distribution of the object, using a histogram in multiple dimensions Also good.

  In the colony identification counting process, the colony detection determination unit 423 uses the distribution of the object as it is, but may generate a histogram by analyzing the distribution of the object by principal component analysis or the like. .

(Third colony identification counting process)
The colony detection determination unit 423 of the present embodiment subtracts each corresponding pixel feature amount of the first medium image from the second medium image as the third colony specific counting process, unlike the above-described colony specific counting process, respectively. Then, a difference image is generated, and the number is counted while identifying colonies based on the feature amount relating to the color of each pixel of the generated difference image.

That is, the colony detection determination unit 423
(1) For each pixel at each coordinate position of the film-type medium 60, a medium image immediately after the culture (first medium image) from a feature amount relating to the color of each pixel of the medium image (second medium image) for executing colony detection And subtracting the feature amount related to the color of each pixel to generate a difference image as a change occurring in the second medium image,
(2) The medium determination criterion information stored in the ROM / RAM 440 is read, and the generated difference image pixel having the feature amount having the third condition included in the medium determination criterion information is detected as the feature pixel. ,
(3) Count at least one of the detected feature pixels or a group of feature pixels connected to the feature pixels while identifying them as colonies.

  In particular, the colony detection determination unit 423 subtracts the RGB gradation values for each arrangement position on the film-type medium 60 of each pixel for each of the first medium image and the second medium image, thereby obtaining the RGB gradation values. May be negative, a square sum of the RGB gradation values of each subtracted pixel is generated, and a value obtained by squaring the value is used as a feature amount of the corresponding pixel of the difference image.

  Then, the colony detection determination unit 423 specifies and counts the feature pixel and the feature pixel group connected to the feature pixel as a colony in the generated difference image as a feature pixel.

  In order to simplify the process, the colony detection determination unit 423 calculates saturation or lightness from each gradation value of RGB and based on the saturation or lightness on the film-type medium 60 of each pixel as described above. A difference value may be calculated for each array position to generate a difference image.

  For example, as shown in FIGS. 13A and 13B, there is a first object that is a non-colony based on the first medium image, and in the second medium image based on the first medium image, enlargement, color When there is a change, no change, and a new colony candidate (second object), as shown in FIG. 13C, a difference image in which only the colony is imaged is generated.

[5.3.3] Sample Pass / Fail Judgment The colony detection determination unit 423 performs medium determination (that is, sample pass / fail determination) on whether the sample of each film-type medium 60 is abnormal or normal. For example, the registration processing unit 421 determines pass / fail of each sample based on a threshold value of the number of bacteria set in advance according to the bacterial species to be detected from the sample (that is, a determination criterion), and the result is stored in the registration processing unit 421. provide.

  In particular, in the present embodiment, since the determination criteria are different based on the bacterial species and the dilution rate, the registration processing unit 421 obtains the medium determination criterion information from the ROM / RAM 440 based on the criteria used when cultivating the specimen and the bacterial species. Read out and perform medium determination.

  Each criterion information is specified in association with the culture medium ID 66. That is, since the type of the film-type medium 60 is different for each bacterial species detected from the specimen, the bacterial species to be detected can be specified by specifying the medium ID 66. Therefore, in this embodiment, the determination reference information specified based on the culture medium ID 66 can be read out by setting the dilution rate in advance.

  Moreover, in this embodiment, since the pass / fail determination of each film type culture medium 60 is used in the process determination, the line determination, and the lot determination, the medium determination is executed in association with these determinations. In addition, the method of pass / fail determination of each film type culture medium 60 in process determination, line determination, and lot determination will be described later.

[5.4] Lot Determination Processing Unit Next, details of the lot determination processing unit 424 in the server device 40 of the present embodiment will be described with reference to FIGS. 14 to 16. 14-16 is a figure for demonstrating the process determination in the server apparatus 40 of this embodiment.

  The lot determination processing unit 424 of the present embodiment analyzes data on hygiene management in the designated lot, work line 80 or process based on the instructions of the administrator input to the administrator terminal device 20 (ie, pass / fail determination). Execute.

  Specifically, the lot determination processing unit 424, for each lot, line information of the work line 80 used for the corresponding lot, and medium information registered in association with the corresponding work line 80 (at least the number of colonies). Based on the above, it is determined whether the food group manufactured or inspected under the same condition has a predetermined condition.

  In addition, when the lot determination is instructed, the lot determination processing unit 424 determines whether the work line 80 included in the corresponding lot and the processes belonging to the work line 80 are abnormal or normal in terms of hygiene management. 80 line determinations (that is, pass / fail determination for hygiene management) and process determinations for each process (that is, determination of pass / fail for hygiene management) are performed, and lot determination is performed using the process determination and line determination.

  In particular, when the lot determination is instructed, the lot determination processing unit 424, for example, the number of colonies of the film-type medium 60 in the medium information that has passed a predetermined culture inspection time such as 24 hours, 48 hours, etc. Based on the medium information of the pass / fail determination of the specimen, the pass / fail of hygienic management of the process is determined, and the pass / fail of hygiene management of the work line 80 is determined based on the pass / fail determination of the process included in the corresponding work line 80. Based on the pass / fail determination of the work line 80 included in the corresponding lot, the pass / fail in sanitary management of the lot is determined.

  Note that the lot determination processing unit 424 of the present embodiment may execute not only lot determination but also process determination or line determination as data analysis.

(Process judgment)
The lot determination processing unit 424 has a culture start time at the same timing, a culture examination time at the same timing, a culture start time having a time within a preset time from the first time to the second time, or a preset first time. The culture start time or the culture test time has a predetermined condition, such as having a culture test time having a time within the time from the first time to the second time, and is registered in association with the same process in the same lot. Each process determination is performed based on the culture medium information of the plurality of film-type culture media 60 that has been performed. That is, the lot determination processing unit 424 executes each process determination by comprehensive determination based on each medium determination result of the plurality of film-type mediums 60.

  Specifically, the lot determination processing unit 424 displays the medium determination results of the corresponding film-type medium 60 (that is, all the medium determination results registered in the medium information having the process ID 71b of the process to be subjected to the process determination). In addition to obtaining, if the number of pass / fail of the judgment result satisfies a predetermined condition, the process judgment of the process to be judged is judged to be acceptable, and if not, the judgment should be made The process judgment of the process is judged as rejected.

  For example, as shown in FIG. 14, three film-type culture media 60 have a process ID 71 b of the process to be determined, the first film-type culture media 60 has a colony number of “20”, and the second film-type culture media 60 When the number of colonies is “30” and the number of colonies of the third film-type medium 60 is “70” and the number of colonies is “30” or less, the determination result is passed, and the predetermined condition is “60”. % ”Is assumed to pass the process determination of the process to be determined. In this case, since two of the three determination results of the film-type medium 60 are acceptable, the lot determination processing unit 424 determines that the process is acceptable.

  In addition, the lot determination processing unit 424 may execute the process determination of the process to be determined based on the number of colonies included in the culture medium information having the process ID 71b of the process to be executed instead of the above-described method. Good.

  For example, as shown in FIG. 15, the three film-type culture media 60 have the process ID 71 b of the process to be determined, the number of colonies of the first film-type culture media 60 is “20”, and the second film-type culture media 60 Medium information in which the number of colonies is “30” and the number of colonies of the third film-type medium 60 is “70” as described above, and the predetermined condition includes the number of colonies equal to or greater than the colony number threshold “70”. When there is no, the case where the process determination of the process which should be determined is passed is assumed. In this case, since the number of colonies in the third film-type medium 60 is “70”, the lot determination processing unit 424 determines that the process is unacceptable.

  On the other hand, the lot determination processing unit 424 is based on the number of colonies included in all the culture medium information having the process ID 71b of the process to be subjected to the process determination, instead of using the above-described threshold value for the number of colonies. You may perform process determination of the process which should be determined.

  For example, as shown in FIG. 16, the three film-type culture media 60 have a process ID 71 b of the process to be determined, the number of colonies of the first film-type culture media 60 is “20”, and the second film-type culture media 60 When the number of colonies is “30” and the number of colonies of the third film-type medium 60 is “70” as described above, and the predetermined condition is that the average of all colonies is equal to or less than the threshold value “30” Assume that the process judgment of the process to be judged is passed. In this case, since the average number of colonies of the three film-type culture media 60 is “40”, the lot determination processing unit 424 determines that the process is unacceptable.

  Note that, when only the process determination is performed, the lot determination processing unit 424 may weight the predetermined process based on the position or role of the process, and execute the process determination after taking the weight into consideration. .

  In addition, the lot determination processing unit 424 of the present embodiment may select one of the above methods based on the number of medium information registered in each process, or two or three of the above methods. The process determination may be executed in combination. The predetermined condition can be changed depending on the type of specimen, the type of bacteria to be detected, and the like, and can be set by an administrator or provided as a part of a program.

(Line judgment)
The lot determination processing unit 424 performs line determination for each work line 80 based on the pass / fail determination for hygiene management of a plurality of processes that are determined at a predetermined timing and registered in association with the corresponding line information. To do. That is, the lot determination processing unit 424 performs line determination by comprehensive determination based on the determination results of a plurality of processes of the same lot determined at a predetermined timing.

  Specifically, the lot determination processing unit 424 is determined at the same timing or a timing satisfying a predetermined condition, and has the line ID of the work line 80 to be subjected to line determination as described above. When the determination result of the determination is acquired and the number of pass / fail of the determination result satisfies a predetermined condition, the line determination of the work line 80 to be determined is determined to be acceptable, and the condition is not satisfied The line determination of the work line 80 to be determined is determined to be unacceptable.

  For example, when the three processes have the line ID of the work line 80 to be determined, the first process is “pass”, the second process is “pass”, and the third process is “fail”. In the case where the work line 80 is configured from a process in which the predetermined condition is “60%”, the lot determination processing unit 424 passes the line determination of the work line 80 to be determined.

(Lot judgment)
The lot determination processing unit 424 executes the lot determination for each lot based on the hygiene management pass / fail determination of the plurality of work lines 80 that are determined at a predetermined timing and registered in association with the corresponding lot information. To do. That is, the lot determination processing unit 424 executes lot determination by comprehensive determination based on the determination results of the plurality of work lines 80.

  Specifically, the lot determination processing unit 424 determines the lot to be determined based on the pass / fail determination determined at a predetermined timing in the sanitary management information of the work line 80 having the lot ID of the lot for which the lot determination is to be performed. Make a decision.

  For example, when a lot is configured from a work line 80 that has passed a predetermined condition of “60%”, the lot determination processing unit 424 determines that the lot determination of the lot to be determined is acceptable. Assume that one work line 80 has a lot ID of a lot to be determined. In this case, when the first work line 80 is “pass”, the second work line 80 is “pass”, and the third work line 80 is “fail”, the lot determination processing unit 424 determines the lot to be determined. It is determined that the lot determination is acceptable.

When the lot work time is long, the lot determination may be executed by dividing the time every predetermined time (for example, 8 hours or 12 hours). In this case, when the lot determination is performed while the work is suspended, a dummy result may be used, or it may be determined that the work is being suspended.

(Other)
The lot determination processing unit 424 can perform determinations and data analysis other than those described above using the culture medium information, line information, lot information, and work management DB 404, and the determination result or data analysis via the report processing unit 425. The result can be provided to the administrator terminal device 20 so that the administrator can view the result.

  Specifically, the lot determination processing unit 424 checks the reliability of the sample cultured in each film-type medium 60, that is, checks whether or not an inspection error has occurred. The medium information in the medium ID is subjected to a predetermined analysis of the medium information or the medium image data in time series from the culture start time to the end of the culture.

  For example, the lot determination processing unit 424 has a specific culture medium ID (same culture medium ID) 66 based on an instruction from the administrator received via the administrator terminal device 20, and starts from the culture start time to a predetermined time. Are extracted together with the medium image data. Then, the lot determination processing unit 424 performs a predetermined analysis on each medium information and each image data along a predetermined time series, or aggregates each medium information and each image data along a time series. In addition, the lot determination processing unit 424 causes the report processing unit 425 to generate the analysis result or the aggregation result as browsing data having a predetermined data format, and allows the administrator to browse the generated browsing data. 20 to provide.

  Note that the lot determination processing unit 424 is linked to the report processing unit 425, and at this time, based on an instruction from the manager terminal device 20, each medium information in one medium ID 66 is used for legal hygiene management reporting. May be made individually viewable.

  Further, the lot determination processing unit 424 may have a search function for medium information, line information, lot information, or work management information. Specifically, the lot determination processing unit 424 uses the lot ID (instruction ID 71a), the work line ID, the process ID 71b, the work ID 71, the culture start time, the lot work date and time, the culture medium ID 66, the specimen type, and the like as search keys. The database 400 may be searched, and the report processing unit 425 may be linked to generate data that allows the administrator to view the corresponding medium information and various types of information.

  Note that the report processing unit 425 is configured to search for medium information (medium image data, number of colonies and medium determination result), process information, and line specified by a search based on an instruction from the administrator received via the administrator terminal device 20. It is also possible to provide information or information on lots in a predetermined report format. That is, the report processing unit 425 is configured to be able to provide various information as evidence or reports in legal inspection reports and other cases.

[5.5] Report Processing Unit Next, details of the report processing unit 425 in the server device 40 of the present embodiment will be described.

  The report processing unit 425 performs data analysis related to hygiene management in the designated lot, work line 80 or process based on the administrator's instruction input to the administrator terminal device 20 and template data having a predetermined report format. An analysis result (that is, a determination result of pass / fail determination) is generated as report data, and the generated report data is provided to the administrator terminal device 20 so as to be viewable by the administrator via the communication control unit 410.

  Specifically, the report processing unit 425 extracts necessary information from the medium information, the line information, and the lot information such as the medium image data, the number of colonies, or the medium determination result, and the extracted information and the lot determination processing unit 424. Based on the analysis result obtained by the above, report data is generated while assigning each information to the template data. Then, the report processing unit 425 provides the administrator terminal device 20 with report data having an image of a medium in which the processing such as rotation is not executed and the identity is ensured.

  Note that, as described above, the report processing unit 425 is configured to generate predetermined report data or browsing data in accordance with various analyzes or searches and provide the data to the administrator terminal device 20. . In other words, the report processing unit 425 can also provide medium information, process information, line information, or lot-related information specified by the search in a predetermined report format based on the received administrator's instruction. In addition, it is configured so that various information can be provided as evidence or reports in statutory inspection reports and other cases.

[6] Hygiene management system operation process [6.1] Medium information registration process (portable communication terminal device)
Next, operation | movement of the culture medium information registration process in the portable communication terminal device 10 of this embodiment is demonstrated using FIG. FIG. 17 is a flowchart showing the culture information registration processing operation in the portable communication terminal device 10 of the present embodiment.

  In this operation, it is assumed that corresponding lot information and line information associated with the work instruction sheet 70 are already stored in the line information DB 402 and the lot information DB 403. Further, it is assumed that the medium ID or instruction ID is attached to the film-type medium 60 and the work instruction sheet 70 by a two-dimensional barcode. Further, in this operation, the number of colonies in each film-type medium 60 is detected at the time of registration in the medium information database 400, and the portable communication terminal device 10 uses RGB for capturing a medium image. It is assumed that calibration for the gradation value or the luminance value is performed.

  First, in the portable communication terminal device 10, when the application control unit 120 detects an activation instruction for the culture medium registration application via the operation unit 170 (step S101), the application control unit 120 reads the culture medium registration application from the application storage unit 101 and activates it ( Step S102). At this time, the application control unit 120 performs initialization of the work memory and other necessary processes under the control of the mobile terminal management control unit 190.

  Next, the application control unit 120 displays an image for interlocking with the display control unit 161 to select whether the initial registration of the film-type medium 60 or the post-culture registration after a predetermined time has elapsed from the start of the culture. It is displayed on the unit 160 and waits for its input (step S103).

  Next, when detecting an input of a selection instruction from the operation unit 170 (step S104), the application control unit 120 determines whether initial registration or post-cultivation registration and sets the result in flag information (step S105).

  Next, the application control unit 120 causes the display unit 160 to display a screen that prompts the imaging of the film-type medium 60, and waits for imaging by the image data generation unit 110 in conjunction with the operation unit 170 (step S106). At this time, the application control unit 120 causes a predetermined image to be superimposed on the display unit 160 in order to align the medium image to be acquired.

  Next, when the application control unit 120 detects imaging by the image data generation unit 110 in conjunction with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S107), the image data generation unit 110 causes the medium ID 66 to be detected. At the same time, the imaged medium image data of the film type medium 60 is acquired and stored in the image data storage unit 102 while giving a predetermined image ID (step S108).

  At this time, the application control unit 120 acquires the medium image data while adjusting the position of the medium image with a marker (not shown) such as a cross formed on the film type medium 60. However, this marker may be formed at one corner of the four corners of the film-type culture medium 60, or may be formed as a plurality of auxiliary lines formed vertically and horizontally on the entire film-type culture medium 60.

  Next, the application control unit 120 acquires the current time from the timer 180 as the imaging time of the medium image data, and stores it in the image data storage unit 102 as metadata in association with the medium image data (step S109).

  Next, the application control unit 120 analyzes the two-dimensional barcode formed in a predetermined area of the acquired imaged culture medium image data, acquires the culture medium ID 66, and stores the image data in association with the culture medium image data. The information is stored in the unit 102 (step S110).

  Next, the application control unit 120 causes the display unit 160 to display a screen for acquiring instruction sheet image data together with the instruction sheet ID 71 and the process ID 71 in conjunction with the display control unit 161 and waits for acquisition of the instruction sheet image data. (Step S111).

  Next, when the application control unit 120 detects imaging by the image data generation unit 110 in cooperation with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S112), an instruction in which the work ID 71 is imaged. The book image data is acquired and stored in the image data storage unit 102 in association with the culture medium image data acquired in step S108 (step S113).

  In addition, when acquiring the process ID 71b as the work ID 71, or when acquiring one process ID 71 from the plurality of process IDs 71b, the application control unit 120 operates in conjunction with the display control unit 161 and the operation unit 170, The process ID 71 to be acquired is displayed and the corresponding process ID 71 is acquired.

  Next, the application control unit 120 analyzes the two-dimensional barcode formed in the predetermined region of the captured instruction image data and the medium image data, acquires the work ID 71, and corresponds to the instruction image data In addition, the image data is stored in the image data storage unit 102 (step S114).

  Next, the application control unit 120 acquires the current time from the timer 180 as the imaging time of the medium image data, and acquires the instruction sheet image data acquired by the operator in conjunction with the display control unit 161 and the operation unit 170. The work ID 71, medium image data, medium ID 66, and imaging time are confirmed (step S115).

  Note that the application control unit 120 may re-acquire the culture image data based on an instruction from the operator when the acquired medium information is confirmed by the operator. At this time, the application control unit 120 may be able to correct the medium image data by the operator in conjunction with the display control unit 161 and the operation unit 170.

  Next, the application control unit 120, based on the operator's instruction, together with flag information indicating whether it is initial registration or post-culture registration, terminal ID, and work ID 71, the acquired medium image data, its metadata, and whether it is initial registration. Flag information indicating whether it is registered after culture is transmitted as medium information to the server device 40 via the network communication unit 130 (step S116), and the registration process of the portable communication terminal device 10 is terminated.

  At this time, when transmitting the culture medium information, the network communication unit 130 executes login for accessing the server device 40 based on the terminal ID or the input ID and password, and the server device 40 is completed after the login is completed. Communication line is established and medium information is transmitted.

[6.2] Medium information registration processing (server device)
Next, operation | movement of the culture medium information registration process including the colony specific count process in the server apparatus 40 of this embodiment is demonstrated using each figure of FIGS. 18 to 20 are flowcharts showing the operation of the medium information registration process including the colony identification counting process in the server device 40 of the present embodiment.

  In addition, this operation | movement is a process performed in conjunction with the culture medium information registration process performed by the portable communication terminal device 10, and the server apparatus 40 is based on the culture medium information transmitted from the portable communication terminal device 10. The following processing is executed.

(First colony identification counting process)
First, in the server device 40, when the communication control unit 410 receives the culture medium information transmitted from the portable communication terminal device 10 (step S200), the registration processing unit 421 is based on the flag information included in the received culture medium information. Whether initial registration or post-culture registration is determined (step S201). At this time, if the registration processing unit 421 determines initial registration, the process proceeds to step S202. If it is determined that the registration is not initial registration, that is, if it is determined that the registration is after culture, step S204 is performed. Move on to processing.

  Next, when it is determined as initial registration, the registration processing unit 421 extracts and specifies the work ID 71 included in the received medium information (step S202).

  Next, the registration processing unit 421 registers the medium information including the received medium image in the medium information DB 401 based on the identified work ID 71 (step S203), and ends this operation. Although the culture start time is stored in advance in the work management DB 404, the registration processing unit 421 registers the imaging time included in the received medium information as the culture start time in the work management DB 404 in the process of step S203. Also good.

  On the other hand, if the registration processing unit 421 determines that the registration is after culture, it extracts and specifies the work ID 71 included in the culture medium information (step S204), and registers the culture medium information based on the imaging time included in the culture medium information. The culture examination time to be specified is specified (step S205).

  At this time, the registration processing unit 421 may be registered by designating a culture examination time for registering the culture medium information in conjunction with the portable communication terminal device 10, or the imaging time included in the received culture medium information. The culture examination time may be registered as it is. In addition, the registration processing unit 421 manages the culture medium registration at the culture test time that has already been performed, and specifies the culture test time based on the timing at which the culture medium information is received and the culture test time that has already been used to register the culture medium information. May be. That is, the registration processing unit 421 may specify the culture examination time by rewriting the execution flag each time the medium information is registered and comparing the received imaging time with reference to the information of the flag.

  Next, the registration processing unit 421 causes the colony detection determination unit 423 to extract the feature pixels by causing the colony detection determination unit 423 to perform image analysis on the medium image in the received medium image data, and based on the extracted feature pixels, A target object corresponding to a non-colony or a colony candidate is detected, and the detected target object is counted (step S206).

  Specifically, the colony detection determination unit 423 identifies, as a target object, a single feature pixel or a feature pixel group in which feature pixels are connected while extracting feature pixels having a value equal to or greater than a predetermined threshold. Count the identified objects.

  Next, the registration processing unit 421 determines whether the culture medium information to be registered is based on the first culture image used as the reference for the colony determination immediately after the culture based on the specified culture examination time in the colony detection determination unit 423. Is determined (step S207). At this time, when the colony detection determination unit 423 determines that the culture medium information to be registered is culture medium information based on the first culture medium image, the colony detection determination unit 423 directly proceeds to the process of step S210, and the culture medium information based on the first culture medium image If it is determined that it is not (that is, the medium information based on the second medium image), the process proceeds to step S208.

  Next, when the colony detection determination unit 423 determines in the process of step S207 that the medium information is not based on the first medium image, that is, the medium information based on the second medium image, the corresponding first medium image. The number of colonies is counted based on the acquired number of non-colonys and the number of detected colony candidates while acquiring the number of objects (that is, non-colonies) included in the medium information registered in (Step S208). ).

  Next, the colony detection determination unit 423 reads the medium determination criterion based on the type of the sample specified based on the work ID 71 and the fungus species to be detected, and detects the number of colonies detected based on the read sample determination criterion. It is determined whether or not satisfies a predetermined condition (step S209). That is, the colony detection determination unit 423 determines that it is acceptable (normal) when the predetermined condition is satisfied, and determines that it is unacceptable (abnormal) when the predetermined condition is not satisfied.

  The colony detection determination unit 423 is linked to the portable communication terminal device 10 instead of the automatic registration described above, and displays the detected number of colonies and the result of the pass / fail determination on the display unit 160 of the portable communication terminal device 10. The user may be allowed to view and confirm.

  Next, the registration processing unit 421 starts the culture start time information using the culture image data, the recognized medium ID 66, the type of the medium image, the number of objects counted, the determined pass / fail, and the imaging time included in the medium information. In the case of the second medium image, the number of colonies detected is registered in the medium information DB 401 in association with the specified work ID 71 (step S210), and this operation ends.

  The registration processing unit 421 displays line information and information to be registered on the display unit 160 of the portable communication terminal device 10, and based on a user instruction input via the portable communication terminal device 10, the culture medium Information or the like may be registered.

  Further, when the culture medium image data is transmitted from the portable communication terminal apparatus 10 and the medium ID 66 is recognized by analyzing each image data by the server apparatus 40, the registration processing unit 421 receives the reception in the process of step S201. The medium ID 66 imaged on each predetermined area of the medium image data thus obtained is analyzed, and the medium ID 66 is recognized and acquired. Similarly, the server device 40 also recognizes the work ID 71 in the instruction image data.

(Second colony identification counting process)
First, in the server device 40, when the communication control unit 410 receives the culture medium information transmitted from the portable communication terminal device 10 (step S300), the registration processing unit 421 is based on the flag information included in the received culture medium information. Whether the registration is initial registration or post-culture registration is determined (step S301). At this time, if the registration processing unit 421 determines initial registration, the process proceeds to step S302. If the registration processing unit 421 determines that it is not initial registration, that is, if it is determined to be post-culture registration, step S304 is performed. Move on to processing.

  Next, when the registration processing unit 421 determines initial registration, the registration processing unit 421 extracts and specifies the work ID 71 included in the received medium information (step S302).

  Next, the registration processing unit 421 registers the medium information including the received medium image in the medium information DB 401 based on the identified work ID 71 (step S303), and ends this operation. Although the culture start time is stored in advance in the work management DB 404, the registration processing unit 421 registers the imaging time included in the received medium information as the culture start time in the work management DB 404 in the process of step S303. Also good.

  On the other hand, if the registration processing unit 421 determines that the registration is after culture, it extracts and specifies the work ID 71 included in the culture medium information (step S304), and registers the culture medium information based on the imaging time included in the culture medium information. The culture examination time to be specified is specified (step S305).

  At this time, the registration processing unit 421 may be registered by designating a culture examination time for registering the culture medium information in conjunction with the portable communication terminal device 10, or the imaging time included in the received culture medium information. The culture examination time may be registered as it is. In addition, the registration processing unit 421 manages the culture medium registration at the culture test time that has already been performed, and specifies the culture test time based on the timing at which the culture medium information is received and the culture test time that has already been used to register the culture medium information. May be. That is, the registration processing unit 421 may specify the culture examination time by rewriting the execution flag each time the medium information is registered and comparing the received imaging time with reference to the information of the flag.

  Next, the registration processing unit 421 causes the colony detection determination unit 423 to perform image analysis on the medium image in the received medium image data, and based on the feature pixels, the target object (non-colony or non-colony candidate) The target object is also specified as the target object, and information specified in each target object (that is, specific information of each target object) is acquired (step S306).

  For example, the colony detection determination unit 423 specifies a single feature pixel or a group of feature pixels connected to the feature pixel as an object while extracting feature pixels having a value equal to or greater than a predetermined threshold, and the specified target. Information such as the coordinate position of the object on the film-type culture medium 60, the characteristic amount relating to the color, and the characteristics of the characteristic pixel used when each object is imaged is acquired as the specific information.

  Next, the registration processing unit 421 determines whether the culture medium information to be registered is based on the first culture image used as the reference for the colony determination immediately after the culture based on the specified culture examination time in the colony detection determination unit 423. Is determined (step S307). At this time, if the colony detection determination unit 423 determines that the medium information to be registered is the medium information based on the first medium image, the colony detection determination unit 423 directly proceeds to the process of step S310, and the medium information based on the first medium image If it is determined that it is not (that is, the medium information based on the second medium image), the process proceeds to step S308.

  Next, when the colony detection determination unit 423 determines that the medium information is not based on the first medium image, that is, the medium information based on the second medium image in the process of step S307, the corresponding first medium image is displayed. In addition to reading out information on each object (that is, non-colony) included in the medium information registered in step 2, the object (colony candidate) in the second medium image and each object (non-colony) in the read first medium image Based on each identification information, the corresponding colony candidate is identified as a colony, and the number of identified colonies is counted (step S308).

  For example, the colony detection determination unit 423 has the same coordinate position on each colony candidate and the film-type medium 60 based on the specific information in each target object of the non-colony in the first medium image and the colony candidate in the second medium image. When a non-colony is identified and there is the identified non-colony, the identity of the colony candidate and the non-colony is determined based on the characteristics of each feature pixel used to image the non-colony and the colony candidate. A non-identical colony candidate is identified as a colony.

  Further, instead of the above, the colony detection determination unit 423 generates and compares feature amounts (for example, histograms) relating to the colors of the non-colony in the first medium image and the colony candidates in the second medium image, respectively, and compares them. Identify colonies in the media image.

  Next, the colony detection determination unit 423 reads the medium determination criterion based on the type of the sample specified based on the work ID 71 and the fungus species to be detected, and detects the number of colonies detected based on the read sample determination criterion. It is determined whether or not satisfies a predetermined condition (step S309). That is, the colony detection determination unit 423 determines that it is acceptable (normal) when the predetermined condition is satisfied, and determines that it is unacceptable (abnormal) when the predetermined condition is not satisfied.

  The colony detection determination unit 423 is linked to the portable communication terminal device 10 instead of the automatic registration described above, and displays the detected number of colonies and the result of the pass / fail determination on the display unit 160 of the portable communication terminal device 10. The user may be allowed to view and confirm.

  Next, the registration processing unit 421 starts the culture start time information using the culture image data, the recognized medium ID 66, the type of the medium image, the characteristic information of the target object, the determined pass / fail, and the imaging time included in the medium information. In the case of the second medium image, the number of colonies detected is registered in the medium information DB 401 in association with the specified work ID 71 (step S310), and this operation ends.

  The registration processing unit 421 displays line information and information to be registered on the display unit 160 of the portable communication terminal device 10, and based on a user instruction input via the portable communication terminal device 10, the culture medium Information or the like may be registered.

  Further, when the culture medium image data is transmitted from the portable communication terminal apparatus 10 and the medium ID 66 is recognized by analyzing each image data by the server apparatus 40, the registration processing unit 421 receives the reception in the process of step S201. The medium ID 66 imaged on each predetermined area of the medium image data thus obtained is analyzed, and the medium ID 66 is recognized and acquired. Similarly, the server device 40 also recognizes the work ID 71 in the instruction image data.

(Third colony identification counting process)
First, in the server device 40, when the communication control unit 410 receives the medium information transmitted from the portable communication terminal device 10 (step S400), the registration processing unit 421 is based on the flag information included in the received medium information. Whether the registration is initial registration or post-culture registration is determined (step S401). At this time, if the registration processing unit 421 determines initial registration, the process proceeds to step S402. If the registration processing unit 421 determines that it is not initial registration, that is, if it is determined to be post-culture registration, step S404 is performed. Move on to processing.

  Next, when it is determined as initial registration, the registration processing unit 421 extracts and specifies the work ID 71 included in the received medium information (step S402).

  Next, the registration processing unit 421 registers the medium information including the received medium image in the medium information DB 401 based on the identified work ID 71 (step S403), and ends this operation. Although the culture start time is stored in advance in the work management DB 404, the registration processing unit 421 registers the imaging time included in the received medium information as the culture start time in the work management DB 404 in the process of step S203. Also good.

  On the other hand, if the registration processing unit 421 determines that the registration is after culture, it extracts and specifies the work ID 71 included in the culture medium information (step S404), and registers the culture medium information based on the imaging time included in the culture medium information. The culture examination time to be specified is specified (step S405).

  At this time, the registration processing unit 421 may be registered by designating a culture examination time for registering the culture medium information in conjunction with the portable communication terminal device 10, or the imaging time included in the received culture medium information. The culture examination time may be registered as it is. In addition, the registration processing unit 421 manages the culture medium registration at the culture test time that has already been performed, and specifies the culture test time based on the timing at which the culture medium information is received and the culture test time that has already been used to register the culture medium information. May be. That is, the registration processing unit 421 may specify the culture examination time by rewriting the execution flag each time the medium information is registered and comparing the received imaging time with reference to the information of the flag.

  Next, the registration processing unit 421 determines whether the culture medium information to be registered is based on the first culture image used as the reference for the colony determination immediately after the culture based on the specified culture examination time in the colony detection determination unit 423. Is determined (step S406). At this time, if the colony detection determination unit 423 determines that the medium information to be registered is the medium information based on the first medium image, the colony detection determination unit 423 directly proceeds to the process of step S410, and the medium information based on the first medium image If it is determined that it is not (that is, the medium information based on the second medium image), the process proceeds to step S407.

  Next, when the colony detection determination unit 423 determines in the process of step S407 that the medium information is not based on the first medium image, that is, the medium information based on the second medium image, the corresponding first medium image. The difference image is generated based on the read first medium image and second medium image while reading (Step S408).

  Next, the colony detection determination unit 423 counts the number of colonies based on the generated difference image (step S408). Specifically, the colony detection determination unit 423 performs image analysis on the generated difference image, detects a feature pixel, and sets the detected feature pixel or a feature pixel group in which the feature pixels are connected to the colony. The counting is executed while specifying as follows.

  Next, the colony detection determination unit 423 reads the medium determination criterion based on the type of the sample specified based on the work ID 71 and the fungus species to be detected, and detects the number of colonies detected based on the read sample determination criterion. It is determined whether or not satisfies a predetermined condition (step S409). That is, the colony detection determination unit 423 determines that it is acceptable (normal) when the predetermined condition is satisfied, and determines that it is unacceptable (abnormal) when the predetermined condition is not satisfied.

  The colony detection determination unit 423 is linked to the portable communication terminal device 10 instead of the automatic registration described above, and displays the detected number of colonies and the result of the pass / fail determination on the display unit 160 of the portable communication terminal device 10. The user may be allowed to view and confirm.

  Next, the registration processing unit 421 includes culture image data, recognized medium ID 66, type of medium image, determined pass / fail, and culture start time information with an imaging time included in the medium information as a culture start time, and a second medium image. In this case, the number of colonies detected is registered in the culture medium information DB 401 in association with the identified work ID 71 (step S410), and this operation ends.

  The registration processing unit 421 displays line information and information to be registered on the display unit 160 of the portable communication terminal device 10, and based on a user instruction input via the portable communication terminal device 10, the culture medium Information or the like may be registered.

  Further, when the culture medium image data is transmitted from the portable communication terminal apparatus 10 and the medium ID 66 is recognized by analyzing each image data by the server apparatus 40, the registration processing unit 421 receives the reception in the process of step S201. The medium ID 66 imaged on each predetermined area of the medium image data thus obtained is analyzed, and the medium ID 66 is recognized and acquired. Similarly, the server device 40 also recognizes the work ID 71 in the instruction image data.

[6.3] Lot Determination Processing Next, the operation of the lot determination processing in the server device 40 of this embodiment will be described using FIG. FIG. 21 is a flowchart showing the operation of lot determination processing in the server device 40 of this embodiment.

  In this operation, it is assumed that the corresponding medium information is registered, and process determination reference information, line determination reference information, and lot determination reference information are registered in advance.

First, when the communication control unit 410 of the server device 40 receives a lot determination instruction transmitted from the administrator terminal device 20 (step S501), the lot determination processing unit 424 can perform lot determination in conjunction with the communication control unit 410. A lot ID that can be determined by searching for a lot ID and the corresponding lot information are transmitted to the administrator terminal device 20 so that the administrator can view and select the lot ID, and an instruction for the lot ID to execute the lot determination process is sent. Wait (step S502).
The administrator terminal device 20 displays a lot ID that can be determined on a predetermined display screen so that the administrator can view and select the lot ID.

  Next, when the communication control unit 410 receives the lot ID specified by the administrator via the administrator terminal device 20 (step S503), the lot determination processing unit 424 determines the process of the process belonging to the corresponding lot, Each criterion information indicating conditions for line determination and lot determination is read from the RAM / ROM 440 (step S504).

  Next, the lot determination processing unit 424 reads out various lot information, line information, and medium information of the corresponding lot ID (step S505), and performs process determination and line determination based on the read lot information, line information, and medium information. The lot determination is performed (step S506). Specifically, the lot determination processing unit 424 executes the process determination of each process specified by the lot information, and the line of each work line 80 specified by the lot information based on the process determination result of the process determination. Make a decision. Then, the lot determination processing unit 424 executes lot determination based on the line determination result.

  Next, the lot determination processing unit 424 allocates the lot determination result to the template while reading the predetermined template information that is the determination report format, and generates report data (step S507).

  Finally, the lot determination processing unit 424 provides the report data generated in conjunction with the communication control unit 410 to the corresponding administrator terminal device 20 (step S508) and ends the operation.

  When the administrator terminal device 20 receives the report data, the administrator terminal device 20 displays the report data so that the administrator can view it. However, the lot determination processing unit 424 may transmit the print data as print data that can be printed on the printer without transmitting the report data to the manager terminal device 20.

[7] Modification [7.1] Modification 1
In the above-described embodiment, the culture medium registration process and the colony detection determination process are executed at the same timing, but the colony detection determination process may be executed at an arbitrary timing.

[7.2] Modification 2
In this embodiment, instead of performing the culture information registration process using a portable communication terminal device 10 such as a tablet information terminal device, a smartphone, or a mobile phone, a laptop or desktop personal computer is used. The registration process of the culture medium information may be realized by a computer and an image input device such as a scanner, a digital camera, or a smartphone.

  In this case, the personal computer and the image input device may be connected according to a predetermined communication standard, and the registration process of the culture medium information may be realized by using the personal computer and the image input device integrally, or a memory card. The medium image data and instruction sheet image data previously acquired by the image input device are stored in other physical memory, and the registration process of the medium information is realized while the stored image data is captured by the personal computer. May be.

  In this case, the functions of the server device 40 may be provided in a personal computer to execute the various processes described above.

[7.3] Modification 3
In the present embodiment, the portable communication terminal device 10, the administrator terminal device 20, and the server device 40 may be installed or used in the same site, or each may be installed in a remote place such as outside the country or remotely. It may be used on the ground and each process described above may be executed. However, it is assumed that the portable communication terminal device 10 is used in the same lot.

[7.4] Modification 4
In the present embodiment, registration of medium information in a specimen cultured in the film-type medium 60 using the film-type medium 60 is executed, but the medium in the specimen cultured in the agar medium using an agar medium. Information registration may be executed.

[7.5] Modification 5
In the present embodiment, instead of acquiring the culture medium ID 66 by imaging the film-type culture medium 60 by the image data generation unit 110, the culture medium ID 66 may be input by an operator's operation input.

  In this case, the application control unit 120 interlocks with the display control unit 161 and the operation unit 170 and causes the operator to manually input the culture medium ID 66 directly using the operation unit 170.

  In addition, the application control unit 120 controls the display control unit 161 and the operation unit 170 to select a display item such as a pull-down menu by clicking or touch selection, and causes the operator to input the culture medium ID 66.

[7.6] Modification 6
In the present embodiment, various processes are executed by the single server device 40, but various processes may be executed by a server system including a plurality of server devices 40.

[7.7] Modification 7
In the present embodiment, the portable communication terminal device 10 is configured to perform calibration for RGB gradation values or luminance values before capturing a medium image. When a color chart is provided and image processing is performed on a culture medium image, feature pixels may be extracted while performing calibration individually.

[7.8] Modification 8
In the present embodiment, when the portable communication terminal device 10 captures a culture medium image, the portable communication terminal device 10 displays an image that assists the alignment of the film-type culture medium 60 to be captured, superimposed on the culture medium image to be captured. And, based on the marker formed on the film-type medium 60, alignment of the medium image is executed, but only one of them may be used, together with or in place of these, A medium image may be taken while always maintaining the same direction by using a jig for fixing the film-type medium 60 at a fixed position.

[7.9] Modification 9
In the present embodiment, in the colony identification counting process of the medium information registration process, if the corresponding first medium image and the specific information related thereto are not stored in the database 400, the medium information registration is performed. The process may be stopped to notify the user of a warning, or the medium information registration process may be executed using predetermined dummy data.

[7.9] Modification 10
In the present embodiment, it is a premise that the object specified in the first medium image is also specified in the second medium image. However, in the colony specifying counting process, in the corresponding first medium image If the corresponding object is not specified on the second medium image, a warning may be given to the user.

  In this case, for example, the colony detection determination unit 423 determines that the object (non-colony) in the first medium image is the second by a process different from the above in the colony identification counting process or using another process. It is detected whether or not the medium n is present on the medium image, and if the target object n non-colony is not present, the user is warned by marking or the like on the second medium image.

  As described above, in the sanitary management system S of the present embodiment, since it is possible to identify non-objects other than colonies such as dust that already existed in the film-type medium 60 before culturing, the medium image after culturing (ie, The second medium image) can be counted while identifying colonies as objects.

  Therefore, in the sanitary management system S of the present embodiment, non-objects other than Ronnie can be excluded, the accuracy in colony detection can be improved, and erroneous colony detection can be prevented, and colony detection has been included. Medium information can be registered accurately.

  In particular, in the sanitary management system S of the present embodiment, in the first colony identification counting process, the first feature pixel and the second feature pixel are each before and after culturing based on the first condition which is the same condition. Since it can detect from a culture medium image, the pixel which comprises the non-object which has a color characteristic similar to a colony in the culture medium image before culture | cultivation can be detected.

  In the sanitary management system S of the present embodiment, in the second colony identification counting process, a first object (that is, a non-colony) having a color characteristic similar to a colony in a culture medium image before culture is used. Since it can be detected, if the non-identity between the imaged first object before culturing and the second object imaged after culturing is determined, it is already present in the film-type medium 60 before the culturing. A second object (that is, a colony candidate) other than a colony such as trash can be identified as a colony.

  Further, in the sanitary management system S of the present embodiment, in the third colony identification counting process, by generating a difference image from the culture medium images before and after the culture, an image indicating the change that has occurred in the second culture image is generated. And since a colony can be specified based on the said image, a colony can be specified, excluding non-objects other than colonies, such as garbage already existing in the film type culture medium 60 before the said culture.

  In the sanitary management system S of the present embodiment, the description has been made using food. However, the present invention is not limited to the food, and can be applied to products that are provided to all living organisms including drugs and drugs. .

DESCRIPTION OF SYMBOLS S ... Hygiene management system 10 ... Portable communication terminal device 20 ... Manager terminal device 30 ... Network 40 ... Server device 60 ... Film type culture medium 70 ... Work instruction sheet 80 ... Work line 100 ... Data storage part 101 ... Application storage part 102 Image data storage unit 110 Image data generation unit 120 Application control unit 130 Network communication unit 140 Short-range wireless communication interface 150 Current position detection unit 160 Display unit 170 Operation unit 180 Timer 190 Mobile device management Control unit 400 ... database 401 ... medium information DB
402 ... Line information DB
403 ... Lot information DB
404 ... Work management DB
410 ... Communication control unit 420 ... Data processing unit 421 ... Registration processing unit 423 ... Colony detection determination unit 424 ... Lot determination processing unit 425 ... Report processing unit 430 ... Server management control unit

Claims (12)

A medium information registration system for registering information on a medium as medium information based on medium image data having a medium image obtained by imaging a medium for culturing bacteria generated in a specimen,
First medium image data having a first medium image obtained by imaging the medium at a first timing which is a given timing, and the medium at a second timing which is a given timing after the first timing Obtaining means for obtaining second image data having a second medium image;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; ,
Counting means for counting the number of the identified colonies ;
Registration means for registering information on the medium including at least the counted number of colonies in a database as medium information;
Equipped with a,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
Identify the first object present in the same coordinate position or the same range on the culture medium as the second object,
The identity of the second object and the identified first object is determined based on the characteristics of the characteristic pixels used when imaging each of the second object and the identified first object. And
As a result of the determination, when it is determined that the second object is not identical to the identified first object, the second object is identified as the colony . A medium information registration system for registering information on a medium as medium information based on medium image data having a medium image obtained by imaging a medium for culturing bacteria generated in a specimen,
First medium image data having a first medium image obtained by imaging the medium at a first timing which is a given timing, and the medium at a second timing which is a given timing after the first timing Obtaining means for obtaining second image data having a second medium image;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; ,
Counting means for counting the number of the identified colonies ;
Registration means for registering information on the medium including at least the counted number of colonies in a database as medium information;
Equipped with a,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
For each of the second objects, a feature quantity relating to the color of each of the first objects is compared using a statistical calculation to determine the identity with each of the first objects,
As a result of the determination, when it is determined that the second object is not identical to the identified first object, the second object is identified as the colony . In the culture medium information registration system according to claim 1 or 2 ,
The characteristics of the feature pixels used when imaging the first object and the second object include the number of each feature pixel, the coordinate position of each feature pixel on the medium, and each feature pixel. A culture medium information registration system including at least one of feature quantities relating to the color of the medium. In the culture medium information registration system according to any one of claims 1 to 3,
The acquisition means is
Acquiring the first medium image data and the second image data in association with the identification information of the medium;
The detection means is
A culture medium information registration system that identifies the number of colonies for each identification information. A program for registering information about the culture medium as culture medium information based on the culture medium image data having a culture medium image obtained by imaging a culture medium for cultivating bacteria generated in a specimen,
The computer,
First medium image data having a first medium image obtained by imaging the medium at a first timing which is a given timing, and the medium at a second timing which is a given timing after the first timing Acquisition means for acquiring second image data having a second medium image;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image;
A counting means for counting the number of the identified colonies ; and
Registration means for registering information on the medium including at least the counted number of colonies in a database as medium information;
Function as
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
Identify the first object present in the same coordinate position or the same range on the culture medium as the second object,
The identity of the second object and the identified first object is determined based on the characteristics of the characteristic pixels used when imaging each of the second object and the identified first object. And
As a result of the determination, when it is determined that the second object is not identical to the identified first object , the program identifies the second object as the colony . A program for registering information about the culture medium as culture medium information based on the culture medium image data having a culture medium image obtained by imaging a culture medium for cultivating bacteria generated in a specimen,
The computer,
First medium image data having a first medium image obtained by imaging the medium at a first timing which is a given timing, and the medium at a second timing which is a given timing after the first timing Acquisition means for acquiring second image data having a second medium image;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image;
A counting means for counting the number of the identified colonies ; and
Registration means for registering information on the medium including at least the counted number of colonies in a database as medium information;
To function as,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
For each of the second objects, a feature quantity relating to the color of each of the first objects is compared using a statistical calculation to determine the identity with each of the first objects,
As a result of the determination, when it is determined that the second object is not identical to the identified first object , the program identifies the second object as the colony . First medium image data having a first medium image obtained by imaging a medium for culturing bacteria generated in the specimen at a first timing which is a given timing, and a second which is a given timing after the first timing. Acquisition means for acquiring second image data having a second medium image obtained by imaging the medium at a timing;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; ,
Counting means for counting the number of the identified colonies ;
Equipped with a,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
Identify the first object present in the same coordinate position or the same range on the culture medium as the second object,
The identity of the second object and the identified first object is determined based on the characteristics of the characteristic pixels used when imaging each of the second object and the identified first object. And
As a result of the determination, when it is determined that the second object is not identical to the identified first object, the second object is identified as the colony. First medium image data having a first medium image obtained by imaging a medium for culturing bacteria generated in the specimen at a first timing which is a given timing, and a second which is a given timing after the first timing. Acquisition means for acquiring second image data having a second medium image obtained by imaging the medium at a timing;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; ,
Counting means for counting the number of the identified colonies ;
Equipped with a,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
For each of the second objects, a feature quantity relating to the color of each of the first objects is compared using a statistical calculation to determine the identity with each of the first objects,
As a result of the determination, when it is determined that the second object is not identical to the identified first object, the second object is identified as the colony. Computer
First medium image data having a first medium image obtained by imaging a medium for culturing bacteria generated in a specimen at a first timing which is a given timing, and a given timing after the first timing. Acquisition means for acquiring second image data having a second medium image obtained by imaging the medium at a second timing;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; as well as,
Counting means for counting the number of the identified colonies ;
To function as,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
Identify the first object present in the same coordinate position or the same range on the culture medium as the second object,
The identity of the second object and the identified first object is determined based on the characteristics of the characteristic pixels used when imaging each of the second object and the identified first object. And
As a result of the determination, when it is determined that the second object is not identical to the identified first object , the program identifies the second object as the colony . Computer
First medium image data having a first medium image obtained by imaging a medium for culturing bacteria generated in a specimen at a first timing which is a given timing, and a given timing after the first timing. Acquisition means for acquiring second image data having a second medium image obtained by imaging the medium at a second timing;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; as well as,
Counting means for counting the number of the identified colonies ;
To function as,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
For each of the second objects, a feature quantity relating to the color of each of the first objects is compared using a statistical calculation to determine the identity with each of the first objects,
As a result of the determination, when it is determined that the second object is not identical to the identified first object , the program identifies the second object as the colony . A communication terminal device that generates a medium image obtained by imaging a medium for cultivating bacteria generated in a specimen as medium image data;
A server device for detecting colonies generated in the medium based on the medium image data and registering them in a database;
With
The server device is
First medium image data having a first medium image obtained by imaging the medium at a first timing which is a given timing, and the medium at a second timing which is a given timing after the first timing Obtaining means for obtaining second image data having a second medium image;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; ,
Counting means for counting the number of the identified colonies ;
Registration means for registering information on the medium including at least the counted number of colonies in a database as medium information;
Equipped with a,
The detection means is
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
Identify the first object present in the same coordinate position or the same range on the culture medium as the second object,
The identity of the second object and the identified first object is determined based on the characteristics of the characteristic pixels used when imaging each of the second object and the identified first object. And
The result of the determination, and health management system, wherein the second object when it is determined that the first object and the non-identical with the identified, identifying the second object and the colonies. A communication terminal device that generates a medium image obtained by imaging a medium for cultivating bacteria generated in a specimen as medium image data;
A server device for detecting colonies generated in the medium based on the medium image data and registering them in a database;
With
The server device is
First medium image data having a first medium image obtained by imaging the medium at a first timing which is a given timing, and the medium at a second timing which is a given timing after the first timing Obtaining means for obtaining second image data having a second medium image;
Extraction means for extracting feature quantities relating to colors of the respective pixels constituting the first medium image and the second medium image;
Detection means for identifying and detecting colonies as the bacterial mass based on the feature amount of each pixel of the extracted first medium image and the feature amount of each pixel of the extracted second medium image; ,
Counting means for counting the number of the identified colonies ;
Registration means for registering information on the medium including at least the counted number of colonies in a database as medium information;
Equipped with a,
The detecting means;
A pixel of the first medium image having the feature amount having a predetermined condition is detected as a first feature pixel, and a pixel of the second medium image having the feature amount having the condition is a second feature pixel. Detect as
Based on the detected first feature pixel, an imaged first object on the first medium image is specified, and on the detected second feature pixel, an image on the second medium image. Identify the second object
For each of the second objects, a feature quantity relating to the color of each of the first objects is compared using a statistical calculation to determine the identity with each of the first objects,
The result of the determination, and health management system, wherein the second object when it is determined that the first object and the non-identical with the identified, identifying the second object and the colonies.