JP2014140335A - Medium image analyzing device, medium information registration system and program, and hygiene management system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a medium information registration system etc. capable of: making a confirmation work performed by a manager in medium easy by notifying the manager when an irregular colony has been detected; and reducing manager's working burden.SOLUTION: The hygiene management system S has the following construction: after a lapse of a predetermined time from start of cultivation, (1) detects a colony generated on a film medium 60 and specifies a property of the colony based on the degree of the property in pixels constructing medium image on which the film medium 60 is imaged; (2) determines irregular property of the detected colony based on a preset criterion property and the property of the colony; and (3) executes display the determination result to the manager, correction, and registration on a database 400.

Description

  The present invention relates to a food hygiene management system and the like.

  In recent years, due to the growth of fast food and other food service industries and the increase in easy processed foods, the opportunity to eat food prepared by others has increased remarkably. On the other hand, when foods such as processed foods and processed foods are mixed with dangerous substances such as poisons or microorganisms, it directly affects the human body. When handling processed foods, not only the safety of raw materials but also the production There is a need for food safety that strictly controls the hygiene of the process and covers the entire production and processing of food.

  In particular, food poisoning incidents that have occurred in various places are the starting point, and it is a proposition to further improve the safety of foods. In addition to complying with the Food Sanitation Law, “HACCP (Hazard Analysis Critical Control) An increasing number of companies have introduced “Point System” and “FSSC (Food Safety System Certification 22000)”.

  As a system for detecting microorganisms mixed in such processed foods, a film-type medium is used, a specimen cultured in the film-type medium is imaged, and image processing is performed on the image of the imaged medium. In addition, detection of colonies that are a mass of bacteria generated in a specimen and counting them are known (for example, Patent Document 1 or 2). In addition, recently, a detection apparatus that identifies recent bacterial species using the characteristics of an RNA gene is also known (for example, Patent Document 3).

JP 2011-2112013 A JP 2012-135240 A International Publication WO2006 / 014022 Pamphlet

  However, in each patent document system and the like, although the fungus (colony) generated in the specimen can be detected or the type of the colony (that is, the fungus species) can be specified, the detected colony is usually detected. In the case of a different bacterial species that is not assumed by the administrator, the discrimination cannot be detected.

  The present invention has been made to solve the above-described problems, and its purpose is to detect the abnormality of a detected colony and notify an administrator when an abnormal colony is detected. Accordingly, it is an object of the present invention to provide a culture medium information registration system and the like that can facilitate the manager's confirmation work on the culture medium and can reduce the work burden on the manager.

  In order to solve the above-described problem, a culture medium information registration system and the like according to the present invention includes an acquisition unit that acquires culture medium data obtained by imaging a culture medium as culture medium image data, and the acquired culture medium image data. Based on the feature amount relating to the color of each pixel constituting the culture medium image, the detection means for detecting colonies generated in the culture medium, and the colony pixels used for imaging the detected colonies, The identifying means for identifying the characteristics of the colony as the colony characteristics, the determining means for determining the abnormality of the detected colony based on the preset reference characteristics and the colony characteristics, and the determining means Data of a discrimination result image obtained by imaging a discrimination result as a result on the medium image is generated, and the discrimination result image is viewed by an administrator And a registration means for registering information relating to the medium including information relating to the identified colonies in the database as medium information based on an instruction from the administrator. Have.

  The culture medium information registration system and the like according to the present invention can allow the administrator to check the status of the culture medium different from normal, such as the discovery of foreign substances that are not normally detected and the occurrence of different types of bacteria. It is easy and can reduce the workload of the administrator, and by executing the correction of the colony, the colony can be accurately identified as a result, and the medium information including them can be accurately registered. .

It is a lineblock diagram showing the composition of one embodiment of the hygiene management system concerning the present invention. It is an example of the film type culture medium used for the sanitary management system of one Embodiment. It is an example of the work instruction used for the sanitary management system of one embodiment. It is a block diagram which shows the structure of the portable communication terminal device used for the sanitary management system of one Embodiment. It is a block diagram which shows the structure of the server apparatus used for the sanitary management system of one Embodiment. It is FIG. (1) for demonstrating the specific process which specifies the colony characteristic performed in the server apparatus of one Embodiment. It is FIG. (2) for demonstrating the specific process which specifies the colony characteristic performed in the server apparatus of one Embodiment. It is a figure for demonstrating the discrimination | determination process which discriminate | determines the abnormality of the colony performed in the server apparatus of one Embodiment. It is a figure for demonstrating the setting of the reference | standard characteristic performed in the server apparatus of one Embodiment. It is an example of the culture medium imaging data imaged in the server apparatus of one Embodiment. It is a flowchart which shows the operation | movement of the registration process of the culture medium information in the portable communication terminal device of one Embodiment. It is a flowchart which shows the operation | movement of the registration process of the culture medium information in the server apparatus of one Embodiment. In the server apparatus of one Embodiment, it is a flowchart (the 1) which shows the operation | movement of the colony detection determination process including a discrimination | determination result display process and a discrimination | determination result correction process in cooperation with an administrator terminal device. In the server apparatus of one Embodiment, it is a flowchart (the 2) which shows operation | movement of the colony detection determination process containing a determination result display process and a determination result correction process in cooperation with an administrator terminal device.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In addition, the following embodiment is a medium information registration system, program, and the like according to the present invention for a hygiene management system using a film-type medium in a food production line or an inspection line (hereinafter referred to as “work line”). It is embodiment at the time of applying a medium image analysis device and a hygiene management system. However, the present invention is not limited to the following embodiments within the scope including the technical idea.

[1] Hygiene management system First, the hygiene management system S of this embodiment will be described with reference to FIG. In addition, FIG. 1 is a block diagram which shows the structure of the sanitary management system S of this embodiment.

  The sanitary management system S of the present embodiment uses a film-type culture medium (that is, a film-type culture medium) and performs data management on information on the culture medium (hereinafter referred to as “medium information”), thereby producing food. Or it is a system for inspecting the sanitary condition on inspection.

  In particular, the sanitary management system S of the present embodiment extracts a processed or processed food as a specimen in a work line 80 having a manufacturing process for manufacturing a processed or processed food or an inspection process for inspecting the food. In addition, this is a system for managing data on the culture state when a pre-specified bacterium such as a general bacterium or E. coli or the like occurring in a specimen in the film-type medium 60 is cultured.

  The hygiene management system S of the present embodiment manages and determines the sanitary state of food on the data, information relating to work in food production or inspection (hereinafter referred to as “work information”), and the extracted sample. Are registered in the server device 40 (specifically, the database 400) in association with the culture medium information of the film-type culture medium 60 acquired by the portable communication terminal device 10 before and after culturing the bacteria (colony) generated in It has a possible configuration.

Specifically, the sanitary management system S of the present embodiment, after a lapse of a predetermined time from the start of culture,
(1) Based on the feature amount of the pixels constituting the medium image in which the film type medium 60 is imaged, colonies generated in the film type medium 60 are detected and their characteristics (hereinafter referred to as “colony characteristics”). )
(2) Based on a preset characteristic (hereinafter referred to as “reference characteristic”) and a colony characteristic, the abnormality of the detected colony is determined,
(3) Browsing, correcting, and registering the determination result in the database 400
It has a configuration.

  In order to realize such a configuration, the sanitary management system S of the present embodiment, as shown in FIG. 1, includes a plurality of portable communication terminal devices 10 used when registering culture medium information regarding each film-type culture medium 60. In addition, the administrator terminal device 20 that manages the sanitary management system S, the network 30, and the database 400, and in conjunction with the portable communication terminal device 10 or the administrator terminal device 20, registration management of medium information is performed. And a server device 40 that executes various types of processing.

  The work information of this embodiment includes, in addition to various types of information related to the manufacturing process or the inspection process, information regarding the culture of the food extracted from the manufacturing process or the inspection process as a specimen and the colonies generated in the specimen. In addition, it is registered in the database 400 using unique identification information (hereinafter referred to as “work ID”).

Specifically, each work information includes
(1) Work ID,
(2) Identification information (hereinafter referred to as “line ID”) of the work line 80 from which the sample is to be extracted or, if the work line 80 has a plurality of processes, the line ID and process identification information (hereinafter referred to as “line ID”). , Referred to as “process ID”) 71b;
(3) Product name of food as a sample, identification information of lot (hereinafter referred to as “lot ID”), lot name,
(4) Type of bacteria detected from specimens such as general bacteria or E. coli (hereinafter referred to as “test type”);
(5) Sample culture conditions such as dilution factor, type of diluent, culture temperature, culture humidity, and culture time,
(6) Specimen culture start time;
(7) a time after a predetermined time has elapsed since the start of culture of the specimen (hereinafter also referred to as “culture test time”);
(8) Sample incubator location such as incubator number and number of steps in the incubator,
(9) Work date and time indicating the work start time and end time;
(10) Worker ID (employee ID) and worker name;
Is included. Each piece of work information is registered in the database 400 for each type and for each work.

  The portable communication terminal device 10 is, for example, a digital camera having a communication function, a tablet-type information terminal device, a smartphone or a portable telephone, or the like, or an imaging function such as a still image or a recording function (hereinafter simply referred to as “camera function”). And a communication terminal device portable by an operator.

  In particular, the portable communication terminal device 10 generates an image data (hereinafter referred to as “medium image data”) by imaging the film-type culture medium 60 by the camera function, and also images the work instruction sheet 70 and displays the instruction sheet. It has a configuration capable of generating an image.

  Then, the portable communication terminal device 10 acquires the work ID 71 and the culture medium ID 66 from the image data of the instruction manual image (hereinafter referred to as “instruction data image data”) and the culture medium image data of the film type culture medium 60, The acquired work ID 71 and medium ID 66, medium image data, and metadata of the medium image data can be registered in the database 400 of the server device 40 as medium information.

  On the other hand, when the portable communication terminal device 10 transmits the culture medium information to the server device 40, BLUETOOTH (registered trademark), wireless LAN (WLAN: Wireless Local Area Network), or wireless PAN (WPAN: Wireless Personal Area Network). The data is transmitted to the server device 40 directly or via the access point 50 using a communication standard for short-range wireless communication or the like, or is transmitted to the server device 40 using a public telephone line network via a mobile base station (not shown). It has a configuration.

  The portable communication terminal device 10 has a browser function constructed by a markup language such as XML (extensible Markup Language), and executes an operation input instruction and an operation confirmation by the operator using the browser function. The culture medium information is transmitted to the server device 40 via the browser function.

  The administrator terminal device 20 is an information communication terminal device such as a tablet information terminal device, a smartphone, a personal computer, or a workstation. The administrator terminal device 20 manages the administrator identification information (hereinafter referred to as “manager ID”), the administrator password, and the worker identification information (hereinafter referred to as “worker ID”). It functions as a control device capable of performing management of access authority to the server device 40, management of the terminal ID of the portable communication terminal device 10, correction of registered medium information, and other management.

  Similarly to the portable communication terminal device 10, the administrator terminal device 20 has a browser function constructed by a markup language, and uses the browser function to exchange data with the server device 40 and to generate a report. It has a configuration capable of executing browsing and the like.

In particular, the administrator terminal device 20
(1) A process of obtaining a colony detection result together with a colony abnormality determination result from the server device 40 based on an instruction from the administrator and displaying it together with a culture medium image (hereinafter referred to as “discrimination result display process”); ,
(2) A process of executing correction of colony abnormality determination in conjunction with the server device 40 (hereinafter referred to as “discrimination result correction process”),
It has the structure which performs.

  Note that the administrator terminal device 20 determines the culture medium information when each operation is interrupted due to a failure of a machine that performs the process or the like in the same lot, or when an error in registration of culture medium information occurs in the operator. It has a configuration that can correct other information.

  The network 30 includes, for example, a public telephone line network (hereinafter referred to as “long-distance communication network”) including a mobile phone network, an IP (Internet Protocol) network such as a short-distance wireless network, or both of which are interconnected. Has been. However, the configuration of the network 30 is not limited to this.

  The server device 40 is a server device used in conjunction with the portable communication terminal device 10 or the administrator terminal device 20 to execute each data process for hygiene management of the lot and work line 80.

  Then, the server device 40 is linked with the portable communication terminal device 10, registers the culture medium information in each film-type medium 60 before the start of culture (hereinafter referred to as “initial registration”), and starts the culture in the database 400. While performing subsequent registration (hereinafter referred to as “post-cultivation registration”), the medium information transmitted from the portable communication terminal device 10 is acquired, and from the medium image formed by the medium image data of the acquired medium information In addition, it has a configuration for detecting colonies generated and cultured in a specimen.

Specifically, when the server device 40 acquires medium image data having a medium image,
(1) Based on the feature amount relating to the color of each pixel constituting the acquired medium image, a colony generated in the film type medium 60 is detected,
(2) Based on the pixels used to image the detected colonies (hereinafter referred to as “colony pixels”), the colony characteristics in the detected colonies are identified,
(3) Based on the reference characteristic and the colony characteristic, the abnormality of the detected colony is determined,
(4) Generate data of a discrimination result image obtained by imaging a discrimination result regarding colony abnormality on a culture medium image, and provide the discrimination result image to the portable communication terminal device 10 so that the administrator can view the discrimination result image.
(5) Based on instructions from the administrator, register information on the identified colonies in the database 400 as medium information.
It has a configuration.

  In particular, in the process (2), the server device 40 calculates two or more feature amounts of the detected colony based on the colony pixel, and the coordinate position on the coordinate system defined by the two or more feature amounts. Is specified as a colony characteristic.

  In addition, in the process of (3), the server device 40 is based on the function that defines the reference characteristic and the coordinate position that indicates the colony characteristic on the coordinate system that is defined by two or more feature amounts. It has the structure which discriminate | determines the abnormality of the detected colony.

The server device 40 is
(A) number of colony pixels,
(B) a feature amount relating to the color of the colony pixel;
(C) the arrangement position on the culture medium image of the colony pixel, or
(D) The colony characteristics are specified based on any one of two or more feature amounts among the feature amounts of (A) to (C).

  On the other hand, the server device 40 sets the reference characteristics based on the colony characteristics of the colonies that have already been determined to be normal and abnormal, and is determined in advance, for example, every time the determination result for determining the abnormality of the detected colonies is determined. The reference characteristic is updated at each timing. However, the reference characteristic of this embodiment is defined by the same feature quantity as the colony feature quantity used when specifying the colony characteristics.

  With such a configuration, in the sanitary management system S of the present embodiment, the characteristics of the colonies detected from the culture medium image are assumed by using the reference characteristics set based on the characteristics of the colonies assumed to be detected. When it is determined that it is an outside colony and has abnormality, the determination result can be browsed by the administrator.

  Therefore, in the sanitary management system S of the present embodiment, the administrator can check the condition of the culture medium different from the usual, such as the discovery of a foreign substance that is not normally detected or the occurrence of a different type of bacteria. As a result, it is possible to facilitate the work and reduce the work burden on the manager, and as a result, to accurately identify colonies and accurately register medium information including them.

  Moreover, in the sanitary management system S of this embodiment, since the presence or absence of the abnormality of a colony can be judged by using the coordinate system based on the feature-value of the detected colony, a uniform judgment can be performed. In addition, the abnormality of colonies can be easily and accurately determined.

  Furthermore, in the sanitary management system S of the present embodiment, since the reference characteristic can be learned based on the colony characteristic determined in the past, the reference characteristic serving as a uniform determination criterion is made highly reliable. To be able to make accurate judgments.

  In the sanitary management system S of the present embodiment, it is possible to save resources as compared with the case where various data analysis and provision are performed using physical resources such as paper media, and the culture medium. By registering media information on the database in the database, registration errors can be significantly reduced and difficult media management can be facilitated, so resources can be saved without wastefully consuming media. Yes.

[2] Film Type Medium Next, the film type medium 60 of the present embodiment will be described with reference to FIG. FIG. 2 is an example of a film-type medium 60 used in this embodiment.

  The film-type medium 60 used in the present embodiment is a medium for culturing bacteria generated in food as a specimen detected from each step of the work line 80 using a film or sheet-like dry medium. For example, the film-type culture medium 60 is used as a culture medium for cultivating general live bacteria, coliform bacteria, and Staphylococcus aureus. In addition, you may use as a culture medium which culture | cultivates various bacteria, substances, or microorganisms, such as mold | fungi, yeast, a Listeria bacterium, a microorganism for water quality, lactic acid bacteria, and a protein.

  The film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “circular frame”) 62, a culture layer 63 for culturing bacteria provided in the frame, a cover sheet 64 covering the culture layer 63, and the left side of the base sheet 61. Medium ID66.

  For example, the culture medium ID 66 is formed of a barcode such as a two-dimensional barcode or alphanumeric characters, and is imaged together when the film-type culture medium 60 is imaged, such as a barcode recognition function or an OCR (Optical Character Recognition) function. It is acquired in the portable communication terminal device 10 or the server device 40 using the image analysis function.

  The base material sheet 61 is not particularly limited as long as it is a film-like or sheet-like base material, and for example, a plastic film or paper can be used. Preferred examples of plastic films include resin films such as polyethylene, polypropylene, polyethylene terephthalate, polyethylene naphthalate, polymethacrylate, polymethyl methacrylate, polymethyl acrylate, polyester, and polycarbonate. Preferred examples include polyethylene terephthalate and polypropylene synthetic paper. Note that the polypropylene-based synthetic paper is a film synthetic paper whose main raw material is polypropylene.

  The film-type culture medium 60 has an IC tag in which a culture medium ID 66 is stored. The short-range wireless communication interface 140 (for example, an IC tag reader) included in the portable communication terminal apparatus 10 causes the medium to be connected to the portable communication terminal apparatus 10. ID66 may be acquired.

[3] Work instruction sheet Next, the work instruction sheet 70 of this embodiment will be described with reference to FIG. FIG. 3 is an example of a work instruction sheet 70 used in the present embodiment.

  The work instruction sheet 70 of the present embodiment includes, for each food group manufactured or inspected under the same conditions, that is, for each lot, work names and contents of one or more manufacturing processes or inspection processes, and work lines 80 to be used. It is an instruction document that describes the name of the food (processed food) to be manufactured or inspected, the quantity, and other information.

  In addition, the work instruction sheet 70 of the present embodiment has an instruction sheet ID 71a formed by printing or other methods on the upper left, and a plurality of process IDs 71b formed by printing or other methods on a predetermined area. . The instruction sheet ID 71a and each process ID 71b are used as the work ID 71, and are formed of, for example, a barcode such as a two-dimensional barcode or alphanumeric characters. The instruction ID 71a and each process ID 71b are imaged in the same manner as the film-type medium 60 when the registration of the film-type medium 60 is executed, and analyzed by the portable communication terminal device 10 or the server device 40. Be recognized.

  The work instruction sheet 70 has an IC tag in which the work ID 71 of the instruction sheet ID 71a or the process ID 71b is stored, like the film type culture medium 60, and has an interface (short distance) that the portable communication terminal device 10 such as a tag reader has. The portable communication terminal device 10 may acquire the work ID 71 by the wireless communication interface 140). In the following description, unless otherwise specified, the work ID 71 indicates an instruction ID 71a or a process ID 71b.

[4] Portable Communication Terminal Device Next, the configuration of the portable communication terminal device 10 of the present embodiment will be described using FIG. FIG. 4 is a block diagram showing the configuration of the portable communication terminal device 10 of the present embodiment.

  The portable communication terminal device 10 of the present embodiment has a data storage unit 100 having a memory function used when various programs are executed, an imaging function, image data of the film-type medium 60, and other image data. In addition to the image data generation unit 110 that generates the media information, the media information is registered in the server device 40 after the initial registration and the post-cultivation registration immediately after the culture in conjunction with the server device 40 (hereinafter referred to as “medium information registration processing”). And an application control unit 120 that executes processing.

  The portable communication terminal device 10 includes a network communication unit 130 that communicates with the server device 40 and other communication devices, a short-range wireless communication interface 140 that exchanges data with an IC tag and other communication interfaces, Controls the current position detection unit 150 that detects the current position, the display unit 160, the display control unit 161 that controls the display unit 160, the operation unit 170 for inputting user operations, the timer 180, and the entire apparatus. A portable terminal management control unit 190.

  And the portable communication terminal device 10 has various necessary members such as a microphone, a speaker, and an e-mail transmission / reception function when having a mail function such as a telephone function and e-mail. Further, the above-described units are connected to each other by a bus 11 to exchange data.

  The data storage unit 100 includes an application storage unit 101 that stores various application programs, an image data storage unit 102 that stores image data captured and generated by the image data generation unit 110, and a portable communication terminal device 10 and management / control programs, and a ROM / RAM 103 that is used as a work area during execution of each program and stores data used in each process executed by the portable communication terminal device 10. doing.

  In particular, the application storage unit 101 includes an application program (hereinafter referred to as “application”) that is executed by the application control unit 120 in conjunction with the image data generation unit 110, the operation unit 170, the display control unit 161, and the image data storage unit 102. Is recorded). The application storage unit 101 also stores a browser program for realizing the above browsing function.

  In the image data storage unit 102, the imaged medium image data and instruction sheet image data, the image ID for managing each image data, various metadata corresponding to each image data such as the imaging time, and the work ID 71 The medium ID 66 and various flag information are stored in association with each other. The image ID is arbitrary identification information that is appropriately given in each portable communication terminal device 10.

  The image data generation unit 110 includes an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and image data based on the electrical signal generated by the CCDI sensor. And a generating unit that generates

  In particular, when the work instruction sheet 70 is imaged, the image data generation unit 110 converts the imaged work instruction sheet 70 into an image and generates instruction sheet image data. The image data generation unit 110 images the film-type medium 60 that has been imaged when the bacteria generated in the specimen are cultured or the film-type medium 60 that has been cultured is imaged. 60 pieces of medium image data are generated as medium image data.

  The application control part 120 implement | achieves culture-medium information registration process with a predetermined application. In particular, the application control unit 120 executes the network communication unit 130 and the display control unit 161 while executing various control programs for controlling each unit of the portable communication terminal device 10 using the culture medium registration application stored in the application storage unit 101. In addition, various processes are executed in conjunction with or controlled by the operation unit 170.

  Specifically, the application control unit 120 executes the medium registration application recorded in the application storage unit 101, controls the image data generation unit 110, acquires the medium image data of the film-type medium 60 captured. The image data is stored in the image data storage unit 102.

  Then, the application control unit 120 acquires the culture medium ID 66 from the imaged culture medium image data, and stores the culture medium image data, the metadata of the culture medium image data, and various flag information together with the acquired culture medium ID 66. Store in the unit 102. Note that the application control unit 120 may execute barcode recognition or OCR recognition in conjunction with another communication device or the database 400 via a communication line.

  In addition, the application control unit 120 performs initial registration for registering the culture medium information in the server device 40 at the start of the culture of the specimen after imaging of the culture medium image data or at a predetermined timing, and registers the culture medium information after the start of the culture of the specimen. Perform registration after incubation. In particular, the application control unit 120 identifies whether the registration is initial registration or post-cultivation registration based on the operator's instruction, and includes information (flag information) indicating either registration in the culture medium information in the server device 40. Send.

  The application control unit 120 acquires the current time from the timer 180 when the film-type medium 60 is imaged, and the image data storage unit as the metadata of the medium image data together with a predetermined image ID using the current time as the imaging time. 102. When the medium image data is transmitted to the server device 40, it is transmitted together.

  In addition, the application control unit 120, when the culture medium ID 66 and the work ID 71 that is the instruction ID 71a and the process ID 71b are stored in the IC tag, the operation unit 170, the display control unit 161, and the short-range wireless communication interface The medium ID 66 and the work ID 71 are acquired in conjunction with 140.

  When the server device 40 recognizes the medium ID 66 and the work ID 71 from the medium image data and the instruction sheet image data, the application control unit 120 transmits instruction sheet image data in addition to the medium image data as the medium information.

  Furthermore, the application control unit 120 may be realized as a function when the CPU (central processing unit) constituting the mobile terminal management control unit 190 executes the application in terms of implementation.

  The network communication unit 130 establishes a communication line with the server device 40 connected to the network 30 under the control of the application control unit 120 and the mobile terminal management control unit 190, and exchanges various data such as culture medium image data. Do.

  The short-range wireless communication interface 140 performs short-range wireless communication using an IC tag under the control of the application control unit 120 and the mobile terminal management control unit 190.

  The current position detection unit 150 recognizes the position of a GPS (Global Positioning System) satellite via the network 30 under the control of the application control unit 120 or the mobile terminal management control unit 190, and transmits a satellite transmitted from the GPS satellite. A signal (GPS signal) is detected.

  Then, the current position detection unit 150 calculates (that is, detects) coordinate values indicated by the latitude and longitude of the current position of the portable communication terminal device 10 based on the detected GPS signal. In addition, the current position detection unit 150 provides the calculated coordinate value to the application control unit 120 as position information.

  In addition, when the portable communication terminal device 10 has a telephone function or a short-range wireless function, the portable communication terminal device 10 is based on the direction and the radio field intensity received by the telephone base station or the like for the radio wave used for the telephone or the short-range radio. The current position of the portable communication terminal device 10 may be calculated (detected).

  The display unit 160 has an image display area of a predetermined size (for example, 5 inches, W480 × H960 pixels), is configured by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 161. A predetermined image is displayed based on the display data. In particular, in the present embodiment, when the culture medium registration application is being executed, the display unit 160 is linked to the operation unit 170, and various displays, captured work instructions 70 and film-type culture media that have been imaged. 60 is displayed.

  The display control unit 161 generates drawing data necessary to cause the display unit 160 to draw a predetermined image under the control of the application control unit 120 or the mobile terminal management control unit 190, and the generated drawing data is displayed on the display unit. 160 is output.

  The operation unit 170 includes various confirmation buttons, operation buttons for inputting operation commands, a number of keys such as a numeric keypad, and a touch sensor provided on the display unit 160, and is used when performing each operation. It has become. Specifically, the operation unit 170 is used when performing operations for executing the various processes described above when the culture medium registration application is activated.

  In the present embodiment, the operation unit 170 can also be used when manually inputting the culture medium ID 66 directly.

  The timer 180 provides the application control unit 120 with the date and time when the image data generation unit 110 images the film-type medium.

  The portable terminal management control unit 190 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and the overall functions of the portable communication terminal device 10. In addition, overall functions for executing the information providing program are generally controlled.

[5] Server Device [5.1] Configuration of Server Device Next, the configuration of the server device 40 of this embodiment will be described with reference to FIG. FIG. 5 is a configuration diagram showing the configuration of the server device 40 of the present embodiment.

  As shown in FIG. 5, the server device 40 of the present embodiment communicates with a database 400 in which various information such as work information and culture medium information is stored, and the portable communication terminal device 10 and the administrator terminal device 20. A communication control unit 410, a data processing unit 420 that executes various processes such as a culture medium information registration process, a server management control unit 430 that controls each unit of the server device 40, a ROM / RAM 440 that is used to control each unit, and a time And a timer 450 used for management. The above-described units are connected to each other by a bus 41, and data transfer is performed between the components.

  The communication control unit 410 is a predetermined network interface, establishes a communication line with the portable communication terminal device 10 or the administrator terminal device 20, and exchanges various data with the portable communication terminal device 10 or the administrator terminal device 20. I do.

  The database 400 includes an HDD or an SSD, and includes a medium information database (hereinafter abbreviated as “medium information DB”) 401, a line information database (hereinafter abbreviated as “line information DB”) 402, and a lot information database (hereinafter referred to as “line information DB”). , “Lot information DB”) 403 and a work management database (hereinafter abbreviated as “work management DB”) 404. For example, each DB of the present embodiment constitutes a database according to the present invention.

The medium information DB 401 is a database in which medium information regarding the film-type medium 60 of the sample extracted for each process of each work line 80 is stored for each work ID 71 and medium ID 66. For example, in the culture medium information DB 401,
(1) Medium ID
(2) Imaged medium image data (3) Image capture time (4) Other information including flag information (5) Colony candidate specific information including feature amount relating to color of each colony candidate (6) Colony candidate imaged Information of each colony candidate including the feature amount of the detection pixel used for the image processing and the coordinate position of the film-type medium 60 (hereinafter referred to as “colony candidate information”).
(7) ID of each colony candidate to be a colony (ID when labeling) and the number of colonies (8) Based on the number of colonies, it is determined whether the film-type medium 60 (that is, the specimen) is normal or abnormal Results of medium determination (9) Work ID
Are recorded in association with each other.

  When the sample to be extracted is always extracted from the same process on the same work line 80 in the same lot, the work ID may be a lot ID, and the sample to be extracted is the same lot. However, when extracting from a different work line 80 or a different process, the line ID or the process ID 71b is obtained.

  The number of colonies and the result of medium determination in each medium information may be registered when the medium information is registered, or may be registered at a predetermined timing different from the registration timing of the medium information.

  Furthermore, when a plurality of imaging times of medium information of the same film type culture medium 60 are registered (that is, when there are a plurality of culture examination times described later), in the same culture medium ID 66, the culture medium at each culture examination time. Each medium information of an image, imaging time, the number of colonies, and medium determination is stored.

The line information DB 402 is a database in which line information regarding each work line 80 is stored for each line ID. For example, the line information DB 402 includes
(1) Line ID
(2) The process ID 71b of the process included in the work line 80 and the two types of data are recorded in association with each other. As the process type, a name for identifying each process such as material input, blending, filling, boiling, packaging, and packaging is used.

The lot information DB 403 is a database in which lot information regarding each lot is stored for each lot ID. For example, in the lot information DB 403,
(1) Lot ID (instruction ID 71a)
(2) Line ID of work line used for production or inspection of lots
(3) Lot work start time (4) Lot work end time (5) Five pieces of data of a work team of workers who perform lot work are recorded in association with each other.

The work management DB 404 is a database that stores various types of information related to work contents. For example, the work management DB 404 includes
(1) Work ID
(2) Line ID of the work line from which the sample is to be extracted (or line ID and process ID 71b)
(3) Type of sample (food) (product name, lot ID and / or lot name)
(4) Type of inspection (generic bacteria or bacteria to be detected such as E. coli)
(5) Culture conditions (dilution ratio, type of diluent, culture temperature, culture humidity and culture time)
(6) Culture start time (7) Time after a predetermined time has elapsed from the start of culture (hereinafter also referred to as “culture test time”)
(8) Culture location (for example, the position of the incubator number and the number of steps in the incubator)
(9) Work date and time (work start time and end time)
(10) Worker ID (and / or worker name)
Are recorded in association with each other.

  In addition, only a single time (that is, an end time for ending the culture of the specimen) may be set as the culture examination time, or after the statutory or predetermined time has elapsed from the culture start time, for example, the culture A plurality of times such as 24 hours from the start time, 48 hours, or 72 hours may be set.

The data processing unit 420 executes various data processing in accordance with the application recorded in the ROM / RAM 440. In particular, the data processing unit 420 executes a predetermined program,
(1) Operation management of the communication control unit 410;
(2) Medium information registration processing for acquiring various medium information in cooperation with each portable communication terminal device 10 and registering it in the database 400;
(3) A colony is detected from each medium image of each film type medium 60 during the medium information registration process or at a predetermined timing after the medium information registration process, the colonies are counted, and the medium is based on the number of colonies A colony detection determination process for executing the determination;
(4) lot determination processing for determining a lot based on registered medium information;
(5) Report processing for outputting the determination result in a report format;
(6) Management and control of the database 400;
I do.

  In particular, in the colony detection determination process, the data processing unit 420 counts the colonies determined to be normal while determining the abnormality of the detected colonies, and executes medium determination based on the number of colonies. Then, the data processing unit 420 provides the administrator with the result of determining the abnormality of the detected colony during execution of the colony detection determination process (while browsing), and if necessary, in accordance with the instruction of the administrator. Based on the corrected discrimination result, the colony count and the medium determination based on the number of colonies are executed. In addition, the data processing unit 420 updates the reference characteristics for each film-type medium 60 or each time the determination result is corrected.

  Specifically, the data processing unit 420 includes a registration processing unit 421, a colony detection determination unit 422, an imaging data generation unit 423, a lot determination processing unit 424, and a report processing unit 425.

  Note that, for example, the registration processing unit 421 of the present embodiment constitutes an acquisition unit and a registration unit according to the present invention, and the colony detection determination unit 422 of the present embodiment includes the detection unit, the specifying unit, the determination unit, and the present invention. Configure setting means. Further, for example, the imaging data generation unit 423 of the present embodiment constitutes a providing unit according to the present invention. Furthermore, details of the registration processing unit 421, colony detection determination unit 422, imaging data generation unit 423, lot determination processing unit 424, and report processing unit 425 of this embodiment will be described later.

  The server management control unit 430 is mainly configured by a central processing unit (CPU), and integrally controls each unit of the server device 40 by executing a program. Specifically, the server management control unit 430 performs login processing for each user and various other controls based on a login request from the portable communication terminal device 10 by a user operation.

  Various programs necessary for driving the server device 40 are recorded in the ROM / RAM 440. In particular, in the ROM / RAM 440, information for defining the reference characteristics, medium determination (pass / fail determination) of each film type medium 60, determination criteria used when executing each determination of process determination, line determination, and lot determination. Each information such as information (hereinafter also referred to as “medium determination criterion information”) is stored. The ROM / RAM 440 is used as a work area during execution of each program.

The timer 450 is used for managing the time required when the medium information registration process and the lot determination process are executed.

[5.2] Registration Processing Unit Next, details of the registration processing unit 421 in the server device 40 of the present embodiment will be described.

  The registration processing unit 421 according to the present embodiment performs a medium information registration process for registering each medium information in the medium information DB 401 while being associated with the work ID 71 in conjunction with the portable communication terminal device 10. In particular, the registration processing unit 421 executes different medium information registration processing based on flag information indicating whether the registration is initial registration or post-culture registration included in the culture medium information.

(Initial registration)
When the flag information indicating initial registration is included in the culture medium information transmitted from the portable communication terminal device 10, the registration processing unit 421 performs a culture medium information registration process based on the initial registration.

  Specifically, when the registration processing unit 421 acquires the culture medium information via the communication control unit 410, the registration processing unit 421 specifies the culture medium ID 66 and the work ID 71 included in the culture medium information. In addition, the registration processing unit 421 searches the work management DB 404 based on the specified work ID 71, specifies the corresponding work information, and associates the acquired medium image data and imaging time with the specified work information. Is registered in the culture medium information DB 401.

  In particular, the registration processing unit 421 specifies the lot ID including the work line 80 from which the sample is extracted based on the acquired work ID 71, the line ID of the work line 80, the process ID 71b from which the sample is extracted, and the specification. The medium image data and the imaging time included in the medium information are registered in the medium information DB 401 in association with the lot ID, the line ID, and the process ID 71b.

  Then, the registration processing unit 421 registers the imaging time in the culture medium information DB 401 as the culture start time. As the culture start time, a preset time may be used instead of the imaging time on the assumption that the medium information registration process is executed at the time.

(Registration after culture)
When the flag information indicating post-cultivation registration is included in the culture medium information transmitted from the portable communication terminal device 10, the registration processing unit 421 performs a registration process based on post-cultivation registration.

  Specifically, when acquiring the culture medium information via the communication control unit 410, the registration processing unit 421 identifies the culture medium ID 66 and the work ID 71 included in the culture medium information, as in the initial registration. Then, the registration processing unit 421 searches the work management DB 404 based on the identified work ID 71, identifies the corresponding work information, and registers the imaging time in the culture medium information DB 401 in association with the identified work information. To do. Note that the culture examination time may be a preset time instead of the imaging time on the assumption that the culture information registration process is executed at the same time as the culture start time.

  On the other hand, the registration processing unit 421 registers the acquired medium image data in the medium information DB 401 together with the analysis result or without analysis while causing the colony detection determination unit 422 to perform image analysis. The colony detection determination unit 422 performs colony detection, colony count, and medium determination by image analysis, and details of the image analysis will be described later.

[5.3] Colony Detection Determination Unit [5.3.1] Operation Principle of Colony Detection Determination Unit Next, the operation principle of the colony detection determination unit 422 in the server device 40 of the present embodiment will be described.

  The colony detection determination unit 422 of the present embodiment acquires the medium image data transmitted from the portable communication terminal device 10 or the medium image data already registered in the medium information DB 401 under the control of the registration processing unit 421. The colonies imaged in the medium image of the acquired medium image data are detected. And the colony detection determination part 422 counts the detected colony, performs a medium determination based on the counted number of colonies, and provides it to the registration process part 421.

  In particular, the colony detection determination unit 422 specifies the characteristics of each colony (that is, the colony characteristics) based on the colony pixels used to image the detected colonies, and is preset with the specified colony characteristics. The abnormality of the colony is discriminated in comparison with the reference characteristic, and the result is imaged by the imaging data generation unit 423 and provided to the administrator terminal device 20 so as to be viewable to the administrator.

  In addition, the colony detection determination unit 422 is a case where the colony determination result is provided to an administrator so that it can be viewed, and when the administrator instructs the correction of the determination result (specifically, correction of the colony). First, a determination result correction process for correcting the determination result for each colony is executed in conjunction with the imaging data generation unit 423.

  Then, the colony detection determination unit 422 executes the finally determined colony, the count of the number of colonies, and the medium determination based on the number of colonies based on the determination result corrected by the determination result correction process, Various information, the number of colonies, and the medium determination result are provided to the registration processing unit 421 as medium information.

  Usually, depending on the determination result of the medium determination including process determination, line determination and rod determination, not only stop shipping of the product, but also when the target product has already been shipped, it is human to eat and drink the product Not only the impact, but social disruption occurs. Therefore, in order to improve the hygiene management reliability for each film type culture medium 60 by the administrator, in addition to preventing erroneous detection of bacteria occurring in the specimen when the product is manufactured or tested, The detected colonies are confirmed. In particular, in order to find foreign matter mixed in the work line or specimen, not only the presence or absence of colonies generated in the film-type medium 60, but also abnormalities in feature quantities such as the shape, size, and color of the colonies are observed. It comes to confirm.

  However, in order to recognize the abnormality in the feature amount such as the shape, size, and color of the colony by the visual inspection of the manager, it is necessary to have a skillful technique, and it is possible to easily determine the abnormality by visual inspection. difficult.

  Therefore, in the present embodiment, by having the above-described configuration, it is possible to make an administrator look closely at a colony having an abnormality, thereby facilitating a confirmation operation for the abnormality of the colony. In addition, it is possible to reduce the workload of the administrator, and as a result, accurately identify colonies and accurately register medium information including them.

  Further, the colony detection determination unit 422 according to the present embodiment, based on the colony characteristics of a confirmed colony (hereinafter also referred to as “determined colony”) when a colony detected based on an instruction from an administrator is fixed, including correction. To learn the reference characteristics. That is, the colony detection determination unit 422 updates the reference characteristics based on the colony characteristics of normal colonies and abnormal colonies each time information on colonies determined as medium information is registered.

  With this configuration, in the present embodiment, the reference characteristics can be defined using actual detection results, so that it is possible to determine the presence or absence of abnormalities in the colonies that have been accurately detected. Details of each process of the colony detection determination unit 422 will be described below.

[5.3.2] Details of Each Process of Colony Detection Determination Unit Next, details of each process of the colony detection determination unit 422 in the server device 40 of the present embodiment will be described with reference to FIGS. To do.

  6 and 7 are diagrams for explaining a specifying process for specifying a colony characteristic executed in the server device 40 of this embodiment, and FIG. 8 is executed in the server device 40 of this embodiment. It is a figure for demonstrating the discrimination | determination process which discriminate | determines the abnormality of a colony. FIG. 9 is a diagram for explaining setting of reference characteristics executed in the server device 40 of the present embodiment.

(Colony detection process)
The colony detection determination unit 422 binarizes the feature amount related to the color of each pixel constituting the medium image using a predetermined threshold, and images the pixel having one value, that is, the colony. Extract colony pixels that are assumed to be used.

  Then, the colony detection determination unit 422 performs connection and labeling of adjacent colony pixels while performing image filter processing for reducing noise, and assigns an ID to the connected colony pixel group as one object, That is, it detects as a colony.

  In particular, the colony detection determination unit 422 includes an expansion process that replaces all the pixels adjacent to the colony pixel with colony pixels when there are other colony pixels adjacent to each colony pixel as the image filter process, and When there is a pixel that is not a colony pixel adjacent to the colony pixel (hereinafter referred to as “non-colony pixel”), a contraction process is performed to replace all adjacent pixels with non-colony pixels.

  The colony detection determination unit 422 temporarily stores the extracted colony pixels in the ROM / RAM 440. In addition, the colony detection determination unit 422 determines, for each detected colony, the colony of each colony based on the feature amount relating to the color of the colony pixel included in each colony, the arrangement position on the medium image of each pixel, or both. Likelihood indicating likelihood or other standard values are calculated, and the effectiveness of the detected colonies is determined based on the calculated values. Colonies that are determined to be invalid by the calculated values are not colonies. You may exclude from detection as a target object.

(Identification of colony characteristics)
The colony detection determination unit 422 specifies the characteristics of the colony as colony characteristics for each detected colony based on the colony pixel of each colony. In particular, the colony detection determination unit 422 calculates two or more feature quantities of a predetermined colony based on the colony pixel in each colony, and is on a coordinate system defined by the two or more feature quantities (feature quantity space). ), A coordinate position defined based on each feature amount is specified as a colony characteristic.

Specifically, the colony detection determination unit 422 is based on each colony pixel for each colony,
(1) Color distribution of each colony pixel (2) Roundness of colony,
(3) Colony size,
(4) Distribution of unevenness values (curvature) for each predetermined length of the outer periphery of the colony (curvature distribution)
2 or more feature quantities are calculated.

  In particular, when the various color distributions in (1) are used, the colony detection determination unit 422 uses the RGB tone values, luminance values, and saturations of each colony pixel, these two or more color components, or these The feature amount such as a feature amount newly calculated by a statistical method based on the value of the value is multi-valued to n (“n” is an integer of 2 or more), and the number of colony pixels (that is, for each color component value) That is, a color distribution (histogram) in which the number of bins obtained by counting the number of colony pixels having gradation values belonging to the range is “n” is generated. Then, the colony detection determination unit 422 normalizes the number of colony pixels of each bin of the generated histogram (calculates a ratio based on the number of all colony pixels) and specifies each as a feature amount. That is, the colony detection determination unit 422 specifies the normalized number of colony pixels in n bins as a feature amount.

  For example, when the luminance value (normalized value) is used and the number of bins is “5” and the number of all colony pixels is “100”, the colony detection determination unit 422 The brightness value of each colony pixel is [0.0 to 0.2], [0.2 to 0.4], [0.4 to 0.6], [0.6 to 0.8] and [0. .8 to 1.0], and the total number of colony pixels (for example, “8”, “7”, “12”, “41” and “32”) ) Is divided by the total number of colony pixels “100”, and five feature amounts “0.08”, “0.07”, “0.12”, “0.41”, and “0.32” are specified. .

  In addition, when using the roundness in (2), the colony detection determination unit 422 calculates, for each colony, the center of gravity coordinates of the colony based on the coordinate position on the medium image in the colony pixel of each colony, A ratio between the distance to the shortest outer colony pixel of the calculated barycentric coordinates and the distance to the longest outer colony pixel is calculated, and the calculated ratio is specified as a feature amount.

  Furthermore, when using the colony size in (3), the colony detection determination unit 422 is based on the number of colony pixels for each colony or the coordinate position of each colony pixel on the medium image using a predetermined scale. The area of the corresponding colony is calculated, and the calculated value is specified as the feature amount.

  Furthermore, when the curvature distribution in (4) is used, the colony detection determination unit 422 calculates the curvature for each predetermined length of the outer circumference for each colony, while m (“m” is 2). In the same way as in (1), a curvature distribution (histogram) with a bin number of m, which is the sum of the numbers belonging to each numerical interval (hereinafter referred to as “number of sections”), is generated. . Then, the colony detection determination unit 422 specifies the normalized number of sections belonging to each bin of the generated histogram as the feature amount. That is, the colony detection determination unit 422 specifies the distribution number (distribution value) of the curvature distribution in m bins as a feature amount as in the concept of (1).

  Then, the colony detection determination unit 422 determines the plurality of feature amounts specified as described above, that is, n normalized color distributions, roundness, colony size, and m normalized curvature distribution numbers. Based on the (n + m + 2) -dimensional feature amount space, a specified coordinate position is specified as a colony characteristic. In other words, the colony detection determination unit 422 generates a vector (n + m + 2) based on each feature amount, and specifies a coordinate position determined based on the vector as a colony characteristic.

  For example, the colony detection determination unit 422 detects colonies A1 to A9 as illustrated in FIG. 6, and the color distribution, the colony size, the roundness, and the bin number are “5” RGB. When the curvature distribution of “5” is a feature amount, as shown in FIG. 7, each value is calculated for each colony ID, and the coordinate position in the 12-dimensional feature amount space (coordinate system) is calculated based on the calculated value. Are identified as colony characteristics. Note that the color distribution shown in FIG. 7 indicates the normalized value of the number of colony pixels belonging to each of the five bins in RGB, and the curvature distribution indicates the normalized value of the number of distributions belonging to each of the five bins. Show.

(Determination of abnormalities in colonies)
The colony detection determination unit 422 compares a predetermined reference characteristic with the colony characteristic of each detected colony, and determines the abnormality of the detected colony. In particular, the colony detection determination unit 422 is a function on the coordinate system defined by two or more feature values that define the colony characteristics, and is a function (identification plane) for distinguishing normal colonies from abnormal colonies. Determine the abnormalities of the colony using the reference characteristics.

  Specifically, the colony detection determination unit 422 defines a function indicating a reference characteristic on a coordinate system defined by two or more feature amounts, and sets the coordinate system as a normal colony region with the reference characteristic as a boundary. Divide into abnormal colony areas. And the colony detection determination part 422 determines the abnormality of the detected colony by determining to which area | region the coordinate position prescribed | regulated based on the feature-value of the detected colony belongs.

  For example, as shown in FIG. 8, in a coordinate system (two-dimensional coordinates) based on two feature amounts, a reference characteristic indicating an identification plane that divides a normal colony region and an abnormal colony region is defined. Is assumed. In such a case, when the coordinate position (x1, y1) of colony A1, the coordinate position (x2, y2) of colony A2, and the coordinate position (x3, y3) of colony A3 are calculated, colony detection The determination unit 422 determines the colonies A1 and A3 as abnormal colonies and determines the colony A2 as a normal colony.

  In the example of FIG. 8, the coordinate system based on the two feature amounts has been described, but the colony detection determination unit 422 has a normal colony region regardless of whether it is 10-dimensional or 100-dimensional. The abnormalities of each colony are determined on the basis of the reference characteristics indicating the identification plane that is divided into abnormal colony regions.

  Further, in the present embodiment, the description has been given using the above-described two or more feature amounts. However, the present invention is not limited thereto as long as the feature amount can be specified based on the colony pixel. For example, a new feature amount calculated using color distribution or a statistical method may be used.

(Setting standard characteristics)
The colony detection determination unit 422
(1) Based on the colony characteristics of colonies that have been determined to be normal and abnormal in advance, or
(2) Based on the reference characteristics used for the determination after the determination of the abnormalities of the colonies and the colony characteristics of each colony determined as normal or abnormal colonies,
Set while learning the reference characteristics.

  Specifically, at the time of initial learning, the colony detection determination unit 422 is identified as a colony in the past and exhibits the same characteristics as the colony characteristics, and similarly, in the past, dust and other non-objects for detection. Based on a learning model (learning algorithm) for classifying into two groups such as support vector machine (SVM) or AdBoost using non-colony characteristics that are distinguished from a certain non-colony and exhibit characteristics similar to colony characteristics To set the reference characteristics.

  For example, when using a support vector machine at the time of initial learning, the colony detection determination unit 422 is defined by two feature amounts (saturation and pixel size) as shown in FIGS. In the coordinate system (feature amount space), each of the identified coordinate positions is identified as a colony characteristic or a non-colony characteristic coordinate position determined based on a feature quantity of n colonies or non-colony detected in the past. A reference characteristic having a condition that minimizes the sum of the lengths of the perpendiculars from to the linear function (identification plane) is set.

  Note that the colony detection determination unit 422 does not use all the colony characteristics and non-colony characteristics that have been determined as colonies in the past, but uses the principal component analysis or the like to provide more characteristic colony characteristics and non-colony colony characteristics and non-colony characteristics. The reference characteristic may be set using a part of the characteristic.

  Further, the colony detection determination unit 422 registers the value of the colony characteristic (that is, the coordinate position) used for setting the reference characteristic including the set reference characteristic and type in the ROM / RAM 440.

  On the other hand, the colony detection determination unit 422 can set the reference characteristics using only the colony characteristics that have been determined as colonies in the past. In this case, the colony detection determination unit 422 specifies and specifies the coordinate positions determined by the colony characteristics that have been determined as colonies in the past on the coordinate system (feature amount space) defined by the two feature amounts. A Gaussian distribution expressing the distribution when each coordinate position is assumed to be a Gaussian distribution (normal distribution) is obtained. And the colony detection determination part 422 determines a normal colony by the predetermined confidence area (90%), and sets the reference | standard characteristic from which the said colony becomes a normal colony.

  In this case, as described above, the reference characteristics are set using more characteristic feature components using principal component analysis or the like without using all the colony characteristics previously determined as colonies. May be. In this embodiment, other distribution functions such as a gamma distribution may be used instead of the normal distribution.

  On the other hand, each time the colony detection determination unit 422 provides the determination result to the administrator terminal device 20 and executes the correction, the reference characteristic used in the determination of the abnormality of the colony before the correction and the correction are performed. A new reference characteristic is generated and updated based on the colony, and the value of the colony characteristic (that is, the coordinate position) used for setting the reference characteristic including the updated reference characteristic and type is registered in the ROM / RAM 440.

  Specifically, when a normal colony is corrected to an abnormal colony, a colony determined to be abnormal is corrected to a normal colony, or a region not detected as a colony is corrected as a colony, the colony detection determination The unit 422 resets the reference characteristics based on the reference characteristics used in determining the abnormality of the colonies before the correction and the corrected colonies, and sets the reference characteristics including the reset reference characteristics and types. The colony characteristic value (that is, the coordinate position) used for the setting is registered in the ROM / RAM 440.

  The colony detection determination unit 422 may apply different reference characteristics for each specimen type, for each lot, for each line, for each process, or for each combination thereof. Further, the determination result correction process in the present embodiment will be described in detail below.

(Discrimination result correction process)
The colony detection determination unit 422 includes the image data generated by the imaging data generation unit 423 and performs transfer of data in conjunction with the administrator terminal device 20, while correcting the determination result of determining the abnormality of the colony Execute result correction processing.

  Specifically, the colony detection determination unit 422 is linked to the administrator terminal device 20 and corrects the colony determined to be normal based on the determination result to a colony having an abnormality based on an instruction from the administrator, or A colony determined to be abnormal based on the determination result is corrected to a normal colony. At this time, the colony detection determination unit 422 receives an administrator's correction instruction from the administrator terminal device 20, and corrects the colony having the colony ID based on the colony ID transmitted together with the correction instruction.

  In addition, when there is an undetected colony, the colony detection determination unit 422 identifies the area designated based on the administrator's instruction as a colony and assigns a new ID. In the present embodiment, regarding the colonies before correction, information about the colonies may be registered as medium information, or data of medium images before correction may be registered as medium information.

(Counting the number of colonies)
The colony detection determination unit 422 determines the number of identified colonies (that is, normal colonies) based on the administrator's instruction (that is, confirmation instruction) or after the colony correction process is performed by the imaging data generation unit 423. Is counted as the number of colonies.

(Sample pass / fail judgment)
The colony detection determination unit 422 performs medium determination (that is, determination of pass / fail of the specimen) as to whether the specimen of each film type culture medium 60 is abnormal or normal. For example, the registration processing unit 421 determines pass / fail of each sample based on a threshold value of the number of bacteria set in advance according to the bacterial species to be detected from the sample (that is, a determination criterion), and the result is stored in the registration processing unit 421. provide.

  In particular, in the present embodiment, since the determination criteria are different based on the bacterial species and the dilution rate, the registration processing unit 421 obtains the medium determination criterion information from the ROM / RAM 440 based on the criteria used when cultivating the specimen and the bacterial species. Read out and perform medium determination.

  Each criterion information is specified in association with the culture medium ID 66. That is, since the type of the film-type medium 60 is different for each bacterial species detected from the specimen, the bacterial species to be detected can be specified by specifying the medium ID 66. Therefore, in this embodiment, the determination reference information specified based on the culture medium ID 66 can be read out by setting the dilution rate and the like in advance.

  Moreover, in this embodiment, since the pass / fail determination of each film type culture medium 60 is used in the process determination, the line determination, and the lot determination, the medium determination is executed in association with these determinations. In addition, the method of pass / fail determination of each film type culture medium 60 in process determination, line determination, and lot determination will be described later.

[5.4] Imaging Data Generation Unit Next, details of each process of the imaging data generation unit 423 in the server device 40 of the present embodiment will be described with reference to FIG. FIG. 10 is an example of medium imaging data imaged in the server device 40 of the present embodiment.

  The imaging data generation unit 423 discriminates image data for highlighting each detected colony on the medium image while changing the display mode of the abnormal colony and the normal colony under the control of the colony detection determination unit 422. And the discriminating image data including the medium image generated via the communication control unit 410 is provided to the administrator terminal device 20.

  For example, as shown in FIGS. 10A and 10B, when a plurality of colonies A are detected in the colony detection determination process, and colonies A1 and A2 are determined to be abnormal, imaging is performed. The data generation unit 423 displays the colony A (excluding A1 and a2) as a colony in a predetermined display mode on the medium image, and the colonies A1 and A2 are displayed as normal in order to watch the abnormality. Discrimination image data to be displayed in a display mode different from the display mode of the discriminated colony A is generated. Then, the imaging data generation unit 423 provides the discriminating image data including the generated culture medium image to the administrator terminal device 20.

  When the colony correction process is executed, the imaging data generation unit 423 generates an image that superimposes a predetermined image on the medium image based on the correction instruction from the administrator, and includes the generated medium image The discrimination image data is provided to the administrator terminal device 20. Further, the imaging data generation unit 423 may provide the discriminating image data to the administrator terminal device 20 in an electronic mail format.

[5.5] Lot Determination Processing Unit Next, details of the lot determination processing unit 424 in the server device 40 of the present embodiment will be described.

  The lot determination processing unit 424 of the present embodiment analyzes data on hygiene management in the designated lot, work line 80 or process based on the instructions of the administrator input to the administrator terminal device 20 (ie, pass / fail determination). Execute.

  Specifically, the lot determination processing unit 424, for each lot, line information of the work line 80 used for the corresponding lot, and medium information registered in association with the corresponding work line 80 (at least the number of colonies). Based on the above, it is determined whether the food group manufactured or inspected under the same condition has a predetermined condition.

  In addition, when the lot determination is instructed, the lot determination processing unit 424 determines whether the work line 80 included in the corresponding lot and the processes belonging to the work line 80 are abnormal or normal in terms of hygiene management. 80 line determinations (that is, pass / fail determination for hygiene management) and process determinations for each process (that is, determination of pass / fail for hygiene management) are performed, and lot determination is performed using the process determination and line determination.

  In particular, when the lot determination is instructed, the lot determination processing unit 424, for example, the number of colonies of the film-type medium 60 in the medium information that has passed a predetermined culture inspection time such as 24 hours or 48 hours from the start of culture, Based on the medium information of the pass / fail determination of the specimen, the pass / fail of hygienic management of the process is determined, and the pass / fail of hygiene management of the work line 80 is determined based on the pass / fail determination of the process included in the corresponding work line 80. Based on the pass / fail determination of the work line 80 included in the corresponding lot, the pass / fail in sanitary management of the lot is determined.

  Note that the lot determination processing unit 424 of the present embodiment may execute not only lot determination but also process determination or line determination as data analysis.

(Process judgment)
The lot determination processing unit 424 has a culture start time at the same timing, a culture examination time at the same timing, a culture start time having a time within a preset time from the first time to the second time, or a preset first time. The culture start time or the culture test time has a predetermined condition, such as having a culture test time having a time within the time from the first time to the second time, and is registered in association with the same process in the same lot. Each process determination is performed based on the culture medium information of the plurality of film-type culture media 60 that has been performed. That is, the lot determination processing unit 424 executes each process determination by comprehensive determination based on each medium determination result of the plurality of film-type mediums 60.

  Specifically, the lot determination processing unit 424 displays the medium determination results of the corresponding film-type medium 60 (that is, all the medium determination results registered in the medium information having the process ID 71b of the process to be subjected to the process determination). In addition to obtaining, if the number of pass / fail of the judgment result satisfies a predetermined condition, the process judgment of the process to be judged is judged to be acceptable, and if not, the judgment should be made The process judgment of the process is judged as rejected.

  For example, the lot determination processing unit 424 determines that the conditions for all the film-type culture media 60 when the acceptable film-type culture media 60 are a predetermined ratio (60%) or more in the individual film-type culture media 60 in the corresponding process ( The number of colonies is equal to or less than a certain number), or the condition that the number of colonies of each film-type medium 60 corresponds (the average number of colonies of a single film-type medium 60 is equal to or less than a certain number). In this case, the corresponding process is determined to be acceptable.

  Note that the lot determination processing unit 424 of the present embodiment can change conditions depending on the type of specimen, the type of bacteria to be detected, etc., and can be set by an administrator or provided as part of a program. The

(Line judgment)
The lot determination processing unit 424 performs line determination for each work line 80 based on the pass / fail determination for hygiene management of a plurality of processes that are determined at a predetermined timing and registered in association with the corresponding line information. To do. That is, the lot determination processing unit 424 performs line determination by comprehensive determination based on the determination results of a plurality of processes of the same lot determined at a predetermined timing.

  Specifically, the lot determination processing unit 424 is determined at the same timing or a timing satisfying a predetermined condition, and has the line ID of the work line 80 to be subjected to line determination as described above. When the determination result of the determination is acquired and the number of pass / fail of the determination result satisfies a predetermined condition, the line determination of the work line 80 to be determined is determined to be acceptable, and the condition is not satisfied The line determination of the work line 80 to be determined is determined to be unacceptable.

  For example, when the three processes have the line ID of the work line 80 to be determined, the first process is “pass”, the second process is “pass”, and the third process is “fail”. In the case where the work line 80 is configured from a process in which the predetermined condition is “60%”, the lot determination processing unit 424 passes the line determination of the work line 80 to be determined.

(Lot judgment)
The lot determination processing unit 424 executes the lot determination for each lot based on the hygiene management pass / fail determination of the plurality of work lines 80 that are determined at a predetermined timing and registered in association with the corresponding lot information. To do. That is, the lot determination processing unit 424 executes lot determination by comprehensive determination based on the determination results of the plurality of work lines 80.

  Specifically, the lot determination processing unit 424 executes the lot determination based on the pass / fail determination in the work line 80 having the lot ID of the lot for which the lot determination is to be performed.

  For example, the lot determination processing unit 424 determines that the lot determination of the lot to be determined is acceptable when the line determination is successful in 60% of the work lines 80 having the lot ID, and the three work lines 80 determine the lot to be determined. Assume that a lot ID is included. In this case, when the first work line 80 is “pass”, the second work line 80 is “pass”, and the third work line 80 is “fail”, the lot determination processing unit 424 determines the lot to be determined. It is determined that the lot determination is acceptable.

  When the lot work time is long, the lot determination may be executed by dividing the time every predetermined time (for example, 8 hours or 12 hours). In this case, when the lot determination is performed while the work is suspended, a dummy result may be used, or it may be determined that the work is being suspended.

(Other)
The lot determination processing unit 424 can perform determinations and data analysis other than those described above using the culture medium information, line information, lot information, and work management DB 404, and the determination result or data analysis via the report processing unit 425. The result can be provided to the administrator terminal device 20 so that the administrator can view the result.

  Specifically, the lot determination processing unit 424 checks the reliability of the sample cultured in each film-type medium 60, that is, checks whether or not an inspection error has occurred. The medium information in the medium ID is subjected to a predetermined analysis of the medium information or the medium image data in time series from the culture start time to the end of the culture.

  For example, the lot determination processing unit 424 has a specific culture medium ID (same culture medium ID) 66 based on an instruction from the administrator received via the administrator terminal device 20, and starts from the culture start time to a predetermined time. Are extracted together with the medium image data. Then, the lot determination processing unit 424 performs a predetermined analysis on each medium information and each image data along a predetermined time series, or aggregates each medium information and each image data along a time series. In addition, the lot determination processing unit 424 causes the report processing unit 425 to generate the analysis result or the aggregation result as browsing data having a predetermined data format, and allows the administrator to browse the generated browsing data. 20 to provide.

  Note that the lot determination processing unit 424 is linked to the report processing unit 425, and at this time, based on an instruction from the manager terminal device 20, each medium information in one medium ID 66 is used for legal hygiene management reporting. May be made individually viewable.

  The lot determination processing unit 424 may have a search function for medium information, line information, lot information, or work management information. Specifically, the lot determination processing unit 424 uses the lot ID (instruction ID 71a), the work line ID, the process ID 71b, the work ID 71, the culture start time, the lot work date and time, the culture medium ID 66, the specimen type, and the like as search keys. The database 400 may be searched, and the report processing unit 425 may be linked to generate data that allows the administrator to view the corresponding medium information and various types of information.

  Note that the report processing unit 425 is configured to search for medium information (medium image data, number of colonies and medium determination result), process information, and line specified by a search based on an instruction from the administrator received via the administrator terminal device 20. It is also possible to provide information or information on lots in a predetermined report format. That is, the report processing unit 425 is configured to be able to provide various information as evidence or reports in legal inspection reports and other cases.

[5.6] Report Processing Unit Next, details of the report processing unit 425 in the server device 40 of the present embodiment will be described.

  The report processing unit 425 performs data analysis related to hygiene management in the designated lot, work line 80 or process based on the administrator's instruction input to the administrator terminal device 20 and template data having a predetermined report format. An analysis result (that is, a determination result of pass / fail determination) is generated as report data, and the generated report data is provided to the administrator terminal device 20 so as to be viewable by the administrator via the communication control unit 410.

  Specifically, the report processing unit 425 extracts necessary information from the medium information, the line information, and the lot information such as the medium image data, the number of colonies, or the medium determination result, and the extracted information and the lot determination processing unit 424. Based on the analysis result obtained by the above, report data is generated while assigning each information to the template data. Then, the report processing unit 425 provides the administrator terminal device 20 with report data having an image of a medium in which the processing such as rotation is not executed and the identity is ensured.

  Note that, as described above, the report processing unit 425 is configured to generate predetermined report data or browsing data in accordance with various analyzes or searches and provide the data to the administrator terminal device 20. . In other words, the report processing unit 425 can also provide medium information, process information, line information, or lot-related information specified by the search in a predetermined report format based on the received administrator's instruction. In addition, it is configured so that various information can be provided as evidence or reports in statutory inspection reports and other cases.

[6] Hygiene management system operation process [6.1] Medium information registration process (portable communication terminal device)
Next, operation | movement of the culture medium information registration process in the portable communication terminal device 10 of this embodiment is demonstrated using FIG. In addition, FIG. 11 is a flowchart which shows the registration processing operation | movement of the culture medium information in the portable communication terminal device 10 of this embodiment.

  In this operation, it is assumed that corresponding lot information and line information associated with the work instruction sheet 70 are already stored in the line information DB 402 and the lot information DB 403.

  Further, it is assumed that the medium ID or instruction ID is attached to the film-type medium 60 and the work instruction sheet 70 by a two-dimensional barcode.

  Further, in this operation, the number of colonies in each film-type medium 60 is detected at the time of registration in the medium information database 400, and the portable communication terminal device 10 uses RGB for capturing a medium image. It is assumed that calibration for the gradation value or the luminance value is performed.

  First, in the portable communication terminal device 10, when the application control unit 120 detects an activation instruction for the culture medium registration application via the operation unit 170 (step S101), the application control unit 120 reads the culture medium registration application from the application storage unit 101 and activates it ( Step S102). At this time, the application control unit 120 performs initialization of the work memory and other necessary processes under the control of the mobile terminal management control unit 190.

  Next, the application control unit 120 displays an image for interlocking with the display control unit 161 to select whether the initial registration of the film-type medium 60 or the post-culture registration after a predetermined time has elapsed from the start of the culture. It is displayed on the unit 160 and waits for its input (step S103).

  Next, when detecting an input of a selection instruction from the operation unit 170 (step S104), the application control unit 120 determines whether initial registration or post-cultivation registration and sets the result in flag information (step S105).

  Next, the application control unit 120 causes the display unit 160 to display a screen that prompts the imaging of the film-type medium 60, and waits for imaging by the image data generation unit 110 in conjunction with the operation unit 170 (step S106). At this time, the application control unit 120 causes a predetermined image to be superimposed on the display unit 160 in order to align the medium image to be acquired.

  Next, when the application control unit 120 detects imaging by the image data generation unit 110 in conjunction with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S107), the image data generation unit 110 causes the medium ID 66 to be detected. At the same time, the imaged medium image data of the film type medium 60 is acquired and stored in the image data storage unit 102 while giving a predetermined image ID (step S108).

  Next, the application control unit 120 acquires the current time from the timer 180 as the imaging time of the medium image data, and stores it in the image data storage unit 102 as metadata in association with the medium image data (step S109).

  Next, the application control unit 120 analyzes the two-dimensional barcode formed in a predetermined area of the acquired imaged culture medium image data, acquires the culture medium ID 66, and stores the image data in association with the culture medium image data. The information is stored in the unit 102 (step S110).

  Next, the application control unit 120 causes the display unit 160 to display a screen for acquiring the instruction sheet image data together with the instruction sheet ID 71a and the process ID 71b in conjunction with the display control unit 161, and waits for acquisition of the instruction sheet image data. (Step S111).

  Next, when the application control unit 120 detects imaging by the image data generation unit 110 in cooperation with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S112), an instruction in which the work ID 71 is imaged. The book image data is acquired and stored in the image data storage unit 102 in association with the culture medium image data acquired in step S108 (step S113).

  In addition, when acquiring the process ID 71b as the work ID 71, or when acquiring the one process ID 71b from the plurality of process IDs 71b, the application control unit 120 operates in conjunction with the display control unit 161 and the operation unit 170, and the user The process ID 71b to be acquired is displayed, and the corresponding process ID 71b is acquired.

  Next, the application control unit 120 analyzes the two-dimensional barcode formed in the predetermined region of the captured instruction image data and the medium image data, acquires the work ID 71, and corresponds to the instruction image data In addition, the image data is stored in the image data storage unit 102 (step S114).

  Next, the application control unit 120 acquires the current time as the imaging time of the medium image data from the timer 180, and in conjunction with the display control unit 161 and the operation unit 170, the application control unit 120 acquires the acquired instruction image data, work ID 71, The medium image data, medium ID 66, and imaging time are confirmed (step S115).

  Note that the application control unit 120 may re-acquire the culture image data based on an instruction from the operator when the acquired medium information is confirmed by the operator. At this time, the application control unit 120 may be able to correct the medium image data by the operator in conjunction with the display control unit 161 and the operation unit 170.

  Next, the application control unit 120, based on the operator's instruction, together with flag information indicating whether it is initial registration or post-culture registration, terminal ID, and work ID 71, the acquired medium image data, its metadata, and whether it is initial registration. Flag information indicating whether it is registered after culture is transmitted as medium information to the server device 40 via the network communication unit 130 (step S116), and the registration process of the portable communication terminal device 10 is terminated.

  At this time, when transmitting the culture medium information, the network communication unit 130 executes login for accessing the server device 40 based on the terminal ID or the input ID and password, and the server device 40 is completed after the login is completed. Communication line is established and medium information is transmitted.

[6.2] Medium information registration processing (server device)
Next, the registration processing operation of the culture medium information in the server device 40 of this embodiment will be described using FIG. In addition, FIG. 12 is a flowchart which shows the registration processing operation | movement of the culture medium information in the server apparatus 40 of this embodiment.

  In addition, this operation | movement is a process performed in conjunction with the culture medium information registration process performed by the portable communication terminal device 10, and the server apparatus 40 uses the culture medium information transmitted from the portable communication terminal apparatus 10 as a culture medium. This is a process for registering in the information DB 401. Moreover, the information regarding colonies, the number of colonies, and the medium information of the medium determination result are registered by the colony detection determination process described later.

  First, in the server device 40, when the communication control unit 410 receives the culture medium information transmitted from the portable communication terminal device 10 (step S300), the registration processing unit 421 is based on the flag information included in the received culture medium information. Whether the registration is initial registration or post-culture registration is determined (step S301).

  At this time, if the registration processing unit 421 determines initial registration, the process proceeds to step S302. If the registration processing unit 421 determines that it is not initial registration, that is, if it is determined to be post-culture registration, step S304 is performed. Move on to processing.

  Next, when it is determined as initial registration, the registration processing unit 421 extracts and specifies the work ID 71 included in the culture medium information (step S302).

  Next, the registration processing unit 421 registers the culture medium information in the culture medium information DB 401 based on the identified work ID 71 (step S303), and ends this operation. Although the culture start time is stored in advance in the work management DB 404, the registration processing unit 421 registers the imaging time included in the received medium information as the culture start time in the work management DB 404 in the process of step S303. Also good.

  On the other hand, if the registration processing unit 421 determines that the registration is after culture, it extracts and specifies the work ID 71 included in the culture medium information (step S304), and registers the culture medium information based on the imaging time included in the culture medium information. The culture examination time to be specified is specified (step S305).

  At this time, the registration processing unit 421 may be registered by designating a culture examination time for registering the culture medium information in conjunction with the portable communication terminal device 10, or the imaging time included in the received culture medium information. The culture examination time may be registered as it is. In addition, the registration processing unit 421 manages the culture medium registration at the culture test time that has already been performed, and specifies the culture test time based on the timing at which the culture medium information is received and the culture test time that has already been used to register the culture medium information. May be. That is, the registration processing unit 421 may specify the culture examination time by rewriting the execution flag each time the medium information is registered and comparing the received imaging time with reference to the information of the flag.

  Next, the registration processing unit 421 registers the culture image data, the recognized culture medium ID 66, and the culture start time information with the imaging time included in the culture medium information as the culture start time in association with the specified work ID 71 in the culture medium information DB 401. (Step S309), and this operation is terminated.

  The registration processing unit 421 displays line information and information to be registered on the display unit 160 of the portable communication terminal device 10, and based on a user instruction input via the portable communication terminal device 10, the culture medium Information or the like may be registered.

  Further, when the culture medium image data is transmitted from the portable communication terminal apparatus 10 and the medium ID 66 is recognized by analyzing each image data by the server apparatus 40, the registration processing unit 421 receives the reception in the process of step S301. The medium ID 66 imaged on each predetermined area of the medium image data thus obtained is analyzed, and the medium ID 66 is recognized and acquired. Similarly, the server device 40 also recognizes the work ID 71 in the instruction image data.

[6.3] Colony Detection Determination Process Including Determination Result Display Process and Determination Result Correction Process Next, in conjunction with the administrator terminal device 20 in the server device 40 of the present embodiment, using each of FIGS. 13 and 14. However, the operation of the colony detection determination process including the determination result display process and the determination result correction process will be described. FIGS. 13 and 14 are flowcharts showing the operation of the colony detection determination process including the determination result display process and the determination result correction process in conjunction with the administrator terminal device 20 in the server device 40 of the present embodiment. .

  This operation is executed under the instruction of the administrator terminal device 20, and the luminance value is used as the feature value of each pixel for detecting the colony.

  In addition, this operation may be started by an instruction from the administrator, or after the above-described medium information registration process, an inquiry from the server device 40 (that is, whether or not the colony detection process is performed in the registered medium information) The execution may be started by responding to the inquiry.

  Further, it is assumed that the reference characteristic is calculated based on the colony characteristics of colonies that have been determined to be normal and abnormal in advance and registered in the ROM / RAM 440.

  First, the administrator terminal device 20 activates a predetermined application and receives an instruction (hereinafter referred to as “colony detection instruction”) to execute the colony detection determination process while specifying the culture medium information, or When an execution instruction is received from the administrator in response to an inquiry as to whether or not to execute the colony detection determination process based on the registered medium information from the server device 40 (step S401), the medium ID 66 of the specified medium information is sent to the server device 40. A colony detection instruction including is transmitted (step S402).

  The administrator terminal device 20 may specify the culture medium ID 66 by the administrator's selection while interlocking with the server device 40, or inquire about whether or not to execute the colony detection determination process transmitted from the server device 40. The medium ID 66 may be specified by responding. In addition, when the administrator terminal device 20 transmits the colony detection instruction, the administrator terminal device 20 waits for reception of the discrimination image data.

  Next, in the server device 40, when the communication control unit 410 receives an instruction to execute colony detection transmitted from the administrator terminal device 20 (step S501), the registration processing unit 421 includes the culture medium information included in the colony detection instruction. And instructing the colony detection determination unit 422 generated in the film-type medium 60 to start executing the colony detection determination process based on the read medium information (step S502). Specifically, the registration processing unit 421 reads the medium information of the medium ID 66 and the medium image data included in the colony detection instruction and provides the read medium information to the colony detection determination unit 422 to execute the colony detection determination process. To start.

  Next, the colony detection determination unit 422 executes a luminance value extraction process for extracting the luminance value of each pixel constituting the medium image acquired from the medium image data (step S503).

  Next, the colony detection determination unit 422 detects a pixel having a luminance value equal to or higher than the threshold as a colony pixel based on a predetermined threshold value, and binarizes the colony pixel and a pixel constituting the culture medium 2 A value process is executed (step S504).

  Next, the colony detection determination unit 422 detects a colony based on the detected colony pixel (step S505). Specifically, the colony detection determination unit 422 detects the colonies by connecting the corresponding colony pixels while executing the image filtering process and the labeling process on the adjacent colony pixels among the detected pixels.

  At this time, the colony detection determination unit 422 assigns an ID to each colony by a labeling process. In addition, the colony detection determination unit 422 determines the number of colony pixels, the brightness value of each colony pixel, the coordinate position of each colony pixel on the film-type medium 60, the position of the center of gravity of each colony, and the like for each colony. Acquire colony information indicating the characteristics of.

  Next, when the colony detection determination unit 422 images each detected colony, the color components such as RGB gradation values or luminance values of each pixel constituting the image, the arrangement position of each pixel on the medium image, Alternatively, based on both of them, two or more feature amounts of each colony are calculated, and the coordinate position of the coordinate system defined by the two or more feature amounts is specified as the colony characteristic (step S506). Specifically, the colony detection determination unit 422 calculates each feature quantity of color distribution, roundness, size, or curvature, and specifies a coordinate position based on each calculated feature quantity.

  Next, the colony detection determination unit 422 determines the abnormality of each colony based on preset reference characteristics and the coordinate position of each colony (step S507).

  Next, the imaging data generation unit 423 causes an administrator with different display modes of normal colonies and abnormal colonies to view on the medium image based on the detected colonies and the determined results. The discriminating image data is generated, and the generated image data is transmitted to the administrator terminal device 20 (step S509).

  Next, when the administrator terminal device 20 receives the discrimination image data transmitted from the server device 40 (step S411), the administrator terminal device 20 marks the colony on the culture medium image by a predetermined display mode based on the discrimination image data, and displays abnormality. An image showing a discrimination result imaged in a display mode in which a colony having a different colony from a normal colony is displayed so as to be viewable to an administrator, and waits for an instruction from the administrator (step S412).

  Next, when the administrator terminal device 20 receives the administrator's instruction (step S413), the administrator's instruction is a correction instruction in the colony determination result (hereinafter referred to as “colony correction instruction”) or a determination result. It is determined whether it is a confirmation instruction for instructing confirmation (hereinafter referred to as “colony confirmation instruction”) (step S414).

  At this time, if the administrator terminal device 20 determines that the administrator instruction is a colony correction instruction, the administrator terminal device 20 transmits the instruction to the server device 40 (step S415), and proceeds to the process of step S411. If it is determined that the instruction is a colony determination instruction, the instruction is transmitted to the server device 40 (step S416), and the process proceeds to step S421.

  The administrator terminal device 20 transmits a colony correction instruction including the ID of the colony to be corrected to the server device 40.

  Next, in the server device 40, when the communication control unit 410 receives an administrator instruction transmitted from the server device 40 (step S511), the colony detection determination unit 422 determines whether the administrator instruction is a colony correction instruction or a colony instruction. It is determined whether it is a confirmation instruction (step S513).

  At this time, if the colony detection determination unit 422 determines that the administrator's instruction is a colony correction instruction, the colony detection determination unit 422 corrects the colony having normal colony abnormality based on the colony candidate ID included in the correction instruction. Or, correction of the abnormal colony to a normal colony is executed (step 515), and the process proceeds to step S508.

  Moreover, the colony detection determination part 422 transfers to the process of step S521, in order to determine a colony and count the number of colonies, when it determines with an instruction | indication of an administrator being a colony determination instruction.

  Next, the colony detection determination unit 422 counts the number of normal colonies as the number of colonies (step S521), and transmits the result (hereinafter also referred to as “determined result”) to the administrator terminal device 20 (step S522). ).

  Next, the colony detection determination unit 422 reads out the medium determination criterion based on the type of the sample specified based on the work ID 71 and the fungus species to be detected, and detects the number of colonies detected based on the read sample determination criterion. It is determined whether or not satisfies a predetermined condition (step S523). That is, the colony detection determination unit 422 determines that it is acceptable (normal) when the predetermined condition is satisfied, and determines that it is unacceptable (abnormal) when the predetermined condition is not satisfied.

  Next, the colony detection determination unit 422 calculates a new reference characteristic based on the reference characteristic used in the immediately preceding step S507 and the confirmed normal colony and the abnormal colony, and stores the calculated reference characteristic in the ROM / RAM 440. Registration is performed (step S524).

  Finally, the registration processing unit 421 registers the information on each colony candidate including whether or not it is a colony, the number of counted colonies, and the determination result of the medium determination in the medium information DB 401 in association with the medium ID 66 (Step S41). 525), this operation is terminated.

  On the other hand, when the administrator terminal device 20 receives the identified colonies and the determination result of the number of colonies (step S421), the administrator terminal device 20 displays the information so as to be viewable to the administrator (step S422) and ends the operation.

[7] Modification [7.1] Modification 1
In the above-described embodiment, the culture medium information registration process and the colony detection determination process are executed at the same timing, but the colony detection determination process may be executed at an arbitrary timing.

[7.2] Modification 2
In this embodiment, instead of performing the culture information registration process using a portable communication terminal device 10 such as a tablet information terminal device, a smartphone, or a mobile phone, a laptop or desktop personal computer is used. The registration process of the culture medium information may be realized by a computer and an image input device such as a scanner, a digital camera, or a smartphone.

  In this case, the personal computer and the image input device may be connected according to a predetermined communication standard, and the registration process of the culture medium information may be realized by using the personal computer and the image input device integrally, or a memory card. The medium image data and instruction sheet image data previously acquired by the image input device are stored in other physical memory, and the registration process of the medium information is realized while the stored image data is captured by the personal computer. May be.

[7.3] Modification 3
In the present embodiment, the portable communication terminal device 10, the administrator terminal device 20, and the server device 40 may be installed or used in the same site, or each may be installed in a remote place such as outside the country or remotely. It may be used on the ground and each process described above may be executed. However, it is assumed that the portable communication terminal device 10 is used in the same lot.

[7.4] Modification 4
In the present embodiment, registration of medium information in a specimen cultured in the film-type medium 60 using the film-type medium 60 is executed, but the medium in the specimen cultured in the agar medium using an agar medium. Information registration may be executed.

[7.5] Modification 5
In the present embodiment, instead of obtaining the culture medium ID 66 by imaging the film-type culture medium 60 by the image data generation unit 110, the culture medium ID 66 may be input by an operator's operation input.

  In this case, the application control unit 120 interlocks with the display control unit 161 and the operation unit 170 and causes the operator to manually input the culture medium ID 66 directly using the operation unit 170.

  In addition, the application control unit 120 controls the display control unit 161 and the operation unit 170 to select a display item such as a pull-down menu by clicking or touch selection, and causes the operator to input the culture medium ID 66.

[7.6] Modification 6
In the present embodiment, various processes are executed by the single server device 40, but various processes may be executed by a server system including a plurality of server devices 40.

[7.7] Modification 7
In this embodiment, the colony detection determination unit 422 uses a histogram in order to use the color distribution as a feature amount when setting or updating the reference characteristic, but using a statistical amount such as an average value or variance. Also good.

[7.8] Modification 8
In this embodiment, the colony detection determination unit 422 updates the reference characteristics when registering the confirmed colony, the number of colonies, and the medium determination result, but when registering the confirmed colony, or The reference characteristic may be updated every certain period such as a specific time every day.

[7.9] Modification 9
In this embodiment, the colony detection determination unit 422 determines whether the colony is a normal colony or an abnormal colony. However, it is not necessary to determine the abnormality for all detected colonies, and the colonies that cannot be determined are identified. The information is registered as medium information together with information indicating that, and it is not necessary to use the colony characteristics of the indistinguishable colonies for updating the reference characteristics.

[7.10] Modification 10
The colony detection determination unit 422 of the present embodiment may have a configuration that can register an administrator's comment on each colony as comment information together with the confirmed colony, the number of colonies, and the medium determination result.

[7.11] Modification 11
In the present embodiment, the colony detection determination unit 422 calculates a likelihood indicating the likelihood of the colony for a normal colony, and the imaging data generation unit 423 presents the calculated likelihood to the discrimination image. The discriminating image data may be generated including the information to be processed.

  Specifically, for each detected colony, the colony detection determination unit 422, when imaging each detected colony candidate, features regarding the color of each pixel constituting the image, and the arrangement of each pixel on the medium image The likelihood of each colony candidate is calculated based on the position or both.

For example, the colony detection determination unit 422
(1) An average value of feature amounts relating to each detected pixel color belonging to a colony candidate, such as RGB gradation value, luminance value, saturation, or a combination of the two,
(2) The roundness of the colony based on the coordinates of the center of gravity of the colony candidate, and
(3) Edge strength indicating the strength of the edge at the boundary of colony candidates,
Are each added using a weighting coefficient, and a value obtained by normalizing a value indicating the addition result is calculated as a likelihood.

[7.12] Modification 12
In the present embodiment, the imaging data generation unit 423 predicts the pre-registered contamination, and based on the information on the bacterial species that may be detected in the film-type medium 60, the imaging data generation unit 423 performs the initial registration. A reference characteristic may be set.

  That is, the imaging data generation unit 423 acquires information on the bacterial species that are predicted to be mixed in advance based on the state of the adjacent work line or information on a product manufactured or inspected on the adjacent work line, and the acquired information While specifying the non-colony characteristics based on the reference characteristics, the reference characteristics may be set based on the specified non-colony characteristics.

[7.13] Modification 13
In the present embodiment, the imaging data generation unit 423 is highly likely to detect abnormal colonies based on the work information specified by the culture medium ID 66 when generating the discrimination image data. With respect to the film-type medium 60 determined to be, determination image data having information for presenting the fact to the administrator on the determination image may be generated.

  For example, the work information presented on the discrimination image of the film-type medium 60 that has been determined to have a high detection probability of an abnormal colony includes culture that includes the specimen and the worker who handled the film-type medium 60 and the incubator number. Contains information about location and other work environments. Moreover, the imaging data generation part 423 may generate | occur | produce the discrimination | determination image data for showing the information regarding the colony which has abnormality in the past with work information with the said work information.

  As described above, in the sanitary management system S of the present embodiment, the sanitary management system S of the present embodiment detects from the culture medium image by using the reference characteristics set based on the characteristics of the colonies that are assumed to be detected. When it is determined that the characteristic of the colony is an unexpected colony and has an abnormality, the determination result can be viewed by an administrator.

  Therefore, in the sanitary management system S of the present embodiment, the administrator can check the condition of the culture medium different from the usual, such as the discovery of a foreign substance that is not normally detected or the occurrence of a different type of bacteria. As a result, it is possible to facilitate the work and reduce the work burden on the manager, and as a result, to accurately identify colonies and accurately register medium information including them.

  In the sanitary management system S of the present embodiment, the description has been made using food. However, the present invention is not limited to the food, and can be applied to products that are provided to all living organisms including drugs and drugs. .

DESCRIPTION OF SYMBOLS S ... Hygiene management system 10 ... Portable communication terminal device 20 ... Manager terminal device 30 ... Network 40 ... Server device 60 ... Film type culture medium 70 ... Work instruction sheet 80 ... Work line 100 ... Data storage part 101 ... Application storage part 102 Image data storage unit 110 Image data generation unit 120 Application control unit 130 Network communication unit 140 Short-range wireless communication interface 150 Current position detection unit 160 Display unit 170 Operation unit 180 Timer 190 Mobile device management Control unit 400 ... database 401 ... medium information DB
402 ... Line information DB
403 ... Lot information DB
404 ... Work management DB
410 ... Communication control unit 420 ... Data processing unit 421 ... Registration processing unit 422 ... Colony detection determination unit 423 ... Imaging data generation unit 424 ... Lot determination processing unit 425 ... Report processing unit 430 ... Server management control unit

Claims (11)

An acquisition means for acquiring medium image data obtained by imaging the medium and imaging it as medium image data;
Detection means for detecting colonies generated in the culture medium based on the characteristic amount relating to the color of each pixel constituting the culture medium image of the acquired culture medium image data;
Based on the colony pixels used to image the detected colonies, identifying means for identifying the characteristics of the colonies as colony characteristics;
A discriminating means for discriminating the abnormality of the detected colony based on the preset reference characteristic and the colony characteristic,
Providing means for generating discrimination result image data obtained by imaging the discrimination result, which is a result discriminated by the discrimination means, on the medium image, and providing the discrimination result image as discrimination result image data so as to be viewable to an administrator When,
Based on the instructions of the administrator, registration means for registering information about the medium including information about the determined colonies in the database as medium information;
A culture medium information registration system comprising: In the culture medium information registration system according to claim 1,
The specifying unit calculates two or more feature amounts of the detected colony based on the colony pixel, and determines a coordinate position of the detected colony on a coordinate system defined by the two or more feature amounts. Identified as the colony characteristics,
The culture medium information registration system in which the discrimination means discriminates the abnormality of the detected colony based on the reference characteristic and the coordinate position of the detected colony. In the culture medium information registration system according to claim 1 or 2,
The specifying means is
(1) the number of colony pixels,
(2) feature quantity related to the color of the colony pixel,
(3) the arrangement position of the colony pixel on the medium image, or
(4) A culture medium information registration system that specifies colony characteristics of the detected colony based on any one of two or more feature quantities among the feature quantities of (1) to (3). In the culture medium information registration system according to any one of claims 1 to 3,
Further comprising setting means for setting the reference characteristic;
The culture medium information registration system which the said setting means sets using the colony characteristic of the said detected colony determined as normal in the past. In the culture medium information registration system according to claim 4,
The culture medium information registration system in which the setting means updates the reference characteristic at each predetermined timing. In the culture medium information registration system according to claim 4 or 5,
The culture medium information registration system, wherein the reference characteristic is a function on a coordinate system defined by the same feature quantity as the colony feature quantity used when specifying the colony characteristic. In the culture medium information registration system according to any one of claims 1 to 6,
A culture medium information registration system further comprising correction means for receiving correction of the determination result based on an instruction from the manager. Computer
An acquisition means for acquiring the culture medium image data obtained by imaging the culture medium as culture medium image data,
Detection means for detecting colonies generated in the culture medium based on the characteristic amount relating to the color of each pixel constituting the culture medium image of the acquired culture medium image data;
Based on the colony pixels used to image the detected colonies, identifying means for identifying the characteristics of the colonies as colony characteristics;
A discriminating means for discriminating the abnormality of the detected colony based on the preset reference characteristic and the colony characteristic,
Providing means for generating discrimination result image data obtained by imaging the discrimination result, which is a result discriminated by the discrimination means, on the medium image, and providing the discrimination result image as discrimination result image data so as to be viewable to an administrator ,as well as,
Based on the instructions of the administrator, registration means for registering information about the medium including information about the determined colonies in the database as medium information,
A program characterized by functioning as An acquisition means for acquiring medium image data obtained by imaging the medium and imaging it as medium image data;
Detection means for detecting colonies generated in the culture medium based on the characteristic amount relating to the color of each pixel constituting the culture medium image of the acquired culture medium image data;
Based on the colony pixels used to image the detected colonies, identifying means for identifying the characteristics of the colonies as colony characteristics;
A discriminating means for discriminating the abnormality of the detected colony based on the preset reference characteristic and the colony characteristic,
Providing means for generating discrimination result image data obtained by imaging the discrimination result, which is a result discriminated by the discrimination means, on the medium image, and providing the discrimination result image as discrimination result image data so as to be viewable to an administrator When,
A medium image analysis apparatus comprising: Computer
An acquisition means for acquiring the culture medium image data obtained by imaging the culture medium as culture medium image data,
Detection means for detecting colonies generated in the culture medium based on the characteristic amount relating to the color of each pixel constituting the culture medium image of the acquired culture medium image data;
Based on the colony pixels used to image the detected colonies, identifying means for identifying the characteristics of the colonies as colony characteristics;
A discriminating means for discriminating the abnormality of the detected colony based on the preset reference characteristic and the colony characteristic, and
Providing means for generating discrimination result image data obtained by imaging the discrimination result, which is a result discriminated by the discrimination means, on the medium image, and providing the discrimination result image as discrimination result image data so as to be viewable to an administrator ,
A program characterized by functioning as A communication terminal device that generates a medium image obtained by imaging a medium for cultivating bacteria generated in a specimen as medium image data;
A server device for detecting colonies generated in the medium based on the medium image data and registering them in a database;
With
The server device is
An acquisition means for acquiring medium image data obtained by imaging the medium and imaging it as medium image data;
Detection means for detecting colonies generated in the culture medium based on the characteristic amount relating to the color of each pixel constituting the culture medium image of the acquired culture medium image data;
Based on the colony pixels used to image the detected colonies, identifying means for identifying the characteristics of the colonies as colony characteristics;
A discriminating means for discriminating the abnormality of the detected colony based on the preset reference characteristic and the colony characteristic,
Providing means for generating discrimination result image data obtained by imaging the discrimination result, which is a result discriminated by the discrimination means, on the medium image, and providing the discrimination result image as discrimination result image data so as to be viewable to an administrator When,
Based on the instructions of the administrator, registration means for registering information about the medium including information about the determined colonies in the database as medium information;
Hygiene management system characterized by comprising.