KR102193302B1 - Method and device for collecting reagent information using image - Google Patents

Abstract

Disclosed are a method and a device for collecting reagent information using an image. According to one aspect of the present invention, the method for collecting reagent information using an image performed in a computing device comprises the steps of: recognizing text of a label in a photographed image of a target reagent bottle; identifying a reagent name by analyzing the text; and correcting the identified reagent name with reference to chemical morpheme information when the identified reagent name does not exist in a reagent name list.

Description

Method and device for collecting reagent information using image {Method and device for collecting reagent information using image}

The present invention relates to a method and apparatus for collecting reagent information using an image for management of a retained reagent.

In general, equipment and reagents used in enterprise or group experiments are managed by an inventory management system called Enterprise Resource Planning (ERP). However, it is easy to use ERP in organizations where departments suitable for roles such as payment, management, and use are divided, but it is difficult to use ERP in university laboratories and small and medium-sized business institutes operated by small professional personnel.

And, in general, university laboratories and small and medium-sized enterprises (SMEs) research institutes, etc., purchase and stock management of equipment and reagents, etc.

However, the above-described general method may adversely affect an experiment plan due to a phenomenon in which work efficiency is deteriorated due to omissions or errors due to the nature of documents written by humans, and it is difficult to confirm an appropriate amount of inventory.

Moreover, in the case of chemical reagents, they have a long and complex name, and due to the enormous amount, it is difficult to manually record each one, and since they are usually managed in a document format such as Excel, there is a problem that it is difficult to determine the actual current status.

For this reason, the increase in administrative work of researchers leads to inefficiencies in work, and financial losses such as duplicate purchases of reagents may also occur.

Korean Patent Registration No. 10-1731169

Accordingly, the present invention has been conceived to solve the above-described problem, and is to provide a method and apparatus for collecting reagent information using an image for obtaining information on a retained reagent using a photographed image.

Other objects of the present invention will become more apparent through preferred embodiments described below.

According to an aspect of the present invention, there is provided a method for collecting reagent information using an image performed in a computing device, the method comprising: recognizing a text of a label from a photographed image of a target reagent bottle; Identifying a reagent name by analyzing the text; And correcting the identified reagent name with reference to the chemical morpheme information when the identified reagent name does not exist in the reagent name list. A method of collecting reagent information using an image is provided.

Here, the correction of the identification reagent name is performed by dividing the identification reagent name into morpheme units, maintaining the divided morphemes of the morphemes present as the chemical morpheme information, and converting the remaining morphemes into similar morphemes, respectively.

In addition, when the correction of the confirmed reagent name is performed, comparing the photographed image with the reagent bottle image having the same reagent name as the correction reagent name by referring to the reagent bottle image DB to check whether the same is present; And final inputting the calibration reagent name only when the verification is successful.

In addition, the color and shape of the reagent bottle and label in the reagent bottle image and the photographed image are compared with each other to determine whether they are the same.

In addition, the reagent bottle image and text other than the reagent name in the label in the photographed image are further compared with each other to determine whether they are identical.

Further, the comparison between the reagent bottle image and the photographed image is performed only when the number of corrected texts is greater than or equal to the threshold value.

In addition, based on the information on the volume of the label text in the photographed image and the information on the manufacturer, calculating the remaining reagent capacity using the obtained weight information of the reagent bottle.

According to another aspect of the present invention, a program of instructions that can be executed by a digital processing device is tangibly embodied, and as a recording medium that can be read by a digital processing device, the text of a label in a photographed image of a target reagent bottle is Recognizing; Identifying a reagent name by analyzing the text; And if the identification reagent name does not exist in the reagent name list, correcting the identification reagent name with reference to the chemical morpheme DB.

According to another aspect of the present invention, a photographing unit for photographing a target reagent bottle; A text recognition unit for recognizing the text of the label in the captured image; And an information generation unit that checks the reagent name by analyzing the text and corrects the identified reagent name with reference to the chemical morpheme information when the confirmed reagent name does not exist in the reagent name list. do.

Here, further comprising a weight measuring unit for measuring the weight of the target reagent bottle, the information generation unit based on the information on the capacity of the label text in the photographed image and information on the manufacturer, the weight information by the measurement module Calculate the remaining reagent capacity by using.

According to the present invention, the input of reagent information is convenient, thereby minimizing the time spent on administration, practical work, etc. other than research, thereby enabling research personnel to concentrate on research.

In addition, according to the present invention, even if the text recognition rate is slightly lower, it is possible to more accurately identify the status of the reagents held by correcting it more accurately, thereby improving work efficiency and preventing financial loss such as duplicate purchase.

In addition, the effects of the present invention are not limited to the above effects, and should be understood to include all effects that can be deduced from the configuration of the invention described in the detailed description or claims of the present invention.

1 and 2 are block diagrams showing the configuration of a reagent information collection apparatus according to each embodiment of the present invention.
3 is a block diagram showing a reagent information collection system according to another embodiment of the present invention.
4 is a flowchart illustrating a process of collecting reagent information using an image according to an embodiment of the present invention.
5 is a flow chart showing a procedure for correcting a confirmation reagent name according to an embodiment of the present invention.
6 is an exemplary view showing a reagent name correction method according to an embodiment of the present invention.
7 and 8 are flowcharts and exemplary diagrams illustrating a reagent name correction verification process using a reagent bottle image according to an embodiment of the present invention.
9 is a flow chart showing a process of generating reagent residual capacity information using an image according to an embodiment of the present invention.

In the present invention, various modifications may be made and various embodiments may be provided, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to a specific embodiment, it is to be understood to include all changes, equivalents, or substitutes included in the spirit and scope of the present invention.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, terms such as a first threshold value and a second threshold value to be described later may be pre-designated as threshold values that are substantially different or some of the same values, but when expressed in the same word as the threshold value, there is a confusion. There is room, so for the convenience of classification, terms such as first and second will be added together.

The terms used in the present specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or a combination thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance.

In addition, components of the embodiments described with reference to each drawing are not limited to the corresponding embodiments, and may be implemented to be included in other embodiments within the scope of maintaining the technical spirit of the present invention. Even if the description is omitted, it is natural that a plurality of embodiments may be implemented again as a unified embodiment.

In addition, in the description with reference to the accompanying drawings, the same components are assigned the same or related reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted. In describing the present invention, when it is determined that a detailed description of related known technologies may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted.

1 and 2 are block diagrams showing the configuration of a reagent information collection device according to each embodiment of the present invention, and Figure 3 is a configuration diagram showing a reagent information collection system according to another embodiment of the present invention.

First, referring to FIG. 1, the reagent information collection apparatus according to the present embodiment includes a photographing unit 10, a storage unit 20, and a control unit 30, and the control unit 30 includes a text recognition unit ( 31) and an information generation unit 32.

The photographing unit 10 is for photographing an external image and generates a photographed image of a reagent bottle (hereinafter referred to as a target reagent bottle) as a target. Since the photographing unit 10 including a camera module or the like will be apparent to those skilled in the art, a more detailed description will be omitted.

The storage unit 20 stores a list of reagent names for various reagents, and chemical morpheme information as information for correcting reagent names. In addition, although it will be described in detail later, the reagent bottle image information for verification of the corrected reagent name may be further stored in the storage unit 20. The reagent name list, chemical morpheme, and reagent bottle images will be described in detail later.

The control unit 30 recognizes the text of the label in the photographed image using OCR (optical character recognition) technology, and extracts the reagent name from the recognized text and uses it as reagent information.

That is, the text recognition unit 31 of the control unit recognizes the text in the captured image, and the information generation unit 32 generates the reagent name of the target reagent bottle as reagent information based on the recognized text. A description will be made later with reference to related drawings (Fig. 4, etc.), but the information generating unit 32 corrects the recognized reagent name when the reagent name is not normally recognized due to a low text recognition rate.

In addition, the information generation unit 32 may further generate the reagent remaining capacity of the target reagent bottle as reagent information as reagent information, and for this purpose, it is necessary to measure the weight of the target reagent bottle. Referring to FIG. 2 according to another embodiment for this, the reagent information collection device may further include a weighing unit 40.

That is, the reagent information collection device measures the weight of the target reagent bottle, photographs an image, and generates information on the reagent name and reagent remaining capacity as reagent information based on the photographed image and weight information. ) Or in a separate database.

The reagent information collection device according to the embodiment of FIGS. 1 and 2 is an illustration of a case in which both a photographing means and a weighing means are provided, and referring to FIG. 3 according to another embodiment, a photographing means, a weighing means, and a reagent It may be implemented in the form of a system including an information DB or the like as a separate device.

That is, as shown in Fig. 3, the reagent information collection device 100 is coupled to the photographing device 210 and the weighing device 220 through a network (or may be directly connected by wire or wireless), and the photographed image and weight information It may be in the form of acquiring, and stores the generated reagent information in the reagent information DB 300 directly connected (or connected through a network).

Hereinafter, for convenience of explanation, the reagent information collecting device of FIG. 2 will be mainly described, but the present invention is not limited thereto, which will become more apparent to those skilled in the art through the following description.

4 is a flowchart illustrating a process of collecting reagent information using an image according to an embodiment of the present invention, FIG. 5 is a flowchart illustrating a process of correcting a confirmation reagent name according to an embodiment of the present invention, and FIG. 6 is It is an exemplary diagram showing a reagent name correction method according to an embodiment of the present invention.

Referring to FIG. 4, the reagent information collection device recognizes a text in a label from a photographed image of a target reagent bottle (S410). OCR technology will be apparent to those skilled in the art, so a more detailed description will be omitted.

The recognized text is analyzed to confirm the reagent name (S420). Since the reagent name is generally larger in size than other texts and has a pattern peculiar to the reagent name, a method of identifying the reagent name among the recognized texts will be apparent to those skilled in the art.

It is checked whether the identified reagent name (hereinafter referred to as the confirmed reagent name) exists in the previously stored reagent name list (S430). That is, it is to verify whether the correct reagent name has been confirmed.

It is determined whether the confirmed reagent name exists in the reagent name list (S440), and if it exists, the confirmed reagent name is determined as the reagent name to generate and store reagent information (S460). Here, the reagent information collection device may provide a user interface for additionally registering a reagent name as well as a registration date and storage location as reagent information.

On the contrary, if the confirmed reagent name does not exist in the reagent name list, it is determined that the recognition is wrong, and the confirmed reagent name is corrected by referring to the chemical morpheme information (S450), and reagent information using the corrected reagent name as the reagent name is generated. Save it.

Recognition of the reagent name according to the present embodiment may be newly defined as CCA (Chemical Compound Analyzer) because it does not simply apply OCR, but includes a correction process through a pre-learned neural network.

In addition, the neural network according to the present embodiment includes a projection layer for reducing the dimension of the input layer, a hidden layer for performing nonlinear transformation on the projection layer, and an output layer for calculating the probability for each state. can do.

Referring to FIG. 5 showing the reagent name correction process and FIG. 6 illustrating the method, the chemical morpheme information 500 constructed using chemical nomenclature and physical property reference standard data is converted into a DB (database), and The reagent name 510 is divided into morpheme units and compared and corrected. That is, the identification reagent name is divided into chemical morpheme units, the text of the morpheme existing as chemical morpheme information is maintained, and correction is performed by converting the remaining morphemes into morphemes based on the most similar chemical morpheme information.

Here, the general definition of a morpheme is the minimum letter having meaning, and the morpheme referred to in the present invention is different as it means the minimum text named in the chemical field, and accordingly, in the present invention, it is referred to as a chemical morpheme.

In addition, as an example of chemical nomenclature, the IUPAC nomenclature is a compound nomenclature established by the International Union for Pure and Applied Chemistry (IUPAC). It is named as a 　derivative in which the hydrogen of the compound is substituted with a substituent group, which is the center of the nomenclature. As a derivative, six types of naming are used: substitution naming, functional naming, additional naming, elimination naming, conjugated naming, and substitute naming).

Of course, it is not limited thereto, and it is natural that the laws of chemical morphemes and the DB method for classification and correction of reagent names can be variously set according to the situation.

Referring to FIG. 5 according to an example of the calibration process, the identification reagent name is divided into chemical morphemes as described above (S510). According to FIG. 6 showing an example, it is subdivided into three types.

For each of the divided morphemes (divided morphemes), one or more similar candidate morphemes are selected by referring to the DBized chemical morpheme information, and maintaining what exists in the DB as it is, and for non-existing divided morphemes (S520).

Then, it is checked whether the correcting reagent name to which each of the candidate morphemes is applied exists in the reagent name list, and any one that exists is selected as the correcting reagent name (S530). Even if all candidate morphemes are applied, if they do not exist in the reagent name list, the target reagent bottle is photographed, text recognized, and analyzed again. Alternatively, if a plurality of corrected reagent names exist in the reagent name list as a result of applying a plurality of candidate morphemes, re-photographing is performed or verification using the reagent bottle image DB described later (see FIGS. 8 and 9) is further performed to either Select

Referring to FIG. 6 showing the correction result accordingly, each divided morpheme divided into three morphemes is corrected according to the chemical morpheme information, so that the correcting reagent name can be finally obtained.

The reagent information collection device can construct chemical morpheme information using big data analysis technology, and can periodically update the chemical morpheme information through learning about the name of a chemical substance using artificial intelligence technology.

In addition, according to an example, when the correction of the confirmation reagent name is performed, a verification procedure for the correction reagent name may be additionally performed, and it is also possible to determine whether to perform the verification procedure using the corrected text number.

7 and 8 are flowcharts and exemplary diagrams illustrating a procedure for correcting a reagent name using a reagent bottle image according to an embodiment of the present invention.

Referring to FIG. 7 along with FIG. 8, when the reagent name correction is performed based on the chemical morpheme information (S710), it is determined whether the number of corrected texts is greater than or equal to a preset threshold (eg, 3). It is determined (S720), and if it is less than the threshold value, a correction reagent name is generated as reagent information (S730).

On the contrary, if the number of correction texts exceeds the threshold value, verification is performed using the reagent bottle image DB 800 for the target reagent bottle 810 in the photographed image (S740), and reagent information is generated as the correction reagent name only when the verification is successful. do. If verification fails, re-photographing of the reagent bottle or recalibration using chemical morpheme information is performed.

The reagent bottle image DB 800 stores images of various reagent bottles corresponding to the same reagent name. For example, each reagent bottle image provided by each manufacturer for reagent name A is registered in the reagent bottle image DB. Using this, if the corrected reagent name is reagent name A, the reagent bottle images and the photographed images of the target reagent bottle are Compare and check whether the same thing exists.

As a method of determining whether they are identical, according to an example, the color and shape of the reagent bottle and the label are compared to determine whether they are identical. That is, using image comparison technology, it is determined whether the shape and color of the reagent bottle itself are the same, and whether the color and shape of the attached label are the same.

In addition, if a reagent bottle image having the same name as the target reagent bottle and the same color and shape of the bottle itself and the label exists, additional texts other than the reagent name in the label may be further compared to determine whether they are identical. For example, a method of using the number of texts or comparing specific information on the capacity of the texts is used.

That is, if the reagent name is the same, the shape and color of the bottle and the label are similar, and the number of texts on the label is the same, it can be determined that the correction of the reagent name has been correctly performed, thereby increasing the accuracy of the correction.

9 is a flowchart illustrating a process of generating reagent residual capacity information using an image according to an embodiment of the present invention.

The reagent information collection device acquires reagent bottle weight information (S910). As described above, the weight of the target reagent bottle is measured using the weighing means 40 or a separate weighing device 210.

Information on the capacity/manufacturer is extracted from the text of the label recognized in the photographed image (S920).

Then, a value obtained by subtracting the weight information of the reagent bottle itself sold by the recognized manufacturer from the measured weight of the reagent bottle is calculated as the remaining reagent capacity (S930). That is, the reagent bottle information for each manufacturer is stored in a DB in advance, and the residual capacity of the reagent is calculated using the measured weight while recognizing the weight of each reagent bottle (that is, the weight of the container excluding the reagent).

For example, if the measurement weight is 100g and the container weight of the reagent bottle of the corresponding volume of the manufacturer is 80g, the remaining reagent capacity is calculated as 20g.

The calculated residual capacity of the reagent is stored as reagent information together with the reagent name (S940).

The reagent information collection method using an image according to the present invention described above may be implemented as a computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording media in which data that can be decoded by a computer system are stored. For example, there may be read only memory (ROM), random access memory (RAM), magnetic tape, magnetic disk, flash memory, optical data storage device, and the like. In addition, the computer-readable recording medium can be distributed to a computer system connected through a computer communication network, and stored and executed as code that can be read in a distributed manner.

In addition, although the above has been described with reference to a preferred embodiment of the present invention, those of ordinary skill in the relevant technical field can use the present invention within the scope not departing from the spirit and scope of the present invention described in the following claims. It will be appreciated that various modifications and changes can be made.

10: photographing unit 20: storage unit
30: control unit 31: text recognition unit
32: information generation unit

Claims (10)

In the reagent information collection method using an image performed in a computing device,
Recognizing the text of the label in the photographed image of the target reagent bottle;
Identifying a reagent name by analyzing the text; And
If the identified reagent name does not exist in the reagent name list, including the step of correcting the identified reagent name with reference to the chemical morpheme information,
Correction of the confirmation reagent name,
It is performed by dividing the identified reagent name into morpheme units, maintaining the divided morphemes of the morphemes present as the chemical morpheme information, and converting the rest into similar morphemes, respectively,
When the correction of the confirmed reagent name is performed, comparing a reagent bottle image having the same reagent name as the correction reagent name with the photographed image by referring to the reagent bottle image DB to check whether the same is present; And
The method of collecting reagent information using an image further comprising the step of finally inputting the corrected reagent name only when the verification is successful. delete delete The method according to claim 1,
A method of collecting reagent information using an image, wherein the reagent bottle image and the color and shape of the reagent bottle and the label in the photographed image are compared with each other to determine whether they are the same. The method of claim 4,
A method of collecting reagent information using an image, wherein the reagent bottle image and text other than the reagent name in the label in the photographed image are further compared with each other to determine whether they are identical. The method according to claim 1,
A method of collecting reagent information using an image in which a comparison between the reagent bottle image and the photographed image is performed only when the number of corrected texts is greater than or equal to a threshold value. The method according to claim 1,
Collecting reagent information using an image, further comprising the step of calculating the remaining reagent capacity using the obtained weight information of the target reagent bottle, based on information on the volume of the text of the label in the photographed image and information on the manufacturer Way. As a recording medium in which a program of instructions that can be executed by a digital processing device is tangibly implemented and can be read by a digital processing device,
Recognizing the text of the label in the photographed image of the target reagent bottle;
Identifying a reagent name by analyzing the text; And
If the identified reagent name does not exist in the reagent name list, including the step of correcting the identified reagent name with reference to the chemical morpheme DB,
Correction of the confirmation reagent name,
It is performed by dividing the identified reagent name into morpheme units, maintaining the divided morphemes of the morphemes present as the chemical morpheme information, and converting the rest into similar morphemes, respectively,
When the correction of the confirmed reagent name is performed, the reagent bottle image having the same reagent name as the correction reagent name and the photographed image are compared with reference to the reagent bottle image DB to determine whether the same thing exists, and only if the confirmation is successful, the correction reagent The recording medium on which the name is finalized. A photographing unit for photographing a target reagent bottle;
A text recognition unit for recognizing the text of the label in the photographed image of the target reagent bottle; And
Comprising an information generation unit for confirming the reagent name by analyzing the text, and correcting the confirmed reagent name by referring to the chemical morpheme information, if the confirmed reagent name does not exist in the reagent name list,
Correction of the confirmation reagent name,
It is performed by dividing the identified reagent name into morpheme units, maintaining the divided morphemes of the morphemes present as the chemical morpheme information, and converting the rest into similar morphemes, respectively,
When the correction of the confirmed reagent name is performed, the reagent bottle image having the same reagent name as the correction reagent name and the photographed image are compared with reference to the reagent bottle image DB to determine whether the same thing exists, and only if the confirmation is successful, the correction reagent The reagent information collection device that the name is finally input. The method of claim 9,
Further comprising a weight measuring unit for measuring the weight of the target reagent bottle,
The information generation unit, based on the information on the capacity of the text of the label in the photographed image and the information on the manufacturer, calculates the residual capacity of the reagent by using the weight information by the weighing unit, reagent information collection device.

Images