KR102605381B1 - System and method of reading equipment nameplate optical character for automatic recognition of equipment specifications - Google Patents

Abstract

A facility nameplate optical character reading system and method for automatic recognition of facility specifications are disclosed. An optical recognition module that optically recognizes strings on equipment nameplates; an item/equipment specification value discrimination module that distinguishes the strings optically recognized by the optical recognition module by designating them as item and equipment specification values, respectively; Configure a facility specification value output module that outputs each item and facility specification value distinguished from the item/equipment specification value distinction module. According to the equipment nameplate optical character reading system and method for automatic recognition of the above-described equipment specifications, it is configured to automatically recognize equipment nameplates without a specific format, correct errors, and generate digital data, thereby providing a basis for evaluating building energy performance. It has the effect of securing data accurately and efficiently.

Description

Equipment nameplate optical character reading system and method for automatic recognition of equipment specifications {SYSTEM AND METHOD OF READING EQUIPMENT NAMEPLATE OPTICAL CHARACTER FOR AUTOMATIC RECOGNITION OF EQUIPMENT SPECIFICATIONS}

The present invention relates to an optical character reading system and method, and more specifically to a system and method for optical character reading of equipment nameplates, and more specifically to a system and method for optical character reading of equipment nameplates for automatic recognition of equipment specifications. will be.

When remodeling a building, energy diagnosis to evaluate the performance of the existing building must be conducted first in order to improve the building's energy performance.

At this time, in order to investigate the building's energy consumption and efficiency, specification information displayed on the nameplate of the equipment in the building is needed.

Previously, to diagnose building energy, an inspector personally walked around the building, checked all equipment nameplates, and transferred specification information into digital data. Because this work relies heavily on the labor of experts, there are problems with errors occurring due to differences in entry methods for each worker or human errors during the entry process. This can be considered a very important basic work because errors in basic specification information can lead to errors in building energy diagnosis.

Meanwhile, there is existing optical character recognition technology for credit cards or ID cards. This optical character reading technology takes advantage of the fact that the position where characters are displayed in forms such as ID cards is constant, or the format of values such as resident registration numbers or names is constant.

However, the format and recognition items of the equipment nameplate vary depending on the type and manufacturer/model of the equipment, such as model name, power consumption, and heating/cooling capacity. The alphabet code, number, and unit (W, kcal/h, There is a problem that the conventional optical character reading technology cannot be used as is due to the different formats (Hz, etc.).

Registered Patent Publication 10-0627195 Public Patent Publication 10-2022-0066475

The purpose of the present invention is to provide an equipment nameplate optical character reading system for automatic recognition of equipment specifications.

Another object of the present invention is to provide a method for reading optical characters on equipment nameplates for automatic recognition of equipment specifications.

The equipment nameplate optical character reading system for automatic recognition of equipment specifications according to the purpose of the present invention described above includes an optical recognition module that optically recognizes a string of the equipment nameplate; an item/equipment specification value discrimination module that distinguishes the strings optically recognized by the optical recognition module by designating them as item and equipment specification values, respectively; It may be configured to include a facility specification value output module that outputs items and facility specification values distinguished from the item/equipment specification value distinction module, respectively.

Here, the item consists of an item related to equipment specifications, and the equipment specification value may consist of a physical specification value of the item.

The optical character reading method of a facility nameplate for automatic recognition of facility specifications according to another object of the present invention described above includes the steps of: an optical recognition module optically recognizing a character string on a facility nameplate; A step in which an item/equipment specification value discrimination module designates and distinguishes the string optically recognized by the optical recognition module as an item and a facility specification value, respectively; The equipment specification value output module may be configured to include a step of outputting items and equipment specification values distinguished from the item/equipment specification value distinction module, respectively.

Here, the item consists of an item related to equipment specifications, and the equipment specification value may consist of a physical specification value of the item.

According to the equipment nameplate optical character reading system and method for automatic recognition of the above-described equipment specifications, it is configured to automatically recognize equipment nameplates without a specific format, correct errors, and generate digital data, thereby providing a basis for evaluating building energy performance. It has the effect of securing data accurately and efficiently.

Figure 1 is a block diagram of a facility nameplate optical character reading system for automatic recognition of facility specifications according to an embodiment of the present invention.
Figure 2 is an exemplary diagram showing the result of bounding box classification according to an embodiment of the present invention.
Figure 3 is an exemplary diagram of a bounding box correction result according to an embodiment of the present invention.
Figure 4 is an exemplary diagram of the result of item-equipment specification value recognition according to an embodiment of the present invention.
Figure 5 is a flowchart of a facility nameplate optical character reading method for automatic recognition of facility specifications according to an embodiment of the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and detailed descriptions will be given for carrying out the invention. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention. While describing each drawing, similar reference numerals are used for similar components.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention. The term and/or includes any of a plurality of related stated items or a combination of a plurality of related stated items.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a block diagram of a facility nameplate optical character reading system for automatic recognition of facility specifications according to an embodiment of the present invention. And Figure 2 is an exemplary diagram showing a bounding box classification result according to an embodiment of the present invention, Figure 3 is an exemplary diagram showing a bounding box correction result according to an embodiment of the present invention, and Figure 4 is an exemplary diagram showing an embodiment of the present invention. This is an example of the item-equipment specification value recognition result according to the example.

Referring to Figure 1, the equipment nameplate optical character reading system 100 for automatic recognition of equipment specifications according to an embodiment of the present invention includes an optical recognition module 110, a bounding box classification module 120, and an item storage module ( 130), equipment specification value unit storage module 140, bounding box modification module 150, string similarity judgment module 160, string post-processing module 170, item/equipment specification value distinction module 180, item/ It may be configured to include a facility specification value output module 190.

Hereinafter, the detailed configuration will be described.

The optical recognition module 110 may be configured to optically recognize a string on a facility nameplate. The optical recognition module 110 can optically recognize character strings using optical character recognition (OCR) technology.

The bounding box classification module 120 may be configured to generate and distinguish bounding boxes for each string based on the string optically recognized by the optical recognition module 110. Here, the boundary box is displayed in the form of a boundary box for each character string on the equipment nameplate, and is displayed in the form of a green box in FIG. 2.

The bounding box classification module 120 may be configured to recognize rows of multiple bounding boxes and classify them by estimating the positions and spacing of letters. Figure 2a) shows a bounding box set through optical character recognition.

Meanwhile, the bounding box classification module 120 can recognize the bounding boxes as bounding boxes of the same row if the y-axis center coordinate of each bounding box matches the y-axis center coordinate of the bounding box on its left.

Meanwhile, the equipment nameplate is composed of pairs of items and their equipment specification values that are repeatedly displayed. In Figure 2, the items include size, cooling capacity, heating capacity, power, current consumption, standard air volume, and operating current, and the equipment specification values for each item are shown in numbers and units representing the physical quantity to the right of each item.

The item storage module 130 may be configured to store each item of the equipment nameplate in advance. The items are related to equipment specifications and include cooling capacity, heating capacity, size, etc. in Figure 2.

The equipment specification value unit storage module 140 may be configured to store in advance the units for the equipment specification values of each item on the equipment nameplate.

The bounding box modification module 150 refers to each item stored in the item storage module 130 and the units pre-stored in the facility specification value unit storage module 140 to modify the bounding box divided in the bounding box division module 120. It can be configured.

Specifically, the bounding box modification module 140 can modify the bounding box to distinguish between the front of the bounding box containing Hangul and the rear of the bounding box whose last character is the unit.

However, here, there may be many errors in string recognition within the bounding box. Because the content or unit of the string is not determined, and the format or location of letters, numbers, and units are not constant, many errors occur in string recognition. In particular, since the bounding box is primarily estimated based on the position and spacing of the letters, one word 'form', like 'form' and 'formula' in a) of Figure 3, is separated and divided into individual bounding boxes. There is a problem that can be done.

The bounding box correction module 150 may be configured to modify the bounding box in a way that corrects these errors. For example, the bounding box of 'Type' and the bounding box of 'Formula' can be combined and modified into one bounding box of 'Form'. Figure 3 illustrates a bounding box modified by modification of the bounding box modification module 150.

The string similarity determination module 160 may be configured to compare the similarity between each item stored in the item storage module 130 and the string of each bounding box modified by the bounding box modification module 150. This determination of string similarity is to find a string that corresponds to an item among several strings. Figure 4 illustrates recognizing string items by determining string similarity for each item 'format' and 'freezing ability'.

Meanwhile, strings may contain various errors.

String post-processing module 170 may be configured to correct these errors.

That is, the string post-processing module 170 may be configured to perform post-processing on strings that are determined to be similar according to a predetermined standard as a result of the similarity comparison of the string similarity determination module 160.

For example, the number '0' in the value part of the equipment performance displayed on the equipment nameplate is often mistakenly recognized as the alphabet 'O', and the special character '/' in the unit part is often mistakenly recognized as the alphabet 'l'. To correct this, it can be configured to convert the upper and lower case letter 'O' followed by a number or ',' to the number '0'. In addition, if the last letter of the recognized equipment item value matches the unit data set in which '/' is replaced with the alphabet 'l', the unit can be configured to be corrected to the correct notation. Rows 3 and 4 of Table 2 are examples of application of the second rule. The unit 'kg/h', which was incorrectly recognized as 'kglh', has been corrected, and the alphabet 'O' in '5,OOO' and '5OO', which are presumed to be numbers, can be converted to the number '0'.

Table 1 shows an example of this string post-processing.

Meanwhile, the item/equipment specification value distinction module 180 designates the string post-processed in the string post-processing module 170 as an item, and stores the string in another bounding box in advance in the facility specification value unit storage module 140. It can be configured to distinguish by referring to the stored units and specifying them as equipment specification values for previously specified items. In Figure 4c), pairs of items and equipment specifications are displayed separately.

The item/equipment specification value output module 190 may be configured to output items and equipment specification values distinguished from the item/equipment specification value distinction module 180, respectively.

Figure 5 is a flowchart of a facility nameplate optical character reading method for automatic recognition of facility specifications according to an embodiment of the present invention.

Referring to FIG. 5, the optical recognition module 110 optically recognizes the string on the equipment nameplate (S101).

Next, the bounding box classification module 120 generates and distinguishes bounding boxes for each string based on the string optically recognized by the optical recognition module 110 (S102).

Next, the bounding box modification module 150 refers to each item stored in the item storage module 130 and the units pre-stored in the facility specification value unit storage module 140 to separate the bounding boxes in the bounding box division module 120. Modify (S103).

Next, the string similarity determination module 160 compares the similarity between each item stored in the item storage module 130 and the string of the bounding box modified by the bounding box modification module 150 (S104).

Next, the string post-processing module 170 performs post-processing on strings that are determined to be similar according to a predetermined standard as a result of the similarity comparison of the string similarity determination module 160 (S105).

Next, the item/facility specification value distinction module 180 designates the string on which post-processing has been performed in the string post-processing module 170 as an item, and stores the string in another bounding box in the facility specification value unit storage module 140. Referring to pre-stored units, they are distinguished by designating them as equipment specification values for designated items (S106).

Next, the equipment specification value output module 190 outputs the items and equipment specification values distinguished from the item/equipment specification value distinction module 180 (S107).

Although the description has been made with reference to the above examples, those skilled in the art can understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. There will be.

110: Optical recognition module
120: Bounding box separation module
130: Item storage module
140: Equipment specification value unit storage module
150: Bounding box modification module
160: String similarity judgment module
170: String post-processing module
180: Item/equipment specification value distinction module
190: Item/equipment specification value output module

Claims (4)

An optical recognition module that optically recognizes strings on facility nameplates;
a bounding box classification module that generates and distinguishes bounding boxes for each string based on the string optically recognized by the optical recognition module;
an item storage module in which each item of the equipment nameplate is stored in advance;
A facility specification value unit storage module in which the units for the facility specification value of each item of the facility name plate are stored in advance;
a bounding box modification module that modifies a bounding box classified in the bounding box division module by referring to each item stored in the item storage module and a unit pre-stored in the facility specification value unit storage module;
a string similarity judgment module that compares the similarity between each item stored in the item storage module and the string of each bounding box modified by the bounding box modification module;
a string post-processing module that performs post-processing to correct errors on strings that are determined to be similar according to a predetermined standard as a result of similarity comparison of the string similarity judgment module;
In the string post-processing module, the post-processed string is designated as an item, and the string in another bounding box is differentiated by designating it as the equipment specification value for the previously specified item by referring to the unit pre-stored in the equipment specification value unit storage module. Module for distinguishing item/equipment specification values;
It includes a facility specification value output module that outputs the items and facility specification values distinguished from the item/equipment specification value distinction module, respectively,
The above items consist of items related to equipment specifications,
The facility nameplate optical character reading system for automatic recognition of facility specifications, characterized in that the facility specification value consists of the physical specification value of the item.
delete A step where the optical recognition module optically recognizes a string on a facility nameplate;
A bounding box classification module generating and distinguishing bounding boxes for each string based on the string optically recognized by the optical recognition module;
A bounding box modification module modifying the bounding box divided by the bounding box classification module by referring to each item stored in the item storage module and the unit pre-stored in the equipment specification value unit storage module;
A string similarity determination module comparing the similarity between each item stored in the item storage module and the string of each bounding box modified by the bounding box modification module;
Post-processing, by a string post-processing module, to correct errors on strings that are determined to be similar according to a predetermined standard based on a similarity comparison result of the string similarity determination module;
The item/equipment specification value distinction module designates the string for which post-processing has been performed in the string post-processing module as an item, and the string in another bounding box is added to the previously specified item by referring to the unit pre-stored in the facility specification value unit storage module. A step of distinguishing by designating equipment specification values for each device;
It includes a step of the equipment specification value output module outputting each item and equipment specification value distinguished from the item/equipment specification value discrimination module,
The above items consist of items related to equipment specifications,
The equipment specification value is a facility nameplate optical character reading method for automatic recognition of facility specifications, characterized in that it consists of the physical specification value of the item.
delete