KR102375566B1 - Electronic apparatus that processes medical expenses receipt printed on paper electronically and operating method thereof - Google Patents

Abstract

Disclosed are an electronic device for electronically processing the medical expenses receipt printed on paper, and an operating method thereof. According to the electronic device for electronically processing the medical expenses receipt printed on paper, and the operating method thereof of, an image matrix is generated according to the color values of a plurality of pixels constituting a scan image with respect to a scanned image into which the table-formatted medical expense details table is inserted. After detecting the vertical lines and horizontal lines constituting the medical expense details table from the scan image by applying a vertical line filter and a horizontal line filter to the image matrix, by inserting a plurality of texts extracted from the scanned image through OCR into the plurality of cells generated by the vertical lines and the horizontal lines, a document with embedded tables may be generated.

Description

Electronic device for electronic document processing of paper-printed medical bill receipts and method of operation thereof

The present invention relates to an electronic device for electronically processing a receipt for medical expenses printed on paper, and a method for operating the same.

Recently, as various OCR (Optical Character Reader) related technologies capable of recognizing characters from an image have appeared, various application services using them have been provided.

For example, a service that recognizes a character from an image and provides an automatic translation function for the character, or a service that recognizes a character from a sign image of a nearby object and provides related information about the surrounding object through an Internet search, etc. exist.

On the other hand, when patients receive medical bills and prescriptions after receiving treatment at the hospital, they usually receive receipts and prescriptions in the form of printed paper documents.

However, there is a risk of loss of paper documents, and when it is necessary to refer to the documents later, there is an inconvenience in that it is not possible to check them directly through an electronic device such as a smart phone.

In order to solve this inconvenience, a method of scanning a paper document and storing it in the form of an image on an electronic device may be considered. However, the method of saving in the image format has a disadvantage in that it is impossible to edit the contents because the document is saved in a simple image file format instead of an electronic document file format. In particular, the medical expense receipt is in the form of a table as shown in the figure shown in FIG. 5, and there is no technology for electronically processing paper documents in the form of a table such as a medical expense receipt, so standardize and edit the medical expense receipt. If you wanted to record this possible electronic document file format, you had to go through the process of creating a table one by one and inputting texts into a plurality of cells that make up the table one by one.

In this regard, if it is possible to electronically process the medical expenses receipts composed of paper documents, the convenience of the administrator who manages the medical expenses receipts of patients can be promoted.

In particular, since attempts to increase work efficiency through computerization are continuing in large hospitals, the need to electronically document and manage medical receipts provided to patients is increasing.

Therefore, there is a need for research on a technology capable of electronically documenting medical bills printed on paper.

An electronic device and an operating method thereof according to the present invention generate a table by extracting lines constituting a medical expense detail table from a scanned image of a paper-printed medical expense receipt, and after extracting text from the scanned image, text on the table By inserting the , paper-printed medical bill receipts can be electronically documented.

An electronic device for electronically documenting a paper-printed medical expense receipt according to an embodiment of the present invention includes a plurality of different patient identifiers, a document file for medical expenses receipts corresponding to each of the plurality of patient identifiers, and the plurality of patient identifiers. Composite information storage in which information on the total amount of medical expenses corresponding to each patient identifier is stored in correspondence with each other First medical expense receipt - The first medical expense receipt is composed of a table-type medical expenses details table in which text for medical expenses details is inserted - As the scanned first scanned image and the first patient identifier are input, When the electronic document processing command for the first medical fee receipt is applied, the first scanned image is n (n is a natural number greater than or equal to 2) horizontally and m (m is a natural number greater than or equal to 2) preset first sizes of the first scanned image. After dividing into rectangular regions, a code of 1 is assigned to a rectangular region having a color corresponding to the color value range among the rectangular regions, and a code of 0 is assigned to the remaining regions to obtain the first scanned image. By binarizing, a plurality of texts existing in the first scan image are extracted using an image matrix generator that generates an mxn image matrix, OCR (Optical Character Reader), and then the plurality of texts and the plurality of texts text position information within the first scanned image for each - the text position information is information about the relative position of each text within the first scanned image with respect to the upper leftmost point of the first scanned image means - a text confirmation unit to confirm, for the mxn image matrix, a preset mxn vertical line filter matrix for detecting vertical lines in a scanned image - The mxn vertical line filter matrix is the mxn vertical line filter matrix Presets among a plurality of columns that make up A component constituting the plurality of first columns is assigned a code of 1, and a component constituting the remaining columns is a matrix to which a code of 0 is assigned - and a preset mxn for detecting a horizontal line in a scanned image Horizontal line filter matrix of - The mxn horizontal line filter matrix is assigned a code of 1 to a component constituting a plurality of preset first rows among a plurality of rows constituting the mxn horizontal line filter matrix, and constituting the remaining rows A component is a matrix to which a code of 0 is assigned - a line detection unit that detects a plurality of vertical lines and a plurality of horizontal lines constituting the medical expense breakdown table from the first scan image by performing a matrix operation based on An electronic document generator generating a first electronic document into which a table composed of the plurality of cells is inserted after checking a plurality of cells generated by the plurality of vertical lines and the plurality of horizontal lines, each of the plurality of texts Based on the text position information in the first scanned image for A document file generating unit generating a document file for After selecting the inserted first cell, at least one cell into which text indicating an amount is inserted among cells positioned in the same row and column as the first cell is identified, and the first cell from among the checked at least one cell After selecting the second cell located closest to the medical bill, the total amount of medical expenses confirmation unit that checks the text inserted into the second cell as information on the total medical expenses, and the text inserted into the second cell as information on the total medical expenses When it is confirmed, the first patient identifier, the document file for the first electronic document, and information on the confirmed total amount of medical expenses are mutually transmitted to the composite information storage unit. and an information storage processing unit for storing the corresponding information.

In addition, the operating method of an electronic device for electronically processing a paper-printed medical bill receipt according to an embodiment of the present invention includes a plurality of different patient identifiers and a document for a medical bill receipt corresponding to each of the plurality of patient identifiers. Maintaining a composite information storage unit in which information on the total amount of medical expenses corresponding to each of the file and each of the plurality of patient identifiers is stored in correspondence with each other, a color value in which a range of color values preset as the color of the line constituting the table is stored Maintaining a storage unit, a first receipt for medical expenses printed on paper from the manager - The first receipt for medical expenses is composed of a table of medical expenses details in which text for medical expenses details is inserted - This scanned first scanned image and When the first patient identifier is input and an electronic document processing command for the first medical fee receipt is applied, the first scanned image is n horizontally (n is a natural number greater than or equal to 2) and vertical m (m is a natural number greater than or equal to 2) ), a code of 1 is assigned to a rectangular area having a color corresponding to the color value range among the rectangular areas, and a code of 0 is assigned to the remaining areas. generating an mxn image matrix by allocating and binarizing the first scanned image; after extracting a plurality of texts present in the first scanned image using OCR, the plurality of texts and the plurality of texts text position information within the first scanned image for each - the text position information is information about the relative position of each text within the first scanned image with respect to the upper leftmost point of the first scanned image means - identifying, for the mxn image matrix, a preset mxn vertical line filter matrix for detecting vertical lines in a scanned image, the mxn vertical line filter matrix constituting the mxn vertical line filter matrix to configure a plurality of preset first columns among a plurality of columns to is a matrix to which a component is assigned a code of 1, and the components constituting the remaining columns are assigned a code of 0 - and a preset mxn horizontal line filter matrix for detecting horizontal lines in the scanned image - of the mxn In the horizontal line filter matrix, a code of 1 is assigned to a component constituting a plurality of preset first rows among a plurality of rows constituting the mxn horizontal line filter matrix, and a code of 0 is assigned to a component constituting the remaining rows. Detecting a plurality of vertical lines and a plurality of horizontal lines constituting the medical expense breakdown table from the first scan image by performing a matrix operation based on generating a first electronic document into which a table composed of the plurality of cells is inserted after checking a plurality of cells generated by generating a document file for the first electronic document by inserting each of the plurality of texts into the plurality of cells constituting a table inserted in the first electronic document based on location information; When the document file for the document is created, after selecting the first cell in which the first text having the highest degree of similarity with the text preset as indicating the total amount of medical expenses among the plurality of texts is inserted, the same as the first cell After checking at least one cell into which text indicating the amount of money is inserted among cells located in rows and columns, and selecting a second cell closest to the first cell from among the checked at least one cell, the second cell 2 Confirming the text inserted into the cell as information on the total amount of medical expenses, and when the text inserted into the second cell is confirmed as information on the total amount of medical expenses, the first patient identifier and the document file for the first electronic document and storing the information on the confirmed total amount of medical expenses in correspondence with each other in the composite information storage unit.

An electronic device and an operating method thereof according to the present invention generate a table by extracting lines constituting a medical expense detail table from a scanned image of a paper-printed medical expense receipt, and after extracting text from the scanned image, text on the table By inserting , paper-printed medical bill receipts can be electronically documented.

1 is a diagram showing the structure of an electronic device according to an embodiment of the present invention.
2 to 6 are diagrams for explaining an electronic device according to an embodiment of the present invention.
7 is a flowchart illustrating a method of operating an electronic device according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. These descriptions are not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. While describing each drawing, like reference numerals are used for similar components, and unless otherwise defined, all terms used in this specification, including technical or scientific terms, refer to those of ordinary skill in the art to which the present invention belongs. It has the same meaning as is commonly understood by those who have it.

In this document, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, in various embodiments of the present invention, each of the components, functional blocks or means may be composed of one or more sub-components, and the electrical, electronic, and mechanical functions performed by each component are electronic. A circuit, an integrated circuit, an ASIC (Application Specific Integrated Circuit), etc. may be implemented as various well-known devices or mechanical elements, and may be implemented separately or two or more may be integrated into one.

On the other hand, the blocks in the accompanying block diagram or steps in the flowchart are computer program instructions that are loaded in a processor or memory of equipment capable of data processing, such as a general-purpose computer, a special-purpose computer, a portable notebook computer, and a network computer, and perform specified functions. can be interpreted as meaning Since these computer program instructions may be stored in a memory provided in a computer device or in a memory readable by a computer, the functions described in the blocks of the block diagrams or the steps of the flowcharts are produced as articles of manufacture containing instruction means for performing the same. it might be In addition, each block or each step may represent a module, segment, or portion of code comprising one or more executable instructions for executing the specified logical function(s). It should also be noted that, in some alternative embodiments, it is also possible for the functions recited in blocks or steps to be executed out of the prescribed order. For example, two blocks or steps shown one after another may be performed substantially simultaneously or in the reverse order, and in some cases, some blocks or steps may be omitted.

1 is a diagram illustrating the structure of an electronic device for electronically documenting a paper-printed medical expense receipt according to an embodiment of the present invention.

Referring to FIG. 1 , an electronic device 110 according to an embodiment of the present invention includes a complex information storage unit 111 , a color value storage unit 112 , an image matrix generation unit 113 , and a text verification unit 114 . , a line detection unit 115 , an electronic document generation unit 116 , a document file generation unit 117 , a total medical expenses confirmation unit 118 , and an information storage processing unit 119 .

In the complex information storage unit 111, a document file for a plurality of different patient identifiers, a medical fee receipt corresponding to each of the plurality of patient identifiers, and information on the total amount of medical expenses corresponding to each of the plurality of patient identifiers are mutually Correspondingly stored.

For example, information may be stored in the complex information storage unit 111 as shown in Table 1 below.

multiple patient identifiers document file Total medical expenses Patient Identifier 1 Document file for medical bill receipt 1 95,000 won Patient Identifier 2 Document file for medical bill receipt 2 120,000 won Patient Identifier 3 Document file for medical bill receipt 3 75,000 won ... ... ...

The color value storage unit 112 stores a range of color values preset as colors of lines constituting the table.

For example, as shown in FIGS. 2 to 6 , when the color of the line constituting the table is made of a color of the sky blue series, the color value storage unit 112 stores the color value range of the line constituting the table as the color of the line constituting the table. may have been

The image matrix generating unit 113 receives a first scanned image of a paper-printed first medical fee receipt from an administrator and a first patient identifier is input, and when an electronic document processing command for the first medical fee receipt is applied, the After dividing the first scanned image into n horizontal (n is a natural number greater than or equal to 2) and vertical m (m is a natural number greater than or equal to 2) rectangular regions of a preset first size, the color value among the rectangular regions An mxn image matrix is generated by assigning a code of 1 to a rectangular region having a color corresponding to the range and binarizing the first scanned image by assigning a code of 0 to the remaining regions.

Here, the first medical expense receipt may be composed of a table-type medical expenses details table in which text for medical expenses details is inserted, as shown in the figure shown in FIG. 5, and each cell constituting the medical expenses history table A plurality of texts may be inserted, such as the text 'patient registration number', the text 'treatment subject', the text 'examination fee', the text '25,000 won', and the like.

In this case, according to an embodiment of the present invention, the image matrix generation unit 113 may include an average value calculation unit 121 and a matrix generation processing unit 122 .

When an electronic document processing command for the first medical expense receipt is applied while the first scan image and the first patient identifier are input from the manager, the average value calculating unit 121 horizontally converts the first scanned image to n, After dividing into m vertical rectangular regions of the first size, an average value of color values of a plurality of pixels constituting each of the rectangular regions is calculated for each of the rectangular regions.

The matrix generation processing unit 122 assigns a code of 1 to a rectangular region in which the average value of the color values of the plurality of pixels among the rectangular regions is included in the color value range, and a rectangular region not included in the color value range. By assigning a code of 0 to a region and binarizing the first scanned image, the mxn image matrix is generated.

For example, it is assumed that the first medical expense receipt is composed of a table-type medical expenses breakdown table in which the text 'treatment period' is inserted, and a first scanned image of the first medical expenses receipt is scanned as shown by reference numeral 210 in FIG. Assume that 'scan image 1 (210)' is the same, and the first patient identifier is 'patient identifier 110'.

At this time, as the first scanned image 'scan image 1 (210)' and the first patient identifier 'patient identifier 110' are input from the manager to the electronic device 110, electronic documentation of the first medical fee receipt When the processing command is applied, the average value calculating unit 121 divides the 'scan image 1 (210)' into n horizontal and m vertical rectangular regions of the first size, and then, for each of the rectangular regions, An average value of color values of a plurality of pixels constituting each of the rectangular regions may be calculated.

Here, assuming that 'n=12' and 'm=8', the average value calculating unit 121 displays the 'scan image 1 (210)' in 12 horizontal and 8 vertical rows as shown in reference numeral 220. It is possible to divide the rectangular regions 220 of one size, and for each of the rectangular regions 220 , an average value of color values of a plurality of pixels constituting each of the rectangular regions 220 may be calculated.

Specifically, the average value calculating unit 121 may calculate the average value of the color values of the light blue color for the line region 221 constituting the medical expenses details table among the rectangular regions 220 , and the background inside the medical expenses history table It is possible to calculate the average value of the white color values for the region 222 constituting the can

Thereafter, the matrix generation processing unit 122 assigns a code of 1 to a rectangular region in which the average value of the color values of the plurality of pixels among the rectangular regions 220 is included in the sky blue color value range in the previous example, and , it is possible to binarize the 'scan image 1 (210)' by assigning a code of 0 to a rectangular region that is not included in the color value range of the sky blue series.

That is, the matrix generation processing unit 122 assigns a code of 1 to the line area 221 constituting the treatment cost detail table among the rectangular areas 220, and the area 222 constituting the background inside the treatment cost detail table and By assigning a code of 0 to the area 223 constituting the letter 'treatment period' and binarizing the 'scan image 1 (210)', an image matrix 230 of 8 x 12 as indicated by reference numeral 230 can be generated. can

The text check unit 114 extracts a plurality of texts present in the first scan image using an optical character reader (OCR), and then the plurality of texts and the first scan image for each of the plurality of texts Check the text position information within.

Here, the text position information means information on the relative position of each text in the first scanned image with respect to the upper leftmost point of the first scanned image.

In addition, the OCR refers to an input device that recognizes printed or handwritten characters on paper by optical means and converts them into computer text. By taking a picture through the camera built into the smartphone instead of inputting it, it can be used to automatically extract the card number and expiration date from the photographed credit card image.

In relation to this, it is said that the first medical fee receipt is composed of a table of medical expenses details in which a plurality of texts such as 'treatment chart', 'patient name', 'treatment date', 'Hong Gil-dong' and '20201022' are inserted, It is assumed that the first scanned image from which the first medical bill receipt is scanned is the same as 'scanned image 2 (410)' in FIG.

At this time, referring to FIG. 4 , the text confirmation unit 114 uses OCR to determine the 'treatment chart', 'patient name', 'treatment date', the plurality of texts present in the 'scan image 2 (410)', After extracting 'Gildong Hong' and '20201022', the plurality of texts 'treatment chart', 'patient name', 'treatment date', 'Gildong Hong' and '20201022' and the plurality of texts 'treatment chart', ' You can check the text location information in the 'scan image 2 (410)' for each of 'Patient Name', 'Date of Treatment', 'Gildong Hong', and '20201022'.

Specifically, the text confirmation unit 114 'scans' with the text location information for the 'treatment chart' among the plurality of texts 'medical chart', 'patient name', 'treatment date', 'Hong Gil-dong', and '20201022'. After measuring the horizontal distance (413) and the vertical distance (414) from the upper left point (411) of 'image 2 (410)' to the midpoint (412) of the text for 'medical chart', 'care chart' and , it is possible to check the horizontal distance 413 and the vertical distance 414, which are text location information for the 'medical chart'.

In the same manner, the text confirmation unit 114 acquires text location information for 'patient name', 'treatment date', 'Hong Gil-dong', and '20201022', and the plurality of texts 'treatment chart', 'patient 'Name', 'Date of treatment', 'Gildong Hong' and '20201022' and the text location information for each of the plurality of texts 'Care chart', 'Patient name', 'Date', 'Gildong Hong' and '20201022' can be checked

The line detection unit 115 for the mxn image matrix, a preset mxn vertical line filter matrix for detecting a vertical line in the scanned image and a preset mxn horizontal line filter matrix for detecting a horizontal line in the scanned image A plurality of vertical lines and a plurality of horizontal lines constituting the medical expense detail table are detected from the first scan image by performing a matrix operation based on the matrix operation.

Here, in the mxn vertical line filter matrix, a code of 1 is assigned to a component constituting a plurality of preset first columns among a plurality of columns constituting the mxn vertical line filter matrix, and a component constituting the remaining columns is 0 is a matrix to which a code of is assigned, and the mxn horizontal line filter matrix is assigned a code of 1 to a component constituting a plurality of preset first rows among a plurality of rows constituting the mxn horizontal line filter matrix, and the remaining A component constituting the rows is a matrix to which codes of 0 are assigned.

In relation to this, in the mxn vertical line filter matrix, a code of 1 is assigned to an area corresponding to a vertical line according to a preset medical cost breakdown table format among the plurality of columns constituting the mxn vertical line filter matrix, and does not correspond to a vertical line It may be pre-configured so that a code of 0 is assigned to a non-existent area.

Similarly, in the mxn horizontal line filter matrix, a code of 1 is assigned to an area corresponding to a horizontal line according to a preset medical expense breakdown table format among the plurality of rows constituting the mxn horizontal line filter matrix, and a code of 1 is assigned to an area that does not correspond to the horizontal line Regions may be preconfigured to be assigned a code of zero.

In this case, according to an embodiment of the present invention, the line detection unit 115 may include a calculation unit 123 and a line detection processing unit 124 .

The operation unit 123 calculates a Hadamard product between the mxn image matrix and the mxn vertical line filter matrix to generate an mxn first operation matrix, and the mxn image matrix and the mxn horizontal line filter matrix After generating a second operation matrix of mxn by calculating the Hadamard product between .

Here, the Hadamard product means an operation of multiplying each component in a matrix or vector of the same size. When there are two matrices '[abc]' and '[xyz]', A matrix can be expressed as '[ax by cz]'.

The line detection processing unit 124 identifies points in the first scan image that correspond to the components to which the code of 1 is assigned among components constituting the mxn third operation matrix as regions constituting the line, From the first scan image, the plurality of vertical lines and the plurality of horizontal lines constituting the medical expenses detail table are detected.

In this regard, it is assumed that the mxn image matrix for the first scan image is a 9 x 7 matrix as shown in Equation 1 below, and the mxn vertical filter matrix is a 9 x 7 matrix as shown in Equation 2 below. Assuming that the mxn horizontal line filter matrix is a 9x7 matrix as shown in Equation 3 below, the operations of the operation unit 123 and the line detection processing unit 124 will be described as follows.

First, the calculator 123 calculates the Hadamard product between the 9 x 7 image matrix and the 9 x 7 vertical line filter matrix as shown in Equation 4 below, so that the A 9 x 7 first operation matrix may be generated so that only a region matching the region is detected.

In addition, the calculator 123 calculates the Hadamard product between the 9 x 7 image matrix and the 9 x 7 horizontal line filter matrix as shown in Equation 5 below, thereby corresponding to the horizontal line according to the preset medical expense breakdown table format. A 9 x 7 second operation matrix may be generated so that only a region matching the region is detected.

Thereafter, the operation unit 123 performs an OR operation between the first operation matrix of 9×7 and the second operation matrix of 9×7, as shown in Equation 6 below, so that the 9×7th 3 You can create an arithmetic matrix.

In this way, when the 9x7 third operation matrix as in Equation 6 is generated through the operation unit 123, the line detection processing unit 124 performs the 9x7 third operation in the first scan image. By identifying points corresponding to the components to which the code of 1 is assigned among the components constituting the matrix as regions constituting the line, as shown in FIG. 3 , the medical expenses breakdown table is constructed from the first scan image A plurality of vertical lines and a plurality of horizontal lines may be detected.

The electronic document generating unit 116 identifies a plurality of cells generated by the plurality of vertical lines and the plurality of horizontal lines, and then generates a first electronic document into which a table composed of the plurality of cells is inserted.

The document file generating unit 117 constructs a table in which each of the plurality of texts is inserted into the first electronic document based on the text position information in the first scan image for each of the plurality of texts to generate a document file for the first electronic document by inserting it into the plurality of cells.

In this case, according to an embodiment of the present invention, the document file generating unit 117 may include an insertion point calculating unit 125 and a file generating processing unit 126 .

The insertion point calculating unit 125 is configured to insert a text insertion point in the first electronic document for each of the plurality of texts based on the text position information in the first scan image for each of the plurality of texts. calculate

Here, the text insertion point means a point at which a location according to the text location information is calculated based on the upper leftmost point of the first electronic document.

The file creation processing unit 126 identifies a cell at a position corresponding to a text insertion point of each of the plurality of texts among the plurality of cells constituting the table inserted into the first electronic document, and then, each of the plurality of texts is inserted into a cell at a position corresponding to a text insertion point of each text to generate a document file for the first electronic document.

For example, if described with reference to FIG. 4 according to the above-described example, the insertion point calculating unit 125 first calculates the plurality of texts 'medical chart', 'patient name', 'treatment date', 'Hong Gil-dong' and '20201022'. Horizontal distance (413) and vertical distance from the upper left point (411) of 'Scan image 2 (410)', which is text location information for 'Medical Chart', to the text midpoint (412) for 'Medical Chart' Based on (414), by calculating a point according to the vertical distance (413) and the horizontal distance (414) based on the leftmost uppermost point in the first electronic document, the text insertion point for the 'medical chart' can be calculated.

In this way, the insertion point calculating unit 125 also for 'patient name', 'treatment date', 'Hong Gil-dong', and '20201022', based on the text position information in 'scan image 2 (410)' , 'Patient name', 'Date of treatment', 'Gildong Hong', and '20201022', respectively, may be calculated as text insertion points in the first electronic document.

Thereafter, the file generation processing unit 126 is configured to include the plurality of texts 'medical chart', 'patient name', 'treatment date', 'Hong Gil-dong' and After checking the cell at the position corresponding to each text insertion point of '20209031022', each of the plurality of texts, 'medical chart', 'patient name', 'treatment date', 'Hong Gil-dong' and '20201022' A document file for the first electronic document may be generated by inserting it into a cell at a position corresponding to the text insertion point.

In this way, the electronic device 110 may generate an electronic document in which the same table as the medical expense details table inserted in the first scan image is inserted.

When the document file for the first electronic document is generated, the total medical expenses confirmation unit 118 includes a first text having the highest degree of similarity with the text preset to indicate the total amount of medical expenses among the plurality of texts. After selecting one cell, check at least one cell in which text indicating an amount is inserted among cells located in the same row and column as the first cell, and among the checked at least one cell, the closest to the first cell After selecting the second cell located in the cell, the text inserted into the second cell is checked as information on the total amount of medical expenses.

In this case, according to an embodiment of the present invention, the length of the longest common subsequence (LCS) may be utilized for the degree of similarity between each of the plurality of texts and the text preset to indicate the total amount of medical expenses.

Here, the longest common subsequence means a continuous character string that matches two character strings. In this regard, when two character strings are referred to as 'ACAYKP, CAPCAK', the longest common subsequence between the two character strings is 'ACAK', so the length of the longest common subsequence between the two character strings is '4'.

In relation to this, the operation of the total medical expenses check unit 118 will be described with reference to the figure shown in FIG. 6 .

First, it is assumed that the preset text is 'total amount of medical expenses', and a document file for a first electronic document into which a table as shown in FIG. 6 is inserted is generated by the document file generating unit 117 . Then, the total treatment cost confirmation unit 118 is the plurality of texts 'patient name, Hong Gil-dong, treatment item, treatment amount by item, hospital name, hospital A, surgery, treatment date, 20201022, examination, 10,000 won, total treatment cost, Among 40,000 won, injection, 30,000 won, payment amount, 40,000 won, hospitalization, the first cell into which the first text having the greatest similarity with the preset text 'total amount of medical expenses' is inserted may be selected.

In relation to this, in the embodiment shown in FIG. 6, the first cell into which the first text having the highest degree of similarity with the preset text 'total medical expenses' is inserted into 'cell 2 (602)' into which the text 'total medical expenses' is inserted. )', the total medical expenses confirmation unit 118 may select 'cell 2 (602)' as the first cell.

Then, the total medical expenses confirmation unit 118 is the cells located in the same row and column as the first cell 'Cell 2 (602)', 'Cell 1 (601), Cell 3 (603), Cell 4 (604), Cell 5 (605), cell 6 (606), cell 7 (607), cell 8 (608), 'Cell 3 (603), cell 5 (605)' is at least one cell in which text indicating the amount is inserted. and 'Cell 3 (603), which is a second cell located closest to the first cell, 'Cell 2 (602)', among the identified at least one cell 'Cell 3 (603) and Cell 5 (605)'. )' is selected as shown in FIG. 6 , and the text '40,000 won' inserted into the second cell 'cell 3 (603)' can be checked as information on the total amount of medical expenses.

When the text inserted into the second cell is identified as information on the total amount of medical expenses, the information storage processing unit 119 stores the first patient identifier, a document file for the first electronic document, and information on the confirmed total amount of medical expenses. They are stored in correspondence with each other in the complex information storage unit 111 .

For example, according to the above-described example, when the text '40,000 won' inserted into the second cell 'cell 3 (603)' by the total medical expenses confirmation unit 118 is confirmed as information about the total medical expenses, information The storage processing unit 119 stores the information on the 'patient identifier 110' which is the first patient identifier, the document file for the first electronic document, and '40,000 won' which is the confirmed total medical expenses in the complex information storage unit 111. They can be stored in correspondence with each other as shown in Table 2 below.

multiple patient identifiers document file Total medical expenses Patient Identifier 1 Document file for medical bill receipt 1 95,000 won Patient Identifier 2 Document file for medical bill receipt 2 120,000 won Patient Identifier 3 Document file for medical bill receipt 3 75,000 won ... ... ... patient identifier 110 Document file for first electronic document 40,000 won

According to an embodiment of the present invention, the electronic device 110 may further include a display unit 120 .

The display unit 120 stores the information about the first patient identifier, the document file for the first electronic document, and the confirmed total amount of medical expenses by the information storage processing unit 119 in correspondence with each other in the composite information storage unit 111 . Thereafter, when a medical fee receipt search command based on the first patient identifier is applied from the manager, the document file for the first electronic document stored in correspondence with the first patient identifier from the complex information storage unit 111 After extracting the information on the total amount of medical expenses and It is displayed at a preset first point in the screen area where the electronic document is displayed.

For example, according to the above-described example, the first patient identifier 'patient identifier 110', the document file for the first electronic document, and '40,000 won', which is the total amount of the confirmed medical expenses by the information storage processing unit 119 Assume that the information is stored in correspondence with each other in the complex information storage unit 111 as shown in Table 2 above. At this time, when it is said from the administrator that a medical treatment receipt search command based on 'patient identifier 110', which is the first patient identifier, has been applied to the electronic device 110, the display unit 120 displays a complex information storage unit as shown in Table 2 above. It is possible to extract the document file for the first electronic document stored in correspondence with the 'patient identifier 110', which is the first patient identifier, and information on '40,000 won,' which is the confirmed total medical expenses, from (111).

Then, the display unit 120 executes the document file for the first electronic document, displays the first electronic document on the screen, and at the same time displays information on '40,000 won,' which is the confirmed total medical expenses, in the first The electronic document may be displayed at a preset first point in a screen area where the electronic document is displayed.

Through this, the administrator can quickly check information on the first electronic document displayed on the screen and information on '40,000 won', which is the confirmed total medical expenses displayed at the first point.

7 is a flowchart illustrating an operation method of an electronic device for electronically processing a paper-printed medical expense receipt according to an embodiment of the present invention.

In step S710, a document file for a plurality of different patient identifiers, a medical fee receipt corresponding to each of the plurality of patient identifiers, and information on the total amount of medical expenses corresponding to each of the plurality of patient identifiers are stored in correspondence with each other Maintains a complex information storage unit.

In step S720, a color value storage unit in which a color value range preset as the color of the line constituting the table is stored is maintained.

In step S730, the first medical expense receipt printed on paper from the manager (the first medical expense receipt is composed of a table-type medical expenses details table in which the text for medical expenses details is inserted) is scanned with the first scanned image and the second 1 When a patient identifier is input and an electronic document processing command for the first medical fee receipt is applied, the first scanned image is n horizontally (n is a natural number greater than or equal to 2) and vertical m (m is a natural number greater than or equal to 2). After dividing into rectangular regions of a preset first size, a code of 1 is assigned to a rectangular region having a color corresponding to the color value range among the rectangular regions, and a code of 0 is assigned to the remaining regions By binarizing the first scan image, an mxn image matrix is generated.

In step S740, after extracting a plurality of texts existing in the first scanned image using OCR, the plurality of texts and text location information ( The text position information refers to information on the relative position of each text in the first scanned image with respect to the upper leftmost point of the first scanned image).

In step S750, for the mxn image matrix, a preset mxn vertical line filter matrix for detecting vertical lines in a scan image (the mxn vertical line filter matrix is a plurality of columns constituting the mxn vertical line filter matrix) A component constituting a plurality of preset first columns is assigned a code of 1, and a component constituting the remaining columns is a matrix to which a code of 0 is assigned) and a dictionary for detecting a horizontal line in the scanned image. A set mxn horizontal line filter matrix (the mxn horizontal line filter matrix is a component constituting a plurality of preset first rows among a plurality of rows constituting the mxn horizontal line filter matrix is assigned a code of 1, and the remaining rows are A plurality of vertical lines and a plurality of horizontal lines constituting the medical expenses detail table are detected from the first scan image by performing a matrix operation based on the component constituting the matrix to which codes of 0 are assigned).

In step S760, after checking a plurality of cells generated by the plurality of vertical lines and the plurality of horizontal lines, a first electronic document into which a table composed of the plurality of cells is inserted is generated.

In step S770 , each of the plurality of texts constitutes a table inserted into the first electronic document based on the text position information in the first scanned image for each of the plurality of texts. A document file for the first electronic document is created by inserting it into cells of .

In step S780, when the document file for the first electronic document is generated, the first cell in which the first text having the highest degree of similarity with the text preset to indicate the total amount of medical expenses among the plurality of texts is inserted After selection, at least one cell in which text indicating an amount is inserted among cells located in the same row and column as the first cell is checked, and among the checked at least one cell located closest to the first cell After selecting the second cell, the text inserted into the second cell is checked as information on the total amount of medical expenses.

In step S790, when the text inserted into the second cell is identified as information on the total amount of medical expenses, the first patient identifier, a document file for the first electronic document, and information on the confirmed total amount of medical expenses are combined They are stored in correspondence with each other in the information storage unit.

In this case, according to an embodiment of the present invention, in the method of operating the electronic device, the first patient identifier, the document file for the first electronic document, and information on the confirmed total amount of medical expenses are mutually transmitted to the composite information storage unit. After correspondingly stored, when a medical fee receipt search command based on the first patient identifier is applied from the manager, the document for the first electronic document stored in correspondence with the first patient identifier from the composite information storage unit After extracting the file and the information on the total amount of medical expenses, the document file for the first electronic document is executed to display the first electronic document on the screen, and at the same time, information on the confirmed total amount of medical expenses is displayed as the first electronic document. 1 The method may further include displaying the electronic document at a preset first point in a screen area where the electronic document is displayed.

In addition, according to an embodiment of the present invention, in step S730, while the first scan image and the first patient identifier are input from the manager, when an electronic document processing command for the first medical fee receipt is applied, the After dividing the first scan image into n horizontal and m vertical rectangular regions of the first size, for each of the rectangular regions, an average value of color values of a plurality of pixels constituting each of the rectangular regions and assigning a code of 1 to a rectangular region in which the average value of the color values of the plurality of pixels among the rectangular regions is included in the color value range, and to a rectangular region not included in the color value range. and binarizing the first scan image by assigning a code of 0 to the mxn image matrix.

In addition, according to an embodiment of the present invention, in step S750, a Hadamard product between the mxn image matrix and the mxn vertical filter matrix is calculated to generate an mxn first operation matrix, and the mxn image matrix and An mxn second operation matrix is generated by calculating the Hadamard product between the mxn horizontal line filter matrices, and then an OR operation is performed between the mxn first operation matrix and the mxn second operation matrix to perform a third operation matrix of mxn generating and in the first scan image, by identifying points corresponding to components to which a code of 1 is assigned among components constituting the mxn third operation matrix as regions constituting a line, the first The method may include detecting the plurality of vertical lines and the plurality of horizontal lines constituting the medical expenses detail table from a scan image.

In addition, according to an embodiment of the present invention, in step S770, based on the text position information in the first scan image for each of the plurality of texts, the 1 Calculating a text insertion point in an electronic document (the text insertion point refers to a point at which a position according to the text position information is calculated based on the upper leftmost point of the first electronic document) and the second 1 After checking a cell at a position corresponding to a text insertion point of each of the plurality of texts among the plurality of cells constituting a table inserted into an electronic document, each of the plurality of texts corresponds to a text insertion point of each text The method may include generating a document file for the first electronic document by inserting it into a cell at a location where the first electronic document is located.

In the above, a method of operating an electronic device according to an embodiment of the present invention has been described with reference to FIG. 7 . Here, since the method of operating the electronic device according to an embodiment of the present invention may correspond to the configuration of the operation of the electronic device 110 described with reference to FIGS. 1 to 6 , a more detailed description thereof will be omitted. do.

The method of operating an electronic device according to an embodiment of the present invention may be implemented as a computer program stored in a storage medium for execution through combination with a computer.

Also, the method of operating an electronic device according to an embodiment of the present invention may be implemented in the form of computer program instructions for execution through combination with a computer and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, in the present invention, specific matters such as specific components, etc., and limited embodiments and drawings have been described, but these are only provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , various modifications and variations are possible from these descriptions by those of ordinary skill in the art to which the present invention pertains.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and not only the claims to be described later, but also all those with equivalent or equivalent modifications to the claims will be said to belong to the scope of the spirit of the present invention. .

110: electronic device
111: complex information storage unit 112: color value storage unit
113: image matrix generation unit 114: text verification unit
115: line detection unit 116: electronic document generating unit
117: document file generation unit 118: total medical expenses confirmation unit
119: information storage processing unit 120: display unit
121: average value calculation unit 122: matrix generation processing unit
123: calculation unit 124: line detection processing unit
125: insertion point calculation unit 126: file generation processing unit

Claims (12)

Composite information storage in which a document file for a plurality of different patient identifiers, a medical fee receipt corresponding to each of the plurality of patient identifiers, and information on the total amount of medical expenses corresponding to each of the plurality of patient identifiers are stored in correspondence with each other wealth;
a color value storage unit storing a preset color value range as the color of the line constituting the table;
The first medical expense receipt printed on paper from the administrator - The first medical expense receipt is composed of a table format medical expenses history table in which text for medical expenses details is inserted - This scanned first scanned image and the first patient When an electronic document processing command for the first medical fee receipt is applied while the identifier is input, the first scanned image is n horizontally (n is a natural number greater than or equal to 2) and m vertical (m is a natural number greater than or equal to 2) dictionary of the first scan image. After dividing into rectangular regions of a set first size, a code of 1 is assigned to a rectangular region having a color corresponding to the color value range among the rectangular regions, and a code of 0 is assigned to the remaining regions. an image matrix generator generating an mxn image matrix by binarizing the first scan image;
After extracting a plurality of texts present in the first scanned image using an optical character reader (OCR), the plurality of texts and text position information in the first scanned image for each of the plurality of texts - a text confirmation unit for confirming that the text position information means information about a relative position of each text in the first scanned image with respect to the upper leftmost point of the first scanned image;
For the mxn image matrix, a preset mxn vertical line filter matrix for detecting vertical lines in a scanned image, wherein the mxn vertical line filter matrix comprises a preset plurality of columns constituting the mxn vertical line filter matrix. A component constituting the first columns is assigned a code of 1, and a component constituting the remaining columns is a matrix assigned a code of 0 - and a preset mxn horizontal line filter for detecting horizontal lines in the scanned image. Matrix - In the mxn horizontal line filter matrix, a code of 1 is assigned to a component constituting a plurality of preset first rows among a plurality of rows constituting the mxn horizontal line filter matrix, and a component constituting the remaining rows is 0 a line detection unit that detects a plurality of vertical lines and a plurality of horizontal lines constituting the medical expense details table from the first scan image by performing a matrix operation based on - that is a matrix to which a code of is assigned;
an electronic document generating unit generating a first electronic document into which a table composed of the plurality of cells is inserted after checking a plurality of cells generated by the plurality of vertical lines and the plurality of horizontal lines;
Based on the text position information in the first scanned image for each of the plurality of texts, each of the plurality of texts is inserted into the plurality of cells constituting a table inserted in the first electronic document, a document file generating unit generating a document file for the first electronic document;
When the document file for the first electronic document is generated, after selecting a first cell in which the first text having the highest degree of similarity with the text preset as indicating the total amount of medical expenses among the plurality of texts is inserted, Among the cells positioned in the same row and column as the first cell, at least one cell in which text indicating the amount is inserted is checked, and a second cell located closest to the first cell is selected from among the checked at least one cell. Then, a total amount of medical treatment check unit for checking the text inserted into the second cell as information about the total amount of medical expenses; and
When the text inserted into the second cell is identified as information on the total amount of medical expenses, the first patient identifier, the document file for the first electronic document, and information on the confirmed total amount of medical expenses are mutually transferred to the composite information storage unit Information storage processing unit to store in correspondence
An electronic device for electronically documenting a paper-printed medical bill receipt comprising a. According to claim 1,
After the information on the first patient identifier, the document file for the first electronic document, and the confirmed total amount of medical expenses by the information storage processing unit are stored in correspondence with each other in the complex information storage unit, the first patient from the manager When a medical expense receipt search command based on the identifier is applied, the document file for the first electronic document stored in correspondence with the first patient identifier and information on the confirmed total medical expenses are extracted from the complex information storage unit. Then, the first electronic document is displayed on the screen by executing the document file for the first electronic document, and at the same time, information on the confirmed total amount of medical expenses is displayed in the screen area where the first electronic document is displayed. 1 point display
An electronic device for electronically documenting a paper-printed medical bill receipt, further comprising a. According to claim 1,
The image matrix generator
While the first scan image and the first patient identifier are input from the manager, when an electronic document processing command for the first medical fee receipt is applied, the first scan image is displayed in n horizontal and m vertical sizes. an average value calculating unit that calculates an average value of color values of a plurality of pixels constituting each of the rectangular regions after dividing the rectangular regions; and
A code of 1 is assigned to a rectangular area in which the average value of the color values of the plurality of pixels among the rectangular areas is included in the color value range, and a code of 0 is assigned to a rectangular area not included in the color value range. A matrix generation processing unit for generating the mxn image matrix by binarizing the first scan image by allocating
An electronic device for electronically documenting a paper-printed medical bill receipt comprising a. According to claim 1,
The line detection unit
A Hadamard product between the mxn image matrix and the mxn vertical line filter matrix is calculated to generate an mxn first operation matrix, and the Hadamard product between the mxn image matrix and the mxn horizontal line filter matrix is calculated an arithmetic operation unit for generating an mxn second operation matrix and then performing an OR operation between the mxn first operation matrix and the mxn second operation matrix to generate a mxn third operation matrix; and
In the first scan image, by identifying points corresponding to the components to which the code of 1 is assigned among the components constituting the mxn third operation matrix as regions constituting the line, the medical expenses from the first scan image A line detection processing unit that detects the plurality of vertical lines and the plurality of horizontal lines constituting the history table
An electronic device for electronically documenting a paper-printed medical bill receipt comprising a. According to claim 1,
The document file generating unit
a text insertion point in the first electronic document for each of the plurality of texts, based on the text position information within the first scanned image for each of the plurality of texts, wherein the text insertion point is an insertion point calculating unit that calculates a point at which a location according to the text location information is calculated based on the upper leftmost point of the first electronic document; and
After checking a cell at a position corresponding to a text insertion point of each of the plurality of texts among the plurality of cells constituting the table inserted into the first electronic document, each of the plurality of texts is set as a text insertion point of each text A file generation processing unit for generating a document file for the first electronic document by inserting it into a cell at a position corresponding to
An electronic device for electronically documenting a paper-printed medical bill receipt comprising a. Composite information storage in which a document file for a plurality of different patient identifiers, a medical fee receipt corresponding to each of the plurality of patient identifiers, and information on the total amount of medical expenses corresponding to each of the plurality of patient identifiers are stored in correspondence with each other maintaining wealth;
maintaining a color value storage unit in which a color value range preset as a color of a line constituting a table is stored;
The first medical expense receipt printed on paper from the administrator - The first medical expense receipt is composed of a table format medical expenses history table in which text for medical expenses details is inserted - This scanned first scanned image and the first patient When an electronic document processing command for the first medical fee receipt is applied while the identifier is input, the first scanned image is n horizontally (n is a natural number greater than or equal to 2) and m vertical (m is a natural number greater than or equal to 2) dictionary of the first scan image. After dividing into rectangular regions of a set first size, a code of 1 is assigned to a rectangular region having a color corresponding to the color value range among the rectangular regions, and a code of 0 is assigned to the remaining regions. generating an mxn image matrix by binarizing the first scan image;
After extracting a plurality of texts present in the first scanned image using an optical character reader (OCR), the plurality of texts and text position information in the first scanned image for each of the plurality of texts - confirming that the text position information means information about a relative position of each text in the first scanned image with respect to the upper leftmost point of the first scanned image;
For the mxn image matrix, a preset mxn vertical line filter matrix for detecting vertical lines in a scanned image, wherein the mxn vertical line filter matrix comprises a preset plurality of columns constituting the mxn vertical line filter matrix. A component constituting the first columns is assigned a code of 1, and a component constituting the remaining columns is a matrix assigned a code of 0 - and a preset mxn horizontal line filter for detecting horizontal lines in the scanned image. Matrix - In the mxn horizontal line filter matrix, a code of 1 is assigned to a component constituting a plurality of preset first rows among a plurality of rows constituting the mxn horizontal line filter matrix, and a component constituting the remaining rows is 0 detecting a plurality of vertical lines and a plurality of horizontal lines constituting the medical expenses detail table from the first scan image by performing a matrix operation based on the matrix to which a code of is assigned;
generating a first electronic document into which a table composed of the plurality of cells is inserted after checking a plurality of cells generated by the plurality of vertical lines and the plurality of horizontal lines;
Based on the text position information in the first scanned image for each of the plurality of texts, each of the plurality of texts is inserted into the plurality of cells constituting a table inserted in the first electronic document, generating a document file for the first electronic document;
When a document file for the first electronic document is generated, after selecting a first cell in which the first text having the highest degree of similarity with the text preset to indicate the total amount of medical expenses among the plurality of texts is inserted, the second cell Among the cells located in the same row and column as the first cell, at least one cell in which text indicating the amount is inserted is checked, and a second cell located closest to the first cell is selected from among the checked at least one cell. thereafter, checking the text inserted into the second cell as information about the total amount of medical expenses; and
When the text inserted into the second cell is identified as information on the total amount of medical expenses, the first patient identifier, the document file for the first electronic document, and information on the confirmed total amount of medical expenses are mutually transferred to the composite information storage unit step to save
An operating method of an electronic device for electronically documenting a paper-printed medical bill receipt comprising a. 7. The method of claim 6,
After the first patient identifier and the document file for the first electronic document and information on the confirmed total amount of medical expenses are stored in correspondence with each other in the complex information storage unit, the medical expenses based on the first patient identifier from the manager When the receipt search command is applied, after extracting the document file for the first electronic document stored in correspondence with the first patient identifier and information on the confirmed total amount of medical expenses from the complex information storage unit, the first electronic Displaying the first electronic document on the screen by executing the document file for the document and simultaneously displaying information on the confirmed total medical expenses at a preset first point in the screen area where the first electronic document is displayed
An operating method of an electronic device for electronically processing medical expenses receipt printed on paper further comprising a. 7. The method of claim 6,
The step of generating the mxn image matrix is
While the first scan image and the first patient identifier are input from the manager, when an electronic document processing command for the first medical fee receipt is applied, the first scan image is displayed in n horizontal and m vertical sizes. calculating an average value of color values of a plurality of pixels constituting each of the rectangular regions after dividing the rectangular regions; and
A code of 1 is assigned to a rectangular area in which the average value of the color values of the plurality of pixels among the rectangular areas is included in the color value range, and a code of 0 is assigned to a rectangular area not included in the color value range. generating the mxn image matrix by binarizing the first scan image by assigning
An operating method of an electronic device for electronically documenting a paper-printed medical bill receipt comprising a. 7. The method of claim 6,
Detecting the plurality of vertical lines and the plurality of horizontal lines includes:
A Hadamard product between the mxn image matrix and the mxn vertical line filter matrix is calculated to generate an mxn first operation matrix, and the Hadamard product between the mxn image matrix and the mxn horizontal line filter matrix is calculated generating an mxn second operation matrix, and then performing an OR operation between the mxn first operation matrix and the mxn second operation matrix to generate a mxn third operation matrix; and
In the first scan image, by identifying points corresponding to the components to which the code of 1 is assigned among the components constituting the mxn third operation matrix as regions constituting the line, the medical expenses from the first scan image Detecting the plurality of vertical lines and the plurality of horizontal lines constituting the history table
An operating method of an electronic device for electronically documenting a paper-printed medical bill receipt comprising a. 7. The method of claim 6,
The step of generating a document file for the first electronic document includes:
a text insertion point in the first electronic document for each of the plurality of texts, based on the text position information within the first scanned image for each of the plurality of texts, wherein the text insertion point is calculating a point at which a location according to the text location information is calculated based on the upper leftmost point of the first electronic document; and
After checking a cell at a position corresponding to a text insertion point of each of the plurality of texts among the plurality of cells constituting the table inserted into the first electronic document, each of the plurality of texts is set as a text insertion point of each text generating a document file for the first electronic document by inserting it into a cell at a position corresponding to
An operating method of an electronic device for electronically documenting a paper-printed medical bill receipt comprising a. A computer-readable recording medium recording a computer program for executing the method of any one of claims 6 to 10 through combination with a computer. A computer program stored in a storage medium for executing the method of any one of claims 6 to 10 through combination with a computer.

Images