WO2008127443A1 - Image data extraction automation process - Google Patents

Image data extraction automation process Download PDF

Info

Publication number
WO2008127443A1
WO2008127443A1 PCT/US2007/085949 US2007085949W WO2008127443A1 WO 2008127443 A1 WO2008127443 A1 WO 2008127443A1 US 2007085949 W US2007085949 W US 2007085949W WO 2008127443 A1 WO2008127443 A1 WO 2008127443A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
text data
template
image
document
Prior art date
Application number
PCT/US2007/085949
Other languages
French (fr)
Inventor
George Kirvin Floyd
Original Assignee
Bank Of America Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank Of America Corporation filed Critical Bank Of America Corporation
Publication of WO2008127443A1 publication Critical patent/WO2008127443A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/1444Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Definitions

  • aspects of the disclosure relate to the automated and semi-automated processing of paper and/or optical documents. More specifically, aspects of the disclosure relate to techniques for use in retrieving data from documents.
  • EOB benefits
  • the EOB document can be a detailed document with a plurality of line items with sub-line items under them (and so on) itemizing the various components of a bill.
  • funds were manually matched up to their corresponding line items in an EOB document.
  • OCR optical character recognition
  • OCR optical character recognition
  • a method for receiving image data; retrieving (i.e., extracting) text data from the image data; selecting a template based on at least one predetermined criteria; using the template to match the text data to identifier fields; and formatting and sending the text data.
  • the predetermined criteria may be based on the source of the image data (e.g., check, explanation of benefits document, etc.) and/or based on the location of particular data on the image retrieved.
  • the text data retrieved from the image data may be updated using data management rules. For example, letters in the text data at particular locations in the image data may be converted to numbers depending on the template and identifier fields.
  • a remote data repository may be accessed to compare the accuracy of the text data against related documents.
  • a tangible computer-readable medium storing computer-executable instructions for causing a processor to perform various steps of methods disclosed herein.
  • a processor maybe located in a system performing one or more aspects of the invention.
  • a system comprising an optical character recognition component, a data storage unit, a template selection component, a data retrieval component, and scanner component.
  • Such a system may access a remote data repository to enhance the accuracy of character data retrieved through optical character recognition.
  • Figure 1 depicts an illustrative personal computing device with peripheral devices in accordance with various aspects of the invention
  • Figure 2 shows an illustrative operating environment for establishing communication between an image acquisition device and a remote computer (e.g., banking website server computer) in accordance with various aspects of the invention.
  • a remote computer e.g., banking website server computer
  • Figure 3 shows a flowchart illustrating a method in accordance with various aspects of the invention.
  • FIG. 1 An example of an illustrative personal computing system 100 in which various aspects and embodiments of the invention may be implemented is show in the simplified diagram in Figure 1. The features of such a device are well-known to those of skill in the art and need not be described at length here.
  • the illustrative system 100 is only one example of a suitable system and is not intended to suggest any limitation as to the scope of use or functionality of the invention.
  • Suitable computing environments for use with the invention include an image processing device 102 or system that support interaction with an input devices 122 (e.g., digital camera 128, document scanner 124, multi-function office device 126, etc.), output devices 118 (e.g., visual display 120), and communication connections 130 (e.g., Ethernet connection, IEEE 802.11, dial-up connection, etc.).
  • the communication connections 130 may be used to allow the image processing device 102 to communicate with other devices.
  • an image processing device 102 commonly includes a memory 106 and a processor 104 (e.g., an Intel microprocessor).
  • Programs comprising sets of instructions and associated data, may be stored in the memory 106, from which they can be retrieved and executed by the processing unit 103.
  • Programs and program modules stored in the memory 106 are those that comprise or are associated with an operating system 1 10 as well as application programs 112.
  • Application programs 112, such as a web browser application, Java runtime environment, and others, and an operating system 1 10 are commonly installed in an image processing device 102.
  • the memory 106 may also include a cache 106 to enhance device performance.
  • Computing system 100 includes forms of computer- readable media.
  • Computer-readable media include any available media that can be accessed by the image processing device 102.
  • Computer-readable media may comprise storage media and communication media.
  • Storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, object code, data structures, program modules, or other data.
  • Communication media include any information delivery media and typically embody data in a modulated data signal such as a carrier wave or other transport mechanism.
  • FIG. 2 depicts a simplified, illustrative operating environment for implementing various aspects and embodiments of the invention.
  • a network 210 e.g., Internet, LAN, WAN, wired network, wireless network.
  • Figure 2 depicts a simplified, illustrative operating environment for implementing various aspects and embodiments of the invention.
  • the illustrative operating environment in figure 2 is only one example of a suitable operating scenario and is not intended to suggest any limitation as to the scope of use or functionality of the invention.
  • the personal computing device 220 may be a conventional personal computer with computer software for performing manual character recognition (MCR).
  • MCR manual character recognition
  • the personal computing device 220 is a handheld device (e.g., a personal digital assistant such as a Treo or Blackberry)
  • a thin-client application is contemplated for use with the invention to enable MCR.
  • MCR may be used to develop and maintain templates associated with the processing and performing OCR on image files corresponding to documents (step 310).
  • the image processing device 102 may communicate over a network 210 with various devices and/or systems.
  • the image processing device 102 may communicate with a digital camera (reference 218, 128), multi- function office device (reference 216, 126), and/or document scanner 124.
  • An image processing device 102 comprising a memory and a processing unit may be used to receive an image of a document such as, for example, a check or an EOB (explanation of benefits) data sheet.
  • the image processing device's memory may store computer-executable instructions.
  • the image processing device 102 may be a farm of computers/servers for large-scale image processing.
  • the image processing functionalities may required extensive processing power that a farm of servers may be ideally equipped to handle.
  • the memory 106 of the image processing device 102 may also include computer- executable instructions that may be executed using a processing unit (e.g., processor 104) in the image processing device.
  • the computer-executable instructions may be used to perform a method.
  • the method may include the steps of retrieving templates based on, among other things, the source of the document and using automatic statistical analysis to enhance the accuracy of data and data groups retrieved from images of paper source documents.
  • the paper source documents may be processed by OCR software installed in the memory 106 of the image processing device 102 to produce associated text data.
  • a scanner device e.g., flatbed scanner 124) may optically scan an EOB document to generate an image file.
  • the text data produced by OCR software may be included in the image file of the paper source document or may be stored in a character data file associated with the image file.
  • a scanner device 124 may include a memory 214 for storing computer-executable instructions that may be executed using a processing unit (e.g., processor 212) to perform the various method steps disclosed herein, method.
  • the method described above may also include using information from the documents to determine their source, and select a template based on the determined source to utilize with each document.
  • a template selection component 202 in the image processing device 102 may be used to select the appropriate template for the document.
  • the method may include processing groups of documents and matching related documents for further processing.
  • the method may be used in a healthcare payment system where one set of document may include documents relating to the services received by patients including healthcare insurance coverage, costs, etc., such as, for example, EOB documents.
  • Another set of documents may include payment documents such as, for example, checks for payments by patients for healthcare services received by the patients.
  • the EOB documents may be matched with the payment documents.
  • the processing may be done in a parallel manner to maximize throughput.
  • parallel processing may be achieved by creating an expandable farm of process servers, all of which may perform one or more of the process steps, working from a single queue of input files.
  • Each process server in the farm may seek to process the oldest file in the queue utilizing First-In First-Out (FIFO) in conjunction with a file contention avoidance utility, which may ensure all files from the queue are processed in the quickest possible manner.
  • FIFO First-In First-Out
  • This may be beneficial in that it may allow scalability of the overall process by expansion of the number of computers in the process farm and may avoid a delay in processing due to one or more large time consuming files preventing other files from being processed if all processes were performed in a strictly serial manner.
  • an incoming document may not have a matching template in the system.
  • a template may contain information that allows the process to control the extraction of individual data elements from the text file output from the OCR process.
  • an EOB document may be provided by a healthcare insurance company for the first time.
  • a template may be created using manual character recognition (MCR), whereby source text data may have been verified manually to find where the data comes from in the source text data.
  • MCR manual character recognition
  • a template may indicate where information appears within the source text data, and its format such as, for example, the type of service provided to a patient, its format, which may be alphabetical characters, and its location, which may be by line and column numbers or with respect to a reference point in the data sheet.
  • the processes by which the statistical analysis is achieved may control all aspects of the fully automated template development process to include vertical drift of the location, where the patient name occasionally appears on line 4 or 6 in the above example, and where related data elements may be retrieved by measuring the offset from the patient name.
  • the source documents may be captured into image files (e.g., high quality image files, low quality image files, etc).
  • the image files may be routed in any manner including, for example, via a secure connection (such as FTP, VPN, etc.) to be received (step 302) at an image processing device 102.
  • Image files may then be processed through one or more optical character recognition (OCR) engines to retrieve or extract text data from the image files in step 305.
  • OCR optical character recognition
  • an appropriate template may be located based on predetermined criteria.
  • information extracted from the image files may be utilized to determine whether one or more criteria have been met for the appropriate template.
  • the template may be utilized to map the text data to data groups that can be stored in a standardized format (in step 313).
  • standardized formats include predetermined formats such as ANSI defined standard formats for the healthcare industry, extensible markup language (XML), and others.
  • the bank routing information sourcing from the financial institution lockbox process may be used to find the appropriate template that maps the OCR produced text data into data groups that can be stored in unique fields within a data file (xVAL).
  • the data file may be used to produce an ANSI, for example, or other related data file for import into a Patient Accounting System in a healthcare service system.
  • the criteria for selecting templates may correspond to the type of document being processed and/or may be selected based on the specific source of the document such as, for example, the healthcare insurance company or the bank issuing the payment.
  • the templates may be used to locate data groups within the text data.
  • the template may be used to match text data to identifier fields. This may be done by creating a record in the data file (xVAL) associated with the text data.
  • the text data may then be parsed using a "mask" on identifier key fields to evaluate each line of the text output to determine if the line is a likely start point for a top of line group or top of form.
  • the "mask” may evaluate attributes of the multiple key data field to determine if the data group on the OCR text extract is a new account on the EOB.
  • This process simulates the manual process of cutting out windows in a cardboard overlay where the key fields are expected to occur based on the statistically learned patters and passing it over the EOB form, wherein when moving the cardboard template over the form, the appearance of the data in the windows resembles what one would expect to find in the key fields of patient name, number, date of service, charges, etc.
  • the attributes of the data in the window may then look, for example, for numbers in the charges field, numbers with dashes or slashes in the date field, alphabetic characters in the name field and numbers (and characters, based on the provider numbering scheme) in the account number field, etc.
  • Identifier key fields may be, for example, information such as account number, name, date, amount being charged, amount paid, etc.
  • the line group identification process may be refined by utilizing masking filters.
  • the masking filters may be defined with character string attributes such as, for example, all numeric as is expected with account numbers and charges, or a specific number of characters as is expected with certain number like phone numbers or social security numbers. Another example of character string attributes may be containing slashes or dashes for dates.
  • This process of refining the line group identification may account for horizontal and vertical drift which allows for variances in the text pattern created by the OCR conversion of image to text data.
  • the OCR conversion of an image may shift a character string vertically or horizontally, which the process of refining the line group identification compensates for and as a result the character strings may be recognized accurately.
  • the retrieved templates may be used to identify individual data fields by using the row and column offset of each data item from a point of reference in the text data.
  • the data fields may then be used to get mapped into the data file (xVAL).
  • the reference point may be the upper left most data item in the image, which in the EOB format may be the account number.
  • a data retrieval component 204 in an image processing device 102 may be for receiving the character data (e.g., text data) and associating it with an appropriate field in the retrieved document template.
  • the data retrieval component 204 may be further configured to update the character data using data management rules (described below.)
  • the data management rules may be added to correct some errors of OCR such as, for example, converting "1" (the letter) to "1" (the number) in an all numeric field.
  • the key fields loaded into the data file may be used to identify corresponding documents.
  • the record from the provider may be identified from the sourced Master Patient Index (MPI) to match payment documents with the corresponding patient healthcare service documents.
  • MPI is the claim data and other data elements used by the provider to bill the payer, and may be stored in a remote data repository 208.
  • the MPI ultimately returned from the payer to the provider on the EOB may be used to enhance accuracy of the OCR. For example, this identification of corresponding documents may enable improvements on the OCR results to help it more accurately match when posting transactions.
  • the MPI may be fed through from the provider system periodically, for example, on daily basis.
  • the information of the MPI may be stored in a data storage unit 208 in communication with the image processing device 102.
  • the data storage unit 208 may also store document templates, image files, and/or statistical data used to enhance the accuracy of data and data groups retrieved from images of paper source documents.
  • This process of identifying corresponding documents may utilize, for example, the MPI, which may contain frequently updated source claims data and related codes, etc. Additionally, identifying corresponding documents may involve a "fuzzy match" process that allows selection of the best matching record from the MPI by weighting the accuracy of the match from all key fields.
  • the fuzzy match process may allow for near matches within a threshold determined acceptable by match rates as controlled in the templates. For example, account numbers are often long and contain many numbers, therefore, when one of the numbers is erroneously recognized, the erroneous number may not have a perfect match, but may be close to some numbers, and the "closeness" of the erroneous number may be quantified as to determine the best match.
  • the best match may be the number ending in 678 based on the match between the remaining digits of the numbers. This may be done using statistical analysis, which may determine the percentage of accuracy between the recognized character and the record from the MPI to select the character string with the highest match percentage and change it if there is no perfect match. Identifying corresponding documents may also pull other information from the MPI which are not on the source document, for example, the EOB. This other information may be, for example, the payer, insurance plan codes, etc. [32] Other data management rules may be applied to the text data (in step 311). For example, certain character strings may contain characters that may not be necessary, such as hyphens in account numbers.
  • Manual verification may also be utilized to provide further verification of the identification process.
  • a post export process may use the manually- verified output to the original and intermediate results from the OCR text data to determine the parameters in the templates. This process may determine significant statistical relationships of the MCR data to the original and intermediate results of the OCR data to measure where data elements fall on the form, for key fields and, once mapped, the other data elements; measure the patterns of field length, formatting, etc. to facilitate extraction and conversion; and measure how the compared to MPI data is effected.
  • the manually verified data and corresponding OCR text dumps are maintained in a data store from which statistical correlation used to automate template creation is performed.
  • the post export process may also utilize a template update cycle based on volumes from ongoing verified production data. Statistical patterns used in the templates may be adjusted as the underlying data adjusts, and the templates may be updated accordingly.
  • signals representing data or events as described herein may be transferred between a source and a destination in the form of electromagnetic waves traveling through signal-conducting media such as metal wires, optical fibers, and/or wireless transmission media (e.g., air and/or space).
  • signal-conducting media such as metal wires, optical fibers, and/or wireless transmission media (e.g., air and/or space).

Abstract

Healthcare providers, insurance providers, patients, others involved in the administration of healthcare services, and numerous others may obtain enhanced efficiency and benefit from automated and semi-automated processing of paper and/or optical documents. One aspect of the processing include a cognitive learn process for use in retrieving data from documents using templates. The templates may identify a mapping of textual data on a document with identifier fields, such as account number, patient name, insurance coverage, and others. Another aspect of the processing may include updating the textual data using data management rules. Yet another aspect of the processing may include accessing a remote data repository to enhance the accuracy of textual data retrieved using optical character recognition of image data.

Description

IMAGE DATA EXTRACTION AUTOMATION PROCESS
RELATED APPLICATION
[01] This application claims priority to U.S. Provisional Application No. 60/911,666 entitled "Cognitive Learn Process in Data Retrieval" which was filed on April 13, 2007, and which is herein incorporated by reference in its entirety.
[02] This application is related to U.S. Provisional Application No. 60/972,752, which was filed on September 15, 2007.
FIELD OF THE INVENTION
[03] Aspects of the disclosure relate to the automated and semi-automated processing of paper and/or optical documents. More specifically, aspects of the disclosure relate to techniques for use in retrieving data from documents.
BACKGROUND
[04] In the healthcare industry an explanation of benefits (EOB) document is commonly provided when a payer submits funds to a payee. The EOB document can be a detailed document with a plurality of line items with sub-line items under them (and so on) itemizing the various components of a bill. In the past, funds were manually matched up to their corresponding line items in an EOB document. As one can imagine, this process was slow and tedious. In an effort to improve this process, some processing facilities used optical character recognition (OCR) technology to optically scan images of EOB documents. The data from the image file of the EOB document could be extracted and assigned to the appropriate line items and corresponding funds.
[05] Although optical character recognition (OCR) technology is known in the art, there is a need in the art for enhancements to OCR capabilities that permit more accurate and automated processing of EOB documents. Generally, there exists a need for enhancements to OCR and OCR-related technology and tools to enhance the processing of OCR image files. BRIEF SUMMARY
[06] Aspects of the present disclosure address one or more of the issues mentioned above by disclosing systems, devices, and methods for a cognitive learn process in data retrieval. The following presents a simplified summary of the disclosure in order to provide a basic understanding of some aspects. It is not intended to identify key or critical elements of the invention or to delineate the scope of the invention. The following summary merely presents some concepts of the disclosure in a simplified form as a prelude to the more detailed description provided below.
[07] In one embodiment in accordance with various aspects of the invention, a method is disclosed for receiving image data; retrieving (i.e., extracting) text data from the image data; selecting a template based on at least one predetermined criteria; using the template to match the text data to identifier fields; and formatting and sending the text data. The predetermined criteria may be based on the source of the image data (e.g., check, explanation of benefits document, etc.) and/or based on the location of particular data on the image retrieved.
[08] In various embodiments, the text data retrieved from the image data may be updated using data management rules. For example, letters in the text data at particular locations in the image data may be converted to numbers depending on the template and identifier fields. In another example, a remote data repository may be accessed to compare the accuracy of the text data against related documents.
[09] Furthermore, a tangible computer-readable medium storing computer-executable instructions for causing a processor to perform various steps of methods disclosed herein. Such a processor maybe located in a system performing one or more aspects of the invention. For example, a system is disclosed comprising an optical character recognition component, a data storage unit, a template selection component, a data retrieval component, and scanner component. Such a system may access a remote data repository to enhance the accuracy of character data retrieved through optical character recognition. These and other embodiments of the invention will become apparent to one of ordinary skill in the art after review of the entirety disclosed herein. BRIEF DESCRIPTION OF THE DRAWINGS
The present disclosure is illustrated by way of example and not limited in the accompanying figures in which like reference numerals indicate similar elements and in
[11] Figure 1 depicts an illustrative personal computing device with peripheral devices in accordance with various aspects of the invention;
[12] Figure 2 shows an illustrative operating environment for establishing communication between an image acquisition device and a remote computer (e.g., banking website server computer) in accordance with various aspects of the invention; and
[13] Figure 3 shows a flowchart illustrating a method in accordance with various aspects of the invention.
DETAILED DESCRIPTION
[14] Healthcare providers, insurance providers, patients, others involved in the administration of healthcare services, and anyone that processes documents or electronic images of documents may benefit from one or more aspects of the embodiments disclosed herein. The features of the illustrative embodiments described herein contemplate additional other embodiments comprising one or more, or a combination thereof, of the aspects described throughout.
[15] An example of an illustrative personal computing system 100 in which various aspects and embodiments of the invention may be implemented is show in the simplified diagram in Figure 1. The features of such a device are well-known to those of skill in the art and need not be described at length here. The illustrative system 100 is only one example of a suitable system and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Suitable computing environments for use with the invention include an image processing device 102 or system that support interaction with an input devices 122 (e.g., digital camera 128, document scanner 124, multi-function office device 126, etc.), output devices 118 (e.g., visual display 120), and communication connections 130 (e.g., Ethernet connection, IEEE 802.11, dial-up connection, etc.). The communication connections 130 may be used to allow the image processing device 102 to communicate with other devices. With reference to Figure 1, an image processing device 102 commonly includes a memory 106 and a processor 104 (e.g., an Intel microprocessor).
[16] Programs, comprising sets of instructions and associated data, may be stored in the memory 106, from which they can be retrieved and executed by the processing unit 103. Among the programs and program modules stored in the memory 106 are those that comprise or are associated with an operating system 1 10 as well as application programs 112. Application programs 112, such as a web browser application, Java runtime environment, and others, and an operating system 1 10 are commonly installed in an image processing device 102. The memory 106 may also include a cache 106 to enhance device performance. Computing system 100 includes forms of computer- readable media. Computer-readable media include any available media that can be accessed by the image processing device 102. Computer-readable media may comprise storage media and communication media. Storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, object code, data structures, program modules, or other data. Communication media include any information delivery media and typically embody data in a modulated data signal such as a carrier wave or other transport mechanism.
[17] In accordance with various aspects of the invention, illustrated in Figure 2 is a personal computing device 220 in communication with an image processing device 102 over a network 210 (e.g., Internet, LAN, WAN, wired network, wireless network). Figure 2 depicts a simplified, illustrative operating environment for implementing various aspects and embodiments of the invention. The illustrative operating environment in figure 2 is only one example of a suitable operating scenario and is not intended to suggest any limitation as to the scope of use or functionality of the invention.
[18] The personal computing device 220 may be a conventional personal computer with computer software for performing manual character recognition (MCR). One skilled in the art will appreciate that in some embodiments where the personal computing device 220 is a handheld device (e.g., a personal digital assistant such as a Treo or Blackberry), a thin-client application is contemplated for use with the invention to enable MCR. As explained below, MCR may be used to develop and maintain templates associated with the processing and performing OCR on image files corresponding to documents (step 310).
[19] The image processing device 102 may communicate over a network 210 with various devices and/or systems. For example, the image processing device 102 may communicate with a digital camera (reference 218, 128), multi- function office device (reference 216, 126), and/or document scanner 124. An image processing device 102 comprising a memory and a processing unit may be used to receive an image of a document such as, for example, a check or an EOB (explanation of benefits) data sheet. The image processing device's memory may store computer-executable instructions. In various embodiments of the invention, the image processing device 102 may be a farm of computers/servers for large-scale image processing. One skilled in the art will appreciate that the image processing functionalities may required extensive processing power that a farm of servers may be ideally equipped to handle.
[20] The memory 106 of the image processing device 102 may also include computer- executable instructions that may be executed using a processing unit (e.g., processor 104) in the image processing device. The computer-executable instructions may be used to perform a method. The method may include the steps of retrieving templates based on, among other things, the source of the document and using automatic statistical analysis to enhance the accuracy of data and data groups retrieved from images of paper source documents. The paper source documents may be processed by OCR software installed in the memory 106 of the image processing device 102 to produce associated text data. In one embodiment in accordance with aspects of the invention, a scanner device (e.g., flatbed scanner 124) may optically scan an EOB document to generate an image file. The text data produced by OCR software (e.g., an OCR component of a system for processing a document) may be included in the image file of the paper source document or may be stored in a character data file associated with the image file. Such a scanner device 124 may include a memory 214 for storing computer-executable instructions that may be executed using a processing unit (e.g., processor 212) to perform the various method steps disclosed herein, method. [21] The method described above may also include using information from the documents to determine their source, and select a template based on the determined source to utilize with each document. In one embodiment, a template selection component 202 in the image processing device 102 may be used to select the appropriate template for the document. For example, if the document is determined to be a check, a template for the check may be retrieved, whereas another template for an EOB data sheet may be retrieved if the document is an EOB data sheet. In one embodiment of the invention, the method may include processing groups of documents and matching related documents for further processing. For example, the method may be used in a healthcare payment system where one set of document may include documents relating to the services received by patients including healthcare insurance coverage, costs, etc., such as, for example, EOB documents. Another set of documents may include payment documents such as, for example, checks for payments by patients for healthcare services received by the patients. Based on the information retrieved by the OCR, the EOB documents may be matched with the payment documents. The processing may be done in a parallel manner to maximize throughput.
[22] In an embodiment in accordance with aspects of the invention, parallel processing may be achieved by creating an expandable farm of process servers, all of which may perform one or more of the process steps, working from a single queue of input files. Each process server in the farm may seek to process the oldest file in the queue utilizing First-In First-Out (FIFO) in conjunction with a file contention avoidance utility, which may ensure all files from the queue are processed in the quickest possible manner. This may be beneficial in that it may allow scalability of the overall process by expansion of the number of computers in the process farm and may avoid a delay in processing due to one or more large time consuming files preventing other files from being processed if all processes were performed in a strictly serial manner.
[23] In an embodiment in accordance with aspects of the invention, an incoming document may not have a matching template in the system. A template may contain information that allows the process to control the extraction of individual data elements from the text file output from the OCR process. For example, an EOB document may be provided by a healthcare insurance company for the first time. A template may be created using manual character recognition (MCR), whereby source text data may have been verified manually to find where the data comes from in the source text data. For example, a template may indicate where information appears within the source text data, and its format such as, for example, the type of service provided to a patient, its format, which may be alphabetical characters, and its location, which may be by line and column numbers or with respect to a reference point in the data sheet. Once templates are initially created using MCR, statistical patterning of documents that utilize the same template may be utilized to continuously update the template to minimize erroneous character recognition.
[24] For example, if in a given template the first letter of the patient's name appears on line 5, column 7, but sometimes it appears on column 6 or 8, statistical patterning may indicate column 7 as the location of the first letter of the patient's name. If the first letter occasionally appears in column 6 in the same type of document, automatically- performed statistical analysis may adjust the template to allow for variances in the starting column position such that horizontal drift, which is common in OCR output, of the starting location will capture instances of where the patient name starts in column 6 as the location of the first letter of the patient's name. The statistical analysis may identify the mean and standard deviations of occurrences of the starting position. Additionally, the processes by which the statistical analysis is achieved, may control all aspects of the fully automated template development process to include vertical drift of the location, where the patient name occasionally appears on line 4 or 6 in the above example, and where related data elements may be retrieved by measuring the offset from the patient name.
[25] In another embodiment in accordance with aspects of the invention, a method for a computing machine to process images of paper source documents is illustrated is illustrated in Figure 3. In step 301, the source documents may be captured into image files (e.g., high quality image files, low quality image files, etc). The image files may be routed in any manner including, for example, via a secure connection (such as FTP, VPN, etc.) to be received (step 302) at an image processing device 102. Image files may then be processed through one or more optical character recognition (OCR) engines to retrieve or extract text data from the image files in step 305. In step 307, an appropriate template may be located based on predetermined criteria. In one example, information extracted from the image files may be utilized to determine whether one or more criteria have been met for the appropriate template. The template may be utilized to map the text data to data groups that can be stored in a standardized format (in step 313). Such standardized formats include predetermined formats such as ANSI defined standard formats for the healthcare industry, extensible markup language (XML), and others.
[26] For example, when a check is imaged and processed using OCR, the bank routing information sourcing from the financial institution lockbox process may be used to find the appropriate template that maps the OCR produced text data into data groups that can be stored in unique fields within a data file (xVAL). The data file may be used to produce an ANSI, for example, or other related data file for import into a Patient Accounting System in a healthcare service system. The criteria for selecting templates may correspond to the type of document being processed and/or may be selected based on the specific source of the document such as, for example, the healthcare insurance company or the bank issuing the payment.
[27] Referring still to Figure 3, in step 308, the templates may be used to locate data groups within the text data. For example, the template may be used to match text data to identifier fields. This may be done by creating a record in the data file (xVAL) associated with the text data. The text data may then be parsed using a "mask" on identifier key fields to evaluate each line of the text output to determine if the line is a likely start point for a top of line group or top of form. The "mask" may evaluate attributes of the multiple key data field to determine if the data group on the OCR text extract is a new account on the EOB. This process simulates the manual process of cutting out windows in a cardboard overlay where the key fields are expected to occur based on the statistically learned patters and passing it over the EOB form, wherein when moving the cardboard template over the form, the appearance of the data in the windows resembles what one would expect to find in the key fields of patient name, number, date of service, charges, etc. The attributes of the data in the window may then look, for example, for numbers in the charges field, numbers with dashes or slashes in the date field, alphabetic characters in the name field and numbers (and characters, based on the provider numbering scheme) in the account number field, etc.
[28] Healthcare EOB data sheets usually have multiple lines on the paper form to identify the full detail of payment information, in addition to other information regarding the patient and his/her condition and treatment, etc. Identifier key fields may be, for example, information such as account number, name, date, amount being charged, amount paid, etc. Using this process also allows filtering out non-account data. The line group identification process may be refined by utilizing masking filters. The masking filters may be defined with character string attributes such as, for example, all numeric as is expected with account numbers and charges, or a specific number of characters as is expected with certain number like phone numbers or social security numbers. Another example of character string attributes may be containing slashes or dashes for dates. This process of refining the line group identification may account for horizontal and vertical drift which allows for variances in the text pattern created by the OCR conversion of image to text data. For example, the OCR conversion of an image may shift a character string vertically or horizontally, which the process of refining the line group identification compensates for and as a result the character strings may be recognized accurately.
[29] The retrieved templates may be used to identify individual data fields by using the row and column offset of each data item from a point of reference in the text data. The data fields may then be used to get mapped into the data file (xVAL). For example, the reference point may be the upper left most data item in the image, which in the EOB format may be the account number. In one embodiment, a data retrieval component 204 in an image processing device 102 may be for receiving the character data (e.g., text data) and associating it with an appropriate field in the retrieved document template. The data retrieval component 204 may be further configured to update the character data using data management rules (described below.)
[30] In step 311, the data management rules may be added to correct some errors of OCR such as, for example, converting "1" (the letter) to "1" (the number) in an all numeric field. The key fields loaded into the data file may be used to identify corresponding documents. For example, the record from the provider may be identified from the sourced Master Patient Index (MPI) to match payment documents with the corresponding patient healthcare service documents. The MPI is the claim data and other data elements used by the provider to bill the payer, and may be stored in a remote data repository 208. The MPI ultimately returned from the payer to the provider on the EOB may be used to enhance accuracy of the OCR. For example, this identification of corresponding documents may enable improvements on the OCR results to help it more accurately match when posting transactions. The MPI may be fed through from the provider system periodically, for example, on daily basis. The information of the MPI may be stored in a data storage unit 208 in communication with the image processing device 102. The data storage unit 208 may also store document templates, image files, and/or statistical data used to enhance the accuracy of data and data groups retrieved from images of paper source documents.
[31] This process of identifying corresponding documents may utilize, for example, the MPI, which may contain frequently updated source claims data and related codes, etc. Additionally, identifying corresponding documents may involve a "fuzzy match" process that allows selection of the best matching record from the MPI by weighting the accuracy of the match from all key fields. The fuzzy match process may allow for near matches within a threshold determined acceptable by match rates as controlled in the templates. For example, account numbers are often long and contain many numbers, therefore, when one of the numbers is erroneously recognized, the erroneous number may not have a perfect match, but may be close to some numbers, and the "closeness" of the erroneous number may be quantified as to determine the best match. For a number ending in 678, for example, if the 7 is interpreted as a 2, and the recognized number therefore ends in 628 instead of 678, the best match may be the number ending in 678 based on the match between the remaining digits of the numbers. This may be done using statistical analysis, which may determine the percentage of accuracy between the recognized character and the record from the MPI to select the character string with the highest match percentage and change it if there is no perfect match. Identifying corresponding documents may also pull other information from the MPI which are not on the source document, for example, the EOB. This other information may be, for example, the payer, insurance plan codes, etc. [32] Other data management rules may be applied to the text data (in step 311). For example, certain character strings may contain characters that may not be necessary, such as hyphens in account numbers.
[33] Manual verification may also be utilized to provide further verification of the identification process. A post export process may use the manually- verified output to the original and intermediate results from the OCR text data to determine the parameters in the templates. This process may determine significant statistical relationships of the MCR data to the original and intermediate results of the OCR data to measure where data elements fall on the form, for key fields and, once mapped, the other data elements; measure the patterns of field length, formatting, etc. to facilitate extraction and conversion; and measure how the compared to MPI data is effected. In one example, the manually verified data and corresponding OCR text dumps are maintained in a data store from which statistical correlation used to automate template creation is performed. The post export process may also utilize a template update cycle based on volumes from ongoing verified production data. Statistical patterns used in the templates may be adjusted as the underlying data adjusts, and the templates may be updated accordingly.
[34] Although not required, one of ordinary skill in the art will appreciate that various aspects described herein may be embodied as a method, a data processing system, or as a computer-readable medium storing computer-executable instructions. For example, a computer-readable medium storing instructions to cause a processor in acomputing device to perform steps of a method in accordance with aspects of the disclosure is contemplated.
[35] In addition, various signals representing data or events as described herein may be transferred between a source and a destination in the form of electromagnetic waves traveling through signal-conducting media such as metal wires, optical fibers, and/or wireless transmission media (e.g., air and/or space).
[36] Aspects of the invention have been described in terms of illustrative embodiments thereof. The features of the embodiments described below contemplate other embodiments comprising one or more, or a combination thereof, of the aspects described throughout. Numerous other embodiments, modifications and variations within the scope and spirit of the appended claims will occur to persons of ordinary skill in the art from a review of this disclosure. For example, one of ordinary skill in the art will appreciate that the steps illustrated in the illustrative figures may be performed in other than the recited order, and that one or more steps illustrated may be optional in accordance with aspects of the disclosure.

Claims

I claim:
1. A method, comprising: receiving image data; retrieving text data from the image data; selecting a template from among a plurality of templates based on at least one predetermined criteria, where the template identifies a mapping of the text data to identifier fields and is based at least in part on patterns obtained through manual verification; matching the text data to the identifier fields using the template; and formatting the text data using a predetermined format.
2. The method of claim 1, where the predetermined criteria is based on at least a source of the image data.
3. The method of claim 2, where the source of the image data is an explanation of benefits document.
4. The method of claim 1, where the predetermined criteria is based on at least a location of the text data on an image corresponding to the image data.
5. The method of claim 4, where the image data includes data corresponding to an image of an explanation of benefits document, and where the identifier fields comprise payee name, insurance coverage, and amount being charged.
6. The method of claim 1, where the retrieving text data uses optical character recognition, the method further comprising: updating the text data using data management rules.
7. The method of claim 6, where the updating the text data includes converting a letter in the text data to a number if the text data matches to an identifier field consisting of all numeric data.
8. The method of claim 6, where the identifier fields comprise account number and payee name, and where the updating the text data includes accessing a remote data repository to compare accuracy of the text data against related documents.
9. The method of claim 8, where the related documents are patient healthcare service documents.
10. The method of claim 1, further comprising: generating a new template through manual character recognition if none of the plurality of templates meets the predetermined criteria to be selected.
11. A computer-readable medium storing computer-executable instructions for causing a processor to perform a method comprising: receiving image data; retrieving text data from the image data using optical character recognition; selecting a template from among a plurality of templates based on a predetermined criteria, where the template identifies a mapping of the text data to identifier fields; matching the text data to the identifier fields using the template; updating the text data using data management rules; formatting the text data into a predetermined format; and sending formatted text data.
12. The computer-readable medium of claim 11, where the predetermined criteria is based on at least a source of the image data being an explanation of benefits document.
13. The computer-readable medium of claim 12, where the identifier fields comprise account number, and where the updating the text data includes accessing a remote data repository to compare accuracy of the text data against healthcare documents.
14. The computer-readable medium of claim 11, where the updating the text data includes converting a number in the text data to a letter if the text data matches to an identifier field consisting of all non-numeric data.
15. A system, comprising: an optical character recognition component configured to perform optical character recognition on an image file to generate character data; a data storage unit storing document templates; a template selection component configured to select one of a plurality of templates; and a data retrieval component configured to receive the character data and associating the character data with an appropriate field in the document template.
16. The system of claim 15, where the image file corresponds to an electronic image of an explanation of benefits paper document.
17. The system of claim 16, further comprising: a scanner component for optically scanning a document corresponding to the image file.
18. The system of claim 15, where the data retrieval component is further configured to update the character data using data management rules.
19. The system of claim 18, where the updating includes converting a letter in the character data to a number if the character data matches to a field in the document template configured to correspond to all numeric characters.
20. The system of claim 15, where the data retrieval component is further configured to access a remote data repository to compare accuracy of the character data against related documents.
PCT/US2007/085949 2007-04-13 2007-11-29 Image data extraction automation process WO2008127443A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US91166607P 2007-04-13 2007-04-13
US60/911,666 2007-04-13

Publications (1)

Publication Number Publication Date
WO2008127443A1 true WO2008127443A1 (en) 2008-10-23

Family

ID=39056030

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/085949 WO2008127443A1 (en) 2007-04-13 2007-11-29 Image data extraction automation process

Country Status (1)

Country Link
WO (1) WO2008127443A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014153156A1 (en) * 2013-03-14 2014-09-25 Craven Jason System and method for converting paper forms to an electronic format
RU2634192C1 (en) * 2016-06-24 2017-10-24 Общество с ограниченной ответственностью "Аби Девелопмент" Data input from series of images applicable to template document
US10095925B1 (en) 2017-12-18 2018-10-09 Capital One Services, Llc Recognizing text in image data
US10140257B2 (en) 2013-08-02 2018-11-27 Symbol Technologies, Llc Method and apparatus for capturing and processing content from context sensitive documents on a mobile device
EP3518140A1 (en) * 2018-01-24 2019-07-31 Wistron Corporation Image data retrieving method and image data retrieving device
US10769362B2 (en) 2013-08-02 2020-09-08 Symbol Technologies, Llc Method and apparatus for capturing and extracting content from documents on a mobile device
DE102021208123A1 (en) 2021-07-28 2023-02-02 Siemens Healthcare Gmbh Computing device and method for validating information
CN116363677A (en) * 2023-03-28 2023-06-30 浙江海规技术有限公司 Identification card identification method and device under complex background, computer equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0407935A2 (en) * 1989-07-10 1991-01-16 Hitachi, Ltd. Document data processing apparatus using image data
US5642435A (en) * 1995-01-25 1997-06-24 Xerox Corporation Structured document processing with lexical classes as context
WO2003038735A1 (en) * 2001-10-31 2003-05-08 Call-Tell Llc Remote automatic reporting system and method
US7149347B1 (en) * 2000-03-02 2006-12-12 Science Applications International Corporation Machine learning of document templates for data extraction

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0407935A2 (en) * 1989-07-10 1991-01-16 Hitachi, Ltd. Document data processing apparatus using image data
US5642435A (en) * 1995-01-25 1997-06-24 Xerox Corporation Structured document processing with lexical classes as context
US7149347B1 (en) * 2000-03-02 2006-12-12 Science Applications International Corporation Machine learning of document templates for data extraction
WO2003038735A1 (en) * 2001-10-31 2003-05-08 Call-Tell Llc Remote automatic reporting system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LIEBOWITZ TAYLOR S ET AL: "EXTRACTION OF DATA FROM PREPRINTED FORMS", MACHINE VISION AND APPLICATIONS, SPRINGER VERLAG, DE, vol. 5, 1992, pages 211 - 222, XP000828275, ISSN: 0932-8092 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014153156A1 (en) * 2013-03-14 2014-09-25 Craven Jason System and method for converting paper forms to an electronic format
US10140257B2 (en) 2013-08-02 2018-11-27 Symbol Technologies, Llc Method and apparatus for capturing and processing content from context sensitive documents on a mobile device
US10769362B2 (en) 2013-08-02 2020-09-08 Symbol Technologies, Llc Method and apparatus for capturing and extracting content from documents on a mobile device
RU2634192C1 (en) * 2016-06-24 2017-10-24 Общество с ограниченной ответственностью "Аби Девелопмент" Data input from series of images applicable to template document
US10095925B1 (en) 2017-12-18 2018-10-09 Capital One Services, Llc Recognizing text in image data
US10943106B2 (en) 2017-12-18 2021-03-09 Capital One Services, Llc Recognizing text in image data
EP3518140A1 (en) * 2018-01-24 2019-07-31 Wistron Corporation Image data retrieving method and image data retrieving device
CN110119459A (en) * 2018-01-24 2019-08-13 纬创资通股份有限公司 Image data retrieval method and image data retrieving apparatus
US11017254B2 (en) 2018-01-24 2021-05-25 Wistron Corporation Image data retrieving method and image data retrieving device
DE102021208123A1 (en) 2021-07-28 2023-02-02 Siemens Healthcare Gmbh Computing device and method for validating information
CN116363677A (en) * 2023-03-28 2023-06-30 浙江海规技术有限公司 Identification card identification method and device under complex background, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
WO2008127443A1 (en) Image data extraction automation process
CN109858453B (en) Universal multi-engine bill identification system and method
US8233751B2 (en) Method and system for simplified recordkeeping including transcription and voting based verification
KR100368586B1 (en) Business form handling method and system for carrying out the same
US20180232204A1 (en) Intelligent data extraction
JP5090369B2 (en) Automated processing using remotely stored templates (method for processing forms, apparatus for processing forms)
US20070033118A1 (en) Document Scanning and Data Derivation Architecture.
US20050289182A1 (en) Document management system with enhanced intelligent document recognition capabilities
US20210366055A1 (en) Systems and methods for generating accurate transaction data and manipulation
US11501549B2 (en) Document processing using hybrid rule-based artificial intelligence (AI) mechanisms
EP2884425B1 (en) Method and system of extracting structured data from a document
WO2016186137A1 (en) Accounting assistance system
CN111191153A (en) Information technology consultation service display device
US20140177951A1 (en) Method, apparatus, and storage medium having computer executable instructions for processing of an electronic document
US20220121881A1 (en) Systems and methods for enabling relevant data to be extracted from a plurality of documents
CN111104853A (en) Image information input method and device, electronic equipment and storage medium
CN207037679U (en) A kind of system of quick scanning invoice information
EP3470993A1 (en) A method and system for click thru capability of electronic media
CN112699873A (en) Invoice data acquisition system and method based on OCR recognition
KR101809362B1 (en) Transaction Information Managing System using Optical Character Reader System and Computerized Transaction Information Managing Method using It
US20200285624A1 (en) Systems and method of managing documents
CN110378599A (en) Ranking method, system, equipment and the computer storage medium of accident prevention quality
CN115640952B (en) Method and system for importing and uploading data
US20230081511A1 (en) Systems and methods for improved payroll administration in a freelance workforce
US10664811B2 (en) Automated check encoding error resolution

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07854837

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07854837

Country of ref document: EP

Kind code of ref document: A1