AU2009233605B2 - Processing Engine - Google Patents
Processing Engine Download PDFInfo
- Publication number
- AU2009233605B2 AU2009233605B2 AU2009233605A AU2009233605A AU2009233605B2 AU 2009233605 B2 AU2009233605 B2 AU 2009233605B2 AU 2009233605 A AU2009233605 A AU 2009233605A AU 2009233605 A AU2009233605 A AU 2009233605A AU 2009233605 B2 AU2009233605 B2 AU 2009233605B2
- Authority
- AU
- Australia
- Prior art keywords
- data
- unstructured
- descriptor
- processing engine
- mappable
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000012545 processing Methods 0.000 title claims abstract description 36
- 230000008030 elimination Effects 0.000 claims abstract description 5
- 238000003379 elimination reaction Methods 0.000 claims abstract description 5
- 238000004891 communication Methods 0.000 claims description 2
- 230000004931 aggregating effect Effects 0.000 abstract description 3
- 238000001914 filtration Methods 0.000 abstract description 3
- 238000000034 method Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000013506 data mapping Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 238000013479 data entry Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- General Physics & Mathematics (AREA)
- Development Economics (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A processing engine which automatically "tags" (also 5 commonly referred to as "maps" or "allocates") information from an already existing financial database with newly created and defined function codes, groups or fields; thus identifying and populating new and usable ways of filtering and aggregating the financial database information. The o biggest advantages of this are elimination of time for manual creation; and also reliable and consistent treatment of these new populations thus significantly reducing errors. -4 PROCESSING ENGINE UNSTRUCTURED TRANSLATOR PARTLY STRUCTURED DATA TABLE DATA TABLE 18f 18f qnq MAP MAPPABLE -k-DATA UNSTRUCTURED DESCRIP-T-01 18 MANUAL DESCRIPTOR ALLOCATION ELEMENT$ STEP 17 - FULLY STRUCTURED F-- -- \14 DATA TABLE q1 q2 MAPPABLE DATA g13 DESCRIPTOR TABLE qn / Fig. 1
Description
PROCESSING ENGINE
The present invention relates to the processing and categorisation of large volumes of data and, more particularly but not exclusively to financial reporting data .
BACKGROUND
Computers are known for their ability to process large volumes of data. However, in the case where the data, or at least parts of it, is unstructured there can be difficulties in the computer recognising the information contained in the data and knowing how to handle it.
There are many instances in industry where unstructured data presents a processing problem to data processing devices. For example hccounting information in the form of trial balances from general ledger systems will present to a data processing system in an unstructured way and typically a different way depending on the general ledger system from which the data is derived.
It is an object of the present invention to address or at least ameliorate some of the above disadvantages.
Notes 1. The term "comprising" (and grammatical variations thereof) is used in this specification in the inclusive sense of "having" or "including", and not in the exclusive sense of "consisting only of". 2. The above discussion of the prior art in the Background of the invention, is not an admission that any information discussed therein is citable prior art or part of the common general knowledge of persons skilled in the art in any country.
BRIEF DESCRIPTION OF INVENTION
In a broad form the processing engine of a preferred embodiment of the present invention when applied to a financial database automatically "tags" (also commonly referred to as "maps" or "allocates") information from an already existing financial database with newly created and defined function codes, groups or fields; thus identifying and populating new and usable ways of filtering and aggregating the financial database information. The biggest advantages of this are elimination of time for manual creation; and also reliable and consistent treatment of .these new populations thus significantly reducing errors and wherein and wherein a unique code or alias comprising a financial reporting code selected from a graded code element set is used to identify individual elements in said at least one trial balance and in said at least one client disclosure document and in said financial reporting content thereby to reorder and re-present said elements in arranging said individual elements in an array together with descriptor elements and interposing said individual elements into said report.
Accordingly, in a further broad form of the present invention there is provided a processing engine for processing unstructured data located in an unstructured data table; said data comprising quantity data associated with an unstructured descriptor element; said engine comparing each said unstructured descriptor element against a master list of mappable data descriptors to create a single data description per entry; in the event of a match between an unstructured descriptor element and a mappable data descriptor in the mappable data descriptors list then quantity data associated with said unstructured data element is associated with the matching mappable data descriptor and copied into a partly structured data table and wherein a unique code or alias comprising a financial reporting code selected from a graded code element set is used to identify individual elements in said at least one trial balance and in said at least one client disclosure document and in said financial reporting content thereby to reorder and re-present said elements in arranging said individual elements in an array together with descriptor elements and interposing said individual elements into said report.
Preferably said partly structured data table is reviewed manually
Preferably those unstructured descriptor elements for which no match is available are manually reviewed and a manual match made so as to produce a fully structured data table from said partially structured data table.
Preferably those unstructured descriptor elements for which no match is available comprise less than 25 per cent of said unstructured data.
Preferably said unstructured data comprises accounting data.
Preferably the structured data table can be filtered and . aggregated by all data fields, including newly created data descriptions, thereby to provide new ways of viewing, summarising and disseminating data.
Preferably advantages of employing the processing engine are elimination of time for manual creation; and also reliable and consistent treatment of these new data descriptions thus significantly reducing errors.
In yet a further broad form of the invention there is provided a processing engine for processing unstructured data located in an unstructured data table in a computer memory; said data comprising quantity data associated with an unstructured descriptor element; said engine including a comparator which compares each said unstructured descriptor element against a master list of mappable data descriptors to create a single data description per entry; in the event of a match signal from said comparator indicating a match between an unstructured descriptor element and a mappable data descriptor in the mappable data descriptors list then quantity data associated with said unstructured data element is associated with the matching mappable data descriptor and copied into a partly structured data table in said computer memory.
Preferably said database and said comparator are implemented via a microprocessor in communication with a computer memory.
BRIEF DESCRIPTION OF DRAWINGS
Embodiments of the present invention will now be described with reference to the accompanying drawings wherein:
Figure 1, is a block diagram of dataflow through a processing engine in accordance with a first preferred embodiment of the present invention,
Figure 2, is a logic flow diagram of processing steps applied to data in accordance with the first embodiment,
Figure 3, illustrates data mapping for a particular instance of data,
Figure 4 is an example .of a fully structured data table,
Fig 5 illustrates a further example of the tagging process where translation is to a common descriptor base -in this case an XBRL common descriptor set,
Fig 6 is a simplified explanation in table form of an embodiment of the technology process showing how the Master Chart Of Accounts tag may be determined.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
With reference to Figure 1 there is illustrated a processing engine 10 in accordance with a first preferred embodiment of the present invention. In this instance the processing engine 10 comprises a translator 11 which receives input from comparator 12. The comparator 12 receives and compares data in unstructured data table 13 and mappable data descriptor table 14. The output of translator 11 is input to partly structured table 15. A manual processing operation is then applied to table 15, the output of which results in a fully structured data table 16.
With reference to Figure 2 a logic flow diagram is provided for processing steps applied to data passing through the processing engine of Figure 1 wherein, in this instance, the data relates to trial balance data. In this instance the processing engine is termed the "autoallocator" in Figure 2. FRS AutoAllocator - outline
Using the FRS AutoAllocator (part of the FRS Process) , we can define the process as:
Importing Trial Balances from any General Ledger system and the FRS System (part of the FRS Process) automatically knows what Master Chart Of Account Allocation (based on data input from the International Financial Reporting Standards) to give it.
For example it would recognise: GL Account Name Master Chart
Till floats as Cash on hand
Westpac account as Cash at bank
Figure 3 illustrates data mapping in the instance where data is trial balance data and comprises a listing of unstructured descriptor elements 17 and a corresponding listing of mappable data descriptors 18. So, for example, unstructured descriptor element 17Δ comprising the descriptor "till floats" maps to a matched mappable data descriptor 18a being descriptor "cash on hand."
In summary the processing engine automatically "tags" (also commonly referred to as "maps" or "allocates") information from an already existing financial database with newly created and defined fgnction codes, groups or fields; thus identifying and populating new and usable ways of filtering and aggregating the financial database information. The biggest advantages of this are elimination of time for manual creation; and also reliable and consistent treatment of .these new populations thus significantly reducing errors .
Explanation of tagging process
The "tagging" (also commonly referred to as "mapping" or "allocating") process uses elements of existing financial database fields (such as the general ledger code, account name / description or balance) to predict a new field (such as a Master Chart of Accounts category or XBRL Value) using, amongst other describable processes, a matrix and array linear pattern. The technology also contains an inbuilt validation process, largely centred around the GL Code (with ranges input to match the current GL, which varies from system to system) and the GL Balance.
The tagging process is instantaneous - once you import the financial database (e.g. the trial balance), the new function codes (e.g. Master Chart of Accounts) appears immediately.
Fig 5 illustrates a further example of the tagging process where translation is to a common descriptor base - in this case an XBRL common descriptor set.
Fig 6 is a simplified explanation of the technology process as to how it determines the Master Chart Of Accounts tag.
In Use
With reference to Figure 4 a fully structured data table 16 is illustrated with reference to a particular example. In this instance the unstructured descriptor "Westpac account" is associated with quantity ql. It is mapped by way of the table of Figure 3 to descriptor "cash at bank" associated with quantity ql. Similarly, the descriptor "trade debtors" is initially associated with quantity q2 and is mapped to be associated with descriptor "trade receivables ."
In the case of the descriptor "special advance" there is no mapping available from the table of Figure 3 so, initially, no mapping takes place in the creation of the partially structured data table. The manual data entry step is then performed whereby the descriptor "special advance" is mapped to "other receivables" and remains associated with quantity qn.
Having produced the fully structured data table the structured data can then have accounting principles applied to it in an automated fashion. It will be appreciated that the more comprehensive the mappable data descriptor table 14 the smaller the amount of manual allocation will be as a proportion of total amount of data processed thereby resulting in the potential for relatively rapid processing of large volumes of data presenting as unstructured data from disparate sources .
The above describes only some embodiments of the present invention' and modifications, obvious to those skilled in the art, can be made thereto without departing from the scope of the present invention.
Claims (8)
1. A processing engine for processing unstructured data located in an unstructured data table; said data comprising quantity data associated with an unstructured descriptor element; said engine comparing each said unstructured descriptor element against a master list of mappable data descriptors to create a single data description per entry; in the event of a match between an unstructured descriptor element and a mappable data descriptor in the mappable data descriptors list then quantity data associated with said unstructured data element is associated with the matching mappable data descriptor and copied into a partly structured data table and wherein a unique code or alias comprising a financial reporting code selected from a graded code element set is used to identify individual elements in said at least one trial balance and in said at least one client disclosure document and in said financial reporting content thereby to reorder and re-present said elements in arranging said individual elements in an array together with descriptor elements and interposing said individual elements into said report.
2. The processing engine of claim 1 wherein said partly structured data table is reviewed manually.
3. The processing engine of claim 2 wherein those unstructured descriptor elements for which no match is available are manually reviewed and a manual match made so as to produce a fully structured data table from said partially structured data table.
4. The processing engine of claim 3 wherein those unstructured descriptor elements for which no match is available comprise less than 25 per cent of said unstructured data.
5. The processing engine of claim 3 wherein said unstructured data comprises accounting data.
6. The processing engine of any previous claim wherein the structured data table can be filtered and aggregated by all data fields, including newly created data descriptions, thereby to provide new ways of viewing, summarising and disseminating data. 7 The processing engine of any previous claim wherein advantages of employing the processing engine are elimination of time for manual creation; and also reliable and consistent treatment of these new data descriptions thus significantly reducing errors.
8. A processing engine for processing unstructured data located in an unstructured data table in a computer memory; said data comprising quantity data associated with an unstructured descriptor element; said engine including a comparator which compares each said unstructured descriptor element against a master list of mappable data descriptors to create a single data description per entry; in the event of a match signal from said comparator indicating a match between an unstructured descriptor element and a mappable data descriptor in the mappable data descriptors list then quantity data associated with said unstructured data element is associated with the matching mappable data descriptor and copied into a partly structured data table in said computer memory and wherein a unique code or alias comprising a financial reporting code selected from a graded code element set is used to identify individual elements in said at least one trial balance and in said at least one client disclosure document and in said financial reporting content thereby to reorder and re-present said elements in arranging said individual elements in an array together with descriptor elements and interposing said individual elements into said report.
9. The processing engine of any previous claim wherein said database and said comparator are implemented via a microprocessor in communication with a computer memory.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2009233605A AU2009233605B2 (en) | 2009-10-30 | 2009-10-30 | Processing Engine |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2009233605A AU2009233605B2 (en) | 2009-10-30 | 2009-10-30 | Processing Engine |
Publications (2)
Publication Number | Publication Date |
---|---|
AU2009233605A1 AU2009233605A1 (en) | 2011-05-19 |
AU2009233605B2 true AU2009233605B2 (en) | 2016-06-23 |
Family
ID=44012659
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
AU2009233605A Ceased AU2009233605B2 (en) | 2009-10-30 | 2009-10-30 | Processing Engine |
Country Status (1)
Country | Link |
---|---|
AU (1) | AU2009233605B2 (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040186826A1 (en) * | 2003-03-21 | 2004-09-23 | International Business Machines Corporation | Real-time aggregation of unstructured data into structured data for SQL processing by a relational database engine |
US20050108212A1 (en) * | 2003-11-18 | 2005-05-19 | Oracle International Corporation | Method of and system for searching unstructured data stored in a database |
US20070011134A1 (en) * | 2005-07-05 | 2007-01-11 | Justin Langseth | System and method of making unstructured data available to structured data analysis tools |
US20090254510A1 (en) * | 2006-07-27 | 2009-10-08 | Nosa Omoigui | Information nervous system |
-
2009
- 2009-10-30 AU AU2009233605A patent/AU2009233605B2/en not_active Ceased
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040186826A1 (en) * | 2003-03-21 | 2004-09-23 | International Business Machines Corporation | Real-time aggregation of unstructured data into structured data for SQL processing by a relational database engine |
US20050108212A1 (en) * | 2003-11-18 | 2005-05-19 | Oracle International Corporation | Method of and system for searching unstructured data stored in a database |
US20070011134A1 (en) * | 2005-07-05 | 2007-01-11 | Justin Langseth | System and method of making unstructured data available to structured data analysis tools |
US20090254510A1 (en) * | 2006-07-27 | 2009-10-08 | Nosa Omoigui | Information nervous system |
Also Published As
Publication number | Publication date |
---|---|
AU2009233605A1 (en) | 2011-05-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9280569B2 (en) | Schema matching for data migration | |
CN116205724A (en) | Large scale heterogeneous data ingestion and user resolution | |
US7624113B2 (en) | Data element naming system and method | |
CN107909493B (en) | Policy information processing method and device, computer equipment and storage medium | |
CN112882699B (en) | Service processing method, device, equipment and medium based on flow configuration engine | |
CN103428080A (en) | Data unpacking and data packing method | |
CN112418798A (en) | Information auditing method and device, electronic equipment and storage medium | |
CN111562965A (en) | Page data verification method and device based on decision tree | |
CN111986039A (en) | Claims wind control identification method and device, computer equipment and readable storage medium | |
CN112949278A (en) | Data checking method and device, electronic equipment and readable storage medium | |
CN110019774B (en) | Label distribution method, device, storage medium and electronic device | |
CN114840531A (en) | Data model reconstruction method, device, equipment and medium based on blood relationship | |
CN105389346A (en) | Bidding clearing method and apparatus in electronic bidding evaluation system | |
CN111159183A (en) | Report generation method, electronic device and computer readable storage medium | |
WO2022048362A1 (en) | Data storage method and apparatus, electronic device, and storage medium | |
AU2009233605B2 (en) | Processing Engine | |
US10042902B2 (en) | Business rules influenced quasi-cubes with higher diligence of data optimization | |
CN110008264B (en) | Data acquisition method and device of cost accounting system | |
US20200082474A1 (en) | Management information system, method, and program | |
WO2012083336A1 (en) | Processing engine | |
CN110648219B (en) | Method and device for standardizing input area of bank transaction system | |
CN112286936A (en) | Account checking method, system and related equipment | |
CN110728121A (en) | Data import system and method for realizing zero development based on existing interface | |
CN116167852B (en) | Method and device for processing fund flow direction data | |
CN113901125B (en) | Data display method and device, storage medium and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FGA | Letters patent sealed or granted (standard patent) | ||
MK14 | Patent ceased section 143(a) (annual fees not paid) or expired |