CN113902402A - Document auxiliary filling method, system, storage medium and device based on AR technology - Google Patents
Document auxiliary filling method, system, storage medium and device based on AR technology Download PDFInfo
- Publication number
- CN113902402A CN113902402A CN202111143325.1A CN202111143325A CN113902402A CN 113902402 A CN113902402 A CN 113902402A CN 202111143325 A CN202111143325 A CN 202111143325A CN 113902402 A CN113902402 A CN 113902402A
- Authority
- CN
- China
- Prior art keywords
- document
- identification
- bill
- area
- template
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/186—Templates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/018—Certifying business or products
- G06Q30/0185—Product, service or business identity fraud
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- Human Resources & Organizations (AREA)
- General Physics & Mathematics (AREA)
- Marketing (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Accounting & Taxation (AREA)
- Data Mining & Analysis (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Finance (AREA)
- Development Economics (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a bill auxiliary filling method, a bill auxiliary filling system, a storage medium and a bill auxiliary filling device based on AR technology, wherein the method is based on an AR terminal and comprises the steps of inputting an electronic version bill picture or a bill scanning corrected picture, and creating a bill template; marking a region needing data identification on the document template picture, numbering and recording coordinates; editing a plurality of numerical calculation formulas by using the data identification area numbers; and the user who fills the document switches the system to an auxiliary filling work mode, uses a handwritten document numerical value information identification and error detection method to shoot a document image through the AR terminal camera, and displays the identification numerical value of the identification area and the calculation result of the check area on the AR terminal in real time. The method is characterized by comprising the following steps of filling in documents based on AR technology in an auxiliary mode, automatically calculating according to a formula, checking document numerical values based on the AR technology, automatically calculating according to the formula and marking errors; the invention can be operated on all AR terminals, is convenient and flexible, avoids errors and has strong real-time performance.
Description
Technical Field
The invention relates to the technical field of digital identification, in particular to a document auxiliary filling method, a document auxiliary filling system, a document auxiliary filling storage medium and a document auxiliary filling device based on an AR technology.
Background
At present, manual filling of paper documents is still the main mode adopted by most enterprises for expense reimbursement, staff who frequently buy and go out spend much time on filling reimbursement documents each month, and financial staff also spend much time checking whether documents are correctly filled. The existing bill recognition technology and the handwritten number recognition technology cannot assist workers in filling and checking bills.
In the prior art, such as CN 113240188A-augmented reality AR-based form filling processing method and device, the technical scheme is only suitable for a bank scene, projection AR is used, expansibility is poor, a form filling template can only be displayed functionally, and formula calculation and checking functions are not provided.
Description of related art:
AR technology: the augmented reality technology is a technology for calculating the position and angle of a camera image in real time and adding a corresponding image, and is characterized in that a virtual world is sleeved on a real world on a screen to interact, so that the real world can be more vividly and specifically displayed. The hardware carrier of the AR technology can be terminal equipment such as a smart phone, AR glasses, an AR head display, an AR projection and the like.
Disclosure of Invention
The document auxiliary filling method based on the AR technology can assist workers in filling and checking documents, and brings great convenience and efficiency improvement for filling and checking handwritten documents.
In order to achieve the purpose, the invention adopts the following technical scheme:
a bill auxiliary filling method based on AR technology comprises an AR terminal, and is characterized in that: including a document template creation process and an auxiliary filling process,
the document template establishing process comprises the steps of establishing a document template by using an input electronic version document picture or a document scanning corrected picture; marking a region needing data identification on the document template picture, numbering and recording coordinates; editing a plurality of numerical calculation formulas by using the data identification area numbers;
the auxiliary filling process comprises the steps that a user who fills in the document switches the system to an auxiliary filling work mode, when filling in the form, a document image shot by an AR terminal camera uses a handwritten document numerical value information identification and error detection method, and the identification numerical value of an identification area and the calculation result of a check area are displayed on the AR terminal in real time.
The method comprises the steps that a document auditing staff switches a system to a document auditing work mode, a document image shot by an AR terminal camera uses a handwritten document numerical value information identification and error detection method, identification numerical values of an identification area and calculation results of a verification area are displayed on the AR terminal in real time, and an error marking area is marked; and judging the area marked with signature authentication by using a signature authentication AI model, and displaying the signature confidence coefficient on the corresponding position of the AR terminal.
Further, the handwritten bill value information identification and error detection method comprises the following steps:
scanning or photographing the handwritten bill to obtain a bill image to be identified;
extracting characteristic points of a bill image to be recognized, matching the characteristic points with preset bill template characteristic points, and determining a bill template with the highest characteristic point matching number;
calculating a homography transformation matrix by using the feature point matching result, and correcting the bill image to be recognized by using homography transformation to obtain a corrected image which has the same width and height as the bill template and is close to the coordinate position;
segmenting the corresponding area of the corrected image according to the identification area coordinate of the bill template with the highest feature point matching number;
performing handwritten character recognition on the segmented area image to obtain a recognition result;
verifying the recognition results one by one according to a calculation formula preset by the template;
when only one group of results enables the calculation formula to be established, outputting the group of results as a recognition result; and when all the recognition results can not make the calculation formula be satisfied, or when a plurality of groups of results can make the calculation formula be satisfied, the result with the maximum confidence level is taken as the recognition result to be output, and when all the recognition results can not make the calculation formula be satisfied, the filling error is judged.
Further, the preset template setting step is as follows:
acquiring an electronic version picture of a bill as a template picture, or replacing the electronic version picture with a picture scanned and corrected by a blank paper bill;
marking a handwritten number identification area on the picture, numbering the identification area and acquiring corresponding identification area coordinate information;
defining a corresponding calculation formula by using the region number logic according to the service scene;
and extracting the characteristic points of the template picture and storing the characteristic points into a characteristic point data file.
On the other hand, the invention also discloses a document auxiliary filling system based on the AR technology, the system runs on the AR terminal or the smart phone connected with the AR terminal, and comprises the following modules:
the document template creating module is used for inputting an electronic version document picture or a document scanning corrected picture and creating a document template;
the identification area marking module marks an area needing data identification on the document template picture, and carries out numbering and coordinate recording;
the calculation formula editing module is used for editing a plurality of numerical calculation formulas by using the data identification area numbers, and the formula editing supports operations of addition, subtraction, multiplication, division and parenthesis;
the signature area marking module marks an area needing signature authentication on the document template picture and records coordinates;
the user interaction module provides a button or gesture interaction function and comprises an opening/stopping auxiliary filling mode and an opening/stopping document checking mode;
the image input module is used for acquiring document images shot by the AR terminal camera;
the result display module is used for calculating the corresponding display position of each identification area on the AR terminal and displaying the identification value and the calculation result; and under the document checking working mode, additionally marking an error marking area and displaying a signature authentication result.
Further, the system also comprises an identification and error detection module;
the identification and error detection module is used for acquiring an output result by using a handwritten bill numerical value information identification and error detection method for the bill image shot by the AR terminal camera, wherein the output result comprises identification numerical values of all identification areas, a calculation result of the check area and an error mark with the calculation numerical value inconsistent with the identification numerical value.
Further, the system also comprises a capitalization conversion module;
the capitalization conversion module is used for converting the calculation result into Chinese capitalization to output for the area with the output format of Chinese capitalization.
Further, the system also comprises a signature authentication module;
and the signature authentication module is used for judging the area marked with signature authentication by using a signature authentication AI model under the bill checking working mode to obtain signature confidence coefficient output.
In yet another aspect, the present invention also discloses a computer readable storage medium storing a computer program, which when executed by a processor causes the processor to perform the steps of the method as described above.
In yet another aspect, the present invention also discloses a computer device comprising a memory and a processor, the memory storing a computer program, the computer program, when executed by the processor, causing the processor to perform the steps of the method as described above.
According to the technical scheme, the bill auxiliary filling method based on the AR technology automatically calculates according to the formula through bill auxiliary filling based on the AR technology, checks the bill value based on the AR technology, automatically calculates according to the formula and marks errors; the invention can be operated on all AR terminals, and the recommended AR terminal is AR glasses connected with the smart phone.
The invention has the following advantages:
1. is convenient and flexible: the intelligent mobile phone or AR glasses can be used for carrying out document auxiliary filling and checking, and a manual pressing calculator is omitted;
2. avoiding errors: the method avoids the filling errors caused by the wrong recording of the calculation formula, the wrong press key of the calculator and the manual copying errors, so as to cause the re-filling of the document;
3. the real-time performance is strong: the calculation result and the error position can be displayed in real time, and the efficiency is extremely high.
Drawings
FIG. 1 is a flow chart of a method of the present invention;
FIG. 2 is a reference image of a document image to be recognized according to an embodiment of the present invention;
FIG. 3 is a corrected image reference of an embodiment of the present invention;
FIG. 4 is a system block diagram of an example of the present invention;
fig. 5 is a schematic diagram of region labeling performed on a template according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention.
As shown in fig. 1, the document auxiliary filling method based on the AR technology in this embodiment includes the following steps:
installing the document auxiliary filling and checking system provided by the invention by using an AR terminal or a smart phone or a PC connected with the AR terminal;
document template creating process: using an input electronic edition document picture or a document scanning corrected picture to create a document template; marking a region needing data identification on a document template picture, numbering and recording coordinates; editing a plurality of numerical calculation formulas by using the data identification area numbers;
auxiliary filling process: the user who fills in the document switches the system to an auxiliary filling work mode, when filling in the form, the document image shot by the AR terminal camera uses a handwritten document numerical value information identification and error detection method to display the identification numerical value of the identification area and the calculation result of the check area on the AR terminal in real time;
and (3) document checking flow: the document auditor switches the system to a document checking working mode, the document image shot by the AR terminal camera uses a handwritten document numerical value information identification and error detection method, the identification numerical value of the identification area and the calculation result of the checking area are displayed on the AR terminal in real time, and an error marking area is marked; and judging the area marked with signature authentication by using a signature authentication AI model, and displaying the signature confidence coefficient on the corresponding position of the AR terminal.
The handwritten bill numerical value information identification and error detection method specifically comprises the following steps:
scanning or photographing the handwritten bill to obtain a bill image to be identified;
extracting characteristic points of a bill image to be recognized, matching the characteristic points with preset bill template characteristic points, and determining a bill template with the highest characteristic point matching number;
calculating a homography transformation matrix by using the feature point matching result, and correcting the bill image to be recognized by using homography transformation to obtain a corrected image which has the same width and height as the bill template and is close to the coordinate position;
segmenting the corresponding area of the corrected image according to the identification area coordinate of the bill template with the highest feature point matching number;
performing handwritten character recognition on the segmented area image to obtain a recognition result;
verifying the recognition results one by one according to a calculation formula preset by the template;
when only one group of results enables the calculation formula to be established, outputting the group of results as a recognition result; and when all the recognition results can not make the calculation formula be satisfied, or when a plurality of groups of results can make the calculation formula be satisfied, the result with the maximum confidence level is taken as the recognition result to be output, and when all the recognition results can not make the calculation formula be satisfied, the filling error is judged.
The preset template setting method comprises the following steps of:
acquiring an electronic version picture of a bill as a template picture, or replacing the electronic version picture with a picture scanned and corrected by a blank paper bill;
marking a handwritten number identification area on the picture, numbering the identification area and acquiring corresponding identification area coordinate information;
defining a corresponding calculation formula by using the region number logic according to the service scene;
and extracting the characteristic points of the template picture and storing the characteristic points into a characteristic point data file.
Specifically, the main steps of the bill identification and inspection stage are as follows:
scanning or photographing the handwritten bill to obtain a bill image to be identified;
extracting feature points of the bill image to be identified, traversing the feature point data files of all the templates for feature point matching, and determining the bill image with the highest feature point matching number as the current bill template;
calculating a homography transformation matrix by using the characteristic point matching result, and correcting the bill image to be recognized by using homography transformation to obtain a corrected image (shown in figures 2 and 3) which has the same width and height as the template image and is close to the coordinate position:
sequentially using the coordinates of the identification areas to segment the corresponding areas of the corrected image, and performing certain degree of outward expansion on the area coordinates in consideration of the fact that the handwritten numbers exceed the selected identification areas;
the invention adopts an artificial intelligent handwritten digit recognition model trained based on MNIST handwritten digit data set, and the accuracy rate of recognizing handwritten digits is far higher than that of a general OCR model; all recognition results of each area exceeding the confidence threshold value are reserved;
verifying the identification results one by one according to the calculation formula, and outputting the group of results as the identification results when only one group of results enables the calculation formula to be established; when all the recognition results can not enable the calculation formula to be established or when a plurality of groups of results can enable the calculation formula to be established, the result with the maximum confidence level is taken as the recognition result to be output, and when all the recognition results can not enable the calculation formula to be established, the filling error is judged; the principle is as follows: for example, the possible recognition results of A are 16 and 10, the possible recognition results of B are 7 and 9, the possible recognition results of C are 23 and 73, and the template defines the formula: if C is a + B, the extraction result according with the calculation logic is: a is 16, B is 7 and C is 23.
And when all the recognition results can not enable the formula to be satisfied, checking out filling errors, and outputting a filling error prompt and the recognition results of the relevant areas.
And returning the verified area number and the identification value thereof.
The following describes a document auxiliary filling system based on AR technology with reference to fig. 4:
the system runs on an AR terminal or a smart phone connected with the AR terminal, and comprises the following modules:
the document template creating module: the document template is used for inputting an electronic version document picture or a document scanning corrected picture and creating a document template;
an identification area labeling module: marking a region needing data identification on a document template picture, numbering and recording coordinates;
a calculation formula editing module: a plurality of numerical calculation formulas are edited using the data identification area number, the formula editing supporting addition, subtraction, multiplication, division, and parenthesis operations, for example (as shown in fig. 5):
equation 1: g1 ═ A1C 1/(D1+ E1-F1)
The numerical calculation formulas on the same document are delivered in order, for example:
equation 1: e1 ═ a1 ═ C1 ═ D1
Equation 2: h1 ═ a1 × C1+ E1+ F1+ G1
The value of E1 is calculated and then substituted into formula 2 to calculate the value of H1
The corresponding identification area on the left side of the equal number of the formula is marked as a check area, and the output format of the check area can be set to be Arabic numerals or Chinese capitals.
Signature area labeling module: marking a region needing signature authentication on a document template picture, and recording coordinates;
a user interaction module: providing button or gesture interaction functions including start/stop assisted fill mode, start/stop document check mode
An image input module: document image shot by AR terminal camera
An identification and error detection module: the method is used for identifying and detecting handwritten bill numerical value information of a document image shot by an AR terminal camera to obtain an output result, wherein the output result comprises identification numerical values of all identification areas, a calculation result of a check area and an error mark indicating that the calculation numerical value is inconsistent with the identification numerical value.
A capitalization conversion module: and for the area with the output format of Chinese capitalization, converting the calculation result into Chinese capitalization and outputting the Chinese capitalization.
A signature authentication module: and under the document checking working mode, judging the area marked with the signature and the authenticity by using a signature and authenticity AI model to obtain signature confidence coefficient output.
A result display module: calculating the corresponding display position of each identification area on the AR terminal and displaying the identification value and the calculation result; and under the document checking working mode, additionally marking an error marking area and displaying a signature authentication result.
In summary, the document auxiliary filling method based on the AR technology of the present invention performs automatic calculation according to the formula through document auxiliary filling based on the AR technology, performs document value check based on the AR technology, performs automatic calculation according to the formula, and marks an error; the invention can be operated on all AR terminals, and the recommended AR terminal is AR glasses connected with the smart phone.
The invention is convenient and flexible: the intelligent mobile phone or AR glasses can be used for carrying out document auxiliary filling and checking, and a manual pressing calculator is omitted; avoiding errors: the method avoids the filling errors caused by the wrong recording of the calculation formula, the wrong press key of the calculator and the manual copying errors, so as to cause the re-filling of the document; the real-time performance is strong: the calculation result and the error position can be displayed in real time, and the efficiency is extremely high.
In yet another aspect, the present invention also discloses a computer readable storage medium storing a computer program, which when executed by a processor causes the processor to perform the steps of the method as described above.
A computer device is also disclosed, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the method as described above.
It is understood that the system provided by the embodiment of the present invention corresponds to the method provided by the embodiment of the present invention, and the explanation, the example and the beneficial effects of the related contents can refer to the corresponding parts in the method.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A bill auxiliary filling method based on AR technology is based on an AR terminal and is characterized in that: including a document template creation process and an auxiliary filling process,
the document template establishing process comprises the steps of establishing a document template by using an input electronic version document picture or a document scanning corrected picture; marking a region needing data identification on the document template picture, numbering and recording coordinates; editing a plurality of numerical calculation formulas by using the data identification area numbers;
the auxiliary filling process comprises the steps that a user who fills in the document switches the system to an auxiliary filling work mode, when filling in the form, a document image shot by an AR terminal camera uses a handwritten document numerical value information identification and error detection method, and the identification numerical value of an identification area and the calculation result of a check area are displayed on the AR terminal in real time.
2. The AR technology-based document auxiliary filling method according to claim 1, wherein: the method comprises the steps that a document auditor switches a system to a document checking working mode, a document image shot by an AR terminal camera uses a handwritten document numerical value information identification and error detection method, identification numerical values of an identification area and calculation results of a checking area are displayed on the AR terminal in real time, and an error marking area is marked; and judging the area marked with signature authentication by using a signature authentication AI model, and displaying the signature confidence coefficient on the corresponding position of the AR terminal.
3. A document filling-in aid method based on AR technology as claimed in claim 1 or 2, wherein the handwritten bill value information identification and error detection method comprises the following steps:
scanning or photographing the handwritten bill to obtain a bill image to be identified;
extracting characteristic points of a bill image to be recognized, matching the characteristic points with preset bill template characteristic points, and determining a bill template with the highest characteristic point matching number;
calculating a homography transformation matrix by using the feature point matching result, and correcting the bill image to be recognized by using homography transformation to obtain a corrected image which has the same width and height as the bill template and is close to the coordinate position;
segmenting the corresponding area of the corrected image according to the identification area coordinate of the bill template with the highest feature point matching number;
performing handwritten character recognition on the segmented area image to obtain a recognition result;
verifying the recognition results one by one according to a calculation formula preset by the template;
when only one group of results enables the calculation formula to be established, outputting the group of results as a recognition result; and when all the recognition results can not make the calculation formula be satisfied, or when a plurality of groups of results can make the calculation formula be satisfied, the result with the maximum confidence level is taken as the recognition result to be output, and when all the recognition results can not make the calculation formula be satisfied, the filling error is judged.
4. A document filling-in aid method based on AR technology as claimed in claim 3,
the preset template setting steps are as follows:
acquiring an electronic version picture of a bill as a template picture, or replacing the electronic version picture with a picture scanned and corrected by a blank paper bill;
marking a handwritten number identification area on the picture, numbering the identification area and acquiring corresponding identification area coordinate information;
defining a corresponding calculation formula by using the region number logic according to the service scene;
and extracting the characteristic points of the template picture and storing the characteristic points into a characteristic point data file.
5. The utility model provides a supplementary filling system of document based on AR technique, the system operation is on AR terminal or the smart mobile phone who is connected with AR terminal, its characterized in that: the system comprises the following modules:
the document template creating module is used for inputting an electronic version document picture or a document scanning corrected picture and creating a document template;
the identification area marking module marks an area needing data identification on the document template picture, and carries out numbering and coordinate recording;
the calculation formula editing module is used for editing a plurality of numerical calculation formulas by using the data identification area numbers, and the formula editing supports operations of addition, subtraction, multiplication, division and parenthesis;
the signature area marking module marks an area needing signature authentication on the document template picture and records coordinates;
the user interaction module provides a button or gesture interaction function and comprises an opening/stopping auxiliary filling mode and an opening/stopping document checking mode;
the image input module is used for acquiring document images shot by the AR terminal camera;
the result display module is used for calculating the corresponding display position of each identification area on the AR terminal and displaying the identification value and the calculation result; and under the document checking working mode, additionally marking an error marking area and displaying a signature authentication result.
6. A document assisted-filling system based on AR technology according to claim 5, characterized in that: also includes an identification and error detection module;
the identification and error detection module is used for acquiring an output result by using a handwritten bill numerical value information identification and error detection method for the bill image shot by the AR terminal camera, wherein the output result comprises identification numerical values of all identification areas, a calculation result of the check area and an error mark with the calculation numerical value inconsistent with the identification numerical value.
7. A document assisted-filling system based on AR technology according to claim 5, characterized in that: the system also comprises a capitalization conversion module;
the capitalization conversion module is used for converting the calculation result into Chinese capitalization to output for the area with the output format of Chinese capitalization.
8. A document assisted-filling system based on AR technology according to claim 5, characterized in that: the signature authentication module is also included;
and the signature authentication module is used for judging the area marked with signature authentication by using a signature authentication AI model under the bill checking working mode to obtain signature confidence coefficient output.
9. A computer-readable storage medium, storing a computer program which, when executed by a processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 4.
10. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111143325.1A CN113902402A (en) | 2021-09-28 | 2021-09-28 | Document auxiliary filling method, system, storage medium and device based on AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111143325.1A CN113902402A (en) | 2021-09-28 | 2021-09-28 | Document auxiliary filling method, system, storage medium and device based on AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113902402A true CN113902402A (en) | 2022-01-07 |
Family
ID=79029858
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111143325.1A Pending CN113902402A (en) | 2021-09-28 | 2021-09-28 | Document auxiliary filling method, system, storage medium and device based on AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113902402A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114495136A (en) * | 2022-04-14 | 2022-05-13 | 滨州市社会保险事业中心 | Financial data storage method, system, computer equipment and storage medium |
| CN117094304A (en) * | 2023-10-18 | 2023-11-21 | 湖北华中电力科技开发有限责任公司 | Prompting method and system for technical standard revision applied to power grid field |
-
2021
- 2021-09-28 CN CN202111143325.1A patent/CN113902402A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114495136A (en) * | 2022-04-14 | 2022-05-13 | 滨州市社会保险事业中心 | Financial data storage method, system, computer equipment and storage medium |
| CN117094304A (en) * | 2023-10-18 | 2023-11-21 | 湖北华中电力科技开发有限责任公司 | Prompting method and system for technical standard revision applied to power grid field |
| CN117094304B (en) * | 2023-10-18 | 2024-01-23 | 湖北华中电力科技开发有限责任公司 | Prompting method and system for technical standard revision applied to power grid field |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110674815A (en) | Invoice image distortion correction method based on deep learning key point detection | |
| CN112528863A (en) | Identification method and device of table structure, electronic equipment and storage medium | |
| CN111476109A (en) | Bill processing method, bill processing apparatus, and computer-readable storage medium | |
| CN113902402A (en) | Document auxiliary filling method, system, storage medium and device based on AR technology | |
| CN110490181B (en) | Form filling and auditing method, device and equipment based on OCR (optical character recognition) technology and computer storage medium | |
| US20110222776A1 (en) | Form template definition method and form template definition apparatus | |
| CN110675940A (en) | Pathological image labeling method and device, computer equipment and storage medium | |
| JP3206579B2 (en) | Address area detection device | |
| CN107564004A (en) | It is a kind of that video labeling method is distorted based on computer auxiliary tracking | |
| CN110956147B (en) | Method and device for generating training data | |
| CN104077557B (en) | A kind of method and apparatus obtaining card image | |
| US20140207631A1 (en) | Systems and Method for Analyzing and Validating Invoices | |
| CN113903024A (en) | Handwritten bill numerical value information identification method, system, medium and device | |
| CN108171239A (en) | The extracting method of certificate pictograph, apparatus and system, computer storage media | |
| CN113642582A (en) | Ammeter reading identification method and device, electronic equipment and storage medium | |
| CN112001200A (en) | Identification code identification method, device, equipment, storage medium and system | |
| CN115223166A (en) | Picture pre-labeling method, picture labeling method and device, and electronic equipment | |
| CN114612905A (en) | Invoice processing method, device, equipment and medium based on RPA and AI | |
| CN114445836A (en) | Information auditing method and device combining RPA and AI and electronic equipment | |
| CN111079562A (en) | Multi-stage data generation self-circulation financial invoice text intelligent identification system and method | |
| CN104408403A (en) | Arbitration method and apparatus for inconsistent phenomenon of two pieces of entry information | |
| CN111325106B (en) | Method and device for generating training data | |
| CN111159997B (en) | Intelligent verification method for enterprise bidding document | |
| CN117115823A (en) | Tamper identification method and device, computer equipment and storage medium | |
| JP4160206B2 (en) | Database registration method using character recognition device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |