CN113240188A - Filling sheet processing method and device based on augmented reality AR - Google Patents

Filling sheet processing method and device based on augmented reality AR Download PDF

Info

Publication number
CN113240188A
CN113240188A CN202110601173.9A CN202110601173A CN113240188A CN 113240188 A CN113240188 A CN 113240188A CN 202110601173 A CN202110601173 A CN 202110601173A CN 113240188 A CN113240188 A CN 113240188A
Authority
CN
China
Prior art keywords
user
augmented reality
service
handled
behavior data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110601173.9A
Other languages
Chinese (zh)
Inventor
康占春
李�昊
郭睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN202110601173.9A priority Critical patent/CN113240188A/en
Publication of CN113240188A publication Critical patent/CN113240188A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401—Transaction verification
    • G06Q20/4014—Identity check for transactions
    • G06Q20/40145—Biometric identity checks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/02—Banking, e.g. interest calculation or account maintenance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Computer Security & Cryptography (AREA)
  • Finance (AREA)
  • General Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Development Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Game Theory and Decision Science (AREA)
  • Technology Law (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a filling processing method and a filling processing device based on Augmented Reality (AR), wherein the method comprises the following steps: acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information; acquiring historical behavior data of a user at a bank terminal according to the identity of the user; predicting a plurality of service types to be handled by a user according to historical behavior data and a relationship between the behavior data and the service types which is established in advance; determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and the relationship between the service type and the document template; determining an optimal projection position according to the current face position information of the user; displaying a document template corresponding to the type of the business to be managed at the optimal projection position by utilizing an Augmented Reality (AR) technology; the document template is used for helping the user complete document filling. The invention can help the user to fill in the document efficiently and accurately, and improves the user experience.

Description

Filling sheet processing method and device based on augmented reality AR
Technical Field
The invention relates to the technical field of augmented reality, in particular to a form filling processing method and device based on augmented reality AR.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
At present, when a customer transacts business at a bank outlet, a plurality of documents need to be filled, the documents comprise a plurality of pieces of information which are unknown how to fill, the customer is likely to be unqualified when filling the documents into a counter, some problems that the customer cannot remember the documents, the business transaction progress is influenced, and the user experience is poor.
Disclosure of Invention
The embodiment of the invention provides an AR-based filling processing method, which is used for helping a user to fill a bill efficiently and accurately, and comprises the following steps:
acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information;
acquiring historical behavior data of a user at a bank terminal according to the identity of the user;
predicting a plurality of service types to be handled by the user according to the historical behavior data and a relationship between the behavior data and the service types which is established in advance;
determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and a relation between the service type and the document template which is established in advance;
determining an optimal projection position according to the current face position information of the user;
displaying a document template corresponding to the type of the business to be managed at the optimal projection position by utilizing an Augmented Reality (AR) technology; the bill template is used for helping the user complete bill filling.
The embodiment of the invention also provides an AR-based filling processing device, which is used for helping a user to fill a bill efficiently and accurately, and comprises the following components:
the identity recognition unit is used for acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information;
the acquisition unit is used for acquiring historical behavior data of a user at a bank end according to the identity of the user;
the prediction unit is used for predicting a plurality of service types to be handled by the user according to the historical behavior data and the relationship between the behavior data and the service types established in advance;
the document template determining unit is used for determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and the relationship between the service type and the document template which is established in advance;
the optimal projection position determining unit is used for determining an optimal projection position according to the current face position information of the user;
the AR display unit is used for displaying the document template corresponding to the service type to be managed at the optimal projection position by utilizing the AR technology; the bill template is used for helping the user complete bill filling.
The embodiment of the invention also provides computer equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor realizes the filling sheet processing method based on the augmented reality AR when executing the computer program.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program for executing the above augmented reality AR-based form filling processing method is stored in the computer-readable storage medium.
In the embodiment of the invention, the filling processing scheme based on the augmented reality AR comprises the following steps: acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information; acquiring historical behavior data of a user at a bank terminal according to the identity of the user; predicting a plurality of service types to be handled by a user according to historical behavior data and a relationship between the behavior data and the service types which is established in advance; determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and a relation between the service type and the document template which is established in advance; determining an optimal projection position according to the current face position information of the user; displaying a document template corresponding to the type of the business to be managed at the optimal projection position by utilizing an Augmented Reality (AR) technology; the document template is used for helping the user complete document filling, the user can be helped to fill documents efficiently and accurately, and user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts. In the drawings:
FIG. 1 is a schematic flow chart illustrating an AR-based form filling processing method according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating an AR-based form filling processing method according to another embodiment of the present invention;
FIG. 3 is a schematic flow chart illustrating an AR-based form filling processing method according to another embodiment of the present invention;
FIG. 4 is a schematic flow chart illustrating an AR-based form filling processing method according to another embodiment of the present invention;
FIG. 5 is a schematic structural diagram of an AR-based form filling processing apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an augmented reality AR-based form filling processing device according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention are further described in detail below with reference to the accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
Before describing the implementation of the present invention, first, terms related to the embodiments of the present invention will be described.
AR: AR (augmented reality) augmented reality transmits virtual information to the real world through a computer technology, then the virtual information and the virtual information exist in the same picture or space simultaneously after being superposed, and then a user in the real world can perform three-dimensional real-time interaction with virtual and real scenes in a natural mode through the coordination of hardware and software.
Aiming at the technical problems in the prior art, the embodiment of the invention provides an augmented reality AR-based form filling processing scheme, which is an AR-based intelligent bank form pre-filling scheme. After the client arrives at a network point, the possible business handling of the client is analyzed according to the behavior data of the client, the client is directly helped to project the bill with the client information to the optimal observation position to be presented by using projection-based Augmented Reality (AR) according to the business selected by the client, the client does not need to raise the head or turn the head to see a filling template, the client is helped to complete filling of the bill more conveniently and accurately, and the client experience of the user is improved. In addition, the inventor finds that the existing website bill template has the defects of being inaccurate in data information, untimely in data updating and the like. Therefore, based on the technical problem of this finding, the inventors have also proposed: if the document format is changed, only the scheme set by the system needs to be changed, and the network does not need to repeatedly print and paste the document template, so that the resource investment is reduced. The augmented reality AR-based form filling processing scheme is described in detail below.
Fig. 1 is a schematic flow diagram of a filling-out processing method based on augmented reality AR in an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
step 101: acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information;
step 102: acquiring historical behavior data of a user at a bank terminal according to the identity of the user;
step 103: predicting a plurality of service types to be handled by the user according to the historical behavior data and a relationship between the behavior data and the service types which is established in advance;
step 104: determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and a relation between the service type and the document template which is established in advance;
step 105: determining an optimal projection position according to the current face position information of the user;
step 106: displaying a document template corresponding to the type of the business to be managed at the optimal projection position by utilizing an Augmented Reality (AR) technology; the bill template is used for helping the user complete bill filling.
The filling processing method based on the augmented reality AR provided by the embodiment of the invention can help the user to fill the bill efficiently and accurately, and the user experience is improved. The steps involved in the embodiments of the present invention will be described in detail below with reference to fig. 2 to 4.
First, the above step 101 is described.
When the customer walks into a bank outlet, the customer can capture a picture of the customer (acquire user image information) by using the camera, and the identity of the customer (user) is judged through image identification. Specifically, the detailed steps of identifying the identity of the client may be: and acquiring biological characteristic information of the user, such as face characteristic information, from the user image information, and matching the acquired face characteristic information with a relationship between the face characteristic information stored in a bank in advance and the user identity information to obtain the identity of the user.
Next, the above step 102 is described.
In specific implementation, after the identity of the client is identified, the background data center collects behavior information of the client (historical behavior data of the user at the bank end), and the behavior data may include: the system comprises a webpage (for example, a webpage that a user browses a certain money and money management product once) browsed by a bank end (for example, a mobile banking APP), things inquired by a client (for example, how the user inquires how to transact credit cards once), asset conditions of the client and the like.
Third, next, the above step 103 is described.
In an embodiment, as shown in fig. 2, predicting a plurality of business types to be transacted by the user according to the historical behavior data and a relationship between the behavior data and the business types established in advance may include step 1031:
predicting a plurality of service types to be handled by the user according to the historical behavior data and a service prediction neural network model generated by pre-training; the business prediction neural network model is generated by pre-training according to a plurality of behavior data samples.
In specific implementation, the artificial intelligence model (business prediction neural network model) is used for judging the business which is possibly transacted by the customer in the bank and the products which are possibly interested by the customer, for example, the user browses a webpage of a certain money financing product once, so that the business type of transacting and purchasing the financing product by the user from a bank branch or the withdrawal business can be predicted according to the behavior data, and the business type is used for purchasing the financing product; for example, if the user inquires how to transact credit cards, the user can predict the transaction of transacting credit cards from bank outlets or activate credit card services, loans and other services according to the behavior data. Specifically, the inputs to the traffic-predicting neural network model may be: behavioral data, the output of the model may be: a plurality of traffic types.
Fourth, next, the above step 104 is described.
In specific implementation, when a customer swipes an identity card or calls a number by using a bank card, the business (a plurality of business types to be handled by the customer) which the customer may need to handle can be recommended for the customer, and after the customer selects the business (the customer selects the business type to be handled from the plurality of business types), all possible document templates for the business are inquired for use in subsequent steps.
In an embodiment, the augmented reality AR-based form filling processing method may further include: acquiring all user information corresponding to the service types to be handled according to the service types to be handled selected by the user from the plurality of service types;
then, in the subsequent step 106, displaying the document template corresponding to the to-be-handled service type at the optimal projection position by using the augmented reality AR technology, which may include: and displaying the bill template corresponding to the type of the business to be managed and the user information at the optimal projection position by utilizing an Augmented Reality (AR) technology.
In specific implementation, after the user selects the service type to be handled from the plurality of service types, the user can also inquire all client information possibly used by the service, and when a document template is displayed for the client in subsequent steps, the client information is displayed by the AR, so that convenience is brought to the user, and the user experience is further improved. Specifically, the customer information can be fused in the corresponding filling position in the document template for displaying.
Fifth, for convenience of description, the above step 105 and step 106 will be described together.
In one embodiment, as shown in fig. 3, determining the optimal projection position according to the current face position information of the user may include step 1051: determining the current eye position information of the user according to the current face position information of the user; and determining the optimal projection position according to the current eye position information of the user.
When the method is specifically implemented, the scheme for determining the optimal projection position is accurate, and the user experience is further improved.
When the method is specifically implemented, the client is directly helped to project the document with the client information to the optimal observation position to present based on the projected Augmented Reality (AR), the client does not need to raise the head or turn the head to see the filling template, the client is helped to complete filling of the document more conveniently and accurately, and the client experience of the user is improved.
Sixthly, the preferred steps of the embodiment of the present invention are described.
In an embodiment, as shown in fig. 4, the above augmented reality AR-based form filling processing method may further include step 107: and when the change of the service is monitored, updating the document template.
In specific implementation, if the document format is changed, only the system setting needs to be changed, and the network does not need to repeatedly print and paste the document template, so that the resource investment is reduced. I.e. the relation between the type of service and the document template is also updated.
To sum up, in the augmented reality AR-based form filling processing method provided by the embodiment of the present invention, after a customer arrives at a website, a possible transaction service of the customer is analyzed according to behavior data of the customer, and according to a service selected by the customer, the projection-based Augmented Reality (AR) is used to directly help the customer project a form with customer information to an optimal observation position for presentation without the need of raising or twisting the head of the customer to see a filling template, so as to help the customer to complete filling of a form more conveniently and accurately, and improve customer experience of the user. If the document format is changed, only the system setting needs to be changed, and the document template does not need to be printed and pasted repeatedly by the network points, so that the resource investment is reduced.
The embodiment of the invention also provides a filling sheet processing device based on the augmented reality AR, and the filling sheet processing device is described in the following embodiment. Because the principle of the device for solving the problems is similar to the augmented reality AR-based form filling processing method, the implementation of the device can refer to the implementation of the augmented reality AR-based form filling processing method, and repeated details are not repeated.
Fig. 5 is a schematic structural diagram of an augmented reality AR-based form filling processing device in an embodiment of the present invention, and as shown in fig. 5, the device includes:
the identity recognition unit 01 is used for acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information;
the acquiring unit 02 is used for acquiring historical behavior data of a user at a bank end according to the identity of the user;
the prediction unit 03 is configured to predict a plurality of service types to be handled by the user according to the historical behavior data and a relationship between behavior data and service types established in advance;
the document template determining unit 04 is configured to determine a document template corresponding to a service type to be handled according to a service type to be handled selected by a user from a plurality of service types and a relationship between a service type and the document template established in advance;
the optimal projection position determining unit 05 is used for determining an optimal projection position according to the current face position information of the user;
the AR display unit 06 is used for displaying the document template corresponding to the to-be-managed service type at the optimal projection position by using an augmented reality AR technology; the bill template is used for helping the user complete bill filling.
In one embodiment, the augmented reality AR-based form filling processing apparatus may further include: the user information acquisition unit is used for acquiring all user information corresponding to the service types to be handled according to the service types to be handled selected by the user from the plurality of service types;
the AR presentation unit is specifically configured to: and displaying the bill template corresponding to the type of the business to be managed and the user information at the optimal projection position by utilizing an Augmented Reality (AR) technology.
In an embodiment, as shown in fig. 6, the augmented reality AR-based form filling processing apparatus may further include: and the updating unit 07 is used for updating the document template when the change of the service is monitored.
In one embodiment, the prediction unit is specifically configured to:
predicting a plurality of service types to be handled by the user according to the historical behavior data and a service prediction neural network model generated by pre-training; the business prediction neural network model is generated by pre-training according to a plurality of behavior data samples.
In an embodiment, the optimal projection position determining unit is specifically configured to: determining the current eye position information of the user according to the current face position information of the user; and determining the optimal projection position according to the current eye position information of the user.
The embodiment of the invention also provides computer equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor realizes the filling sheet processing method based on the augmented reality AR when executing the computer program.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program for executing the above augmented reality AR-based form filling processing method is stored in the computer-readable storage medium.
In the embodiment of the invention, the filling processing scheme based on the augmented reality AR comprises the following steps: acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information; acquiring historical behavior data of a user at a bank terminal according to the identity of the user; predicting a plurality of service types to be handled by a user according to historical behavior data and a relationship between the behavior data and the service types which is established in advance; determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and a relation between the service type and the document template which is established in advance; determining an optimal projection position according to the current face position information of the user; displaying a document template corresponding to the type of the business to be managed at the optimal projection position by utilizing an Augmented Reality (AR) technology; the document template is used for helping the user complete document filling, the user can be helped to fill documents efficiently and accurately, and user experience is improved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (12)

1. A filling processing method based on Augmented Reality (AR) is characterized by comprising the following steps:
acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information;
acquiring historical behavior data of a user at a bank terminal according to the identity of the user;
predicting a plurality of service types to be handled by the user according to the historical behavior data and a relationship between the behavior data and the service types which is established in advance;
determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and a relation between the service type and the document template which is established in advance;
determining an optimal projection position according to the current face position information of the user;
displaying a document template corresponding to the type of the business to be managed at the optimal projection position by utilizing an Augmented Reality (AR) technology; the bill template is used for helping the user complete bill filling.
2. The Augmented Reality (AR) -based form filling processing method of claim 1, further comprising: acquiring all user information corresponding to the service types to be handled according to the service types to be handled selected by the user from the plurality of service types;
displaying the bill template corresponding to the to-be-managed service type at the optimal projection position by utilizing an Augmented Reality (AR) technology, wherein the method comprises the following steps: and displaying the bill template corresponding to the type of the business to be managed and the user information at the optimal projection position by utilizing an Augmented Reality (AR) technology.
3. The Augmented Reality (AR) -based form filling processing method of claim 1, further comprising: and when the change of the service is monitored, updating the document template.
4. The Augmented Reality (AR) -based form filling processing method of claim 1, wherein predicting a plurality of business types to be handled by the user according to the historical behavior data and a pre-established relationship between behavior data and business types comprises:
predicting a plurality of service types to be handled by the user according to the historical behavior data and a service prediction neural network model generated by pre-training; the business prediction neural network model is generated by pre-training according to a plurality of behavior data samples.
5. The Augmented Reality (AR) -based form filling processing method of claim 1, wherein determining the optimal projection position according to the current face position information of the user comprises: determining the current eye position information of the user according to the current face position information of the user; and determining the optimal projection position according to the current eye position information of the user.
6. A fill-out processing device based on Augmented Reality (AR), comprising:
the identity recognition unit is used for acquiring user image information when a user arrives at a bank outlet; identifying the user identity according to the user image information;
the acquisition unit is used for acquiring historical behavior data of a user at a bank end according to the identity of the user;
the prediction unit is used for predicting a plurality of service types to be handled by the user according to the historical behavior data and the relationship between the behavior data and the service types established in advance;
the document template determining unit is used for determining a document template corresponding to the service type to be handled according to the service type to be handled selected from the plurality of service types by the user and the relationship between the service type and the document template which is established in advance;
the optimal projection position determining unit is used for determining an optimal projection position according to the current face position information of the user;
the AR display unit is used for displaying the document template corresponding to the service type to be managed at the optimal projection position by utilizing the AR technology; the bill template is used for helping the user complete bill filling.
7. The Augmented Reality (AR) -based form-filling processing apparatus of claim 6, further comprising: the user information acquisition unit is used for acquiring all user information corresponding to the service types to be handled according to the service types to be handled selected by the user from the plurality of service types;
the AR presentation unit is specifically configured to: and displaying the bill template corresponding to the type of the business to be managed and the user information at the optimal projection position by utilizing an Augmented Reality (AR) technology.
8. The Augmented Reality (AR) -based form-filling processing apparatus of claim 6, further comprising: and the updating unit is used for updating the document template when the change of the service is monitored.
9. The Augmented Reality (AR) -based form filling processing apparatus of claim 6, wherein the prediction unit is specifically configured to:
predicting a plurality of service types to be handled by the user according to the historical behavior data and a service prediction neural network model generated by pre-training; the business prediction neural network model is generated by pre-training according to a plurality of behavior data samples.
10. The Augmented Reality (AR) -based wakeout processing apparatus of claim 6, wherein the optimal projection position determining unit is specifically configured to: determining the current eye position information of the user according to the current face position information of the user; and determining the optimal projection position according to the current eye position information of the user.
11. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 5 when executing the computer program.
12. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the method of any one of claims 1 to 5.
CN202110601173.9A 2021-05-31 2021-05-31 Filling sheet processing method and device based on augmented reality AR Pending CN113240188A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110601173.9A CN113240188A (en) 2021-05-31 2021-05-31 Filling sheet processing method and device based on augmented reality AR

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110601173.9A CN113240188A (en) 2021-05-31 2021-05-31 Filling sheet processing method and device based on augmented reality AR

Publications (1)

Publication Number Publication Date
CN113240188A true CN113240188A (en) 2021-08-10

Family

ID=77136165

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110601173.9A Pending CN113240188A (en) 2021-05-31 2021-05-31 Filling sheet processing method and device based on augmented reality AR

Country Status (1)

Country Link
CN (1) CN113240188A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114153306A (en) * 2021-11-29 2022-03-08 国网辽宁省电力有限公司本溪供电公司 Intelligent interconnection business hall

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114153306A (en) * 2021-11-29 2022-03-08 国网辽宁省电力有限公司本溪供电公司 Intelligent interconnection business hall

Similar Documents

Publication Publication Date Title
TWI718348B (en) Offline interaction method and device based on augmented reality
WO2019095884A1 (en) Image recognition technology-based self-service vending method, apparatus, electronic device and computer storage medium
CN108256442A (en) Financial account information is extracted in the improved digital picture from card
CN108509458B (en) Business object identification method and device
CN112765230B (en) Payment big data analysis method and big data analysis system based on internet finance
CN113627411A (en) Super-resolution-based commodity identification and price matching method and system
TW201911180A (en) Method and device for evaluating goods
CN111736940A (en) Business interface display method and device for intelligent counter
CN115019322A (en) Font detection method, device, equipment and medium
CN113240188A (en) Filling sheet processing method and device based on augmented reality AR
CN111967970B (en) Bank product recommendation method and device based on spark platform
CN110362796B (en) Service assistance method and device, service self-service machine and storage medium
CN114066564A (en) Service recommendation time determination method and device, computer equipment and storage medium
CN113112345A (en) Intelligent counter business handling method, device and system based on 5G
CN112183594A (en) Bill image processing method and device, storage medium and electronic equipment
US20190019339A1 (en) Systems and methods for dynamically displaying information about an object using augmented reality
CN113127058A (en) Data annotation method, related device and computer program product
CN112257450A (en) Data processing method, device, readable storage medium and equipment
CN112396513B (en) Data processing method and device
US20230396857A1 (en) Video generation method and apparatus, and electronic device and computer-readable medium
CN113221521A (en) Filling processing method and system based on VR
CN114511368A (en) Data processing method, monitoring method, system and electronic equipment
CN113259872A (en) Product processing method and system for unmanned network
CN115222509A (en) Processing method and device for mobile banking screen capture information
CN116206207A (en) Method and device for determining placement position of automatic teller machine and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination