CN105427107B - Payment method and device based on intelligent glasses - Google Patents
Payment method and device based on intelligent glasses Download PDFInfo
- Publication number
- CN105427107B CN105427107B CN201510738393.0A CN201510738393A CN105427107B CN 105427107 B CN105427107 B CN 105427107B CN 201510738393 A CN201510738393 A CN 201510738393A CN 105427107 B CN105427107 B CN 105427107B
- Authority
- CN
- China
- Prior art keywords
- user
- payment
- information
- bill
- mobile payment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 239000011521 glass Substances 0.000 title claims description 107
- 239000004984 smart glass Substances 0.000 claims abstract description 52
- 238000000605 extraction Methods 0.000 claims description 17
- 238000001514 detection method Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 24
- 238000010586 diagram Methods 0.000 description 16
- 230000004397 blinking Effects 0.000 description 9
- 238000012790 confirmation Methods 0.000 description 9
- 230000004044 response Effects 0.000 description 7
- 238000012795 verification Methods 0.000 description 6
- 238000003708 edge detection Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 239000013598 vector Substances 0.000 description 4
- 208000003443 Unconsciousness Diseases 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000012706 support-vector machine Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 210000001652 frontal lobe Anatomy 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 235000012054 meals Nutrition 0.000 description 2
- 210000000869 occipital lobe Anatomy 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000193 eyeblink Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/148—Segmentation of character regions
- G06V30/153—Segmentation of character regions using recognition of characters or words
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
Abstract
The invention discloses payment method and device based on smart glasses, which comprises the steps of judging whether an opening instruction sent by a second user is received or not, if the opening instruction is received, opening a mobile payment function, shooting a paper bill after the mobile payment function is opened to form a video picture, extracting bill account information and amount information of the paper bill from the video picture, displaying the bill account information and the amount information, receiving a payment instruction sent after the second user confirms the bill account information and the payment amount information, and paying the paper bill according to the payment instruction and user account information preset in a mobile payment platform.
Description
Technical Field
The invention relates to a communication technology, in particular to payment methods and devices based on intelligent glasses.
Background
Nowadays, with the rapid development of communication technology nowadays, mobile payment has become very mainstream applications.
Existing mobile payment services are typically implemented based on smartphones. Online transactions such as online shopping and traditional real transactions such as dining, car-taking and even supermarket shopping generally adopt a mobile payment mode to settle expenses.
However, the payment using the smart phone still requires the user to manually input information or scan the two-dimensional code, so that convenience and user experience are not very good.
Disclosure of Invention
The invention provides payment methods and devices based on smart glasses, and aims to solve the technical problem that in the prior art, smart phones are complex to operate during payment.
The invention aspect provides payment methods based on intelligent glasses, including:
judging whether an opening instruction sent by a second user is received, and if the opening instruction is received, opening the mobile payment function, wherein the second user is the user who uses the intelligent glasses currently;
shooting a paper bill after a mobile payment function is started to form a video picture;
extracting the bill account information and the amount information of the paper bill from the video picture, and displaying the bill account information and the amount information;
receiving a payment instruction sent by a second user after confirming the bill account information and the payment amount information;
and paying the paper bill according to the payment instruction and th user account information preset in the mobile payment platform, wherein the th user is a user who sets an account in the mobile payment platform.
Another aspect of the invention provides smart-glasses-based payment devices, comprising:
the judging module is used for judging whether an opening instruction sent by a second user is received or not, and if the opening instruction is received, the mobile payment function is started, wherein the second user is the user who uses the intelligent glasses currently;
the shooting module is used for shooting the paper bill after the mobile payment function is started to form a video picture;
the extraction module is used for extracting the bill account information and the payment amount information of the paper bill from the video picture and displaying the bill account information and the payment amount information;
the receiving module is used for receiving a payment instruction sent by a second user after confirming the bill account information and the payment amount information;
and the payment module is used for paying the paper bill according to the payment instruction and th user account information preset in the mobile payment platform, wherein the th user is a user who sets an account in the mobile payment platform.
According to the payment method and device based on the intelligent glasses, the mobile payment function is started after the start instruction sent by the user is received, and the paper bill is shot to form a video picture; extracting account information and payment amount information of the paper bill from the video picture and displaying the account information and the payment amount information; and receiving a payment instruction sent by a user, and paying the paper bill according to the payment instruction and user account information preset in the mobile payment platform. The mobile payment can be completed by simply confirming the mobile payment through the intelligent glasses, the operation mode that the two-dimensional code needs to be scanned or manually input when the mobile payment is carried out through the intelligent mobile phone is avoided, the mobile payment method is more convenient, and the user experience is better.
Drawings
Fig. 1 is a flowchart of a smart glasses-based payment method provided by embodiment of the present invention;
fig. 2 is a flowchart of a payment method based on smart glasses according to a second embodiment of the present invention;
fig. 3 is a flowchart of a payment method based on smart glasses according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a paper bill to be paid according to a fifth embodiment of the present invention;
fig. 5 is a flowchart of a payment method based on smart glasses according to a fifth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a paper bill to be paid after superimposing labels according to the fifth embodiment of the present invention;
FIG. 7 is a schematic diagram of a structure of an identifier and numeric character display according to a fifth embodiment of the present invention;
fig. 8 is a schematic diagram of an identifier a in a coordinate system of a smart glasses lens according to a fifth embodiment of the present invention;
FIG. 9 is a diagram of a numeric character A' in a camera coordinate system according to a fifth embodiment of the present invention
Fig. 10 is a schematic structural diagram of an apparatus according to a sixth embodiment of the present invention;
fig. 11 is a schematic structural diagram of an apparatus according to a seventh embodiment of the present invention;
fig. 12 is a schematic structural diagram of an apparatus according to an eighth embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are partial embodiments of of the present invention, rather than all embodiments.
Google Glass, introduced by Google corporation in 2012, is the most mature practical product at present and can be used as a sample of hardware configuration and software functions of smart glasses, and has installed video cameras capable of shooting 720P videos on glasses frames so as to be able to shoot real scenes seen by users in front of eyes, a micro projection display is also installed on glasses lenses so as to project display pictures on reflection screens and reflect the display pictures into human eyes, so that a virtual screen superimposed on the real scenes is formed in the human eyes, the visual effect is like watching a high-definition screen of 25 inches, the Google Glass supports access to the mobile internet so as to realize various application functions requiring networking, the Google Glass can realize control of the devices by voice commands, and a blink control technology is introduced, so that changes of optical signals brought by using eye sensors are sensed so as to realize human-computer interaction in response to actions, for example, when the user uses the smart glasses to trigger smart phones to continuously to shoot various intelligent programs, so as to provide more convenient visual information, smart phone calls, smart phones can provide more mature eye-view videos, and sub-line-like eye-blink-based on-prompting information.
Example
Fig. 1 is a flowchart of a payment method based on smart glasses according to an embodiment of the present invention, and as shown in fig. 1, the method of this embodiment may include:
before step 101, similar to mobile payment in a smart phone, a user needs to open a personal account on a mobile payment platform, recharge the account or associate the account with a bank card, register the personal identity of the user, and bind smart glasses with at least accounts, wherein the user is the user who opens the personal account on the mobile payment platform, and the second user is the user who currently uses the smart glasses.
Specifically, the opening instruction may be a voice instruction, and the smart glasses may determine whether to open payment according to the voice instruction, for example, the second user may speak "GLASS, i.e., i want to pay" while watching a bill, and the smart glasses may start mobile payment in response to the voice instruction.
specifically, after the payment function is started, the intelligent glasses shoot paper bills to be paid seen by the second user to form a video picture, and the video picture comprises bill account information, payment amount information and other contents.
103, extracting the bill account information and the payment amount information of the paper bill from the video picture and displaying the bill account information and the payment amount information;
correspondingly, the payee needs to support mobile payment of the meal fee, and sets up an enterprise account on the mobile payment platform by using the unit name as an account name for receiving the payment of the user.
Specifically, a character string containing account information can be extracted from a video picture through a character extraction and recognition algorithm, then the character string is transmitted to a mobile payment platform through a mobile internet, the mobile payment platform inquires the character string to determine whether an account name corresponding to the character string exists or not, if so, the mobile payment platform feeds back an account confirmation message to the intelligent glasses, the intelligent glasses store the extracted character string as opposite-side account information after receiving the account confirmation message sent by the mobile payment platform, the intelligent glasses recognize payment amount information through the character extraction and recognition algorithm in the step, extract numbers and store the extracted numbers as payment amount information, the intelligent glasses generate a payment confirmation page according to the obtained opposite-side account information and the payment amount information and display the payment amount information on the intelligent glasses, and a second user sends a payment instruction to the intelligent glasses after confirming the bill account information and the payment amount information displayed on the intelligent glasses.
and 105, paying the paper bill according to the payment instruction and th user account information preset in the mobile payment platform, wherein the th user is a user who sets an account in the mobile payment platform.
Specifically, the payment instruction of the user may be a voice instruction preset with the smart glasses to instruct the smart glasses to perform payment. The smart glasses judge whether to start payment according to the voice command, for example, when the user watches the bill, the user can speak "GLASS, Payment Bar", and the smart glasses start mobile payment in response to the voice command.
According to the payment method based on the intelligent glasses, the mobile payment function is started after the start instruction sent by the user is received, and the paper bill is shot to form a video picture; extracting account information and payment amount information of the paper bill from the video picture and displaying the account information and the payment amount information; and receiving a payment instruction sent by a user, and paying the paper bill according to the payment instruction and user account information preset in the mobile payment platform. The mobile payment can be completed by simply confirming the mobile payment by utilizing the intelligent glasses, the mobile payment realized by the intelligent mobile phone is not required to be acquired by scanning the two-dimensional code or manually inputting and other modes, the mobile payment is more convenient, and the user experience is better.
Example two
In order to increase the security of the smart glasses, this embodiment is further defined by step on the basis of embodiment , fig. 2 is a flowchart of a payment method based on smart glasses according to a second embodiment of the present invention, as shown in fig. 2, before step 101, the method of this embodiment may include:
step 201, collecting th user physical sign information as th user physical sign information;
step 202, binding the th user physical sign information with the smart glasses and storing the information in preset user account information.
step 203, acquiring sign information of a second user as second user sign information, and comparing the second user sign information with th user sign information stored in preset user account information;
and 204, if the paper bill is matched with the mobile payment platform, paying the paper bill according to the payment instruction and user account information preset in the mobile payment platform.
Specifically, the payment instruction of the user may be a voice instruction preset with the smart glasses to instruct the smart glasses to perform payment. The smart glasses judge whether to start payment according to the voice command, for example, when the user watches the bill, the user can speak "GLASS, Payment Bar", and the smart glasses start mobile payment in response to the voice command.
The intelligent glasses are used for receiving a payment instruction of a second user, verifying the identity of the second user, and specifically acquiring second user physical sign information of the second user using the intelligent glasses at present, uploading the second user physical sign information to the mobile payment platform, enabling the mobile payment platform to compare the second user physical sign information with -th user physical sign information stored in the mobile payment platform, if the second user physical sign information is matched with the -th user physical sign information, enabling the current user to pass identity verification, feeding back identity verification passing information to the intelligent glasses by the mobile payment platform, uploading bill account information and payment amount information to the mobile payment platform by the intelligent glasses after the mobile payment platform passes the identity verification, enabling the mobile payment platform to pay the bill account information by using -th user account information bound with the intelligent glasses, feeding back payment success information to the intelligent glasses by the mobile payment platform after the payment is completed, and displaying the information on the intelligent glasses in a successful payment page.
Wherein the th user physical sign information can be iris feature data of th user, and the second user physical sign information can be iris feature data of the second user.
According to the payment method based on the intelligent glasses, the sign information of the second user is obtained and used as the second user sign information, the second user sign information is compared with -th user sign information stored in the preset user account information, if the second user sign information is matched with the preset user account information, the paper bill is paid according to the payment instruction and the preset user account information in the mobile payment platform, the safe payment of the intelligent glasses is achieved, the condition that the glasses are stolen is avoided, and the safety is better.
EXAMPLE III
In this embodiment, on the basis of the embodiment , step 101 is further defined by step fig. 3 is a flowchart of a payment method based on smart glasses according to a third embodiment of the present invention, as shown in fig. 3, in this embodiment, step 101 may specifically include:
specifically, the intelligent glasses use a character extraction and recognition algorithm according to the video pictures to obtain image areas where each character in the image is located, for example, through closed edge detection, and then recognize the characters through template matching, and detect whether digital characters exist in the video pictures seen by the user in front of the eyes shot in real time currently.
wherein, the turn-on indication information may be a predetermined number of consecutive blinking motions.
Specifically, the intelligent glasses sense whether a preset number of continuous blinking actions exist or not by using the eye sensors, and if the preset number of continuous blinking actions exist, the user can be confirmed to carry out mobile payment, so that the mobile payment function is started. If there are no predetermined number of consecutive blinking actions, the mobile payment function is not turned on.
It should be noted that the opening instruction in step 101 may be understood as, in this embodiment, a numeric character and opening instruction information preset by the user and the smart glasses.
According to the payment method based on the intelligent glasses, whether the mobile payment function of the intelligent glasses is started or not is determined by jointly judging whether the characters exist in the video picture or not and whether the preset starting indication information of the user and the intelligent glasses is received or not, and the situation that the mobile payment is mistakenly started by the intelligent glasses due to unconscious operation of the user is avoided.
Example four
In this embodiment, on the basis of the embodiment , step 101 is further defined by step , in this embodiment, step 101 may specifically include:
optionally, the start command in step 101 may also be a brain electrical signal.
In particular, the smart eye may configure a brain-computer interface. When a user watches a paper bill, the mobile payment function in the intelligent glasses is started through the electroencephalogram signals.
The method can be realized in such a way that an electroencephalogram signal acquisition module of a brain-computer interface acquires electroencephalograms of a spectacle wearer by respectively setting sampled electroencephalogram electrodes for occipital lobe area potential, frontal lobe area potential and ear position, performs preprocessing such as filtering, mean value calculation and sampling on the acquired electroencephalograms, then sequentially concatenates data acquired by all the electrodes to form sample feature vectors, identifies the electroencephalograms by adopting a support vector machine classifier according to extracted electroencephalogram features, and interacts with intelligent spectacles if the currently acquired electroencephalograms are matched with feature vectors for starting a mobile payment function, so that mobile payment application is opened.
According to the payment method based on the intelligent glasses, the electroencephalogram signal of a glasses wearer is collected through the electroencephalogram signal collection module of the brain-computer interface, the collected electroencephalogram signal is preprocessed, the electroencephalogram signal is identified by the aid of the support vector machine classifier according to the extracted electroencephalogram characteristics, and if the currently collected electroencephalogram signal is matched with the feature vector for starting the mobile payment function, the brain-computer interface interacts with the intelligent glasses, so that mobile payment application is opened. The condition that the mobile payment is opened by mistake by the intelligent glasses is avoided due to unconscious operation of the user.
EXAMPLE five
In this embodiment, on the basis of the above embodiment, step 103 is further refined by , fig. 4 is a schematic diagram of a paper bill structure to be paid according to the fifth embodiment of the present invention, please refer to fig. 4, and the extraction of the bill account information in step 103 can be realized in the following manner, wherein the collection unit "beijing hotel" and the unit name "beijing hotel" on the mobile payment platform open an enterprise account.
The intelligent glasses can extract a character string of the Beijing major restaurant from the account list picture through a character extraction and recognition algorithm, then the character string is transmitted to a background server of the mobile payment platform through the mobile internet, the background server utilizes the character string to inquire, determines whether an account name corresponding to the character string exists or not, feeds back an account confirmation message to the intelligent glasses after the existence of the account name is confirmed, and after the account confirmation message is obtained, the intelligent glasses temporarily store the extracted character string of the Beijing major restaurant as the account information of the other side.
Fig. 5 is a flowchart of a payment method based on smart glasses according to a fifth embodiment of the present invention, and as shown in fig. 5, in step 103, the method extracts amount information of the paper bill from the video picture, and displays the amount information, specifically including the following steps:
and 403, generating identifiers with the number equal to the number of the recognized numerical characters, and sequentially displaying the identifiers on the smart glasses, so that the identifiers correspond to the numerical characters on the paper bill.
The correspondence refers to the mutual superposition of the identifier displayed by the smart glasses and the number on the paper bill, which are seen by the user through the smart glasses, in the spatial direction, the identifier can be a number or letters or other identification symbols as long as the identifier corresponds to the number characters on the paper bill.
It should be noted that, in this embodiment, step 401 may be executed before, after, or simultaneously with step 103 extracting and displaying the bill account information of the paper bill, and only implementable manners are shown in the figure, and the order of the implementable manners is not limited.
Specifically, fig. 6 is a schematic structural diagram of a paper bill to be paid after superimposing the labels provided in the fifth embodiment of the present invention, please refer to fig. 6,
the intelligent glasses firstly recognize the digital characters in the video picture, the number of the recognized digital characters is obtained, the position coordinates of the digital characters on the paper bill are determined by the intelligent glasses, the overlapping positions of the identifiers ① to ⑧ are calculated according to the position coordinates of the digital characters, the overlapping positions are converted into display coordinates, and the semitransparent identifiers ① to ⑧ are projected and displayed on the intelligent glasses according to the display coordinates, and the identifiers ① to ⑧ displayed according to the display coordinates are overlapped on the numbers of the real paper bill seen by the second user.
The smart glasses have a micro-projector that projects and displays a symbol set to be translucent on the display screen so that the displayed symbol can be seen by the eyes of the second user, and further, since the glasses lens and the symbol are both translucent so that the numerical characters printed on the paper bill can be seen through them by the eyes of the second user, and further, the identifier and the numerical characters seen by the eyes of the second user are superimposed on in visual effect, which forms a visual perception that the price numbers and the symbols ① to ⑧ are superimposed on in fig. 6.
Accordingly, the second user sees the bill on which the identifier icons ① through ⑧ are superimposed, and may say "GLASS" and pay item 8 "by using a voice command, thereby accurately locating the number" 792.88 "as payment amount information, and also may perform accurate location by using a blink command, the identifier icons ① through ⑧ are not displayed at the same time but sequentially displayed in a loop from ① to ⑧, and when the identifier icons ⑧ are displayed, the second user may blink three times in succession as confirmation, locating the number" 792.88 "as payment amount information, or further, may select item ⑧ among them by using an electroencephalogram command in the case that the identifier icons ① through ⑧ are displayed.
Preferably, step 403 can be implemented by referring to fig. 7 as a schematic structural diagram of the identifier and the numeric character display provided by the fifth embodiment of the present invention, fig. 8 as a schematic structural diagram of the identifier a in the coordinate system of the intelligent eyeglass lens provided by the fifth embodiment of the present invention, and fig. 9 as a schematic structural diagram of the numeric character a ' in the coordinate system of the camera provided by the fifth embodiment of the present invention, please refer to fig. 7, 8 and 9, where the identifier a ' is displayed on the eyeglass lens 81 by projection, so that the coordinate of a ' on the eyeglass lens 81 can be (X ', Y '). the numeric character a on the paper bill 82 can be recognized by a character recognition method in the prior art, and an edge pixel point of the numeric character a can be extracted by using a character edge extraction algorithm in the prior art, points are selected from the edge pixel points, and the optical axis O of the imaging lens of the camera is taken as an origin, so that the coordinate of the anchor point in the camera coordinate system, that is is (X, Y).
For example, points of the lenses of the intelligent glasses 81 and points of the paper bill are two points on straight lines seen by the eyes 83, then coordinates (X, Y) of the point on the lenses of the intelligent glasses 81 on the projection coordinate system and coordinates (X ', Y') of the point on the paper bill 83 on the camera coordinate system have a mapping relationship which is superposed with each other and expressed as M.
Furthermore, it can be determined that the coordinates of the anchor point of the number a on the paper bill 83 are (X, Y) by the character extraction and the character edge detection, and then, in the projection superimposition display step of the identifier a ', the projection display of the number a and the identifier icon a ' can be realized by displaying the identifier icon a ' at the (X ', Y ') point by projection according to M.
If the position of the paper bill is moved in the process of superposition display, so that the position of the digital character A is changed, the display position of the identifier A' is adjusted accordingly, and the steps of character extraction, character edge detection and projection superposition need to be executed again.
According to the payment method based on the intelligent glasses, the number of the recognized digital characters is obtained by recognizing the digital characters on the video picture, the identifiers equal to the number of the recognized digital characters are generated, and the identifiers are sequentially displayed on the intelligent glasses, so that the identifiers correspond to the digital characters on the paper bill.
EXAMPLE six
Fig. 10 is a schematic structural diagram of a device according to a sixth embodiment of the present invention, referring to fig. 10, the present embodiment provides types of payment devices based on smart glasses, including:
the judging module 1 is used for judging whether an opening instruction sent by a second user is received or not, and if the opening instruction is received, the mobile payment function is started, wherein the second user is a user who uses the intelligent glasses currently;
the shooting module 2 is used for shooting the paper bill after the mobile payment function is started to form a video picture;
the extraction module 3 is used for extracting the bill account information and the payment amount information of the paper bill from the video picture and displaying the bill account information and the payment amount information;
the receiving module 4 is configured to receive a payment instruction sent by the second user after confirming the bill account information and the payment amount information;
and the payment module 5 is used for paying the paper bill according to the payment instruction and th user account information preset in the mobile payment platform, wherein the th user is a user who sets an account in the mobile payment platform.
The th user is a user who opens a personal account on the mobile payment platform, and the second user is a user who uses the smart glasses currently.
Specifically, the opening instruction may be a voice instruction, and the smart glasses may determine whether to open payment according to the voice instruction, for example, the second user may speak "GLASS, i.e., i want to pay" while watching a bill, and the smart glasses may start mobile payment in response to the voice instruction.
Correspondingly, the payee needs to support mobile payment of the meal fee, and sets up an enterprise account on the mobile payment platform by using the unit name as an account name for receiving the payment of the user.
Specifically, a character string containing account information can be extracted from a video picture through a character extraction and recognition algorithm, then the character string is transmitted to a mobile payment platform through a mobile internet, the mobile payment platform inquires the character string to determine whether an account name corresponding to the character string exists or not, if so, the mobile payment platform feeds back an account confirmation message to the intelligent glasses, the intelligent glasses store the extracted character string as opposite-side account information after receiving the account confirmation message sent by the mobile payment platform, the intelligent glasses recognize payment amount information through the character extraction and recognition algorithm in the step, extract numbers and store the extracted numbers as payment amount information, the intelligent glasses generate a payment confirmation page according to the obtained opposite-side account information and the payment amount information and display the payment amount information on the intelligent glasses, and a second user sends a payment instruction to the intelligent glasses after confirming the bill account information and the payment amount information displayed on the intelligent glasses.
Specifically, the payment instruction of the user may be a voice instruction preset with the smart glasses to instruct the smart glasses to perform payment. The smart glasses judge whether to start payment according to the voice command, for example, when the user watches the bill, the user can speak "GLASS, Payment Bar", and the smart glasses start mobile payment in response to the voice command.
According to the payment method based on the intelligent glasses, the mobile payment function is started after the start instruction sent by the user is received, and the paper bill is shot to form a video picture; extracting account information and payment amount information of the paper bill from the video picture and displaying the account information and the payment amount information; and receiving a payment instruction sent by a user, and paying the paper bill according to the payment instruction and user account information preset in the mobile payment platform. The mobile payment can be completed by simply confirming the mobile payment by utilizing the intelligent glasses, the mobile payment realized by the intelligent mobile phone is not required to be acquired by scanning the two-dimensional code or manually inputting and other modes, the mobile payment is more convenient, and the user experience is better.
EXAMPLE seven
In order to increase the safety of the smart glasses, in the present embodiment, a step is further performed on the basis of the fifth embodiment, fig. 11 is a schematic structural diagram of an apparatus provided by the seventh embodiment of the present invention, please refer to fig. 11, where the apparatus provided by the present embodiment further includes:
the acquisition module 6 is used for acquiring the user sign information;
the storage module 7 is used for binding the collected user sign information with the intelligent glasses and storing the collected user sign information and the intelligent glasses in preset user account information;
the payment module 5 is specifically configured to acquire the sign information of the user, and compare the acquired sign information of the user with the sign information of the user stored in the preset user account information;
and if the payment instruction is matched with the user account information preset by the user on the mobile payment platform, the paper bill is paid.
Specifically, the payment instruction of the user may be a voice instruction preset with the smart glasses to instruct the smart glasses to perform payment. The smart glasses judge whether to start payment according to the voice command, for example, when the user watches the bill, the user can speak "GLASS, Payment Bar", and the smart glasses start mobile payment in response to the voice command.
The intelligent glasses are used for receiving a payment instruction of a second user, verifying the identity of the second user, and specifically acquiring second user physical sign information of the second user using the intelligent glasses at present, uploading the second user physical sign information to the mobile payment platform, enabling the mobile payment platform to compare the second user physical sign information with -th user physical sign information stored in the mobile payment platform, if the second user physical sign information is matched with the -th user physical sign information, enabling the current user to pass identity verification, feeding back identity verification passing information to the intelligent glasses by the mobile payment platform, uploading bill account information and payment amount information to the mobile payment platform by the intelligent glasses after the mobile payment platform passes the identity verification, enabling the mobile payment platform to pay the bill account information by using -th user account information bound with the intelligent glasses, feeding back payment success information to the intelligent glasses by the mobile payment platform after the payment is completed, and displaying the information on the intelligent glasses in a successful payment page.
Wherein the th user physical sign information can be iris feature data of th user, and the second user physical sign information can be iris feature data of the second user.
According to the payment method based on the intelligent glasses, the sign information of the second user is obtained and used as the second user sign information, the second user sign information is compared with -th user sign information stored in the preset user account information, if the second user sign information is matched with the preset user account information, the paper bill is paid according to the payment instruction and the preset user account information in the mobile payment platform, the safe payment of the intelligent glasses is achieved, the condition that the glasses are stolen is avoided, and the safety is better.
Example eight
In this embodiment, based on the embodiment , the determining module 1 is further defined by , fig. 12 is a schematic structural diagram of an apparatus provided in an eighth embodiment of the present invention, as shown in fig. 12, in this embodiment, the determining module 1 further includes:
the detection module 11 is configured to detect the video frame and determine whether a digital character exists;
the judging submodule 12 is configured to judge whether preset opening instruction information of the user and the smart glasses is received or not after the existence of the characters is detected;
and the starting module 13 is used for starting the mobile payment application after receiving the starting instruction information.
Specifically, the intelligent glasses use a character extraction and recognition algorithm according to the video pictures to obtain image areas where each character in the image is located, for example, through closed edge detection, and then recognize the characters through template matching, and detect whether digital characters exist in the video pictures seen by the user in front of the eyes shot in real time currently.
Wherein, the turn-on indication information may be a predetermined number of consecutive blinking motions.
Specifically, the intelligent glasses sense whether a preset number of continuous blinking actions exist or not by using the eye sensors, and if the preset number of continuous blinking actions exist, the user can be confirmed to carry out mobile payment, so that the mobile payment function is started. If there are no predetermined number of consecutive blinking actions, the mobile payment function is not turned on.
It should be noted that the opening instruction in step 101 may be understood as, in this embodiment, a numeric character and opening instruction information preset by the user and the smart glasses.
According to the payment method based on the intelligent glasses, whether the mobile payment function of the intelligent glasses is started or not is determined by jointly judging whether the characters exist in the video picture or not and whether the preset starting indication information of the user and the intelligent glasses is received or not, and the situation that the mobile payment is mistakenly started by the intelligent glasses due to unconscious operation of the user is avoided.
Example nine
In this embodiment, based on the above embodiment, steps are further performed on the extraction module 3, where the extraction module 3 in this embodiment may be specifically configured to recognize the numeric characters on the video picture, acquire the number of recognized numeric characters, generate identifiers equal to the number of recognized numeric characters, and sequentially display the identifiers on the smart glasses, so that the identifiers correspond to the numeric characters on the paper bill.
According to the payment method based on the intelligent glasses, the number of the recognized digital characters is obtained by recognizing the digital characters on the video picture, the identifiers equal to the number of the recognized digital characters are generated and are sequentially displayed on the intelligent glasses, so that the identifiers correspond to the digital characters on the paper bill.
Accordingly, the hardware structure of the smart glasses may be configured to include: the device comprises a lens, a spectacle frame, a microprocessor, a camera for shooting real scenes seen by a user in front of eyes, a miniature projection display (comprising a reflecting screen), a voice collector, an eye sensor for sensing blinking, an iris collecting sensor, a communication module and a brain-computer interface.
The brain-computer interface comprises an electroencephalogram signal acquisition module, an electroencephalogram signal processing module and an electroencephalogram signal classification module, wherein the electroencephalogram signal acquisition module is used for acquiring electroencephalogram signals of a glasses wearer through electroencephalogram electrodes which respectively sample potential in an occipital lobe area, potential in a frontal lobe area and ear positions, the electroencephalogram signal processing module is used for preprocessing the acquired electroencephalogram signals such as filtering, mean value calculation and sampling, and then data acquired by all the electrodes are sequentially connected in series to form sample characteristic vectors, and the electroencephalogram signal classification module is used for recognizing the electroencephalogram signals by adopting a support vector machine classifier according to electroencephalogram characteristics extracted by the electroencephalogram signal processing module and converting the recognized signals into instruction threads which can be executed by a microprocessor to carry out brain-computer control and interaction on the intelligent glasses.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus described above may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
It will be understood by those skilled in the art that all or a portion of the steps of implementing the various method embodiments described above may be performed by hardware associated with program instructions, and that the program may be stored in a computer readable storage medium, which when executed performs the steps comprising the various method embodiments described above, including ROM, RAM, magnetic or optical disks, among various media capable of storing program code.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (4)
- A payment method based on smart glasses, comprising:judging whether an opening instruction sent by a second user is received, and if the opening instruction is received, opening the mobile payment function, wherein the second user is the user who uses the intelligent glasses currently;shooting a paper bill after a mobile payment function is started to form a video picture;extracting the bill account information and the amount information of the paper bill from the video picture, and displaying the bill account information and the amount information;receiving a payment instruction sent by a second user after confirming the bill account information and the payment amount information;paying the paper bill according to the payment instruction and th user account information preset in the mobile payment platform, wherein th user is a user who sets an account in the mobile payment platform;wherein, whether the judgement received the opening instruction that the second user sent, if receive opening instruction, then open the mobile payment function, include:detecting the video picture and judging whether digital characters exist or not;if the characters exist, judging whether preset opening indication information of the user and the intelligent glasses is received or not;if the opening indication information is received, opening the mobile payment application;the method for displaying the paper bill comprises the following steps of extracting amount information of the paper bill from the video picture, and displaying the amount information, and specifically comprises the following steps:identifying digital characters on the video picture;acquiring the number of the recognized digital characters;and generating identifiers with the number equal to the number of the recognized numerical characters, and sequentially displaying the identifiers on the intelligent glasses so that the identifiers correspond to the numerical characters on the paper bill, wherein the identifiers correspond to the numerical characters on the paper bill, and the identifiers displayed by the intelligent glasses and the numbers on the paper bill are mutually superposed in a spatial direction.
- 2. The method of claim 1, wherein the step of capturing the paper bill further comprises, before forming the video frame:collecting user sign information;binding the collected user sign information with the intelligent glasses and storing the information in preset user account information;the payment of the paper bill according to the payment instruction and user account information preset by a user on a mobile payment platform specifically comprises the following steps:acquiring the sign information of the user, and comparing the acquired sign information of the user with the sign information of the user stored in the preset user account information;and if the payment instruction is matched with the user account information preset by the user on the mobile payment platform, the paper bill is paid.
- A payment device based on smart glasses, comprising:the judging module is used for judging whether an opening instruction sent by a second user is received or not, and if the opening instruction is received, the mobile payment function is started, wherein the second user is the user who uses the intelligent glasses currently;the shooting module is used for shooting the paper bill after the mobile payment function is started to form a video picture;the extraction module is used for extracting the bill account information and the payment amount information of the paper bill from the video picture and displaying the bill account information and the payment amount information;the receiving module is used for receiving a payment instruction sent by a second user after confirming the bill account information and the payment amount information;the payment module is used for paying the paper bill according to the payment instruction and th user account information preset in the mobile payment platform, wherein the th user is a user who sets an account in the mobile payment platform;wherein the judging module comprises:the detection module is used for detecting the video picture and judging whether digital characters exist or not;the judging submodule is used for judging whether preset opening indication information of the user and the intelligent glasses is received or not after the existence of the characters is detected;the starting module is used for starting the mobile payment application after receiving the starting indication information;wherein the extraction module is specifically configured to:identifying digital characters on the video picture;acquiring the number of the recognized digital characters;and generating identifiers with the number equal to the number of the recognized numerical characters, and sequentially displaying the identifiers on the intelligent glasses so that the identifiers correspond to the numerical characters on the paper bill, wherein the correspondence between the identifiers and the numerical characters on the paper bill indicates that the identifiers displayed by the intelligent glasses and the numbers on the paper bill are mutually overlapped in a spatial direction.
- 4. The apparatus of claim 3, further comprising:the acquisition module is used for acquiring the user sign information;the storage module is used for binding the collected user sign information with the intelligent glasses and storing the collected user sign information and the intelligent glasses in preset user account information;the payment module is specifically used for acquiring the sign information of the user and comparing the acquired sign information of the user with the sign information of the user stored in the preset user account information; and if the payment instruction is matched with the user account information preset by the user on the mobile payment platform, the paper bill is paid.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510738393.0A CN105427107B (en) | 2015-11-03 | 2015-11-03 | Payment method and device based on intelligent glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510738393.0A CN105427107B (en) | 2015-11-03 | 2015-11-03 | Payment method and device based on intelligent glasses |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105427107A CN105427107A (en) | 2016-03-23 |
| CN105427107B true CN105427107B (en) | 2020-01-31 |
Family
ID=55505295
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510738393.0A Active CN105427107B (en) | 2015-11-03 | 2015-11-03 | Payment method and device based on intelligent glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105427107B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106408285A (en) * | 2016-09-30 | 2017-02-15 | 中国银联股份有限公司 | AR-technology-based payment method and payment system |
| WO2018086020A1 (en) * | 2016-11-10 | 2018-05-17 | 深圳市赛亿科技开发有限公司 | Method and device for acquiring user purchase information at cash register system |
| CN107066079A (en) | 2016-11-29 | 2017-08-18 | 阿里巴巴集团控股有限公司 | Service implementation method and device based on virtual reality scenario |
| CN107122642A (en) | 2017-03-15 | 2017-09-01 | 阿里巴巴集团控股有限公司 | Identity identifying method and device based on reality environment |
| CN109426334A (en) * | 2017-08-23 | 2019-03-05 | 北京京东尚科信息技术有限公司 | Information display method and device |
| CN109102271A (en) * | 2018-07-26 | 2018-12-28 | 广东小天才科技有限公司 | Method of payment, payment mechanism, smartwatch and computer readable storage medium |
| CN109102280A (en) * | 2018-08-01 | 2018-12-28 | 福州市晋安区绿奇鑫环保科技有限公司 | A kind of the safety verification method and server of barcode scanning payment environment |
| CN108694578A (en) * | 2018-08-02 | 2018-10-23 | 广东小天才科技有限公司 | Method of payment, payment mechanism, terminal device and computer readable storage medium |
| CN109034827A (en) * | 2018-08-30 | 2018-12-18 | Oppo广东移动通信有限公司 | Method of payment, device, wearable device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104574064A (en) * | 2015-01-26 | 2015-04-29 | 深圳前海万融智能信息有限公司 | Mobile phone payment method and system for prompting pre-authorized electronic bill |
| CN104597625A (en) * | 2013-10-30 | 2015-05-06 | 富泰华工业（深圳）有限公司 | Intelligent glasses |
| CN204679734U (en) * | 2015-06-15 | 2015-09-30 | 徐世通 | Intelligent translation glasses |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9830586B2 (en) * | 2014-03-31 | 2017-11-28 | Ncr Corporation | Electronic payments |
-
2015
- 2015-11-03 CN CN201510738393.0A patent/CN105427107B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104597625A (en) * | 2013-10-30 | 2015-05-06 | 富泰华工业（深圳）有限公司 | Intelligent glasses |
| CN104574064A (en) * | 2015-01-26 | 2015-04-29 | 深圳前海万融智能信息有限公司 | Mobile phone payment method and system for prompting pre-authorized electronic bill |
| CN204679734U (en) * | 2015-06-15 | 2015-09-30 | 徐世通 | Intelligent translation glasses |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105427107A (en) | 2016-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105427107B (en) | Payment method and device based on intelligent glasses | |
| US10509951B1 (en) | Access control through multi-factor image authentication | |
| US9857589B2 (en) | Gesture registration device, gesture registration program, and gesture registration method | |
| US10346675B1 (en) | Access control through multi-factor image authentication | |
| US9412017B1 (en) | Methods systems and computer program products for motion initiated document capture | |
| EP3391315B1 (en) | A system and method enabling guided positional tracking for an electronics device | |
| WO2020112262A1 (en) | Method and system for facilitating facial-recognition-based payment system with multiple viewing angles and reduced mispayment risk | |
| EP3133592B1 (en) | Display apparatus and controlling method thereof for the selection of clothes | |
| CN110033293B (en) | Method, device and system for acquiring user information | |
| CN107122642A (en) | Identity identifying method and device based on reality environment | |
| WO2016048633A1 (en) | Systems, apparatuses, and methods for gesture recognition and interaction | |
| CN108345907A (en) | Recognition methods, augmented reality equipment and storage medium | |
| WO2021035575A1 (en) | Method for preventing unauthorized observation during payment process, and electronic device | |
| CN110570185B (en) | Resource transfer method and device, storage medium and electronic equipment | |
| US10354242B2 (en) | Scanner gesture recognition | |
| JP6191519B2 (en) | Transaction system and transaction apparatus | |
| WO2021164511A1 (en) | Information processing method and system based on eyeball tracking, and payment processing method based on eyeball tracking | |
| CN113111932B (en) | Article checking method and system of intelligent container | |
| WO2014085438A2 (en) | Methods, systems, and media for detecting gaze locking | |
| CN105894288A (en) | Using method of supermarket face payment platform | |
| CN206271123U (en) | Payment mechanism based on face recognition | |
| CN107577973B (en) | image display method, image identification method and equipment | |
| CN102117521A (en) | Method and system for information collection and recognition for non-cash payment | |
| US10218900B2 (en) | Document reorientation processing | |
| CN115620378A (en) | Multi-view cow face intelligent acquisition method, device and system and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |