CN108280641B

CN108280641B - AR technology-based payment method and device

Info

Publication number: CN108280641B
Application number: CN201810084118.5A
Authority: CN
Inventors: 王竹灵; 朱沁
Original assignee: Koubei Shanghai Information Technology Co Ltd
Current assignee: Koubei Shanghai Information Technology Co Ltd
Priority date: 2018-01-29
Filing date: 2018-01-29
Publication date: 2021-01-08
Anticipated expiration: 2038-01-29
Also published as: CN108280641A

Abstract

The application discloses a payment method based on AR technology, which comprises the following steps: detecting whether a payment device which is in wireless connection with a cash register is in a payable range, if so, judging whether the cash register exists in a live-action image acquired by the payment device, and if so, executing the following operations: synthesizing a payment identifier corresponding to the cash register into the live-action image to obtain a payment guide image; and paying to an account associated with the cash register device according to a payment request initiated aiming at the payment identifier in the payment guide image. The payment method based on the AR technology reduces the work of store customers and cashiers in the payment process, has higher payment efficiency, and provides more convenient and more humanized payment experience for the store customers.

Description

AR technology-based payment method and device

Technical Field

The application relates to the technical field of AR, in particular to a payment method based on AR technology. The application also relates to a payment device based on the AR technology, and another payment method and device based on the AR technology.

Background

Augmented Reality (AR) is a technology for calculating the position and angle of a camera image in real time and adding a corresponding image, and the technology simulates and simulates entity information (vision, hearing and the like) which is difficult to experience in a certain time space range of the real world by scientific technologies such as computers and the like and then superposes the entity information, applies virtual information to the real world and is perceived by human senses, so that the sensory experience beyond the Reality is achieved.

On the other hand, at present, payment methods such as mobile payment and electronic payment have entered various fields of daily life of users, so that great convenience is provided for daily life of users, users are increasingly used to pay by using portable intelligent devices such as smart phones, for example, when a user has a meal, the user can pay in multiple ways, the most extensive payment methods are payment code payment and code scanning payment, payment code payment is a payment code (such as a pay-for-treasure payment code) presented by a user (customer), and a cashier and settlement staff of a dining store finishes payment by scanning the payment code presented by the user through a handheld cashier device; the code scanning payment means that a user goes to a dining store front desk to scan store codes through payment software to pay after dining is finished, and the payment can be initiated by calling a payment code for the store to scan the code for payment and actively filling in the payment amount according to the setting of the store. In addition, the department store table code payment is carried out in a wider payment mode, the two-dimensional code needs to be arranged on each table of the department store in advance, the two-dimensional code is bound with the table number in the background of the cash register system, and a user can directly read payment amount to complete payment after scanning the table code.

However, in some shops without a handheld POS, a customer using a payment code to pay needs to walk to a front desk cash register after having a meal, and often needs to queue up at peak time of the meal, which results in low payment efficiency. In addition, the payment is carried out by adopting the table code payment of the store scanning, the table code is required to be pasted on each table and communicated with the cashier system at the background, and the amount information after the waiter places the order can be obtained by scanning the table code by the customer. The setting cost of the table code is relatively high, and the cashier system has the requirement of getting through the table code.

Disclosure of Invention

The application provides a payment method based on an AR technology, which aims to overcome the defects in the prior art. The application also relates to a payment device based on the AR technology, and another payment method and device based on the AR technology.

The application provides a payment method based on AR technology, which comprises the following steps:

detecting whether a payment device which is in wireless connection with a cash register is in a payable range, if so, judging whether the cash register exists in a live-action image acquired by the payment device, and if so, executing the following operations:

synthesizing a payment identifier corresponding to the cash register into the live-action image to obtain a payment guide image;

and paying to an account associated with the cash register device according to a payment request initiated aiming at the payment identifier in the payment guide image.

Optionally, before the step of synthesizing the payment identifier corresponding to the cash register device into the live-action image and obtaining the payment guide image is executed, the following operations are executed:

and judging whether the image acquisition direction of the payment equipment is aligned with the position of the cash register equipment, if so, executing the step of synthesizing the payment identifier corresponding to the cash register equipment into the live-action image to obtain a payment guide image.

Optionally, if the determination result of the step of determining whether the image capturing direction of the payment device is aligned with the position of the cash register device is negative, the following operations are performed:

determining coordinate information of an image element of the cash register device in the live view image;

determining a moving direction and/or a rotating direction for moving and/or rotating the image element of the cash register device to the central area of the live-action image according to the coordinate information;

synthesizing a movement indicator mark and/or a rotation indicator mark corresponding to the movement direction and/or the rotation direction into the live-action image to obtain a movement guide image;

and sending the mobile guide image to the payment device, and displaying the mobile guide image on a screen of the payment device by the payment device.

Optionally, the determining whether the cash registering device exists in the live-action image collected by the payment device is implemented in the following manner:

detecting whether an image element of the cash register exists in the live-action image, if so, executing the step of synthesizing a payment identifier corresponding to the cash register into the live-action image to obtain a payment guide image; if not, the following operations are executed:

determining relative position information of the payment device to the cash register device;

according to the relative position information and the image acquisition direction of the payment equipment, determining that the payment equipment is moved to the initial movement direction and/or the initial rotation direction of the cash register equipment, wherein the image acquisition range of the payment equipment covers the initial movement direction and/or the initial rotation direction of the cash register equipment;

synthesizing an initial movement indicator mark and/or an initial rotation indicator mark corresponding to the initial movement direction and/or the initial rotation direction into the live-action image to obtain an initial guide image;

sending the initial guide image to the payment device, and displaying the initial guide image on a screen of the payment device by the payment device.

Optionally, the determining the relative position information of the payment device to the cash register device is implemented in the following manner:

acquiring first position information of the payment equipment and second position information of the cash register equipment;

and calculating the relative position information of the payment device to the cash register device according to the first position information and the second payment position information.

Optionally, the store corresponding to the account is provided with at least two cash registering devices, and the cash registering devices are respectively provided with a wireless connection device.

Optionally, if the cash register device set by the store includes a first cash register device and a second cash register device;

correspondingly, the determining the relative position information of the payment device to the cash register device is implemented in the following manner:

acquiring first wireless signal intensity of the first cash register device and second wireless signal intensity of the second cash register device, which are detected by the payment device;

according to the first wireless signal intensity and the second wireless signal intensity, respectively calculating a first distance between the payment device and the first cash register device and a second distance between the payment device and the second cash register device;

and determining first relative position information of the payment device to the first cash register device and second relative position information of the payment device to the second cash register device according to the first distance and the second distance.

Optionally, the payment device acquires the live-action image according to a preset acquisition cycle, and the payment guide image generated according to the live-action image in each acquisition cycle is sent to the payment device, and the payment device displays the payment guide image on a screen of the payment device.

Optionally, the payment identifier corresponding to the cash register device and the image element of the cash register device both have a position association and/or a size association in the payment guide image.

Optionally, the payment method based on the AR technology includes:

judging whether the image elements of the cash register in the live-action images acquired in two adjacent acquisition periods have position changes, if so, executing the following operations:

determining displacement information of an image element of the cash register device in the live-action image;

calculating new coordinate information of the payment identifier in the payment guiding image formed in the next acquisition period according to the displacement information and the coordinate information of the payment identifier in the payment guiding image generated in the previous acquisition period;

synthesizing the payment identifier into a payment guide image formed in the next acquisition period according to the new coordinate information;

and sending the generated payment guiding image to the payment device, and displaying the payment guiding image on a screen of the payment device by the payment device.

Optionally, the payment method based on the AR technology includes:

judging whether the sizes of the image elements of the cash register device in the live-action images acquired in two adjacent acquisition periods are changed, if so, executing the following operations:

determining a scaling at which image elements of the checkout device change in size in the live view image;

calculating new size information of the payment identifier in the payment guiding image generated in the next acquisition period according to the scaling and the size information of the payment identifier in the payment guiding image generated in the previous acquisition period;

synthesizing the payment identifier into a payment guide image formed in the next acquisition period according to the new size information;

Optionally, the payment method based on the AR technology includes:

judging whether the sizes and the positions of image elements of the cash register device in the live-action images acquired in two adjacent acquisition periods are changed, if so, executing the following operations:

determining displacement information of image elements of the cash register device in the live-action image and a scaling rate of the image elements with changed sizes;

calculating new coordinate information and new size information of the payment identifier in the payment guide image formed in the next acquisition period according to the displacement information, the scaling and the coordinate information and the size information of the payment identifier in the payment guide image generated in the previous acquisition period;

synthesizing the payment identifier into the payment guide image formed in the next acquisition period according to the new coordinate information and the new size information;

Optionally, the association between the cash register device and the account is determined based on a binding relationship between a hardware identifier of the wireless connection device of the cash register setting and the account.

Optionally, the detecting whether the payment device wirelessly connected to the cash register device is within the payable range is implemented in the following manner:

determining the signal strength of the wireless signal of the wireless connection device set by the cash register device detected by the payment device;

judging whether the signal intensity is in a signal intensity threshold range corresponding to the payable range, if so, executing the step of judging whether the cash register device exists in the live-action image acquired by the payment device; if not, sending reminding information of the payment equipment out of the payable range to the payment equipment.

The present application further provides a device for paying at a client based on AR technology, comprising:

the payment range detection unit is used for detecting whether the payment equipment which is in wireless connection with the cash register is in the payment range or not, and if so, the cash register detection unit is operated;

the cash register device detection unit is used for judging whether the cash register device exists in the live-action image acquired by the payment device or not, and if so, operating the payment guide image synthesis unit and the payment unit;

the payment guide image synthesis unit is used for synthesizing a payment identifier corresponding to the cash register device into the live-action image to obtain a payment guide image;

the payment unit is used for paying to an account associated with the cash register device according to a payment request initiated aiming at the payment identifier in the payment guide image.

The present application further provides a method for payment at a client based on AR technology, comprising:

acquiring a live-action image based on an image acquisition device of the payment equipment;

uploading the live-action image to a server;

receiving and displaying a payment guide image sent by the server aiming at the live-action image; the payment guide image comprises a payment identifier corresponding to the cash register device;

and determining an account associated with the cash register device according to the received payment operation instruction aiming at the payment identifier and carrying out payment.

Optionally, before the step of acquiring the live-action image by the image acquisition device based on the payment device is executed, the following operations are executed:

judging whether the use authority of the image acquisition device is acquired, if so, judging whether the use authority of a wireless connection device of the payment equipment is acquired, if so, establishing wireless connection between the payment equipment and the cash register equipment, and executing the step of acquiring the live-action image by the image acquisition device based on the payment equipment; if the information is not acquired, generating reminding information for operating the wireless connection device on the payment equipment; and if not, generating reminding information for operating the image acquisition device on the payment equipment.

Optionally, the account associated with the cash register device is determined and paid according to the received payment operation instruction for the payment identifier, and the payment is implemented in the following manner:

receiving a payment operation instruction sent by a user aiming at the payment identifier displayed by the payment equipment;

determining an account associated with the checkout device;

acquiring a store list under the account;

and receiving a payment amount and a payment password input to the account by the user based on the payment device according to the store selected by the user in the store list.

The present application additionally provides a device for making payment at a client based on AR technology, comprising:

the real-scene image acquisition unit is used for acquiring a real-scene image based on an image acquisition device of the payment equipment;

the live-action image uploading unit is used for uploading the live-action image to a server;

the payment guide image receiving and displaying unit is used for receiving and displaying the payment guide image sent by the server end aiming at the live-action image; the payment guide image comprises a payment identifier corresponding to the cash register device;

and the payment unit is used for determining the account associated with the cash register device according to the received payment operation instruction aiming at the payment identifier and carrying out payment.

The AR technology-based payment method provided by the application comprises the following steps: detecting whether a payment device which is in wireless connection with a cash register is in a payable range, if so, judging whether the cash register exists in a live-action image acquired by the payment device, and if so, executing the following operations: synthesizing a payment identifier corresponding to the cash register into the live-action image to obtain a payment guide image; and paying to an account associated with the cash register device according to a payment request initiated aiming at the payment identifier in the payment guide image.

According to the payment method based on the AR technology, the payment scene is limited in the specific area range through the detection of the payable range, the live-action image acquired by the payment equipment to the payment scene is synthesized with the related virtual information, so that the payment is realized by providing a payment entrance through the AR method combining the live-action image and the virtual information of the payment scene, the work of store customers and cashiers in the payment process is reduced, the payment efficiency is higher, and meanwhile, more convenient and more humanized payment experience is provided for the store customers.

Drawings

FIG. 1 is a process flow diagram of an embodiment of a payment method based on AR technology provided herein;

FIG. 2 is a schematic diagram of a payment process based on AR technology provided herein;

FIG. 3 is a schematic diagram of a live-action image provided by the present application;

FIG. 4 is a schematic illustration of an initial guide image provided herein;

FIG. 5 is a schematic illustration of a second type of live-action image provided by the present application;

FIG. 6 is a schematic diagram of a motion-guided image provided herein;

FIG. 7 is a schematic illustration of a payment guidance image provided herein;

FIG. 8 is a schematic diagram of an embodiment of a payment device based on AR technology provided herein;

FIG. 9 is a process flow diagram of another embodiment of a payment method based on AR technology as provided herein;

fig. 10 is a schematic diagram of another embodiment of a payment device based on AR technology provided herein.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.

The application provides a payment method based on an AR technology, and also provides a payment device based on the AR technology, another payment method based on the AR technology and another payment device based on the AR technology. The following detailed description and the description of the steps of the method are individually made with reference to the drawings of the embodiments provided in the present application.

The embodiment of the payment method based on the AR technology provided by the application is as follows:

referring to fig. 1, which shows a processing flow diagram of an embodiment of a payment method based on AR technology provided by the present application, referring to fig. 2, which shows a schematic diagram of a payment flow based on AR technology provided by the present application, referring to fig. 3, which shows a schematic diagram of a live-action image provided by the present application, referring to fig. 4, which shows a schematic diagram of an initial guide image provided by the present application, referring to fig. 5, which shows a schematic diagram of a second live-action image provided by the present application, referring to fig. 6, which shows a schematic diagram of a mobile guide image provided by the present application, referring to fig. 7, which shows a schematic diagram of a payment guide image provided by the present application.

Step S101, whether a payment device which is in wireless connection with a cash register device is in a payable range is detected.

The payment method based on the AR technology provided by the application has the advantages that the AR technology is applied to the payment scene, the wireless connection device is arranged on the cashier equipment of the off-line physical store in the payment scene, the cashier equipment and the payment equipment can be wirelessly connected, the virtual information for reminding and guiding a user (namely, a store customer) is synthesized into the live-action image collected by the payment equipment according to the live-action image of the off-line physical store collected by the payment equipment, the synthesized image is displayed to the user through the payment equipment, so that the payment entrance is provided for the user through the AR method combining the live-action image of the real scene of the off-line physical store in the payment scene and the virtual information, the user is guided to complete payment in the store, the operation efficiency in the payment process can be improved, the work of the user and store cashiers is reduced, and the AR technology is applied to the payment method in the payment scene, the payment method provides more convenient and more humanized payment experience for the user.

It should be noted that, the payment method based on the AR technology provided in the present application may be implemented on the basis of a server, for example, on the side of a server for providing a payment service, in this implementation, the payment method based on the AR technology needs to cooperate with the payment method based on the AR technology implemented on the client provided below, and the payment is completed through the cooperative execution of the two methods. The embodiments of the present application are described by taking this as an example, that is: the payment method based on the AR technology implemented on the server side is taken as an example for description, so that please refer to the embodiment of the payment method based on the AR technology implemented on the client side provided in the following description of the present application.

In addition, the payment method based on the AR technology provided by the present application may also be implemented based on a client, for example, a payment device where the client is located is used as an operation carrier of the payment method based on the AR technology. Or, the payment method based on the AR technology may also be implemented based on both the server and the client, and when the payment method based on the AR technology is implemented specifically, part of steps of the payment method based on the AR technology may be executed at the server, and another part of steps is executed based on the client.

According to the payment method based on the AR technology, when the payment method is specifically implemented, an AR payment setting needs to be configured on a cash register in advance in a store, and first, a wireless connection device is arranged on the cash register, so that the interaction between the cash register and the payment device in the payment process can be realized, for example, after a Bluetooth module is arranged in the cash register, the cash register can detect a smart phone for starting Bluetooth, and accordingly, the smart phone can detect the cash register through the Bluetooth when in payment. Secondly, after the wireless connection device is arranged on the cash register device, the cash register device needs to be bound with a cash register account (for example, an account of a store) of the store, so that the payment operation initiated by the user can be corresponded to the account of the store, and the amount paid by the user can be transacted to the account of the store. Preferably, the hardware identifier of the wireless connection device of the cash register setting can be bound with the store account, and the payment device identifies the store account to be paid by identifying the hardware identifier of the wireless connection device in the cash register device. Finally, when payment is carried out, the cash register device also needs to start the AR function, namely, the wireless connection device arranged on the cash register device is opened, so that the payment device of the user can detect the cash register device through the wireless signal of the wireless connection device, and the AR payment is carried out on the basis.

As shown in fig. 2, when an AR payment setting is configured on a cash register device (e.g., a cash register), the AR payment setting is implemented by payment software (e.g., a payment bank), the store first sets a payment bank collection account number and binds the payment bank collection account number with a cash register ID, and a binding relationship between the cash register ID and the payment bank collection account is established by a hardware identifier of a bluetooth module according to the cash register setting, so as to bind store information (e.g., store ID, name) with the cash register device. In addition, for stores operated in a chain mode, one or more stores may be bound to the same store account, a specific store under the store account may be selected by the user for payment, or a specific store under the store account may be designated by the store party for payment when the user pays.

Above-mentioned completion is to receiving the AR payment setting of silver-colored equipment side, correspondingly, still need to carry out AR payment setting to this side of user place customer end, promptly: the AR payment is started when payment is carried out through the payment equipment, specifically, the use permission of an image acquisition device of the payment equipment is obtained, and the use permission of a wireless connection device of the payment equipment is obtained, for example, when a user pays through a portable smart phone, the use permission of a camera and the use permission of Bluetooth of the smart phone are obtained, the user is ensured to smoothly start the camera to acquire a live-action image in a current payment scene when paying, and Bluetooth connection is established with the cash register equipment through Bluetooth. In practical applications, the opening of AR payments on payment devices can be achieved by: whether the use authority of a wireless connection device of the payment equipment is obtained or not is further judged by judging whether the use authority of the image acquisition device of the payment equipment is obtained or not, and if the use authority of the wireless connection device is obtained, wireless connection between the payment equipment and the cash register equipment is established; if the use authority of the wireless connection device is not obtained, generating reminding information for operating the wireless connection device on the payment equipment to remind a user of opening the use authority of the wireless connection device; and if the use authority of the image acquisition device is not obtained, generating reminding information for operating the image acquisition device on the payment equipment, and reminding a user to open the use authority of the wireless connection device so as to start AR payment of the payment equipment.

Generally speaking, in an AR payment scenario, a wireless signal coverage range of a wireless connection device set by a cash register device is limited, and meanwhile, an image acquisition range of a payment device is also limited, which not only means that an image acquisition direction of the image acquisition device in the payment device is limited, for example, an image acquisition angle of a camera configured by a terminal device such as a smart phone is limited, but also means that an acquisition distance of the image acquisition device is limited, if the distance is too far, definition of an acquired live-action image may not be guaranteed, and subsequently, identification of image elements in the live-action image is difficult. Therefore, in order to overcome the above defects, by limiting the payment range, for example, the radius of the bluetooth signal coverage range of the bluetooth device in the cash register is 60 meters, in order to ensure smooth bluetooth communication, the region of the payable range can be limited to be within 5m or 10m from the cash register, so that not only is smooth bluetooth communication between the payment device and the cash register ensured, but also the quality of the acquired live-action image can be ensured when the user performs image acquisition through the image acquisition device in the payment device in the region.

In specific implementation, whether the payment device is in a payable range needs to be detected, that is, whether the payment device wirelessly connected with the cash register device is in the payable range is detected in the step, and if the payment device is in the payable range, the following processing is performed, that is, the following step S102 is executed to determine whether the cash register device exists in the live-action image acquired by the payment device; and if the payment equipment is out of the payable range, guiding the user to move to the payable range for payment in a reminding manner.

In a preferred implementation manner provided by the embodiment of the present application, whether the payment device is within the payable range is detected by: determining the signal strength of a wireless signal of a wireless connection device set by the cash register device detected by the payment device; judging whether the signal intensity is in a signal intensity threshold range corresponding to the payable range, if so, performing subsequent processing, namely executing the following step S102 to judge whether a cash register exists in the live-action image acquired by the payment equipment; if not, sending reminding information of the user, which is out of the payable range, to the payment device so as to guide the user to pay within the payable range.

Step S102, judging whether the cash register device exists in the live-action image collected by the payment device.

The step S101 detects whether the payment device is within a payable range, if the payment device is within the payable range, the step is executed to determine whether the cash register device exists in the live-action image acquired by the payment device, and if the cash register device exists in the live-action image, the step S103 is executed to synthesize a payment identifier corresponding to the cash register device into the live-action image to obtain a payment guidance image; if the real-time image does not exist, the user needs to be reminded and guided to move the payment equipment, and correspondingly, the image acquisition range of the payment equipment is changed, so that the cash register equipment appears in the real-time image acquired by the payment equipment.

In a preferred embodiment provided by the embodiment of the present application, in this step, it is determined whether the cash register device exists in the live-action image collected by the payment device, and the method specifically includes:

detecting whether an image element of a cash register exists in the live-action image, if so, executing the following step S103, and synthesizing a payment identifier corresponding to the cash register into the live-action image to obtain a payment guide image; if not, the following operations are executed: determining relative position information of the payment device to the cash register device; according to the relative position information and the image acquisition direction of the payment equipment, determining that the payment equipment is moved to the initial movement direction and/or the initial rotation direction of the cash register equipment covered by the image acquisition range of the payment equipment; synthesizing an initial movement indicator mark and/or an initial rotation indicator mark corresponding to the initial movement direction and/or the initial rotation direction into the live-action image to obtain an initial guide image; and sending the initial guide image to a payment device, and displaying the initial guide image on a screen of the payment device by the payment device.

For example, in a live-action image acquired by a smartphone carried by a user, if the live-action image shown in fig. 3 does not have a cash register, determining relative position information of the smartphone with respect to the cash register in the actual scene, determining an image acquisition direction of the smartphone according to a gyroscope built in the smartphone, determining which direction to rotate the smartphone according to the relative position information of the smartphone and the image acquisition direction of the smartphone, so that the smartphone can be brought into an image acquisition range of the smartphone, synthesizing a rotation indicator corresponding to the direction into the live-action image, and finally sending the synthesized initial guide image to the smartphone, and displaying the initial guide image on a screen of the smartphone, as shown in fig. 4. After the smart phone is rotated counterclockwise according to the rotation indication direction, the cash register appears in the live-action image collected by the smart phone, as shown in fig. 5.

In a specific implementation, the determining the relative position information of the payment device to the cash register device is preferably implemented in the following manner: acquiring first position information of the payment equipment and second position information of the cash register equipment; and calculating and obtaining the relative position information of the payment device to the cash register device according to the first position information and the second payment position information. The first location information of the payment device and the second location information of the cashier device are determined, such as by GPS or LBS.

As described above, according to the signal strength of the wireless signal sent by the wireless connection device set by the cash register device detected by the payment device, the distance between the payment device and the cash register device can be determined, and based on this, if the distances between the payment device and the two cash register devices can be respectively determined, the position of the payment device can be determined accordingly. In practice, a plurality of cash register devices are provided in many stores, and preferably, if the cash register devices complete AR payment setting, the position information of the payment device may be determined according to the signal strength of the wireless signals of at least two of the cash register devices detected by the payment device.

Preferably, if the store is provided with two cash register devices: the first and second cash register devices may determine, based on the first and second cash register devices, relative position information of the payment device with respect to the cash register devices as follows: acquiring first wireless signal intensity of a first cash register device and second wireless signal intensity of a second cash register device, which are detected by payment equipment; according to the first wireless signal intensity and the second wireless signal intensity, respectively calculating a first distance between a payment device and the first cash register device and a second distance between the payment device and the second cash register device; and determining first relative position information of the payment device to the first cash register device and second relative position information of the payment device to the second cash register device according to the first distance and the second distance.

And step S103, synthesizing the payment identifier corresponding to the cash register into the live-action image to obtain a payment guide image.

In specific implementation, before the payment identifier corresponding to the cash register device is synthesized into the live-action image acquired by the payment device in this step, whether the payment device is aligned with the cash register device may be further detected, preferably, whether the image acquisition direction of the payment device is aligned with the position of the cash register device may be further detected, and if the detection result is that the payment device is aligned with the cash register device, this step may be executed to synthesize the payment identifier corresponding to the cash register device into the live-action image, so as to obtain the payment guidance image. If the detection result is that the payment device is not yet aligned with the cash register device, the payment device is preferably directed to the cash register device by: determining coordinate information of an image element of a cash register device in the live view image; determining a moving direction and/or a rotating direction for moving and/or rotating an image element of a cash register device to the central area of the live-action image according to the coordinate information; synthesizing a movement indicator mark and/or a rotation indicator mark corresponding to the movement direction and/or the rotation direction into the live-action image to obtain a movement guide image; and sending the mobile guide image to a payment device, and displaying the mobile guide image on a screen of the payment device by the payment device.

For example, as shown in fig. 5, in the live-action image, the smartphone is included in the left edge area, and it can be known that although the cash register is located in the image capturing range of the smartphone, the image capturing direction of the smartphone is not aligned with the position of the cash register; the smartphone is moved to the left side according to the movement indication sign for moving the smartphone to the left side displayed in the movement guidance image shown in fig. 6, and after the movement, the image element of the cash register is displayed in the central area of the payment guidance image collected by the smartphone, as shown in fig. 7.

In this step, the payment identifier corresponding to the cash register device is synthesized into the live-action image collected by the payment device, so as to obtain the payment guide image. And after the payment guide image is obtained after the composition, sending the payment guide image to a payment device, and displaying the payment guide image on a screen of the payment device by the payment device. In a preferred embodiment provided by the embodiment of the application, when the payment device collects the live-action image, the live-action image is collected according to a preset collection period, and the live-action image collected in each collection period is sent to the server, and then the server generates the payment guide image according to the live-action image and sends the payment guide image to the payment device, and the payment device displays the payment guide image on a screen of the payment device.

Preferably, the payment identifier corresponding to the cash registering device and the image element of the cash registering device both have a position association and/or a size association in said payment guide image. Based on this, if the position of the cash register device in the live-action image collected by the payment device changes, for example, the position of the payment device changes due to the user walking, or the image collecting direction of the payment device changes due to the arm movement of the user, so that the position of the cash register in the live-action image collected by the payment device changes, the payment identifier corresponding to the cash register device also changes along with the position change of the cash register device, so as to present an effect that the payment identifier "follows" the cash register device, in an embodiment of the present application, the following method is adopted to implement: judging whether the image elements of the cash register in the live-action images acquired in two adjacent acquisition periods have position changes, if so, executing the following operations: determining displacement information of an image element of a cash register device in the live-action image; calculating new coordinate information of the payment identifier in the payment guiding image formed in the next acquisition period according to the displacement information and the coordinate information of the payment identifier in the payment guiding image generated in the previous acquisition period; synthesizing the payment identifier into a payment guide image formed in the next acquisition period according to the new coordinate information; and sending the generated payment guiding image to a payment device, and displaying the payment guiding image on a screen of the payment device by the payment device.

In addition, if the size of the image element of the cash register device in the live-action image collected by the payment device changes, for example, because the user adjusts the focal length of the camera of the smart phone, or the user holds the smart phone to be close to the cash register device, so that the image element of the cash register device in the live-action image collected by the smart phone becomes larger, the payment identifier corresponding to the cash register device also becomes larger along with the larger of the cash register device, in an embodiment of the present application, the following method is adopted to implement: judging whether the sizes of the image elements of the cash register device in the live-action images acquired in two adjacent acquisition periods are changed, if so, executing the following operations: determining a scaling at which image elements of a checkout device change in size in the live view image; calculating new size information of the payment identifier in the payment guiding image generated in the next acquisition period according to the scaling and the size information of the payment identifier in the payment guiding image generated in the previous acquisition period; synthesizing the payment identifier into a payment guide image formed in the next acquisition period according to the new size information; and sending the generated payment guiding image to a payment device, and displaying the payment guiding image on a screen of the payment device by the payment device.

In addition to the above-mentioned change of the position of the cashier device in the live-action image acquired by the payment device, or the change of the size of the image element of the cashier device in the live-action image acquired by the payment device, if the size and the position of the image element of the cashier device in the live-action image acquired by the payment device change at the same time, the following method may be adopted: judging whether the sizes and the positions of image elements of the cash register device in the live-action images acquired in two adjacent acquisition periods are changed, if so, executing the following operations: determining displacement information of an image element of a cash register in the live-action image and a scaling rate of the image element with changed size; calculating new coordinate information and new size information of the payment identifier in the payment guide image formed in the next acquisition period according to the displacement information, the scaling and the coordinate information and the size information of the payment identifier in the payment guide image generated in the previous acquisition period; synthesizing the payment identifier into the payment guide image formed in the next acquisition period according to the new coordinate information and the new size information; and sending the generated payment guiding image to a payment device, and displaying the payment guiding image on a screen of the payment device by the payment device.

Step S104, payment is carried out on the account associated with the cash register device according to a payment request initiated aiming at the payment identifier in the payment guide image.

After the payment guide image is generated in step S103, the generated payment guide image is sent to a payment device, and the payment device displays the payment guide image on a screen thereof, where the displayed payment guide image includes a payment identifier corresponding to a cash register. When a user pays, the payment identifier is triggered, for example, the user clicks the payment identifier "pay" corresponding to a cash register included in a payment guide image displayed on a smart phone screen through touch operation, as shown in fig. 7, after receiving a payment operation instruction triggered by the user for the payment identifier, the client sends a payment request to the server, and simultaneously determines a store account associated with the cash register device corresponding to the currently triggered payment identifier, further determines a specific store corresponding to the currently triggered payment operation under the store account, inputs a payment amount and a payment password for payment after determining the store, sends a message notification of successful payment to the server after successful payment, and forwards the message notification of successful payment to one end of the cash register device by the server, so as to complete a payment process.

The embodiment of the payment device based on the AR technology provided by the application is as follows:

in the above embodiment, a payment method based on AR technology is provided, and correspondingly, a payment device based on AR technology is also provided in the present application, which is described below with reference to the accompanying drawings.

Referring to fig. 8, a schematic diagram of an embodiment of a payment device based on AR technology provided in the present application is shown.

Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to the corresponding description of the method embodiments provided above for relevant portions. The device embodiments described below are merely illustrative.

The application provides a payment device based on AR technique includes:

a payable range detection unit 801, configured to detect whether a payment device wirelessly connected to a cash register is within a payable range, and if so, operate the cash register detection unit 802;

the cash register device detecting unit 802 is configured to determine whether the cash register device exists in the live-action image collected by the payment device, and if the cash register device exists in the live-action image, operate the payment guide image synthesizing unit 803 and the payment unit 804;

the payment guide image synthesizing unit 803 is configured to synthesize a payment identifier corresponding to the cash register device into the live-action image, so as to obtain a payment guide image;

the payment unit 804 is configured to pay an account associated with the cash register device according to a payment request initiated for the payment identifier in the payment guide image.

Optionally, the payment apparatus based on AR technology includes:

and an image acquisition direction determining unit, configured to determine whether an image acquisition direction of the payment device is aligned with a position where the cash register device is located, and if so, operate the payment guiding image synthesizing unit 803.

Optionally, if the judgment result output by the image acquisition direction judgment unit indicates that the image acquisition direction of the payment device is not aligned with the position of the cash register device, the coordinate information determination unit, the change direction determination unit, the movement guide image synthesis unit and the movement guide image display unit are operated;

the coordinate information determination unit is used for determining coordinate information of an image element of the cash register device in the live-action image;

the change direction determining unit is used for determining a moving direction and/or a rotating direction for moving and/or rotating the image element of the cash register device to the central area of the live-action image according to the coordinate information;

the moving guide image synthesis unit is used for synthesizing a moving indication mark and/or a rotating indication mark corresponding to the moving direction and/or the rotating direction into the live-action image to obtain a moving guide image;

the mobile guide image display unit is used for sending the mobile guide image to the payment equipment, and the payment equipment displays the mobile guide image on a screen of the payment equipment.

Optionally, the cash register device detecting unit 802 includes:

an image element detection subunit, configured to detect whether an image element of the cash register device exists in the live-action image, and if so, operate the payment guidance image synthesizing unit 803 and the payment unit 804; if the relative position information does not exist, the relative position information determining subunit, the initial change direction determining subunit, the initial guide image synthesizing subunit and the initial guide image displaying subunit are operated;

the relative position information determining subunit is configured to determine relative position information of the payment device with respect to the cash registering device;

the initial change direction determining subunit is configured to determine, according to the relative position information and the image acquisition direction of the payment device, an initial movement direction and/or an initial rotation direction in which the payment device is moved to a position in which an image acquisition range of the payment device covers the cash register device;

the initial guide image synthesizing subunit is configured to synthesize an initial movement indicator and/or an initial rotation indicator corresponding to the initial movement direction and/or the initial rotation direction into the live-action image, so as to obtain an initial guide image;

the initial guide image display subunit is configured to send the initial guide image to the payment device, and the payment device displays the initial guide image on a screen of the payment device.

Optionally, the relative location information determining subunit includes:

the first sub-unit is used for acquiring first position information of the payment equipment and second position information of the cash register equipment;

and the second subunit is used for calculating the relative position information of the payment device to the cash register device according to the first position information and the second payment position information.

Optionally, if the cash register device set by the store includes a first cash register device and a second cash register device; correspondingly, the relative position information determining subunit includes:

the third subunit is configured to acquire a first wireless signal strength of the first cash registering device detected by the payment device, and a second wireless signal strength of the second cash registering device;

the fourth subunit is configured to calculate, according to the first wireless signal strength and the second wireless signal strength, a first distance between the payment device and the first cash register device and a second distance between the payment device and the second cash register device, respectively;

a fifth subunit, configured to determine, according to the first distance and the second distance, first relative position information of the payment device with respect to the first cash registering device, and second relative position information of the payment device with respect to the second cash registering device.

Optionally, the payment apparatus based on AR technology includes:

the position change detection unit is used for judging whether the image elements of the cash register device in the live-action images acquired in two adjacent acquisition periods are changed in position or not, and if yes, the displacement information determination unit, the new coordinate information calculation unit, the first payment guide image synthesis unit and the first payment guide image display unit are operated;

wherein the displacement information determination unit is configured to determine displacement information of an image element of the cash register device occurring in the live view image;

the new coordinate information calculation unit is used for calculating new coordinate information in a payment guide image formed in a later acquisition period of the payment identifier according to the displacement information and the coordinate information in the payment guide image generated in the previous acquisition period of the payment identifier;

the first payment guide image synthesis unit is used for synthesizing the payment identifier into the payment guide image formed in the next acquisition period according to the new coordinate information;

the first payment guiding image display unit is used for sending the generated payment guiding image to the payment equipment, and the payment equipment displays the payment guiding image on a screen of the payment equipment.

Optionally, the payment apparatus based on AR technology includes:

the size change detection unit is used for judging whether the size of an image element of the cash register device in the live-action images acquired in two adjacent acquisition periods changes or not, and if yes, the scaling determination unit, the new size information calculation unit, the second payment guide image synthesis unit and the second payment guide image display unit are operated;

wherein the scaling determining unit is configured to determine a scaling at which an image element of the cash registering device changes in size in the live view image;

the new size information calculation unit is used for calculating new size information in the payment guide image formed in the next acquisition period of the payment identifier according to the scaling and the size information in the payment guide image generated in the previous acquisition period of the payment identifier;

the second payment guide image synthesis unit is used for synthesizing the payment identifier into the payment guide image formed in the next acquisition period according to the new size information;

the second payment guiding image display unit is used for sending the generated payment guiding image to the payment equipment, and the payment equipment displays the payment guiding image on a screen of the payment equipment.

Optionally, the payment apparatus based on AR technology includes:

the position size change detection unit is used for judging whether the sizes and the positions of image elements of the cash register device in the live-action images acquired in two adjacent acquisition periods are changed or not, and if yes, the position size change determination unit, the position size change calculation unit, the third payment guide image synthesis unit and the third payment guide image display unit are operated;

the position size change determining unit is used for determining displacement information of an image element of the cash register device in the live-action image and a scaling rate of the image element with changed size;

the position size change calculation unit is used for calculating new coordinate information and new size information in a payment guide image formed in a later acquisition period of the payment identifier according to the displacement information, the scaling and the coordinate information and the size information in the payment guide image generated in the previous acquisition period of the payment identifier;

the third payment guide image synthesizing unit is used for synthesizing the payment identifier into the payment guide image formed in the next acquisition period according to the new coordinate information and the new size information;

and the third payment guiding image display unit is used for sending the generated payment guiding image to the payment equipment, and the payment equipment displays the payment guiding image on a screen of the payment equipment.

Optionally, the payable range detection unit 801 includes:

a signal strength determining subunit, configured to determine a signal strength of a wireless signal of the wireless connection device set by the cash register device detected by the payment device;

a signal strength determining subunit, configured to determine whether the signal strength is within a signal strength threshold range corresponding to the payable range, and if so, operate the cash register device detecting unit 802; if not, sending reminding information of the payment equipment out of the payable range to the payment equipment.

Another embodiment of the payment method based on the AR technology provided by the present application is as follows:

in the foregoing embodiment, a payment method based on an AR technology is provided, and correspondingly, another payment method based on an AR technology is also provided in the present application, and is implemented based on a client, and cooperates with the payment method based on an AR technology implemented based on a server in the foregoing embodiment, which is described below with reference to the accompanying drawings.

Referring to fig. 9, a flow chart of a process of an embodiment of a payment method based on AR technology provided in the present application is shown.

Since the present embodiment is matched with the method embodiments provided above, the description is relatively simple, and the relevant portions only need to refer to the corresponding description of the method embodiments provided above. The method embodiments described below are merely illustrative.

step S901, collecting a live-action image by an image collecting device based on a payment device;

step S902, uploading the live-action image to a server;

step S903, receiving and displaying a payment guide image sent by the server aiming at the live-action image; the payment guide image comprises a payment identifier corresponding to the cash register device;

step S904, determining an account associated with the cash register device according to the received payment operation instruction for the payment identifier, and performing payment.

Optionally, before the step S901 is executed, the following operations are executed: judging whether the use authority of the image acquisition device is acquired, if so, judging whether the use authority of a wireless connection device of the payment equipment is acquired, if so, establishing wireless connection between the payment equipment and the cash register equipment, and executing the step S901; if the information is not acquired, generating reminding information for operating the wireless connection device on the payment equipment; and if not, generating reminding information for operating the image acquisition device on the payment equipment.

Optionally, the step S904 is implemented as follows:

determining an account associated with the checkout device;

acquiring a store list under the account;

Another embodiment of a payment device based on AR technology provided by the present application is as follows:

in the above embodiments, another payment method based on AR technology is provided, and correspondingly, another payment apparatus based on AR technology is provided in the present application, which is described below with reference to the accompanying drawings.

Referring to fig. 10, a schematic diagram of another embodiment of a payment device based on AR technology provided in the present application is shown.

Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant portions are only referred to the corresponding description of another payment method embodiment based on AR technology provided above. The device embodiments described below are merely illustrative.

The application provides another payment device based on AR technique includes:

the real-scene image acquisition unit 10-01 is used for acquiring a real-scene image based on an image acquisition device of the payment equipment;

the live-action image uploading unit 10-02 is used for uploading the live-action image to a server;

a payment guide image receiving and displaying unit 10-03, configured to receive and display a payment guide image sent by the server for the live-action image; the payment guide image comprises a payment identifier corresponding to the cash register device;

and the payment unit 10-04 is configured to determine an account associated with the cash register device according to the received payment operation instruction for the payment identifier, and perform payment.

Optionally, the payment apparatus based on AR technology includes:

the image acquisition device use permission judging unit is used for judging whether the use permission of the image acquisition device is obtained or not, and if so, the wireless connection device use permission judging unit is operated; if not, generating reminding information for operating the image acquisition device on the payment equipment;

the wireless connection device use permission judging unit is used for judging whether the use permission of the wireless connection device of the payment equipment is obtained or not, if so, establishing wireless connection between the payment equipment and the cash register equipment, and operating the live-action image acquisition unit 10-01; and if the information is not acquired, generating reminding information for operating the wireless connection device on the payment equipment.

Optionally, the payment unit 10-04 includes:

the payment operation instruction receiving subunit is used for receiving a payment operation instruction sent by a user aiming at the payment identifier displayed by the payment equipment;

an account determining subunit, configured to determine an account associated with the cash registering device;

the store list acquiring subunit is used for acquiring a store list under the account;

and the store payment subunit is used for receiving the payment amount and the payment password input to the account by the user based on the payment device according to the store selected by the user in the store list.

Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.

In a typical configuration, a computing device includes one or more processors, input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Claims

1. A payment method based on AR technology is characterized by comprising the following steps:

synthesizing a payment identifier corresponding to the cash register into the live-action image to obtain a payment guide image, and sending the payment guide image to the payment device;

and paying to an account associated with the cash register device according to a payment request initiated after the payment device receives a payment operation instruction triggered by a user aiming at a payment identifier corresponding to the cash register device in the payment guide image.

2. The AR technology-based payment method according to claim 1, wherein before the step of synthesizing the payment identifier corresponding to the cash register device into the live-action image and obtaining the payment-oriented image is executed, the following operations are executed:

3. The AR technology-based payment method according to claim 2, wherein if the determination result of the step of determining whether the image capturing direction of the payment apparatus is aligned with the position of the cash register apparatus is negative, the following operations are performed:

4. The AR technology-based payment method according to claim 1, wherein the determining whether the cash register device exists in the live-action image collected by the payment device is implemented by:

5. The AR technology-based payment method according to claim 4, wherein the determining of the relative position information of the payment device to the cash register device is implemented by:

and calculating the relative position information of the payment device to the cash register device according to the first position information and the second position information.

6. The AR technology-based payment method according to claim 5, wherein the store corresponding to the account is provided with at least two cash register devices, and the cash register devices are respectively provided with wireless connection devices.

7. The AR technology-based payment method according to claim 6, wherein if the cashier devices set by the store comprise a first cashier device and a second cashier device;

8. The AR technology-based payment method according to any one of claims 1 to 7, wherein the payment device acquires the live-action image according to a preset acquisition cycle, and the payment guidance image generated from the live-action image in each acquisition cycle is transmitted to the payment device, and the payment guidance image is displayed on a screen thereof by the payment device.

9. The AR technology-based payment method of claim 8, wherein both the payment identification corresponding to the cash register device and the image element of the cash register device have a position association and/or a size association in the payment guide image.

10. The AR technology-based payment method of claim 9, comprising:

11. The AR technology-based payment method of claim 10, comprising:

12. The AR technology-based payment method of claim 10, comprising:

13. The AR technology-based payment method of any one of claims 1 to 7, wherein the association of the cash register device with the account is determined based on a binding relationship between a hardware identifier of the wireless connection device of the cash register setting and the account.

14. The AR technology-based payment method according to claim 13, wherein the detection of whether the payment device establishing wireless connection with the cash register device is within a payable range is performed by:

judging whether the signal intensity is in a signal intensity threshold range corresponding to the payable range, if so, executing the step of judging whether the cash register device exists in the live-action image acquired by the payment device;

if not, sending reminding information of the payment equipment out of the payable range to the payment equipment.

15. An apparatus for payment based on AR technology, comprising:

the payment guide image synthesis unit is used for synthesizing a payment identifier corresponding to the cash register device into the live-action image to obtain a payment guide image, and sending the payment guide image to the payment device;

the payment unit is used for paying to an account associated with the cash register device according to a payment request initiated after the payment device receives a payment operation instruction triggered by a user aiming at a payment identifier corresponding to the cash register device in the payment guide image.

16. A method for payment at a client based on AR technology, comprising:

the method comprises the steps that an image acquisition device based on payment equipment acquires a live-action image, wherein the live-action image is a live-action image with cash register equipment, and the payment equipment is payment equipment which is in a payable range and is in wireless connection with the cash register equipment;

uploading the live-action image to a server;

and according to the received payment operation instruction of the user for the payment identifier corresponding to the cash register equipment in the payment guide image, determining an account associated with the cash register equipment and carrying out payment.

17. The method for making payment at a client based on AR technology as claimed in claim 16, wherein before the step of collecting live-action image by the image collecting device based on payment equipment, the following operations are performed:

18. The method for making payment at a client based on AR technology of claim 16, wherein the determining and making payment of the account associated with the cash register device according to the received payment operation instruction for the payment identifier is implemented as follows:

determining an account associated with the checkout device;

acquiring a store list under the account;

19. An apparatus for making payment at a client based on AR technology, comprising:

the payment device comprises a live-action image acquisition unit, a payment device and a payment processing unit, wherein the live-action image acquisition unit is used for acquiring a live-action image based on an image acquisition device of the payment device, the live-action image is a live-action image with a cash register device, and the payment device is a payment device which is in a payable range and is in wireless connection with the cash register device;

and the payment unit is used for determining an account associated with the cash register device and paying according to a received payment operation instruction of the user for the payment identification corresponding to the cash register device in the payment guide image.