CN110210869B - Payment method and related equipment - Google Patents
Payment method and related equipment Download PDFInfo
- Publication number
- CN110210869B CN110210869B CN201910502913.6A CN201910502913A CN110210869B CN 110210869 B CN110210869 B CN 110210869B CN 201910502913 A CN201910502913 A CN 201910502913A CN 110210869 B CN110210869 B CN 110210869B
- Authority
- CN
- China
- Prior art keywords
- password
- gazing
- payment
- display screen
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Collating Specific Patterns (AREA)
Abstract
本申请公开了一种支付方法及相关设备,应用于包括显示屏和摄像模组的电子设备,所述方法包括:解析支付订单,得到N个订单特征信息;在所述显示屏的N个显示区域上分别显示所述N个订单特征信息;通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,每个第一焦点对应一个第一注视时刻;将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作。采用本申请实施例可提高支付的安全性。
The present application discloses a payment method and related equipment, which are applied to electronic equipment including a display screen and a camera module. The method includes: parsing a payment order to obtain N order feature information; The N order feature information is displayed on the area respectively; the human eyes are tracked by the camera module to determine the M first focal points where the human eyes look at the display screen, and each first focal point corresponds to a first gaze Time: arrange the order feature information corresponding to each first focus according to the order of the time of gazing, and obtain the first gazing password; if the first gazing password matches the first set gazing password, then execute the payment operation. The security of payment can be improved by adopting the embodiment of the present application.
Description
技术领域technical field
本申请涉及电子技术领域,尤其涉及一种支付方法及相关设备。The present application relates to the field of electronic technology, in particular to a payment method and related equipment.
背景技术Background technique
随着科技的发展和移动通信的进步,移动支付在我们的生活中得到了广泛的应用。目前的移动支付方式通常是基于指纹识别或者数字密码进行验证。在用户确定订单后,然后开启指纹验证请求用户输入指纹,或者开启密码框请求用户在键盘上手动输入数字密码,这种接触式支付方法密码信息容易被复制,安全性低。With the development of science and technology and the progress of mobile communication, mobile payment has been widely used in our life. The current mobile payment method is usually based on fingerprint recognition or digital password for verification. After the user confirms the order, then turn on the fingerprint verification to request the user to enter the fingerprint, or open the password box to request the user to manually enter the digital password on the keyboard. The password information of this contact payment method is easy to be copied, and the security is low.
发明内容Contents of the invention
本申请实施例提供一种支付方法及相关设备,用于提高支付的安全性。Embodiments of the present application provide a payment method and related equipment, which are used to improve payment security.
第一方面,本申请实施例提供一种支付方法,应用于包括显示屏和摄像模组的电子设备,所述方法包括:In the first aspect, an embodiment of the present application provides a payment method, which is applied to an electronic device including a display screen and a camera module, and the method includes:
解析支付订单,得到N个订单特征信息,所述N为大于1的整数;Parse the payment order to obtain N order feature information, where N is an integer greater than 1;
在所述显示屏的N个显示区域上分别显示所述N个订单特征信息;Displaying the N pieces of order characteristic information on the N display areas of the display screen;
通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,每个第一焦点对应一个第一注视时刻,所述M为大于1的整数;Tracking the human eyes through the camera module to determine M first focal points where the human eyes watch the display screen, each first focal point corresponds to a first gaze moment, and the M is an integer greater than 1;
将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;Arrange the order feature information corresponding to each first focus according to the order of the gazing time, and obtain the first gazing password;
若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作。If the first gaze password matches the first set gaze password, the payment operation is performed.
第二方面,本申请实施例提供一种支付装置,应用于包括显示屏和摄像模组的电子设备,所述装置包括:In the second aspect, the embodiment of the present application provides a payment device, which is applied to electronic equipment including a display screen and a camera module, and the device includes:
解析单元,用于解析支付订单,得到N个订单特征信息,所述N为大于1的整数;A parsing unit, configured to parse the payment order to obtain N order feature information, where N is an integer greater than 1;
显示单元,用于在所述显示屏的N个显示区域上分别显示所述N个订单特征信息;A display unit, configured to respectively display the N pieces of order characteristic information on the N display areas of the display screen;
确定单元,用于通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,每个第一焦点对应一个第一注视时刻,所述M为大于1的整数;A determining unit, configured to track human eyes through the camera module to determine M first focal points where the human eyes gaze at the display screen, each first focal point corresponds to a first gazing moment, and the M is greater than an integer of 1;
排序单元,将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;The sorting unit arranges the order feature information corresponding to each first focus according to the order of the gazing time, and obtains the first gazing password;
执行单元,用于若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作。An execution unit, configured to perform a payment operation if the first gaze password matches the first set gaze password.
第三方面,本申请实施例提供一种电子设备,包括处理器、存储器、通信接口以及一个或多个程序,其中,上述一个或多个程序被存储在上述存储器中,并且被配置由上述处理器执行,上述程序包括用于执行本申请实施例第一方面所述的方法中的步骤的指令。In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and are configured to be processed by the above-mentioned The above program includes instructions for executing the steps in the method described in the first aspect of the embodiments of the present application.
第四方面,本申请实施例提供了一种计算机可读存储介质,其中,上述计算机可读存储介质存储用于电子数据交换的计算机程序,其中,上述计算机程序使得计算机执行如本申请实施例第一方面所述的方法中所描述的部分或全部步骤。In a fourth aspect, the embodiment of the present application provides a computer-readable storage medium, wherein the above-mentioned computer-readable storage medium stores a computer program for electronic data exchange, wherein the above-mentioned computer program enables the computer to execute Part or all of the steps described in the method described in one aspect.
第五方面,本申请实施例提供了一种计算机程序产品,其中,上述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,上述计算机程序可操作来使计算机执行如本申请实施例第一方面所述的方法中所描述的部分或全部步骤。该计算机程序产品可以为一个软件安装包。In a fifth aspect, the embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute the program as implemented in the present application. For example, some or all of the steps described in the method described in the first aspect. The computer program product may be a software installation package.
可以看出,在本申请实施例中,电子设备先解析支付订单,得到N个订单特征信息;然后在显示屏的N个显示区域上分别显示该N个订单特征信息;通过摄像模组追踪人眼,以确定人眼注视显示屏的M个第一焦点;最后将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;若第一注视密码与第一设定注视密码相匹配,则执行支付操作,不同于目前基于指纹识别或数字密码的接触式支付方法,本方法无需直接接触电子设备就可进行解锁,从而提高了支付的安全性。It can be seen that in the embodiment of the present application, the electronic device first analyzes the payment order to obtain N order characteristic information; Eyes, to determine the M first focal points of the human eye on the display screen; finally, arrange the order feature information corresponding to each first focal point according to the order of the gazing time to obtain the first gazing password; if the first gazing password is the same as the first gazing password Once the set gaze password matches, the payment operation will be performed. Unlike the current contact payment method based on fingerprint identification or digital password, this method can be unlocked without direct contact with the electronic device, thereby improving the security of payment.
本申请的这些方面或其他方面在以下实施例的描述中会更加简明易懂。These or other aspects of the present application will be more concise and understandable in the description of the following embodiments.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1是本申请实施例提供的一种电子设备的结构示意图;FIG. 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
图2A是本申请实施例提供的一种支付方法的流程示意图;Fig. 2A is a schematic flow diagram of a payment method provided by an embodiment of the present application;
图2B是本申请实施例提供的一种显示屏显示订单特征信息的结构示意图;FIG. 2B is a schematic structural diagram of a display screen displaying order feature information provided by an embodiment of the present application;
图2C是本申请实施例提供的一种第一注视密码的结构示意图;Fig. 2C is a schematic structural diagram of a first gaze password provided by the embodiment of the present application;
图2D是本申请实施例提供的一种第二注视密码的结构示意图;Fig. 2D is a schematic structural diagram of a second gaze password provided by the embodiment of the present application;
图3是本申请实施例提供的一种支付方法的流程示意图;Fig. 3 is a schematic flow diagram of a payment method provided by an embodiment of the present application;
图4是本申请实施例提供的一种电子设备的结构示意图;FIG. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
图5是本申请实施例提供的一种支付装置的结构示意图。Fig. 5 is a schematic structural diagram of a payment device provided by an embodiment of the present application.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分的实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is an embodiment of a part of the application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.
以下分别进行详细说明。Each will be described in detail below.
本申请的说明书和权利要求书及所述附图中的术语“第一”、“第二”、“第三”和“第四”等是用于区别不同对象,而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second", "third" and "fourth" in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order . Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or apparatuses.
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.
以下,对本申请中的部分用语进行解释说明,以便于本领域技术人员理解。Hereinafter, some terms used in this application are explained to facilitate the understanding of those skilled in the art.
电子设备可以包括各种具有无线通信功能的手持设备、车载设备、可穿戴设备、计算设备或连接到无线调制解调器的其他处理设备,以及各种形式的用户设备(UserEquipment,UE),移动台(Mobile Station,MS),终端设备(terminal device)等等。Electronic devices may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, as well as various forms of user equipment (UserEquipment, UE), mobile station (Mobile Station, MS), terminal device (terminal device) and so on.
请参见图1,图1是本申请实施例提供的一种电子设备的结构示意图,该电子设备包括处理器、存储器、信号处理器、通信接口、触控屏、扬声器、麦克风、随机存取存储器(Random Access Memory,RAM)、摄像模组、发射器和传感器等等。Please refer to FIG. 1. FIG. 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device includes a processor, a memory, a signal processor, a communication interface, a touch screen, a speaker, a microphone, and a random access memory. (Random Access Memory, RAM), camera modules, transmitters and sensors, etc.
其中,处理器也可以是AP处理器,也可以是其他处理器。Wherein, the processor may also be an AP processor, or other processors.
其中,存储器、信号处理器、触控屏、扬声器、麦克风、RAM、摄像模组、发射器和传感器与处理器连接,通信接口与信号处理器连接。Wherein, the memory, the signal processor, the touch screen, the speaker, the microphone, the RAM, the camera module, the transmitter and the sensor are connected with the processor, and the communication interface is connected with the signal processor.
其中,该触控屏包括显示屏和触控面板(Touch Panel,TP)。所述显示屏用于显示至少一个图标。Wherein, the touch screen includes a display screen and a touch panel (Touch Panel, TP). The display screen is used to display at least one icon.
其中,传感器包括屏下指纹传感器、红外传感器、陀螺仪等。Among them, the sensors include under-screen fingerprint sensors, infrared sensors, gyroscopes, etc.
其中,摄像模组包括前置摄像头和后置摄像头,摄像模组用于追踪人眼。Wherein, the camera module includes a front camera and a rear camera, and the camera module is used to track human eyes.
其中,发射器用于发射光信号。Wherein, the transmitter is used for transmitting optical signals.
在本申请实施例中,处理器,用于解析支付订单,得到N个订单特征信息,所述N为大于1的整数;在所述显示屏的N个显示区域上分别显示所述N个订单特征信息;通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,每个第一焦点对应一个第一注视时刻,所述M为大于1的整数;将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作。In the embodiment of the present application, the processor is configured to parse the payment order to obtain N order feature information, where N is an integer greater than 1; and display the N orders on the N display areas of the display screen respectively Feature information: track the human eyes through the camera module to determine M first focal points where the human eyes watch the display screen, each first focal point corresponds to a first gaze moment, and the M is greater than 1 Integer; arrange the order characteristic information corresponding to each first focal point according to the order of gazing time to obtain the first gazing password; if the first gazing password matches the first set gazing password, then execute the payment operation.
在本申请的一实现方式中,处理器,还用于若所述第一注视密码与所述第一设定注视密码不匹配,则在所述显示屏上显示数字键盘;通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的K个第二焦点,每个第二焦点对应一个第二注视时刻,所述K为大于1的整数;将每个第二焦点对应的信息按照注视时刻的早晚顺序进行排列,得到第二注视密码;若所述第二注视密码与第二设定注视密码相匹配,则执行所述支付操作。In an implementation of the present application, the processor is further configured to display a numeric keyboard on the display screen if the first gaze password does not match the first set gaze password; The group tracks the human eyes to determine K second focal points of the human eyes on the display screen, each second focal point corresponds to a second gaze moment, and the K is an integer greater than 1; each second focal point The corresponding information is arranged according to the order of gazing time, and the second gazing password is obtained; if the second gazing password matches the second set gazing password, the payment operation is executed.
在本申请的一实现方式中,处理器,还用于若所述第二注视密码与所述第二设定注视密码不匹配,则通过所述摄像模组获取所述人眼的第一录像;解析所述第一录像,以得到所述人眼的眨眼节奏;若所述眨眼节奏与预设眨眼节奏相匹配,则执行所述支付操作。In an implementation of the present application, the processor is further configured to obtain the first video of the human eye through the camera module if the second gaze password does not match the second set gaze password. ; Analyzing the first video to obtain the blinking rhythm of the human eye; if the blinking rhythm matches a preset blinking rhythm, perform the payment operation.
在本申请的一实现方式中,处理器,还用于若所述眨眼节奏与所述预设眨眼节奏不匹配,则通过所述摄像模组获取所述人眼的第一图像;解析所述第一图像,以得到所述人眼的虹膜信息和/或巩膜信息;若所述虹膜信息和/或所述巩膜信息与预设虹膜信息和/或预设巩膜信息相匹配,则执行所述支付操作。In an implementation manner of the present application, the processor is further configured to acquire the first image of the human eye through the camera module if the blink rhythm does not match the preset blink rhythm; analyze the The first image is to obtain iris information and/or sclera information of the human eye; if the iris information and/or the sclera information matches the preset iris information and/or preset sclera information, then execute the payment operation.
在本申请的一实现方式中,在通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点方面,处理器,具体用于控制所述发射器发射第一光信号照射人眼;通过所述摄像模组获取所述人眼的M个第二图像;确定所述M个第二图像中的所述人眼的瞳孔的第一位置和普尔钦斑的第二位置,所述普尔钦斑为所述第一光信号照射在所述人眼的角膜上反射形成的光斑;基于所述M个第二图像中的所述第一位置和所述第二位置确定所述人眼注视所述显示屏的M个第一焦点,每个第二图像对应的获取时刻与每个第一焦点对应的注视时刻相同。In an implementation manner of the present application, in terms of tracking the human eyes through the camera module to determine the M first focal points where the human eyes look at the display screen, the processor is specifically used to control the transmitter Emit the first light signal to irradiate the human eye; acquire M second images of the human eye through the camera module; determine the first position of the pupil of the human eye in the M second images and The second position of the spot, the Purchin spot is the light spot formed by the reflection of the first light signal on the cornea of the human eye; based on the first position in the M second images and the The second position determines M first focal points where the human eyes gaze at the display screen, and the acquisition time corresponding to each second image is the same as the gazing time corresponding to each first focus.
在本申请的一实现方式中,在通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点之前,处理器,还用于控制所述发射器发射M个第二光信号照射所述N个显示区域中的M个显示区域,每个第二光信号对应照射一个显示区域,不同的显示区域的第二光信号的颜色是不同的,所述第二光信号的颜色用于提示所述人眼的注视顺序,不同的第二光信号的颜色对应不同的注视顺序。In an implementation manner of the present application, before the human eyes are tracked by the camera module to determine the M first focal points where the human eyes look at the display screen, the processor is also used to control the transmitter transmitting M second light signals to irradiate M display areas in the N display areas, each second light signal correspondingly irradiates one display area, and the colors of the second light signals in different display areas are different, the The color of the second light signal is used to prompt the gaze sequence of the human eyes, and different colors of the second light signal correspond to different gaze sequences.
在本申请的一实现方式中,所述N个订单特征信息包括以下至少两个:收货地址、配送时间、商品名称、订单金额、备注信息、联系电话、支付账号。In an implementation manner of the present application, the N pieces of order feature information include at least two of the following: delivery address, delivery time, commodity name, order amount, remark information, contact number, and payment account number.
需要说明的是,各模块所执行的步骤的具体实现过程可参见下述方法所述的具体实现过程,在此不再叙述。It should be noted that, for the specific implementation process of the steps executed by each module, reference may be made to the specific implementation process described in the following methods, which will not be described here again.
请参见图2A,图2A是本申请实施例提供的一种支付方法的流程示意图,应用于包括显示屏和摄像模组的电子设备,所述方法包括:Please refer to Fig. 2A. Fig. 2A is a schematic flow diagram of a payment method provided by an embodiment of the present application, which is applied to electronic equipment including a display screen and a camera module. The method includes:
步骤201:解析支付订单,得到N个订单特征信息,所述N为大于1的整数。Step 201: Parse the payment order to obtain N order feature information, where N is an integer greater than 1.
在本申请的一实现方式中,所述N个订单特征信息包括以下至少两个:收货地址、配送时间、商品名称、订单金额、备注信息、联系电话、支付账号。In an implementation manner of the present application, the N pieces of order feature information include at least two of the following: delivery address, delivery time, commodity name, order amount, remark information, contact number, and payment account number.
在本申请的一实现方式中,在解析支付订单,得到N个订单特征信息之前,所述方法还包括:In an implementation of the present application, before parsing the payment order and obtaining N order feature information, the method further includes:
在检测到支付指令时,获取支付订单。When the payment instruction is detected, the payment order is acquired.
其中,支付指令可以是对电子设备实体按键(例如电源按键、音量按键等)的按压操作,也可以是对显示屏的点击、滑动等操作,还可以是对电子设备的抬起唤醒操作,还可以是对电子设备预设次数的眨眼操作或预设时长的注视操作,在此不作限定。Among them, the payment instruction may be a pressing operation on a physical button of the electronic device (such as a power button, a volume button, etc.), or an operation such as clicking or sliding on a display screen, or an operation of lifting and waking up an electronic device, or It may be a blink operation of a preset number of times or a gaze operation of a preset duration on the electronic device, which is not limited herein.
步骤202:在所述显示屏的N个显示区域上分别显示所述N个订单特征信息。Step 202: Displaying the N pieces of order characteristic information on the N display areas of the display screen respectively.
举例说明,图2B是本申请实施例提供的一种显示屏显示订单特征信息的结构示意图。如图2B所示,图中所示的电子设备包括4个显示区域,显示区域1显示收货地址,显示区域2显示配送时间,显示区域3显示商品名称,显示区域4显示订单金额。For example, FIG. 2B is a schematic structural diagram of a display screen displaying order feature information provided in an embodiment of the present application. As shown in Figure 2B, the electronic device shown in the figure includes four display areas,
步骤203:通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,每个第一焦点对应一个第一注视时刻,所述M为大于1的整数。Step 203: Track the human eyes through the camera module to determine M first focal points where the human eyes gaze at the display screen, each first focal point corresponds to a first gaze moment, and the M is greater than 1 integer.
在本申请的一实现方式中,所述电子设备还包括发射器,所述通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,包括:In an implementation manner of the present application, the electronic device further includes a transmitter, and the tracking of human eyes through the camera module to determine the M first focal points where the human eyes look at the display screen includes:
控制所述发射器发射第一光信号照射人眼;controlling the transmitter to emit a first light signal to irradiate human eyes;
通过所述摄像模组获取所述人眼的M个第二图像;acquiring M second images of the human eyes through the camera module;
确定所述M个第二图像中的所述人眼的瞳孔的第一位置和普尔钦斑的第二位置,所述普尔钦斑为所述第一光信号照射在所述人眼的角膜上反射形成的光斑;Determining a first position of the pupil of the human eye and a second position of Purchin's spot in the M second images, the Purchin's spot is that the first light signal is irradiated on the cornea of the human eye Spots formed by reflection;
基于所述M个第二图像中的所述第一位置和所述第二位置确定所述人眼注视所述显示屏的M个第一焦点,每个第二图像对应的获取时刻与每个第一焦点对应的注视时刻相同。Based on the first position and the second position in the M second images, determine the M first focal points where the human eyes look at the display screen, and the acquisition moment corresponding to each second image is the same as each The gaze moment corresponding to the first focal point is the same.
在本申请的一实现方式中,所述基于所述M个第二图像中的所述第一位置和所述第二位置确定所述人眼注视所述显示屏的M个第一焦点,包括:In an implementation manner of the present application, the determining the M first focal points at which the human eyes watch the display screen based on the first position and the second position in the M second images includes :
基于第一公式和第二公式确定所述人眼注视所述显示屏的M个第一焦点的坐标,所述第一公式和所述第二公式分别为:Determine the coordinates of the M first focal points where the human eyes look at the display screen based on the first formula and the second formula, the first formula and the second formula are respectively:
xn=a+a1·δxn+a2·δxn 2+a3·δxn 3+a4·δxn 4+a5·δxn 5;x n = a+a 1 ·δ xn +a 2 ·δ xn 2 +a 3 ·δ xn 3 +a 4 ·δ xn 4 +a 5 ·δ xn 5 ;
yn=b+b1·δyn+b2·δyn 2+b3·δyn 3+b4·δyn 4+b5·δyn 5;y n =b+b 1 ·δ yn +b 2 ·δ yn 2 +b 3 ·δ yn 3 +b 4 ·δ yn 4 +b 5 ·δ yn 5 ;
其中,所述xn和yn分别为第n个焦点的横坐标和纵坐标,所述δxn和δyn分别为第n个普尔钦斑的横坐标和第n个瞳孔的横坐标之差的绝对值、第n个普尔钦斑的纵坐标和第n个瞳孔的纵坐标之差的绝对值,所述a~a5、b~b5为经验参数;Wherein, said x n and y n are respectively the abscissa and ordinate of the nth focal point, and said δ xn and δ yn are respectively the difference between the abscissa of the nth Purchin spot and the abscissa of the n pupil , the absolute value of the difference between the ordinate of the nth Purchin's spot and the ordinate of the nth pupil, the a~a 5 , b~b 5 are empirical parameters;
基于所述M个第一焦点的坐标确定所述M个第一焦点。The M first focal points are determined based on the coordinates of the M first focal points.
其中,a~a5、b~b5可以基于多次试验确定,或者基于神经网络方法训练确定。Wherein, a~a 5 , b~b 5 can be determined based on multiple experiments, or determined based on neural network training.
在本申请的一实现方式中,所述基于所述M个第二图像中的所述第一位置和所述第二位置确定所述人眼注视所述显示屏的M个第一焦点,包括:In an implementation manner of the present application, the determining the M first focal points at which the human eyes watch the display screen based on the first position and the second position in the M second images includes :
基于第三公式和第四公式确定所述人眼注视所述显示屏的M个第一焦点的坐标,所述第三公式和所述第四公式分别为:Determine the coordinates of the M first focal points where the human eyes look at the display screen based on the third formula and the fourth formula, the third formula and the fourth formula are respectively:
xn=c+c1·δxn+c2·δyn+c3·δxn·δyn+c4·δxn 2+c5·δyn 2;x n =c+c 1 ·δ xn +c 2 ·δ yn +c 3 ·δ xn ·δ yn +c 4 ·δ xn 2 +c 5 ·δ yn 2 ;
yn=d+d1·δyn+d2·δxn+d3·δxn·δyn+d4·δxn 2+d5·δyn 2;y n =d+d 1 ·δ yn +d 2 ·δ xn +d 3 ·δ xn ·δ yn +d 4 ·δ xn 2 +d 5 ·δ yn 2 ;
其中,所述xn和yn分别为第n个焦点的横坐标和纵坐标,所述δxn和δyn分别为第n个普尔钦斑的横坐标和第n个瞳孔的横坐标之差的绝对值、第n个普尔钦斑的纵坐标和第n个瞳孔的纵坐标之差的绝对值,所述c~c5、d~d5为经验参数;Wherein, said x n and y n are respectively the abscissa and ordinate of the nth focal point, and said δ xn and δ yn are respectively the difference between the abscissa of the nth Purchin spot and the abscissa of the n pupil The absolute value of , the absolute value of the difference between the ordinate of the nth Purchin spot and the ordinate of the nth pupil, the c~c 5 , d~d 5 are empirical parameters;
基于所述M个第一焦点的坐标确定所述M个第一焦点。The M first focal points are determined based on the coordinates of the M first focal points.
其中,c~c5、d~d5可以基于多次试验确定,或者基于神经网络方法训练确定。Wherein, c-c 5 , d-d 5 can be determined based on multiple experiments, or determined based on neural network training.
步骤204:将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码。Step 204: Arrange the order feature information corresponding to each first focal point according to the order of gazing time, to obtain the first gazing password.
步骤205:若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作。Step 205: If the first gaze password matches the first set gaze password, perform a payment operation.
举例说明,图2C是本申请实施例提供的一种第一注视密码的结构示意图。如图2C所示,人眼在首先第一注视时刻1注视收货地址,然后在第一注视时刻2注视配送时间,接着在第一注视时刻3注视商品名称,最后在第一注视时刻4注视订单金额,由此可以得到第一注视密码为:收货地址—>配送时间—>商品名称—>订单金额,若第一设定注视密码也为:收货地址—>配送时间—>商品名称—>订单金额,则执行支付操作。For example, FIG. 2C is a schematic structural diagram of a first gaze password provided by an embodiment of the present application. As shown in Figure 2C, the human eye focuses on the delivery address at the
可以看出,在本申请实施例中,电子设备先解析支付订单,得到N个订单特征信息;然后在显示屏的N个显示区域上分别显示该N个订单特征信息;通过摄像模组追踪人眼,以确定人眼注视显示屏的M个第一焦点;最后将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;若第一注视密码与第一设定注视密码相匹配,则执行支付操作,不同于目前基于指纹识别或数字密码的接触式支付方法,本方法无需直接接触电子设备就可进行解锁,从而提高了支付的安全性。It can be seen that in the embodiment of the present application, the electronic device first analyzes the payment order to obtain N order characteristic information; Eyes, to determine the M first focal points of the human eye on the display screen; finally, arrange the order feature information corresponding to each first focal point according to the order of the gazing time to obtain the first gazing password; if the first gazing password is the same as the first gazing password Once the set gaze password matches, the payment operation will be executed. Unlike the current contact payment method based on fingerprint identification or digital password, this method can be unlocked without direct contact with the electronic device, thereby improving the security of payment.
在本申请的一实现方式中,所述方法还包括:In an implementation of the present application, the method further includes:
若所述第一注视密码与所述第一设定注视密码不匹配,则在所述显示屏上显示数字键盘;If the first gaze password does not match the first set gaze password, a numeric keyboard is displayed on the display screen;
通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的K个第二焦点,每个第二焦点对应一个第二注视时刻,所述K为大于1的整数;Tracking the human eyes through the camera module to determine K second focal points where the human eyes watch the display screen, each second focal point corresponds to a second gazing moment, and the K is an integer greater than 1;
将每个第二焦点对应的信息按照注视时刻的早晚顺序进行排列,得到第二注视密码;Arrange the information corresponding to each second focal point according to the order of the gazing time, and obtain the 2nd gazing password;
若所述第二注视密码与第二设定注视密码相匹配,则执行所述支付操作。If the second gaze password matches the second set gaze password, the payment operation is executed.
举例说明,图2D是本申请实施例提供的一种第二注视密码的结构示意图。如图2D所示,人眼首先在第二注视时刻1注视数字键盘上的4,然后在第二注视时刻2注视数字键盘上的3,接着在第二注视时刻3注视数字键盘上的7,最后在第二注视时刻4注视数字键盘上的1,由此可以得到第二注视密码为:4371,若第二设定注视密码也为:4371,则执行支付操作。For example, FIG. 2D is a schematic structural diagram of a second gaze password provided by an embodiment of the present application. As shown in Figure 2D, the human eye first focuses on 4 on the numeric keypad at the
在本申请的一实现方式中,所述方法还包括:In an implementation of the present application, the method further includes:
若所述第二注视密码与所述第二设定注视密码不匹配,则通过所述摄像模组获取所述人眼的第一录像;If the second gaze password does not match the second set gaze password, then obtain the first video of the human eye through the camera module;
解析所述第一录像,以得到所述人眼的眨眼节奏;analyzing the first video to obtain the blink rhythm of the human eye;
若所述眨眼节奏与预设眨眼节奏相匹配,则执行所述支付操作。If the blinking rhythm matches the preset blinking rhythm, the payment operation is performed.
举例说明,人眼首先眨眼4次,然后停顿1s之后在眨眼3次,接着停顿1s之后在眨眼7次,再停顿1s之后眨眼1次,则可确定眨眼节奏为4371,若预设眨眼节奏也为4371,则执行支付操作。For example, if the human eye first blinks 4 times, then blinks 3 times after a pause of 1 second, then blinks 7 times after a pause of 1 second, and then blinks 1 time after a pause of 1 second, then the blink rhythm can be determined to be 4371. If the preset blink rhythm is also If it is 4371, execute the payment operation.
在本申请的一实现方式中,所述方法还包括:In an implementation of the present application, the method further includes:
若所述眨眼节奏与所述预设眨眼节奏不匹配,则通过所述摄像模组获取所述人眼的第一图像;If the blinking rhythm does not match the preset blinking rhythm, acquiring the first image of the human eye through the camera module;
解析所述第一图像,以得到所述人眼的虹膜信息和/或巩膜信息;analyzing the first image to obtain iris information and/or sclera information of the human eye;
若所述虹膜信息和/或所述巩膜信息与预设虹膜信息和/或预设巩膜信息相匹配,则执行所述支付操作。If the iris information and/or the sclera information match the preset iris information and/or the preset sclera information, the payment operation is performed.
其中,虹膜信息包括以下至少一种:像冠、水晶体、细丝、斑点、凹点、射线、皱纹、条纹。Wherein, the iris information includes at least one of the following: crowns, crystals, filaments, spots, pits, rays, wrinkles, and stripes.
其中,巩膜信息包括以下至少一点:巩膜血管分叉点、巩膜血管交叉点、巩膜血管端点、巩膜血管纹线。Wherein, the sclera information includes at least one of the following: scleral vessel bifurcation point, scleral vessel intersection point, scleral vessel end point, and scleral vessel striae.
在本申请的一实现方式中,所述通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点之前,所述方法还包括:In an implementation manner of the present application, before the human eyes are tracked by the camera module to determine that the human eyes look at the M first focal points of the display screen, the method further includes:
控制所述发射器发射M个第二光信号照射所述N个显示区域中的M个显示区域,每个第二光信号对应照射一个显示区域,不同的显示区域的第二光信号的颜色是不同的,所述第二光信号的颜色用于提示所述人眼的注视顺序,不同的第二光信号的颜色对应不同的注视顺序。Controlling the emitter to emit M second light signals to illuminate M display areas in the N display areas, each second light signal corresponds to illuminating one display area, and the colors of the second light signals in different display areas are Differently, the color of the second light signal is used to prompt the gaze sequence of the human eyes, and different colors of the second light signal correspond to different gaze sequences.
举例说明,如图2B所示,控制发射器发射红光照射显示区域1,红光用于提示人眼首先注视显示区域1;控制发射器发射蓝光照射显示区域2,蓝光用于提示人眼首先注视显示区域2;控制发射器发射黄光照射显示区域3,黄光用于提示人眼首先注视显示区域3;控制发射器发射绿光照射显示区域4,绿光用于提示人眼首先注视显示区域4.For example, as shown in Figure 2B, the control emitter emits red light to irradiate
在本申请的一实现方式中,所述若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作之前,所述方法还包括:In an implementation of the present application, if the first gaze password matches the first set gaze password, before performing the payment operation, the method further includes:
基于所述N个订单特征信息中的至少一个订单特征信息确定所述第一设定注视密码。The first set gaze password is determined based on at least one order characteristic information in the N pieces of order characteristic information.
举例说明,若订单特征信息包括收货地址、配送时间、商品名称、订单金额,则确定第一设定注视密码为:收货地址—>配送时间—>商品名称—>订单金额;若订单信息包括备注信息、联系电话、支付账号,则确定第一设定注视密码为:备注信息—>联系电话—>支付账号。For example, if the order feature information includes the delivery address, delivery time, product name, and order amount, then determine the first set watch password as: delivery address—>delivery time—>product name—>order amount; if the order information Including remark information, contact phone number, payment account number, then determine the first set watch password as: Remark Information—>Contact Number—>Payment Account Number.
在本申请的一实现方式中,所述若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作之前,所述方法还包括:In an implementation of the present application, if the first gaze password matches the first set gaze password, before performing the payment operation, the method further includes:
基于所述支付订单对应的支付应用的第一信息确定所述第一设定注视密码,所述第一信息包括以下至少一种:所述支付应用的安全级别、与上次打开所述支付应用的间隔时长、所述支付应用的使用频率。The first set gaze password is determined based on the first information of the payment application corresponding to the payment order, and the first information includes at least one of the following: the security level of the payment application, and the last time the payment application was opened The interval length of the payment application and the frequency of use of the payment application.
在本申请的一实现方式中,若所述支付应用为银行应用,则确定所述支付应用的安全级别为A;若所述支付应用为支付宝或微信,则确定所述支付应用的安全级别为B;若所述支付应用为运营商应用,则确定所述支付应用的安全级别为C,安全级别A大于B大于C。In an implementation of the present application, if the payment application is a bank application, then determine that the security level of the payment application is A; if the payment application is Alipay or WeChat, then determine that the security level of the payment application is A B: If the payment application is an operator application, determine that the security level of the payment application is C, and the security level A is greater than B than C.
举例说明,若安全级别为A,则确定第一设定注视密码为:收货地址—>配送时间—>商品名称—>订单金额;若安全级别为B,则确定第一设定注视密码为:商品名称—>订单金额—>收货地址—>配送时间;若安全级别为C,则确定第一设定注视密码为:收货地址—>商品名称—>订单金额—>配送时间。For example, if the security level is A, then determine the first set watch password as: receiving address —> delivery time —> commodity name —> order amount; if the security level is B, then determine the first set watch password is : Commodity name—>order amount—>delivery address—>delivery time; if the security level is C, then confirm that the first set watch password is: receiver address—>commodity name—>order amount—>delivery time.
又举例说明,与上次打开所述支付应用的间隔时长大于或等于一分钟时,则确定第一设定注视密码为:收货地址—>配送时间—>商品名称—>订单金额;与上次打开所述支付应用的间隔时长大于或等于一分钟时,则确定第一设定注视密码为:商品名称—>订单金额—>收货地址—>配送时间。As another example, when the interval between the last time the payment application was opened is greater than or equal to one minute, then the first set watch password is determined to be: receiving address—>delivery time—>commodity name—>order amount; When the interval between opening the payment application for the first time is greater than or equal to one minute, then determine that the first set watch password is: product name—>order amount—>delivery address—>delivery time.
又举例说明,所述支付应用的使用频率大于或等于5次/周时,则确定第一设定注视密码为:收货地址—>配送时间—>商品名称—>订单金额;所述支付应用的使用频率小于5次/周时,则确定第一设定注视密码为:商品名称—>订单金额—>收货地址—>配送时间。Another example illustrates that when the frequency of use of the payment application is greater than or equal to 5 times/week, then the first set watch password is determined to be: delivery address—>delivery time—>commodity name—>order amount; the payment application When the frequency of use is less than 5 times/week, then confirm that the first setting watch password is: product name—>order amount—>delivery address—>delivery time.
与所述图2A所示的实施例一致的,请参阅图3,图3是本申请实施例提供的一种支付方法的流程示意图,应用于包括显示屏、摄像模组和发射器的电子设备,本方法包括:Consistent with the embodiment shown in FIG. 2A, please refer to FIG. 3. FIG. 3 is a schematic flowchart of a payment method provided by the embodiment of the present application, which is applied to electronic equipment including a display screen, a camera module and a transmitter , this method includes:
步骤301:解析支付订单,得到N个订单特征信息,所述N个订单特征信息包括以下至少两个:收货地址、配送时间、商品名称、订单金额、备注信息、联系电话、支付账号,所述N为大于1的整数。Step 301: Parse the payment order to obtain N order feature information. The N order feature information includes at least two of the following: delivery address, delivery time, commodity name, order amount, remarks, contact number, payment account number, all Said N is an integer greater than 1.
步骤302:在所述显示屏的N个显示区域上分别显示所述N个订单特征信息。Step 302: Displaying the N pieces of order characteristic information on the N display areas of the display screen respectively.
步骤303:控制所述发射器发射M个第二光信号照射所述N个显示区域中的M个显示区域,每个第二光信号对应照射一个显示区域,不同的显示区域的第二光信号的颜色是不同的,所述第二光信号的颜色用于提示所述人眼的注视顺序,不同的第二光信号的颜色对应不同的注视顺序。Step 303: Control the emitter to emit M second light signals to illuminate M display areas in the N display areas, each second light signal corresponds to illuminate a display area, and the second light signals of different display areas The colors are different, and the color of the second light signal is used to prompt the gaze order of the human eyes, and different colors of the second light signal correspond to different gaze orders.
步骤304:控制所述发射器发射第一光信号照射人眼。Step 304: Control the transmitter to emit a first light signal to irradiate human eyes.
步骤305:通过所述摄像模组获取所述人眼的M个第二图像。Step 305: Obtain M second images of the human eyes through the camera module.
步骤306:确定所述M个第二图像中的所述人眼的瞳孔的第一位置和普尔钦斑的第二位置,所述普尔钦斑为所述第一光信号照射在所述人眼的角膜上反射形成的光斑。Step 306: Determine the first position of the pupil of the human eye and the second position of the Purchin spot in the M second images, the Purchin spot is the first light signal irradiated on the human eye Spots formed by reflection on the cornea.
步骤307:基于所述M个第二图像中的所述第一位置和所述第二位置确定所述人眼注视所述显示屏的M个第一焦点,每个第二图像对应的获取时刻与每个第一焦点对应的注视时刻相同。Step 307: Based on the first position and the second position in the M second images, determine M first focal points where the human eyes look at the display screen, and the acquisition time corresponding to each second image The fixation moments corresponding to each first focal point are the same.
步骤308:将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码。Step 308: Arrange the order feature information corresponding to each first focal point according to the order of gazing time, to obtain the first gazing password.
步骤309:确定所述第一注视密码与第一设定注视密码是否匹配。Step 309: Determine whether the first gaze password matches the first set gaze password.
若否,则执行步骤310;If not, execute
若是,则执行步骤320。If yes, execute
步骤310:在所述显示屏上显示数字键盘。Step 310: Display a numeric keypad on the display screen.
步骤311:通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的K个第二焦点,每个第二焦点对应一个第二注视时刻,所述K为大于1的整数。Step 311: Track the human eyes through the camera module to determine K second focal points where the human eyes gaze at the display screen, each second focal point corresponds to a second gaze moment, and the K is greater than 1 integer.
步骤312:将每个第二焦点对应的信息按照注视时刻的早晚顺序进行排列,得到第二注视密码。Step 312: arrange the information corresponding to each second focal point according to the sequence of gazing time, and obtain the 2nd gazing password.
步骤313:确定所述第二注视密码与第二设定注视密码是否匹配。Step 313: Determine whether the second gaze password matches the second set gaze password.
若否,则执行步骤314;If not, then execute
若是,则执行步骤320。If yes, execute
步骤314:通过所述摄像模组获取所述人眼的第一录像。Step 314: Obtain the first video of the human eye through the camera module.
步骤315:解析所述第一录像,以得到所述人眼的眨眼节奏。Step 315: Analyze the first video to obtain the blink rhythm of the human eye.
步骤316:确定所述眨眼节奏与预设眨眼节奏是否匹配。Step 316: Determine whether the blinking rhythm matches a preset blinking rhythm.
若否,则执行步骤317;If not, then execute
若是,则执行步骤320。If yes, execute
步骤317:解析所述第一图像,以得到所述人眼的虹膜信息和/或巩膜信息。Step 317: Analyze the first image to obtain iris information and/or sclera information of the human eye.
步骤318:确定所述虹膜信息和/或所述巩膜信息与预设虹膜信息和/或预设巩膜信息是否匹配。Step 318: Determine whether the iris information and/or the sclera information match the preset iris information and/or the preset sclera information.
若否,则执行步骤319;If not, then execute
若是,则执行步骤320。If yes, execute
步骤319:不执行所述支付操作。Step 319: The payment operation is not performed.
步骤320:执行所述支付操作。Step 320: Execute the payment operation.
需要说明的是,本实施例的具体实现过程可参见上述方法实施例所述的具体实现过程,在此不再叙述。It should be noted that, for the specific implementation process of this embodiment, reference may be made to the specific implementation process described in the foregoing method embodiments, which will not be described here again.
与上述图2A和图3所示的实施例一致的,请参阅图4,图4是本申请实施例提供的一种电子设备的结构示意图,如图所示,该电子设备包括处理器、存储器、通信接口以及一个或多个程序,其中,上述一个或多个程序被存储在上述存储器中,并且被配置由上述处理器执行,上述程序包括用于执行以下步骤的指令:Consistent with the embodiment shown in FIG. 2A and FIG. 3 above, please refer to FIG. 4. FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in the figure, the electronic device includes a processor, a memory , a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the processor, and the programs include instructions for performing the following steps:
解析支付订单,得到N个订单特征信息,所述N为大于1的整数;Parse the payment order to obtain N order feature information, where N is an integer greater than 1;
在所述显示屏的N个显示区域上分别显示所述N个订单特征信息;Displaying the N pieces of order characteristic information on the N display areas of the display screen;
通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,每个第一焦点对应一个第一注视时刻,所述M为大于1的整数;Tracking the human eyes through the camera module to determine M first focal points where the human eyes watch the display screen, each first focal point corresponds to a first gaze moment, and the M is an integer greater than 1;
将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;Arrange the order feature information corresponding to each first focus according to the order of the gazing time, and obtain the first gazing password;
若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作。If the first gaze password matches the first set gaze password, the payment operation is performed.
在本申请的一实现方式中,上述程序包括还用于执行以下步骤的指令:In an implementation of the present application, the above-mentioned program includes instructions for performing the following steps:
若所述第一注视密码与所述第一设定注视密码不匹配,则在所述显示屏上显示数字键盘;If the first gaze password does not match the first set gaze password, a numeric keyboard is displayed on the display screen;
通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的K个第二焦点,每个第二焦点对应一个第二注视时刻,所述K为大于1的整数;Tracking the human eyes through the camera module to determine K second focal points where the human eyes watch the display screen, each second focal point corresponds to a second gazing moment, and the K is an integer greater than 1;
将每个第二焦点对应的信息按照注视时刻的早晚顺序进行排列,得到第二注视密码;Arrange the information corresponding to each second focal point according to the order of the gazing time, and obtain the 2nd gazing password;
若所述第二注视密码与第二设定注视密码相匹配,则执行所述支付操作。If the second gaze password matches the second set gaze password, the payment operation is executed.
在本申请的一实现方式中,上述程序包括还用于执行以下步骤的指令:In an implementation of the present application, the above-mentioned program includes instructions for performing the following steps:
若所述第二注视密码与所述第二设定注视密码不匹配,则通过所述摄像模组获取所述人眼的第一录像;If the second gaze password does not match the second set gaze password, then obtain the first video of the human eye through the camera module;
解析所述第一录像,以得到所述人眼的眨眼节奏;analyzing the first video to obtain the blink rhythm of the human eye;
若所述眨眼节奏与预设眨眼节奏相匹配,则执行所述支付操作。If the blinking rhythm matches the preset blinking rhythm, the payment operation is performed.
在本申请的一实现方式中,上述程序包括还用于执行以下步骤的指令:In an implementation of the present application, the above-mentioned program includes instructions for performing the following steps:
若所述眨眼节奏与所述预设眨眼节奏不匹配,则通过所述摄像模组获取所述人眼的第一图像;If the blinking rhythm does not match the preset blinking rhythm, acquiring the first image of the human eye through the camera module;
解析所述第一图像,以得到所述人眼的虹膜信息和/或巩膜信息;analyzing the first image to obtain iris information and/or sclera information of the human eye;
若所述虹膜信息和/或所述巩膜信息与预设虹膜信息和/或预设巩膜信息相匹配,则执行所述支付操作。If the iris information and/or the sclera information match the preset iris information and/or the preset sclera information, the payment operation is performed.
在本申请的一实现方式中,所述电子设备还包括发射器,在通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点方面,上述程序包括具体用于执行以下步骤的指令:In an implementation manner of the present application, the electronic device further includes a transmitter. In terms of tracking human eyes through the camera module to determine the M first focal points where the human eyes look at the display screen, the above program Include instructions specifically to perform the following steps:
控制所述发射器发射第一光信号照射人眼;controlling the transmitter to emit a first light signal to irradiate human eyes;
通过所述摄像模组获取所述人眼的M个第二图像;acquiring M second images of the human eyes through the camera module;
确定所述M个第二图像中的所述人眼的瞳孔的第一位置和普尔钦斑的第二位置,所述普尔钦斑为所述第一光信号照射在所述人眼的角膜上反射形成的光斑;Determining a first position of the pupil of the human eye and a second position of Purchin's spot in the M second images, the Purchin's spot is that the first light signal is irradiated on the cornea of the human eye Spots formed by reflection;
基于所述M个第二图像中的所述第一位置和所述第二位置确定所述人眼注视所述显示屏的M个第一焦点,每个第二图像对应的获取时刻与每个第一焦点对应的注视时刻相同。Based on the first position and the second position in the M second images, determine the M first focal points where the human eyes look at the display screen, and the acquisition moment corresponding to each second image is the same as each The gaze moment corresponding to the first focal point is the same.
在本申请的一实现方式中,在通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点之前,上述程序包括还用于执行以下步骤的指令:In an implementation manner of the present application, before the human eyes are tracked by the camera module to determine the M first focal points where the human eyes look at the display screen, the above program includes instructions for performing the following steps :
控制所述发射器发射M个第二光信号照射所述N个显示区域中的M个显示区域,每个第二光信号对应照射一个显示区域,不同的显示区域的第二光信号的颜色是不同的,所述第二光信号的颜色用于提示所述人眼的注视顺序,不同的第二光信号的颜色对应不同的注视顺序。Controlling the emitter to emit M second light signals to illuminate M display areas in the N display areas, each second light signal corresponds to illuminating one display area, and the colors of the second light signals in different display areas are Differently, the color of the second light signal is used to prompt the gaze sequence of the human eyes, and different colors of the second light signal correspond to different gaze sequences.
在本申请的一实现方式中,所述N个订单特征信息包括以下至少两个:收货地址、配送时间、商品名称、订单金额、备注信息、联系电话、支付账号。In an implementation manner of the present application, the N pieces of order feature information include at least two of the following: delivery address, delivery time, commodity name, order amount, remark information, contact number, and payment account number.
需要说明的是,本实施例的具体实现过程可参见上述方法实施例所述的具体实现过程,在此不再叙述。It should be noted that, for the specific implementation process of this embodiment, reference may be made to the specific implementation process described in the foregoing method embodiments, which will not be described here again.
上述实施例主要从方法侧执行过程的角度对本申请实施例的方案进行了介绍。可以理解的是,电子设备为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。The foregoing embodiments mainly introduce the solutions of the embodiments of the present application from the perspective of executing a process on the method side. It can be understood that, in order to realize the above functions, the electronic device includes hardware structures and/or software modules corresponding to each function. Those skilled in the art should easily realize that the present application can be implemented in the form of hardware or a combination of hardware and computer software in combination with the units and algorithm steps of each example described in the embodiments disclosed herein. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
本申请实施例可以根据所述方法示例对电子设备进行功能单元的划分,例如,可以对应各个功能划分各个功能单元,也可以将两个或两个以上的功能集成在一个处理单元中。所述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。需要说明的是,本申请实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。The embodiment of the present application may divide the electronic device into functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated units can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic, and is only a logical function division, and there may be another division manner in actual implementation.
下面为本申请装置实施例,本申请装置实施例用于执行本申请方法实施例所实现的方法。请参阅图5,图5是本申请实施例提供的一种支付装置的结构示意图,应用于包括显示屏和摄像模组的电子设备,所述装置包括:The following are the device embodiments of the present application, and the device embodiments of the present application are used to implement the methods implemented by the method embodiments of the present application. Please refer to Figure 5. Figure 5 is a schematic structural diagram of a payment device provided by an embodiment of the present application, which is applied to electronic equipment including a display screen and a camera module, and the device includes:
解析单元501,用于解析支付订单,得到N个订单特征信息,所述N为大于1的整数;The
显示单元502,用于在所述显示屏的N个显示区域上分别显示所述N个订单特征信息;A
确定单元503,用于通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点,每个第一焦点对应一个第一注视时刻,所述M为大于1的整数;The
排序单元504,将每个第一焦点对应的订单特征信息按照注视时刻的早晚顺序进行排列,得到第一注视密码;The
执行单元505,用于若所述第一注视密码与第一设定注视密码相匹配,则执行支付操作。The
在本申请的一实现方式中,所述显示单元502,还用于若所述第一注视密码与所述第一设定注视密码不匹配,则在所述显示屏上显示数字键盘;In an implementation of the present application, the
所述确定单元503,还用于通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的K个第二焦点,每个第二焦点对应一个第二注视时刻,所述K为大于1的整数;The
所述排序单元504,还用于将每个第二焦点对应的信息按照注视时刻的早晚顺序进行排列,得到第二注视密码;The
所述执行单元505,还用于若所述第二注视密码与第二设定注视密码相匹配,则执行所述支付操作。The executing
在本申请的一实现方式中,所述装置还包括获取单元506,用于若所述第二注视密码与所述第二设定注视密码不匹配,则通过所述摄像模组获取所述人眼的第一录像;In an implementation of the present application, the device further includes an
所述解析单元501,还用于解析所述第一录像,以得到所述人眼的眨眼节奏;The
所述执行单元505,还用于若所述眨眼节奏与预设眨眼节奏相匹配,则执行所述支付操作。The executing
在本申请的一实现方式中,所述获取单元506,还用于若所述眨眼节奏与所述预设眨眼节奏不匹配,则通过所述摄像模组获取所述人眼的第一图像;In an implementation manner of the present application, the
所述解析单元501,还用于解析所述第一图像,以得到所述人眼的虹膜信息和/或巩膜信息;The
所述执行单元505,还用于若所述虹膜信息和/或所述巩膜信息与预设虹膜信息和/或预设巩膜信息相匹配,则执行所述支付操作。The
在本申请的一实现方式中,所述电子设备还包括发射器,在通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点方面,所述确定单元503,具体用于控制所述发射器发射第一光信号照射人眼;通过所述摄像模组获取所述人眼的M个第二图像;确定所述M个第二图像中的所述人眼的瞳孔的第一位置和普尔钦斑的第二位置,所述普尔钦斑为所述第一光信号照射在所述人眼的角膜上反射形成的光斑;基于所述M个第二图像中的所述第一位置和所述第二位置确定所述人眼注视所述显示屏的M个第一焦点,每个第二图像对应的获取时刻与每个第一焦点对应的注视时刻相同。In an implementation manner of the present application, the electronic device further includes a transmitter, and in terms of tracking human eyes through the camera module to determine M first focal points where the human eyes look at the display screen, the
在本申请的一实现方式中,在通过所述摄像模组追踪人眼,以确定所述人眼注视所述显示屏的M个第一焦点之前,所述装置还包括控制单元507,用于控制所述发射器发射M个第二光信号照射所述N个显示区域中的M个显示区域,每个第二光信号对应照射一个显示区域,不同的显示区域的第二光信号的颜色是不同的,所述第二光信号的颜色用于提示所述人眼的注视顺序,不同的第二光信号的颜色对应不同的注视顺序。In an implementation manner of the present application, before the human eyes are tracked by the camera module to determine the M first focal points where the human eyes look at the display screen, the device further includes a
在本申请的一实现方式中,所述N个订单特征信息包括以下至少两个:收货地址、配送时间、商品名称、订单金额、备注信息、联系电话、支付账号。In an implementation manner of the present application, the N pieces of order feature information include at least two of the following: delivery address, delivery time, commodity name, order amount, remark information, contact number, and payment account number.
需要说明的是,解析单元501、显示单元502、确定单元503、排序单元504、执行单元505、获取单元506和控制单元507可通过处理器实现。It should be noted that the
本申请实施例还提供一种计算机存储介质,其中,该计算机存储介质存储用于电子数据交换的计算机程序,该计算机程序使得计算机执行如上述方法实施例中记载的任一方法的部分或全部步骤,上述计算机包括电子设备。An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables the computer to execute some or all of the steps of any method described in the above method embodiments , the above-mentioned computer includes electronic equipment.
本申请实施例还提供一种计算机程序产品,上述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,上述计算机程序可操作来使计算机执行如上述方法实施例中记载的任一方法的部分或全部步骤。该计算机程序产品可以为一个软件安装包,上述计算机包括电子设备。An embodiment of the present application also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute any one of the methods described in the above method embodiments. Some or all steps of the method. The computer program product may be a software installation package, and the computer includes electronic equipment.
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本申请所必须的。It should be noted that for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Depending on the application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by this application.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置,可通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如上述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components can be combined or integrated. to another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical or other forms.
上述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
上述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储器中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储器中,包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本申请各个实施例上述方法的全部或部分步骤。而前述的存储器包括:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。If the above-mentioned integrated units are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or part of the contribution to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory. Several instructions are included to make a computer device (which may be a personal computer, server or network device, etc.) execute all or part of the steps of the above-mentioned methods in various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储器中,存储器可以包括:闪存盘、只读存储器(英文:Read-Only Memory,简称:ROM)、随机存取器(英文:Random Access Memory,简称:RAM)、磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-Only Memory, abbreviated: ROM), random access device (English: Random Access Memory, abbreviated: RAM), magnetic disk or optical disk, etc.
以上对本申请实施例进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The embodiments of the present application have been introduced in detail above, and specific examples have been used in this paper to illustrate the principles and implementation methods of the present application. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application; meanwhile, for Those skilled in the art will have changes in specific implementation methods and application scopes based on the ideas of the present application. In summary, the contents of this specification should not be construed as limiting the present application.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910502913.6A CN110210869B (en) | 2019-06-11 | 2019-06-11 | Payment method and related equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910502913.6A CN110210869B (en) | 2019-06-11 | 2019-06-11 | Payment method and related equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110210869A CN110210869A (en) | 2019-09-06 |
CN110210869B true CN110210869B (en) | 2023-07-07 |
Family
ID=67791964
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910502913.6A Expired - Fee Related CN110210869B (en) | 2019-06-11 | 2019-06-11 | Payment method and related equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110210869B (en) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107392575A (en) * | 2017-07-12 | 2017-11-24 | 北京奇安信科技有限公司 | A kind of automated payment method and device |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW201518979A (en) * | 2013-11-15 | 2015-05-16 | Utechzone Co Ltd | Handheld eye-controlled ocular device, password input device and method, computer-readable recording medium and computer program product |
TWI528213B (en) * | 2014-05-30 | 2016-04-01 | 由田新技股份有限公司 | Handheld identity verification apparatus, identity verification method and identity verification system |
CN104156643B (en) * | 2014-07-25 | 2017-02-22 | 中山大学 | Eye sight-based password inputting method and hardware device thereof |
CN107016270A (en) * | 2015-12-01 | 2017-08-04 | 由田新技股份有限公司 | Dynamic graphic eye movement authentication system and method combining face authentication or hand authentication |
KR20170112569A (en) * | 2016-03-31 | 2017-10-12 | 삼성전자주식회사 | Method for Paying for Goods and the Electronic Device supporting the same |
US10063560B2 (en) * | 2016-04-29 | 2018-08-28 | Microsoft Technology Licensing, Llc | Gaze-based authentication |
CN106709320A (en) * | 2016-11-29 | 2017-05-24 | 维沃移动通信有限公司 | Identity authentication method and mobile terminal |
CN109145566A (en) * | 2018-09-08 | 2019-01-04 | 太若科技(北京)有限公司 | Method, apparatus and AR glasses based on blinkpunkt information unlock AR glasses |
-
2019
- 2019-06-11 CN CN201910502913.6A patent/CN110210869B/en not_active Expired - Fee Related
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107392575A (en) * | 2017-07-12 | 2017-11-24 | 北京奇安信科技有限公司 | A kind of automated payment method and device |
Non-Patent Citations (2)
Title |
---|
PUFPass: A password management mechanism based on software/hardware codesign☆;Qingli Guo et al.;Integration;第64卷;173-183 * |
面向多设备交互的眼动跟踪方法;程时伟;孙志强;陆煜华;;计算机辅助设计与图形学学报(第07期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN110210869A (en) | 2019-09-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113383295B (en) | Biofeedback method for conditioning digital content to stimulate a larger pupil radius response | |
US11119573B2 (en) | Pupil modulation as a cognitive control signal | |
CN106471419B (en) | Management information is shown | |
KR102348489B1 (en) | Electronic device and method for analyzing body components recognizable body measuring region automatically | |
US10617301B2 (en) | Information processing device and information processing method | |
RU2625950C2 (en) | Information processing device | |
KR20180109109A (en) | Method of recognition based on IRIS recognition and Electronic device supporting the same | |
US20150235227A1 (en) | Payment method based on identity recognition and wrist-worn apparatus | |
CN110353622A (en) | A kind of vision testing method and eyesight testing apparatus | |
KR20170001430A (en) | Display apparatus and image correction method thereof | |
CN111445413B (en) | Image processing method, device, electronic device and storage medium | |
CN108875468A (en) | Biopsy method, In vivo detection system and storage medium | |
CN108650408B (en) | Screen unlocking method and mobile terminal | |
CN107463823A (en) | Mobile terminal, application control method and computer-readable storage medium | |
US20220354361A1 (en) | Visual acuity test method and device | |
WO2016131337A1 (en) | Method and terminal for detecting vision | |
CN110174937A (en) | Watch the implementation method and device of information control operation attentively | |
CN111612780B (en) | Human eye vision recognition method, device and computer storage medium | |
WO2021115097A1 (en) | Pupil detection method and related product | |
CN109117819A (en) | Object recognition methods, device, storage medium and wearable device | |
CN113491502A (en) | Eyeball tracking calibration inspection method, device, equipment and storage medium | |
CN110210869B (en) | Payment method and related equipment | |
CN106681491A (en) | Data processing method of virtual reality terminal and virtual reality terminal | |
CN117954047A (en) | Rehabilitation training scheme determining method and device, computer equipment and medium | |
US20240013431A1 (en) | Image capture devices, systems, and methods |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20230707 |