CN112613475B - Code scanning interface display method and device, mobile terminal and storage medium - Google Patents

Code scanning interface display method and device, mobile terminal and storage medium Download PDF

Info

Publication number
CN112613475B
CN112613475B CN202011633743.4A CN202011633743A CN112613475B CN 112613475 B CN112613475 B CN 112613475B CN 202011633743 A CN202011633743 A CN 202011633743A CN 112613475 B CN112613475 B CN 112613475B
Authority
CN
China
Prior art keywords
mobile terminal
payment
code scanning
interface
code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011633743.4A
Other languages
Chinese (zh)
Other versions
CN112613475A (en
Inventor
孙哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202011633743.4A priority Critical patent/CN112613475B/en
Publication of CN112613475A publication Critical patent/CN112613475A/en
Application granted granted Critical
Publication of CN112613475B publication Critical patent/CN112613475B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B21/00Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01PMEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P15/00Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
    • G01P15/14Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration by making use of gyroscopes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01PMEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P15/00Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
    • G01P15/18Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration in two or more dimensions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

The embodiment of the application provides a code scanning interface display method and device, a mobile terminal and a storage medium, and relates to the technical field of mobile payment. The method comprises the following steps: acquiring movement pose information of a mobile terminal; the mobile pose information is identified to obtain an identification result, wherein the identification result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed; responding to the identification result to indicate that the mobile terminal is in a pre-code scanning state, and acquiring a target image, wherein the target image is used for indicating that payment is performed based on a graphic code provided by a service provider; and displaying a code scanning interface corresponding to the graphic code provided by the service provider. According to the embodiment of the application, the code scanning interface corresponding to the graphic code is automatically displayed based on the position and the gesture of the mobile terminal, so that complicated interface touch operation is not needed, the operation required by the code scanning interface opening process is simplified, and the interface opening efficiency is improved.

Description

Code scanning interface display method and device, mobile terminal and storage medium
Technical Field
The embodiment of the application relates to the technical field of mobile payment, in particular to a code scanning interface display method and device, a mobile terminal and a storage medium.
Background
With the development of terminal technology, users can pay the corresponding amount of money of the articles by using the mobile phone.
In the related art, a user may purchase goods through a pay-by-scan manner. Firstly, a user needs to find an icon of an application program corresponding to the two-dimensional code, so that the application program displays a home page; then the user needs to find an entrance for scanning the two-dimensional code in the home page; and scanning the two-dimensional code through the entrance, thereby completing the code scanning payment process.
Disclosure of Invention
The embodiment of the application provides a code scanning interface display method and device, a mobile terminal and a storage medium. The technical scheme is as follows:
in one aspect, an embodiment of the present application provides a method for displaying a code scanning interface, where the method includes:
acquiring movement pose information of a mobile terminal, wherein the movement pose information is used for indicating the position and the pose of the mobile terminal in a movement state;
the mobile pose information is identified to obtain an identification result, wherein the identification result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed;
responding to the identification result to indicate that the mobile terminal is in the pre-scanning state, and acquiring a target image, wherein the target image is used for indicating payment based on a graphic code provided by a service provider;
And displaying a code scanning interface corresponding to the graphic code provided by the service provider.
In another aspect, an embodiment of the present application provides a code scanning interface display device, where the device includes:
the information acquisition module is used for acquiring movement pose information of the mobile terminal, wherein the movement pose information is used for indicating the position and the pose of the mobile terminal in a movement state;
the information identification module is used for carrying out identification processing on the mobile pose information to obtain an identification result, wherein the identification result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed;
the image acquisition module is used for responding to the identification result and used for indicating that the mobile terminal is in the code scanning preposition state and acquiring a target image, and the target image is used for indicating that payment is carried out based on the graphic code provided by the service provider;
and the interface display module is used for displaying a code scanning interface corresponding to the graphic code provided by the service provider.
In another aspect, an embodiment of the present application provides a mobile terminal, where the mobile terminal includes a processor and a memory, where the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the method for displaying a code scanning interface according to the above aspect.
In yet another aspect, embodiments of the present application provide a computer readable storage medium having a computer program stored therein, the computer program being loaded and executed by a processor to implement the scan code interface display method according to the above aspect.
In yet another aspect, embodiments of the present application provide a computer program product comprising computer instructions stored in a computer-readable storage medium. The processor of the mobile terminal reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the mobile terminal executes the code scanning interface display method.
The technical scheme provided by the embodiment of the application can bring the following beneficial effects:
determining whether the mobile terminal is in a pre-code scanning state or not based on the mobile pose information of the mobile terminal; when the mobile terminal is determined to be in the code scanning preposition state, an image for indicating the graphic code provided by the service provider is acquired, and a code scanning interface corresponding to the graphic code is displayed. According to the embodiment of the application, the code scanning interface corresponding to the graphic code is automatically displayed based on the position and the gesture of the mobile terminal, so that complicated interface touch operation is not needed, the operation required by the code scanning interface opening process is simplified, and the interface opening efficiency is improved.
Drawings
FIG. 1 is a flowchart of a method for displaying a code scanning interface according to an embodiment of the present application;
FIG. 2 is a flowchart of a method for displaying a scan interface according to another embodiment of the present application;
FIG. 3 is a schematic diagram of recognition model training provided by one embodiment of the present application;
FIG. 4 is a schematic diagram of a payment process provided by one embodiment of the present application;
FIG. 5 is a flowchart of a method for displaying a scan code interface according to another embodiment of the present application;
FIG. 6 is a schematic diagram of a code scanning interface display process according to an embodiment of the present application;
FIG. 7 is a block diagram of a code scanning interface display device according to an embodiment of the present application;
fig. 8 is a block diagram of a mobile terminal according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings.
According to the method provided by the embodiment of the application, the execution main body of each step can be a mobile terminal. In a possible implementation, the mobile terminal is an electronic device such as a cell phone, tablet, smart wearable device, laptop portable computer, or the like.
The mobile terminal in the embodiment of the application comprises a display screen. Alternatively, the display screen may be a TFT (Thin Film Transistor, thin film field effect transistor) liquid crystal display screen, where the TFT liquid crystal display screen means that each liquid crystal pixel on the liquid crystal display is driven by a thin film transistor integrated therein, so that high-speed, high-brightness and high-contrast display of screen information can be achieved. Alternatively, the display screen may be an STN (Super Twisted Nematic ) screen, which has advantages of low power consumption and power saving. Optionally, the Display screen may also be an OLED (Organic Light-Emitting Display) Display screen, where the OLED Display screen has the characteristics of thinness, lightness, active Light emission, no viewing angle problem, high definition, high brightness, fast response speed, low energy consumption, wide application temperature range, strong shock resistance, low cost, and soft Display. The display screen of the terminal may have only a display function, and of course, in other possible implementation manners, the display screen of the terminal may also have both a display function and a touch function.
The mobile terminal in the embodiment of the present application further includes an image capturing device, which may be a camera or other devices, and the embodiment of the present application is not limited thereto. The mobile terminal is taken as an example of a mobile phone for description, the image acquisition device can be arranged on a front panel of the mobile terminal, can be arranged on a back panel of the mobile terminal, and can be arranged on the front panel and the back panel of the mobile terminal at the same time.
The application is described below by means of several examples.
Referring to fig. 1, a flowchart of a method for displaying a scan interface according to an embodiment of the application is shown. The method can be applied to a mobile terminal and can comprise the following steps.
And step 101, obtaining the movement pose information of the mobile terminal.
In the embodiment of the application, the mobile pose information is used for indicating the position and the pose of the mobile terminal in a mobile state.
In a possible implementation manner, the movement pose information of the mobile terminal is obtained through a sensor. For example, when the mobile terminal is in an operating state, sensor data is continuously collected through the sensor, and the sensor data is used as mobile pose information of the mobile terminal.
In a possible implementation, the sensor data may be acquired by a single sensor or by a plurality of different types of sensors.
In one example, the mobile terminal may acquire data in two dimensions of acceleration and displacement through the gyro sensor, to obtain acceleration data and displacement data, wherein the acceleration data includes acceleration in three directions of three axes (x axis, y axis, z axis), the displacement data includes displacement in three directions of three axes (x axis, y axis, z axis), and the mobile terminal determines the acceleration data and the displacement data as movement pose information of the mobile terminal.
In another example, the mobile terminal may collect acceleration data and displacement data through an acceleration Sensor (Accelerometer Sensor, ASensor) and a Gravity Sensor (gsnsor), the acceleration data including accelerations in three directions of three axes (x-axis, y-axis, z-axis), the displacement data including displacements in three directions of three axes (x-axis, y-axis, z-axis), and the mobile terminal determines the acceleration data and the displacement data as movement pose information of the mobile terminal.
In a possible implementation manner, the mobile terminal collects sensor data of preset times through the sensor, the sensor data of the preset times are determined to be mobile pose information of the mobile terminal, the preset times can be 30-200 times, if the preset times are too few, the mobile terminal collection time is too short, and the finally obtained recognition result can be inaccurate; if the preset times are too long, the mobile terminal may take too long, which may result in a need for a user to hold the mobile terminal for a long time to transfer resources, so that the resource transfer efficiency is lower. For example, the mobile terminal may collect 128 sensor data (displacement and acceleration in three directions of x, y and z), and stitch the collected 128 sensor data into 128 x 6-dimensional data (mobile pose information of the mobile terminal).
Step 102, performing recognition processing on the mobile pose information to obtain a recognition result, wherein the recognition result is used for indicating whether the mobile terminal is in a pre-code scanning state.
The code scanning preposition state refers to a preposition state when a code scanning interface is displayed. In a possible implementation manner, when the user performs the code scanning payment action, the mobile terminal obtains mobile pose information, and determines that the mobile terminal is in a code scanning pre-state based on the mobile pose information, where the code scanning pre-state may be referred to as a to-be-paid state, and of course, in other possible implementation manners, the code scanning pre-state may be referred to as other states.
And step 103, responding to the identification result to indicate that the mobile terminal is in a pre-code scanning state, and acquiring a target image, wherein the target image is used for indicating that payment is performed based on the graphic code provided by the service provider.
A service provider refers to an object that provides a service, and illustratively, the service provider may provide at least one of the following services: food, hotel, play, movie, bus, leisure, etc.
The graphic code provided by the service provider can be any graphic code, for example, the graphic code provided by the service provider can be a bar code, a two-dimensional code or other graphic codes, and the display form of the graphic code is not limited in the embodiment of the application.
In a possible implementation manner, the target image is acquired through the image acquisition device under the condition that the identification result is used for indicating that the mobile terminal is in a pre-scanning state. Illustratively, the mobile terminal acquires the target image in the background, and the user does not perceive the operation. In a possible implementation, the image acquisition device may be an AON (Always on) camera, which consumes less power.
In a possible implementation, the target image may include one or more images, and the number of images included in the target image may be determined by the acquisition frequency of the image acquisition device. The target image may be an image acquired by the image acquisition device within one second, or an image acquired by the image acquisition device within a preset time, where the preset time may be a default time, or a time set by a user.
In a possible implementation manner, the front panel and the back panel of the mobile terminal are both provided with image acquisition devices, and the mobile terminal determines which image acquisition device is used for acquiring the target image based on the current gesture. The mobile terminal may determine whether to use the image capturing device on the front panel to capture the target image or the image capturing device on the back panel to capture the target image based on a current gesture of the user holding the mobile terminal and a current gesture of the mobile terminal. In a possible implementation, the mobile terminal may acquire the target image using both the image acquisition device on the front panel and the image acquisition device on the back panel.
Step 104, displaying a code scanning interface corresponding to the graphic code provided by the service provider.
In the embodiment of the application, the code scanning interface is used for scanning the graphic codes provided by the service provider.
The code scanning interfaces corresponding to different graphic codes may be different, and the terminal needs to display the code scanning interface corresponding to the graphic code to successfully scan and identify the graphic code.
In a possible implementation, in response to the identification result being used to indicate that the mobile terminal is not in the code-scanning pre-state, the method starts from step 101 again.
It should be noted that payment may also be referred to as resource transfer, and of course, in other possible implementations, payment may also be referred to as other words, which are not limited in this regard.
In summary, in the technical scheme provided by the embodiment of the application, whether the mobile terminal is in a pre-code scanning state is determined based on the mobile pose information of the mobile terminal; when the mobile terminal is determined to be in the code scanning preposition state, an image for indicating the graphic code provided by the service provider is acquired, and a code scanning interface corresponding to the graphic code is displayed. According to the embodiment of the application, the code scanning interface corresponding to the graphic code is automatically displayed based on the position and the gesture of the mobile terminal, so that complicated interface touch operation is not needed, the operation required by the code scanning interface opening process is simplified, and the interface opening efficiency is improved.
Referring to fig. 2, a flowchart of a method for displaying a scan interface according to another embodiment of the application is shown. The method can be applied to a mobile terminal and can comprise the following steps.
Step 201, obtaining movement pose information of a mobile terminal.
In the embodiment of the application, the mobile pose information is used for indicating the position and the pose of the mobile terminal in a mobile state.
The description of step 201 is referred to the above embodiments, and will not be repeated here.
Step 202, performing recognition processing on the mobile pose information through a recognition model to obtain a recognition result, wherein the recognition result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed.
The recognition model is a model for recognizing whether the mobile terminal is in a pre-scan state. Illustratively, the recognition model may be a CNN (Convolutional Neural Network ) model.
The recognition model may be provided in a sensor hub, which is a software and hardware solution based on a low power MCU (Micro Control Unit ) and a lightweight RTOS (Real-Time Operating System ) for connecting and processing sensor data acquired by various sensors. In a possible implementation manner, an SOC (System on Chip) of the terminal is integrated with an MCU, where an operating System is running on the SOC and an RTOS is running on the MCU, and the MCU performs motion recognition on sensor data collected by the sensor (i.e. mobile pose information of the mobile terminal).
Illustratively, the recognition model in the embodiment of the present application can be adapted to the sequence data, and the size of the recognition model in the embodiment of the present application after quantization is less than 20kb, and the quantized recognition model is stored in the sensor hub.
In a possible implementation manner, when the mobile terminal performs recognition processing on the mobile pose information through the recognition model, before obtaining a recognition result, the recognition model needs to be trained, and the training process of the recognition model may include the following steps:
1. acquiring training data, wherein the training data comprises at least one training movement pose information and a standard recognition result corresponding to the training movement pose information;
2. carrying out recognition processing on the training movement pose information through a recognition model to obtain a prediction recognition result;
3. and training the recognition model based on the predicted recognition result and the standard recognition result to obtain a recognition model after training.
In a possible implementation manner, training movement pose information when the mobile terminal is in a code scanning preposition state is taken as a positive sample, training movement pose information when the mobile terminal is not in the code scanning preposition state is taken as a negative sample, and training is performed on an initial neural network model to finally obtain an identification model meeting the identification accuracy requirement.
Illustratively, as shown in FIG. 3, a schematic diagram of recognition model training provided by one embodiment of the present application is shown. Assume that 128 x 6-dimensional data formed by splicing 128 sensor data acquired by a sensor is used as training movement pose information; labeling the training mobile pose information (either manually or by a labeling model) to obtain a standard recognition result; the training movement pose information is identified through a neural network model (identification model) to obtain a prediction identification result; and obtaining the recognition model after training in response to the error between the predicted recognition result and the standard recognition result being smaller than the threshold value.
Step 203, responding to the identification result to indicate that the mobile terminal is in a pre-code scanning state, and acquiring an image through a rear camera of the mobile terminal to obtain an acquired image.
Under the condition that the mobile terminal is in a code scanning preposed state, the mobile terminal performs image acquisition through the postposition camera, and the postposition camera can be an AON postposition camera and is low in power consumption.
In a possible implementation manner, the identification result is used for indicating that the mobile terminal is in a code scanning preposition state, and image acquisition is performed through a prepositive camera of the mobile terminal to obtain an acquired image.
In a possible implementation, the mobile terminal determines whether to use a front camera or a rear camera for image acquisition based on the current pose.
In a possible implementation manner, the middle frame of the mobile terminal can be provided with an image acquisition device, and the mobile terminal can acquire images through the image acquisition device arranged on the middle frame.
In response to the acquired image including the graphic code, a target image including the graphic code is acquired from the acquired image, step 204.
In an embodiment of the application, the target image is used to indicate that payment is to be made based on a graphic code provided by the service provider.
In a possible implementation manner, the mobile terminal performs image recognition on the acquired image, determines whether the acquired image includes a graphic code, and acquires the target image from the acquired image in response to the acquired image including the graphic code.
In a possible implementation manner, when the mobile terminal performs image acquisition to obtain an acquired image, the acquired image is identified to find that the graphic code provided by the service provider does not exist, the terminal can confirm whether the acquired image includes the code scanning device, if the acquired image does not include the code scanning device or the graphic code provided by the service provider, the mobile terminal can perform the step of acquiring the mobile pose information of the mobile terminal again after false identification possibly occurs.
After the mobile terminal is identified to be in the pre-code scanning state, the image recognition technology is adopted to detect the graphic codes, so that the probability of false calling out of a code scanning interface is reduced, and the actual accuracy and the display safety of the code scanning interface are improved.
In step 205, a payment procedure corresponding to the graphic code provided by the service provider is determined based on the image feature of the target image, and the payment procedure refers to an application program providing a payment function.
In a possible implementation manner, the mobile terminal cuts out a graphic code area from the target image; image features of the graphic code region are determined. The graphics codes corresponding to different payment programs are different, and therefore, the image features of the graphics code areas corresponding to different payment programs are different. The image feature of the target image is used to indicate identification information of a payment procedure, and the mobile terminal determines the payment procedure for scanning the graphic code provided by the service provider based on the identification information of the payment procedure.
In a possible implementation manner, if the mobile terminal cannot determine the payment procedure corresponding to the graphic code provided by the service provider, the mobile terminal may determine the payment procedure corresponding to the graphic code as a default payment procedure, where the default payment procedure may be set by the user or determined by the mobile terminal based on the frequency of use, and the embodiment of the present application is not limited to this. And if the code scanning error occurs after the code scanning of the default payment program is used, automatically switching to a code scanning interface corresponding to another payment program.
In a possible implementation manner, a graphic code identification model may be pre-stored in the mobile terminal, and the input of the graphic code identification model is a target image, and the input of the graphic code identification model is output as a payment program corresponding to the graphic code in the target image. For the code scanning equipment detection model obtained through training, the model can be processed in modes of tailoring a network, optimizing the network, quantifying the model and the like before the model is deployed, so that the model is further simplified, the model reasoning speed is improved, and the real-time detection requirement of a mobile terminal is met.
Step 206, displaying the code scanning interface corresponding to the payment procedure.
The code scanning interface is an interface corresponding to the payment procedure determined in step 205.
Step 207, displaying a payment interface, wherein the payment interface comprises an input box of a payment amount and a payment confirmation control.
And responding to the code scanning interface to successfully scan the graphic codes provided by the identification service provider, and the mobile terminal jumps to display the payment interface.
The input box of the payment amount refers to a control for inputting the payment amount, and the confirmation payment control refers to a control for confirming payment to the service provider.
Step 208, the amount input in the payment amount input box is obtained.
In a possible implementation manner, the user may input the amount in the payment amount input box through voice, touch control, gesture and the like.
Taking the input of the payment amount in the payment amount input box by the user through voice as an example for description, the mobile terminal receives a voice instruction aiming at the payment amount input box; the amount is determined from the voice command.
In a possible implementation manner, the terminal needs to perform voiceprint recognition on the voice instruction, determines the voiceprint of the registered user (the registered user may refer to the registered user of the payment application) or the owner of the mobile terminal based on the voiceprint recognition, and determines the amount based on the voiceprint of the registered user or the owner. In a possible implementation manner, after determining the information of the registered user or the owner through voiceprint recognition, the mobile terminal may provide the amount of the payment amount to the service provider without receiving a selection instruction for confirming the payment control, that is, without executing step 209 described below.
As shown in fig. 4, a user turns over a mobile terminal 401, the mobile terminal 401 obtains mobile pose information, determines that the mobile terminal is in a pre-scanning state based on the mobile pose information, the mobile terminal obtains a target image, the target image is used for indicating a graphic code 402 provided by a service provider to pay, the mobile terminal displays a scanning code interface 403, after the mobile terminal 401 successfully scans and identifies the graphic code 402 provided by the service provider through the scanning code interface 403, the mobile terminal 401 displays a payment interface 404, the mobile terminal 401 collects voiceprints of a owner to determine the amount, and pays the service provider with the amount of the amount.
The embodiment of the application can automatically switch the payment program based on the graphic code provided by the service provider, provides a more convenient payment mode, and brings higher convenience and safety for life of people. According to the embodiment of the application, the mobile terminal is triggered to pay by detecting the gesture action or gesture of the user holding the mobile terminal, the post camera is triggered to photograph and identify the graphic code through action detection, the corresponding payment program is automatically opened according to the identified graphic code, and the mobile terminal is enabled to automatically input specific amount to be paid according to the voiceprint recognition amount of the owner after unlocking, so that the convenience of user payment is improved when the user is inconvenient to input the amount through touch.
Step 209, in response to receiving a selection instruction for confirming the payment control, paying the service provider an amount of the money.
In a possible implementation, the selection instruction for confirming the payment control may be triggered by voice, gesture, touch, and the like.
In a possible implementation manner, after the mobile terminal successfully pays the service provider an amount of the amount (i.e., the mobile terminal successfully transfers the exchange resource from a first resource account to a second resource account, where the first resource account is a resource account corresponding to a user of the mobile terminal and the second resource account is a resource account corresponding to the service provider), the mobile terminal resumes displaying an original user interface, where the original user interface is a user interface displayed by the mobile terminal before the mobile terminal is in the pre-scan state. Illustratively, the original user interface may be a screen-in interface, an unlock desktop, a user interface of a previous application, etc., and the embodiment of the present application is not limited to the original user interface.
In a possible implementation manner, when the payment program starts the secret payment-free payment, the payment interface only comprises an input box of the payment amount, the amount of the amount input in the input box of the payment amount is obtained, and the mobile terminal pays the amount of the amount to the service provider.
Through voice input of the amount and voice confirmation of payment, the embodiment of the application provides a convenient and fast payment mode without sense and contact, and the experience of a user is improved.
It should be noted that, the amount may also be referred to as a virtual resource, and the amount may also be referred to as a virtual resource amount, and of course, in other possible implementations, there may be other names for the amount and the amount, which is not limited in this embodiment of the present application.
In the embodiment of the application, the user only needs to execute the pre-code scanning action and shoot the image of the graphic code by using the mobile terminal, and the mobile terminal can automatically display the code scanning interface without complex interface touch operation. And the mobile terminal does not need to start a camera for a long time to collect images by taking the pre-code scanning action as a pre-condition, so that the overall power consumption of the terminal when the code scanning interface is automatically displayed is reduced.
According to the embodiment of the application, whether the gesture action of the user is to open the payment program identification graphic code is detected by the sensor, when the identification result is that the payment program identification graphic code is opened, the payment program corresponding to the graphic code is automatically opened to scan the code, so that inconvenience caused by the need of switching when the user opens the wrong application program is avoided, and the user experience is improved. According to the embodiment of the application, the rear camera shoots an image of the environment opposite to the rear camera of the mobile terminal, and whether resource transfer is performed based on the graphic code is confirmed, so that the first false recognition based on the mobile pose information is avoided, the recognition accuracy and success rate of a payment scene are ensured, and a non-sensing and non-contact convenient payment mode is provided for a user.
In summary, in the technical scheme provided by the embodiment of the application, the code scanning interface is automatically displayed, so that the payment operation flow is simplified, and the payment efficiency is improved.
According to the embodiment of the application, after the mobile terminal is determined to be in the pre-code scanning state, the payment program corresponding to the graphic code provided by the service provider is determined through the image recognition technology, and then the code scanning interface corresponding to the payment program is displayed, so that the probability of successful payment is improved.
Referring to fig. 5, a flowchart of a method for displaying a scan interface according to another embodiment of the present application is shown. The method can be applied to a mobile terminal and can comprise the following steps.
Step 501, mobile pose information of a mobile terminal is obtained, where the mobile pose information is used to indicate a position and a pose of the mobile terminal in a mobile state.
Step 502, performing recognition processing on the mobile pose information to obtain a recognition result, where the recognition result is used to indicate whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed.
In step 503, in response to the identification result, the mobile terminal is indicated to be in a pre-scan state, and a target image is acquired, where the target image is used to indicate payment based on the graphic code provided by the service provider.
The description of steps 501 to 503 can be found in the above embodiments, and will not be repeated here.
Step 504, jumping from the original user interface to the code scanning interface under the condition that the mobile terminal is in an unlocking state.
The unlocking state refers to a state that the mobile terminal is in normal operation, and the unlocking state and the screen locking state are two different states.
The original user interface refers to a user interface displayed by the mobile terminal before the mobile terminal is in the code scanning pre-state, that is, a user interface that the user is watching before the user performs the code scanning payment operation.
And under the condition that the mobile terminal is in a code scanning preposition state, and the target image is used for indicating the payment based on the graphic code provided by the service provider, the mobile terminal confirms that the payment needs to be carried out through the code scanning interface. If the mobile terminal is in the unlocking state, the mobile terminal can directly jump from the original user interface to the code scanning interface without executing unlocking operation.
Step 505, under the condition that the mobile terminal is in a screen locking state, receiving authentication information input by a user, wherein the authentication information is used for triggering the mobile terminal to perform authentication; and responding to the identity verification information input by the user and the preset identity verification information to be consistent, and jumping from the screen locking interface to the code scanning interface.
Authentication may include any of the following: password authentication, voice authentication, face authentication, iris authentication, fingerprint authentication. Illustratively, the authentication information may include any of the following: password, voice, face, iris, fingerprint.
It should be noted that, step 504 and step 505 are not performed simultaneously, and the mobile terminal determines whether to be in an unlocked state; executing step 504 when the mobile terminal is in an unlocked state; execution begins at step 505 when the mobile terminal is in a lock screen state.
The preset authentication information is information for the user to pre-store in the mobile terminal for authenticating the user's identity. The preset identity verification information is consistent with the type of the identity verification information input by the user, namely, when the identity verification information input by the user is a password, the preset identity verification information is the password; when the authentication information input by the user is sound, the preset authentication information is sound; when the identity verification information input by the user is a human face, the preset identity verification information is the human face; when the identity verification information input by the user is the iris, the preset identity verification information is the iris; when the authentication information input by the user is a fingerprint, the preset authentication information is a fingerprint.
Taking identity verification as password verification for example, the mobile terminal displays a password input interface, the mobile terminal receives the password input by the user in the password input interface, and determines that the identity verification is passed when the input password is consistent with the set password.
In a possible implementation manner, a plurality of preset identity verification information are prestored in the mobile terminal, and when the identity verification information input by the user is consistent with one of the plurality of preset identity verification information, the passing of the identity verification is confirmed.
The screen locking interface is an interface displayed when the mobile terminal is not unlocked, and is an interface displayed when the mobile terminal is in a screen locking state. When the mobile terminal determines that the identity verification information input by the user is consistent with the preset identity verification information, the mobile terminal is successfully unlocked, and the mobile terminal jumps to the code scanning interface from the screen locking interface.
In a possible implementation manner, when the authentication information input by the user is inconsistent with the preset authentication information, the mobile terminal displays prompt information, where the prompt information is used to prompt the user to reenter the authentication information.
Step 506, displaying the code scanning interface corresponding to the graphic code provided by the service provider.
The explanation is presented by taking the mobile terminal in the screen locking state as an example, and as shown in fig. 6, a schematic diagram of a code scanning interface display flow is shown. The mobile terminal displays a screen locking interface 601, and a user moves the mobile terminal so that the mobile terminal is in a code scanning preposition state; the mobile terminal acquires a target image, wherein the target image is used for indicating a resource transfer mode provided by a service provider to transfer resources based on a graphic code; the mobile terminal receives the authentication information input by the user, and in response to the authentication information input by the user being consistent with the preset authentication information, the mobile terminal jumps from the screen locking interface 601 to the code scanning interface 602. The mobile terminal background simulates and opens a payment program corresponding to the graphic code, enters a home page of the payment program, and then simulates and receives an opening instruction of the code scanning interface from the home page of the payment program, so that the terminal screen displays the code scanning interface, and the operation is simple.
The following are examples of the apparatus of the present application that may be used to perform the method embodiments of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the method of the present application.
Referring to fig. 7, a block diagram of a code scanning interface display device according to an embodiment of the present application is shown, where the device has functions for implementing the foregoing method examples, and the functions may be implemented by hardware or implemented by executing corresponding software by hardware. The apparatus 700 may include:
An information obtaining module 710, configured to obtain mobile pose information of a mobile terminal, where the mobile pose information is used to indicate a position and a pose of the mobile terminal in a mobile state;
the information identifying module 720 is configured to identify the mobile pose information to obtain an identification result, where the identification result is used to indicate whether the mobile terminal is in a pre-scan state, and the pre-scan state is a pre-scan state when a scan interface is displayed;
an image acquisition module 730, configured to, in response to the identification result, be configured to indicate that the mobile terminal is in the pre-scan state, acquire a target image, where the target image is configured to indicate that payment is performed based on a graphic code provided by a service provider;
and the interface display module 740 is used for displaying a code scanning interface corresponding to the graphic code provided by the service provider.
In summary, in the technical scheme provided by the embodiment of the application, whether the mobile terminal is in a pre-code scanning state is determined based on the mobile pose information of the mobile terminal; when the mobile terminal is determined to be in the code scanning preposition state, an image for indicating the graphic code provided by the service provider is acquired, and a code scanning interface corresponding to the graphic code is displayed. According to the embodiment of the application, the code scanning interface corresponding to the graphic code is automatically displayed based on the position and the gesture of the mobile terminal, so that complicated interface touch operation is not needed, the operation required by the code scanning interface opening process is simplified, and the interface opening efficiency is improved.
In an exemplary embodiment, the image acquisition module 730 is configured to:
acquiring an image through a rear camera of the mobile terminal to obtain an acquired image;
and in response to the acquired image including the graphic code, acquiring the target image including the graphic code from the acquired image.
In an exemplary embodiment, the interface display module 740 is configured to:
determining a payment program corresponding to the graphic code provided by the service provider based on the image characteristics of the target image, wherein the payment program refers to an application program for providing a payment function;
and displaying a code scanning interface corresponding to the payment program.
In an exemplary embodiment, the apparatus further comprises: a quantity acquisition module, a money payment module (not shown in the figure).
The interface display module 740 is further configured to display a payment interface, where the payment interface includes an input box for payment amount and a payment confirmation control;
the quantity acquisition module is used for acquiring the quantity of the amount input in the payment amount input box;
and the amount payment module is used for paying the amount of the amount to the service provider in response to receiving the selection instruction of the confirmed payment control.
In an exemplary embodiment, the number acquisition module is configured to:
receiving a voice instruction of an input box for the payment amount;
the amount is determined from the voice command.
In an exemplary embodiment, the apparatus further comprises: an interface skip module (not shown).
The interface jumping module is used for:
jumping from an original user interface to the code scanning interface under the condition that the mobile terminal is in an unlocking state;
under the condition that the mobile terminal is in a screen locking state, receiving authentication information input by a user, wherein the authentication information is used for triggering the mobile terminal to perform authentication; and responding to the identity verification information input by the user being consistent with the preset identity verification information, and jumping from the screen locking interface to the code scanning interface.
In an exemplary embodiment, the information identifying module 720 is configured to:
and carrying out recognition processing on the mobile pose information through a recognition model to obtain a recognition result.
In an exemplary embodiment, the apparatus further comprises: a model training module (not shown);
the model training module is used for:
acquiring training data, wherein the training data comprises at least one piece of training movement pose information and a standard recognition result corresponding to the training movement pose information;
The training movement pose information is identified through the identification model, and a prediction identification result is obtained;
and training the recognition model based on the predicted recognition result and the standard recognition result to obtain the recognition model after training.
It should be noted that, when the apparatus provided in the foregoing embodiment performs the functions thereof, only the division of the foregoing functional modules is used as an example, in practical application, the foregoing functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to perform all or part of the functions described above. In addition, the apparatus and the method embodiments provided in the foregoing embodiments belong to the same concept, and specific implementation processes of the apparatus and the method embodiments are detailed in the method embodiments and are not repeated herein.
Referring to fig. 8, a block diagram of a mobile terminal according to an embodiment of the present application is shown.
The mobile terminal in the embodiment of the application can comprise one or more of the following components: a processor 810 and a memory 820.
Processor 810 may include one or more processing cores. The processor 810 connects various parts within the overall terminal using various interfaces and lines, performs various functions of the terminal and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 820, and invoking data stored in the memory 820. Alternatively, the processor 810 may be implemented in hardware in at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 810 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU) and a modem etc. Wherein, the CPU mainly processes an operating system, application programs and the like; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 810 and may be implemented on a single chip.
Optionally, the processor 810, when executing program instructions in the memory 820, implements the methods provided by the various method embodiments described above.
The Memory 820 may include a random access Memory (Random Access Memory, RAM) or a Read-Only Memory (ROM). Optionally, the memory 820 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 820 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 820 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the various method embodiments described above, and the like; the storage data area may store data created according to the use of the mobile terminal, etc.
The structure of the mobile terminal described above is merely illustrative, and the mobile terminal may include more or less components in actual implementation, such as: a display screen, an image capturing apparatus, and the like, which is not limited in this embodiment.
Those skilled in the art will appreciate that the structure shown in fig. 8 is not limiting of the mobile terminal and may include more or fewer components than shown, or may combine certain components, or may employ a different arrangement of components.
In an exemplary embodiment, there is also provided a computer readable storage medium having stored therein a computer program loaded and executed by a processor of a mobile terminal to implement the steps in the above-described embodiments of the scan code interface display method.
In an exemplary embodiment, a computer program product is provided that includes computer instructions stored in a computer-readable storage medium. The processor of the mobile terminal reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the mobile terminal executes the code scanning interface display method.
It should be understood that references herein to "a plurality" are to two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. In addition, the step numbers described herein are merely exemplary of one possible execution sequence among steps, and in some other embodiments, the steps may be executed out of the order of numbers, such as two differently numbered steps being executed simultaneously, or two differently numbered steps being executed in an order opposite to that shown, which is not limiting.
The foregoing description of the exemplary embodiments of the application is not intended to limit the application to the particular embodiments disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the application.

Claims (10)

1. The code scanning interface display method is characterized by comprising the following steps of:
acquiring movement pose information of a mobile terminal, wherein the movement pose information is used for indicating the position and the pose of the mobile terminal in a movement state;
the mobile pose information is identified to obtain an identification result, wherein the identification result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed;
responding to the identification result to indicate that the mobile terminal is in the pre-scanning state, and acquiring a target image, wherein the target image is used for indicating payment based on a graphic code provided by a service provider; the mobile terminal acquires the target image in the background, and the operation of acquiring the target image in the background is not perceived by a user;
determining a payment program corresponding to the graphic code provided by the service provider based on the image characteristics of the target image, wherein the payment program refers to an application program for providing a payment function;
And displaying a code scanning interface corresponding to the payment program.
2. The method of claim 1, wherein the acquiring the target image comprises:
acquiring an image through a rear camera of the mobile terminal to obtain an acquired image;
and in response to the acquired image including the graphic code, acquiring the target image including the graphic code from the acquired image.
3. The method of claim 1, wherein after displaying the scan code interface corresponding to the payment procedure, further comprising:
displaying a payment interface, wherein the payment interface comprises an input box of payment amount and a payment control;
acquiring the amount input in the payment amount input box;
and in response to receiving a selection instruction of the confirmed payment control, paying the amount of the amount to the service provider.
4. A method according to claim 3, wherein the obtaining the amount entered in the payment amount entry box comprises:
receiving a voice instruction of an input box for the payment amount;
the amount is determined from the voice command.
5. The method of claim 1, wherein before displaying the scan code interface corresponding to the payment procedure, further comprises:
jumping from an original user interface to the code scanning interface under the condition that the mobile terminal is in an unlocking state;
under the condition that the mobile terminal is in a screen locking state, receiving authentication information input by a user, wherein the authentication information is used for triggering the mobile terminal to perform authentication; and responding to the identity verification information input by the user being consistent with the preset identity verification information, and jumping from the screen locking interface to the code scanning interface.
6. The method according to any one of claims 1 to 5, wherein the identifying the moving pose information to obtain an identification result includes:
and carrying out recognition processing on the mobile pose information through a recognition model to obtain a recognition result.
7. The method according to claim 6, wherein the identifying the moving pose information by the identifying model further comprises, before obtaining the identifying result:
acquiring training data, wherein the training data comprises at least one piece of training movement pose information and a standard recognition result corresponding to the training movement pose information;
The training movement pose information is identified through the identification model, and a prediction identification result is obtained;
and training the recognition model based on the predicted recognition result and the standard recognition result to obtain the recognition model after training.
8. A code scanning interface display device, the device comprising:
the information acquisition module is used for acquiring movement pose information of the mobile terminal, wherein the movement pose information is used for indicating the position and the pose of the mobile terminal in a movement state;
the information identification module is used for carrying out identification processing on the mobile pose information to obtain an identification result, wherein the identification result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed;
the image acquisition module is used for responding to the identification result and used for indicating that the mobile terminal is in the code scanning preposition state and acquiring a target image, and the target image is used for indicating that payment is carried out based on the graphic code provided by the service provider; the mobile terminal acquires the target image in the background, and the operation of acquiring the target image in the background is not perceived by a user;
The interface display module is used for determining a payment program corresponding to the graphic code provided by the service provider based on the image characteristics of the target image, wherein the payment program refers to an application program for providing a payment function; and displaying a code scanning interface corresponding to the payment program.
9. A mobile terminal, characterized in that it comprises a processor and a memory, said memory storing a computer program, said computer program being loaded and executed by said processor to implement the method of displaying a swipe code interface according to any of claims 1 to 7.
10. A computer readable storage medium having a computer program stored therein, the computer program being loaded and executed by a processor to implement the scan code interface display method of any one of claims 1 to 7.
CN202011633743.4A 2020-12-31 2020-12-31 Code scanning interface display method and device, mobile terminal and storage medium Active CN112613475B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011633743.4A CN112613475B (en) 2020-12-31 2020-12-31 Code scanning interface display method and device, mobile terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011633743.4A CN112613475B (en) 2020-12-31 2020-12-31 Code scanning interface display method and device, mobile terminal and storage medium

Publications (2)

Publication Number Publication Date
CN112613475A CN112613475A (en) 2021-04-06
CN112613475B true CN112613475B (en) 2023-10-31

Family

ID=75252919

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011633743.4A Active CN112613475B (en) 2020-12-31 2020-12-31 Code scanning interface display method and device, mobile terminal and storage medium

Country Status (1)

Country Link
CN (1) CN112613475B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113177471A (en) * 2021-04-28 2021-07-27 Oppo广东移动通信有限公司 Motion detection method, motion detection device, electronic device, and storage medium
CN113298212A (en) * 2021-05-25 2021-08-24 艾酷软件技术(上海)有限公司 Graphic code display method and device
CN113887264B (en) * 2021-06-07 2022-06-21 荣耀终端有限公司 Code scanning method, system and related device
CN117453105A (en) * 2021-09-27 2024-01-26 荣耀终端有限公司 Method and device for exiting two-dimensional code
CN113935349A (en) * 2021-10-18 2022-01-14 交互未来(北京)科技有限公司 Method and device for scanning two-dimensional code, electronic equipment and storage medium
CN115079886B (en) * 2022-07-21 2023-01-03 荣耀终端有限公司 Two-dimensional code recognition method, electronic device, and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107656684A (en) * 2017-09-21 2018-02-02 珠海市魅族科技有限公司 Pay control method, device, computer installation and computer-readable recording medium
CN109067964A (en) * 2018-06-12 2018-12-21 Oppo广东移动通信有限公司 Camera control method, device, mobile terminal and storage medium
CN109213326A (en) * 2018-11-23 2019-01-15 深圳市万通顺达科技股份有限公司 Two dimensional code call-out method based on gyroscope, device, payment system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107656684A (en) * 2017-09-21 2018-02-02 珠海市魅族科技有限公司 Pay control method, device, computer installation and computer-readable recording medium
CN109067964A (en) * 2018-06-12 2018-12-21 Oppo广东移动通信有限公司 Camera control method, device, mobile terminal and storage medium
CN109213326A (en) * 2018-11-23 2019-01-15 深圳市万通顺达科技股份有限公司 Two dimensional code call-out method based on gyroscope, device, payment system

Also Published As

Publication number Publication date
CN112613475A (en) 2021-04-06

Similar Documents

Publication Publication Date Title
CN112613475B (en) Code scanning interface display method and device, mobile terminal and storage medium
US10942580B2 (en) Input circuitry, terminal, and touch response method and device
US11449857B2 (en) Code scanning method, code scanning device and mobile terminal
KR100947990B1 (en) Gaze Tracking Apparatus and Method using Difference Image Entropy
CN108446638B (en) Identity authentication method and device, storage medium and electronic equipment
US20170053149A1 (en) Method and apparatus for fingerprint identification
WO2020156194A1 (en) Fingerprint unlocking method and device, terminal and storage medium
CN112036331B (en) Living body detection model training method, device, equipment and storage medium
CN107742072B (en) Face recognition method and mobile terminal
CN108986245A (en) Work attendance method and terminal based on recognition of face
CN110059686B (en) Character recognition method, device, equipment and readable storage medium
CN111641677B (en) Message reminding method, message reminding device and electronic equipment
CN115079886B (en) Two-dimensional code recognition method, electronic device, and storage medium
US20190370451A1 (en) Touch Response Method and Device
CN109901761A (en) A kind of content display method and mobile terminal
CN110244894A (en) A kind of control method of screen locking, device, handheld terminal and storage medium
CN111325746A (en) Skin detection method and electronic equipment
CN112818733B (en) Information processing method, device, storage medium and terminal
CN112486387A (en) Application program control method and device
CN112989299A (en) Interactive identity recognition method, system, device and medium
CN110517034A (en) A kind of object identifying method and mobile terminal
CN108764927A (en) A kind of payment verification method, server and terminal
CN111275874B (en) Information display method, device and equipment based on face detection and storage medium
CN111405175B (en) Camera control method, device, computer equipment and storage medium
CN107529635A (en) Terminal control method, device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant