WO2020221009A1

WO2020221009A1 - Code scanning method and mobile terminal

Info

Publication number: WO2020221009A1
Application number: PCT/CN2020/084912
Authority: WO
Inventors: 陈锟
Original assignee: 维沃移动通信有限公司
Priority date: 2019-04-28
Filing date: 2020-04-15
Publication date: 2020-11-05
Also published as: CN110110571B; CN110110571A

Abstract

Provided are a code scanning method and a mobile terminal. The method comprises: identifying an external code scanner through a camera in the case where a display screen of the mobile terminal displays an identification code (101); and moving the identification code or outputting a movement instruction based on the identification result(102), wherein the movement instruction is used for instructing to move the position of the identification code in the display screen or move the mobile terminal.

Description

Code scanning method and mobile terminal

Cross references to related applications

This application claims the priority of Chinese Patent Application No. 201910349784.1 filed in China on April 28, 2019, the entire content of which is incorporated herein by reference.

Technical field

The present disclosure relates to the field of electronic technology, and in particular to a code scanning method and a mobile terminal.

Background technique

Currently, many scanning scenarios are based on fixed code scanners, such as self-service supermarkets, parking lots, public transportation systems, and self-service ticket collection. However, because the code scanner is fixed, when scanning the identification code of the mobile terminal (for example, a two-dimensional code), the user is usually required to face the corresponding identification code directly to the machine, that is, make the display screen of the mobile terminal and the scanner In contrast, this makes the user unable to accurately grasp the relative position between the identification code on the display screen of the mobile terminal and the barcode scanner. Therefore, during the scanning process, the user needs to repeatedly move the mobile terminal held to try to make the identification code It is aligned with the scanning area of the code scanner, which results in a cumbersome scanning operation process, low efficiency, and inconvenience to users.

Summary of the invention

The present disclosure provides a code scanning method and a mobile terminal to solve the problem of low code scanning operation efficiency in related technologies.

In the first aspect, embodiments of the present disclosure provide a code scanning method applied to a mobile terminal, and the method includes:

When the identification code is displayed on the display screen of the mobile terminal, the external code scanner is identified through the camera;

Based on the recognition result, move the identification code or output a movement instruction, wherein the movement instruction is used to instruct to move the position of the identification code in the display screen or move the mobile terminal.

In a second aspect, the embodiments of the present disclosure also provide a mobile terminal, the mobile terminal including:

The identification module is used to identify the external code scanner through the camera when the identification code is displayed on the display screen of the mobile terminal;

The control module is configured to move the identification code or output a movement instruction based on the identification result, wherein the movement instruction is used to instruct to move the position of the identification code in the display screen or move the mobile terminal.

In a third aspect, the embodiments of the present disclosure also provide a mobile terminal, including a processor, a memory, and a program stored on the memory and capable of running on the processor. The program is executed when the processor is executed. The steps of the above scanning code method.

In a fourth aspect, embodiments of the present disclosure also provide a computer-readable storage medium with a program stored on the computer-readable storage medium, and when the program is executed by a processor, the steps of the foregoing code scanning method are implemented.

In the embodiment of the present disclosure, the external code scanner is recognized by the camera, and based on the recognition result, the identification code is moved or the movement instruction is output, which can achieve rapid alignment between the identification code and the scanning area of the external code scanner, or assist the user to achieve The quick alignment between the identification code and the scanning area of the code scanner avoids repeated attempts by the user during the scanning process and improves the scanning efficiency.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following will briefly introduce the accompanying drawings used in the description of the embodiments of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

FIG. 1 is a flowchart of a code scanning method provided by an embodiment of the present disclosure;

FIG. 2 is a flowchart of a code scanning method provided by another embodiment of the present disclosure;

Figure 3 is a schematic diagram of a corner area provided by an embodiment of the present disclosure;

Fig. 4a is a schematic diagram of a code scanner scanning an identification code according to an embodiment of the present disclosure;

FIG. 4b is a schematic diagram of a code scanner scanning an identification code according to an embodiment of the present disclosure;

Figure 5 is a schematic diagram of a display screen provided by an embodiment of the present disclosure;

FIG. 6 is a flowchart of a code scanning method provided by another embodiment of the present disclosure;

Fig. 7a is a schematic diagram of a code scanner scanning an identification code provided by another embodiment of the present disclosure;

Fig. 7b is a schematic diagram of a code scanner scanning an identification code according to another embodiment of the present disclosure;

Fig. 8a is a schematic diagram of a code scanner scanning an identification code provided by another embodiment of the present disclosure;

Fig. 8b is a schematic diagram of a code scanner scanning an identification code according to another embodiment of the present disclosure;

FIG. 9 is a structural diagram of a mobile terminal provided by an embodiment of the present disclosure;

FIG. 10 is a schematic diagram of the hardware structure of a mobile terminal according to various embodiments of the present disclosure.

Detailed ways

The technical solutions in the embodiments of the present disclosure will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure.

The embodiment of the present disclosure provides a code scanning method, which is applied to a mobile terminal. Referring to FIG. 1, FIG. 1 is a flowchart of a code scanning method provided by an embodiment of the present disclosure. As shown in FIG. 1, it includes the

following steps

101 and 102.

Step 101: When the identification code is displayed on the display screen of the mobile terminal, the external code scanner is recognized through the camera.

In this embodiment, recognizing the external code scanner through the camera may be recognizing whether the external code scanner exists through the camera, or recognizing the relative position relationship between the camera and the code scanner through the camera. The aforementioned identification code can be a two-dimensional code or a barcode. The above-mentioned relative positional relationship may be a relative position in space, a relative distance or other relative positional relationship. Among them, the above-mentioned relative position relationship, for example, can be identified using TOF (Time of Flight) technology, etc.; specifically, TOF technology continuously sends light pulses to the scanner, and then uses the camera to receive the light pulses returned from the scanner Signal, the relative position information between the camera and the code scanner is obtained by detecting the flight time of the light pulse; TOF technology is relatively two-dimensional imaging, which can obtain a richer position relationship between objects.

In this embodiment, the above-mentioned mobile terminal may be a mobile phone, a tablet (Personal Computer), a laptop (Laptop Computer), a personal digital assistant (PDA for short), and a mobile Internet Device (MID). ) Or wearable devices (Wearable Device), etc.

Step 102: Based on the identification result, move the identification code or output a movement instruction.

In this embodiment, by moving the identification code, rapid alignment between the identification code and the scanning area of the code scanner can be achieved. Wherein, the movement instruction may be used to indicate to move the position of the identification code in the display screen or to move the mobile terminal, that is, the output movement instruction may be to instruct the user to move the identification code, or it may be The user is instructed to move the mobile terminal, and by instructing the user to move the identification code or the mobile terminal, the user is assisted to achieve rapid alignment between the identification code and the scanning area of the code scanner. Wherein, the aforementioned movement instruction is output through the display screen of the mobile terminal or through the audio output of the mobile terminal.

Wherein, moving the identification code may include moving the location of the identification code, and may also include enlarging the identification code to cause the location of the identification code to change.

In the code scanning method of the embodiment of the present disclosure, in the case that the display screen of the mobile terminal displays the identification code, the external code scanner is recognized through the camera, and the identification code is moved or the movement instruction is output based on the recognition result. The movement instruction is used to instruct to move the position of the identification code in the display screen or move the mobile terminal. It can realize the rapid alignment between the identification code and the scanning area of the code scanner, or assist the user to realize the rapid alignment between the identification code and the scanning area of the code scanner, and improve the scanning efficiency.

Referring to Figure 2, Figure 2 is a flowchart of a code scanning method provided by another embodiment of the present disclosure. The difference between this embodiment of the present disclosure and the previous embodiment is mainly that the recognition result indicates the presence of an external code scanner. In an embodiment, moving the identification code based on the identification result includes: moving the identification code to the target area of the display screen of the mobile terminal when the identification result indicates that there is an external code scanner.

As shown in FIG. 2, the code scanning method provided by the embodiment of the present disclosure includes the following

steps

201 and 202.

Step 201: When the identification code is displayed on the display screen of the mobile terminal, the external code scanner is identified through the camera.

Wherein, recognizing the external code scanner through the camera may be recognizing whether the external code scanner exists through the camera, and the identification code may be a two-dimensional code or a barcode. For example, when the identification code is displayed on the display screen of the mobile terminal, the camera of the mobile terminal can be activated and images can be collected, and then the existence of an external code scanner can be identified based on the collected images.

Step 202: If the identification result indicates that there is an external code scanner, move the identification code to the target area of the display screen of the mobile terminal.

Wherein, the target area is located in a first preset area of the display screen of the mobile terminal; at least one vertex of the first preset area coincides with a vertex of the display screen of the mobile terminal.

In this embodiment, the aforementioned first preset area may be any corner area of the display screen of the mobile terminal, and the corner area is an included corner area formed by the edge of the display screen of the mobile terminal. For example, as shown in FIG. 3, the areas G1 to G4 are the corner areas of the display screen of the mobile terminal.

Optionally, the first preset area may also be an area that overlaps with three sides of the display screen of the mobile terminal. For example, the first preset area is the upper half or the lower half of the display screen. It is assumed that the range of the identification code displayed in the area is relatively large, and the user can accurately recognize the display area of the identification code on the mobile terminal, which facilitates the user to scan the code for alignment.

Optionally, after the above step 201 and before the above step 202, that is, when the identification code is displayed on the display screen of the mobile terminal, after the external code scanner is recognized through the camera, the recognition result indicates that there is an external code scanner. In this case, before moving the identification code to the target area of the display screen of the mobile terminal, the method may further include:

Acquiring the touch area of the user on the display screen of the mobile terminal;

Wherein, the aforementioned first preset area is a preset area determined from at least two preset areas according to the touch area.

In this embodiment, at least one vertex of each of the aforementioned at least two preset regions coincides with the vertex of the display screen. For example, the aforementioned at least two preset areas may include at least two corner areas of the display screen.

In this embodiment, the display screen of the above-mentioned mobile terminal may be a touch display screen. In this way, the touch area can be obtained by detecting the contact position of the user with the display screen of the mobile terminal when holding the mobile terminal.

Optionally, the above-mentioned first preset area is a preset area determined from at least two preset areas according to the touch area, and may specifically include, after obtaining the touch area of the user on the display screen, The identification code is moved to the first preset area opposite to the touch area, for example, a corner area away from the touch area may be used as the first preset area. Compared with the conventional position where the identification code is placed in the center of the display screen, the identification code is moved to the first preset area opposite to the touch area. On the one hand, the user has an accurate display position of the identification code on the display screen. Cognition, on the other hand, makes it unnecessary for the user to adjust the holding posture to avoid blocking the identification code when performing the scan code alignment operation.

For example, as shown in Figure 4a, when the user holds the lower right corner of the mobile terminal, the touch area T is at the lower right corner of the display screen. As shown in Figure 4b, the identification code is moved to the bottom right corner of the mobile terminal. The target area of the display screen can be to move the identification code to the upper left corner of the display screen, that is, when the user is holding the lower right corner of the mobile terminal to scan the code, only the upper left corner of the display screen of the mobile terminal needs to be aligned with the scan code. The scanning area of the encoder can quickly achieve alignment.

It should be noted that if the user's touch area on the display screen of the mobile terminal is not obtained, the identification code may be moved to the first preset area. For example, when the user holds the frame of the mobile terminal and scans the code without touching the display screen of the mobile terminal, the identification code is moved to a preset first preset area, where the first preset area may be a display screen The upper left corner, the upper right corner, the lower left corner, or the lower right corner and other corner areas conforming to the user's operating habits, the first preset area may be set by the system or customized by the user.

Optionally, the display screen may include a first display screen and a second display screen. The first display screen and the second display screen are in a state of being opposite to each other. The identification code is displayed, and the display position of the identification code on the first display screen corresponds to the display position of the identification code on the second display screen.

For example, as shown in FIG. 5, when the first display screen A is relatively close to the scanner side and the second display screen B is relatively far away from the scanner side, when the identification code is moved to the target area of the display screen of the mobile terminal, The identification code on the first display screen A and the identification code on the second display screen B move to the target area synchronously, that is, the display position of the moved identification code on the first display screen A and the identification code Corresponding to the display position on the second display screen B, the user can know the display of the identification code on the first display screen A on the side facing the code scanner by watching the display position of the identification code on the second display screen B Location, convenient for users to scan code alignment.

It should be noted that the position correspondence can be understood as the display position of the first display screen A and the display position of the second display screen B that are opposite to each other. As shown in FIG. 5, the lower right corner of the first display screen A The corresponding position of the G1 area is the G1' area in the lower left corner of the second display screen B. Accordingly, the corresponding position of G2 in the lower left corner of the first display screen A is the G2' area in the lower right corner of the second display screen B. The first display The corresponding position of G3 in the upper left corner of screen A is the G3' area in the upper right corner of the second display screen B, and the corresponding position of G4 in the upper right corner of the first display screen A is the G4' area in the upper left corner of the second display screen B.

In the code scanning method of the embodiment of the present disclosure, when the display screen of the mobile terminal displays the identification code, the external code scanner is recognized through the camera, and when the recognition result indicates the existence of the external code scanner, the The identification code to the target area of the display screen of the mobile terminal, and the target area is set as the first preset area, so that the user can accurately recognize the display area of the identification code on the mobile terminal, and set the first preset area It is set relative to the touch area, which is convenient for users to scan code alignment, and can assist users to achieve rapid alignment between the identification code and the scanning area of the code scanner, and improve the scanning efficiency.

Refer to FIG. 6, which is a flowchart of a code scanning method provided by another embodiment of the present disclosure. The difference between this embodiment of the present disclosure and the previous embodiment is mainly that the recognition result is defined as the camera and the scan The relative position relationship of the encoder is shown in FIG. 6. The scanning method provided by the embodiment of the present disclosure includes the following

steps

301 and 302.

Step 301: When the identification code is displayed on the display screen of the mobile terminal, identify the external code scanner through the camera.

In this embodiment, recognizing the external code scanner through the camera may be recognizing the relative position relationship between the camera and the code scanner through the camera. Wherein, the relative position relationship may be a relative position in space, a relative distance relationship or other relative position relationships. To identify the relative position relationship, for example, TOF technology or the like can be used. The identification code may be a two-dimensional code, a barcode or other types of identification codes.

Step 302: If the identification result is the relative position relationship between the camera and the code scanner, move the identification code or output a movement instruction according to the relative position relationship.

In this embodiment, by moving the identification code, rapid alignment between the identification code and the scanning area of the code scanner can be achieved. Wherein, the movement instruction is used to instruct to move the position of the identification code in the display screen or to move the mobile terminal, that is, the output movement instruction may be instructing the user to move the identification code, or it may be an instruction The user moves the mobile terminal, and by instructing the user to move the identification code or the mobile terminal, the user is assisted to achieve rapid alignment between the identification code and the scanning area of the code scanner. Wherein, the movement instruction is output through the display screen of the mobile terminal or through the audio output of the mobile terminal.

It should be noted that moving the identification code may include moving the location of the identification code, and also includes enlarging the identification code to cause the location of the identification code to change.

Optionally, in the above step 302, that is, the moving the identification code according to the relative position relationship may include:

Determining an alignment area on the display screen corresponding to the scanning area of the code scanner based on the relative position relationship;

Move the identification code to the alignment area.

In this embodiment, since the relative positional relationship between the camera of the mobile terminal and the display screen of the mobile terminal is determined, when the relative positional relationship between the camera and the barcode scanner is known, the relationship between the barcode scanner and the display screen can be clarified. The relative position between the two can then determine the alignment area on the display screen corresponding to the scanning area of the code scanner.

For example, as shown in FIG. 7a, based on the relative position relationship, the alignment area G corresponding to the scanning area of the code scanner is determined on the display screen; as shown in FIG. 7b, the identification code moves to the The alignment area G.

In this embodiment, the alignment area is identified based on the relative position relationship, and the identification code is moved to the alignment area, which can quickly realize the scan code alignment, without the user repeatedly adjusting the position of the mobile terminal, and avoiding the user from multiple scan code alignment attempts , Improve scanning efficiency.

Optionally, the display screen includes a first display screen and a second display screen, the first display screen and the second display screen are in a state of being opposite to each other, and both the first display screen and the second display screen display The identification code, and the display position of the identification code on the first display screen corresponds to the display position of the identification code on the second display screen;

In the above step 302, that is, the moving the identification code according to the relative position relationship may include:

Based on the relative position relationship, determining an alignment area on the first display screen corresponding to the scanning area of the code scanner;

Displaying an alignment area identifier on the display area corresponding to the alignment area on the second display screen;

Receiving a movement operation for the identification code displayed on the second display screen;

In response to the moving operation, the identification code displayed on the second display screen is moved, wherein the identification code displayed on the first display screen moves following the identification code displayed on the second display screen.

In this embodiment, the corresponding display area can be understood as the mirror position area of the alignment area on the second display screen and the first display screen; it should be noted that the explanation of the mirror position can refer to the previous embodiment , I won’t repeat it here.

In practical applications, by displaying the alignment area mark on the display area corresponding to the alignment area on the second display screen, the user can refer to the alignment area mark displayed on the second display screen and move the second display area. The identification code displayed on the display screen until the identification code displayed on the second display screen moves to the area where the alignment area mark is located. Wherein, in the process of moving the identification code displayed on the second display screen, the identification code displayed on the first display screen can move with the identification code displayed on the second display screen to maintain the identification code on the first display screen. Always correspond to the position of the identification code on the second display screen, for example, keep the identification code on the first display screen in a mirror position with the identification code on the second display screen.

In this embodiment, by displaying the alignment area identifier on the display area corresponding to the alignment area on the second display screen, it is convenient for the user to visually view the alignment area, so that the identification code can be moved in a targeted manner. It can avoid the user from making multiple invalid scan code alignment attempts, realize fast alignment, and improve code scan efficiency.

Optionally, the display screen includes a first display screen and a second display screen, the first display screen and the second display screen are in a state of being opposite to each other, and both the first display screen and the second display screen display The identification code, and the display position of the identification code on the first display screen corresponds to the display position of the identification code on the second display screen; wherein the first display screen faces the code scanner, The second display screen faces the code scanner;

The foregoing step 302, that is, in the case where the recognition result is the relative position relationship between the camera and the code scanner, outputting a movement instruction according to the relative position relationship may include:

The movement instruction is displayed on the second display screen according to the relative position relationship.

In this embodiment, the movement instruction can be used to instruct the user to move the identification code, or to instruct the user to move the mobile terminal. For example, the aforementioned movement instruction may be an arrow indicating a movement direction, so that the user can move the mobile terminal or the direction of the mobile identification code based on the movement direction indicated by the arrow.

In practical applications, when the first display screen faces the code scanner, the second display screen usually faces the user. In this way, the movement instructions are displayed on the second display screen to facilitate the user to view, and then move based on the movement instructions. The terminal or mobile identification code facilitates quick alignment between the identification code and the scanning area of the code scanner.

It should be noted that when the user moves the identification code on the second display screen, the identification code on the first display screen moves synchronously with the identification code on the second display screen to maintain the identification code on the first display screen. Always correspond to the identification code position on the second display screen.

Optionally, this embodiment can also dynamically display the relative position relationship in real time on the second display screen, so that the user can intuitively feel the relative position relationship between the identification code and the code scanner, wherein the real-time dynamic display The relative position relationship can be displayed in the form of a two-dimensional or three-dimensional image.

Optionally, the relative position relationship includes the distance between the camera and the code scanner;

The above step 302, that is, moving the identification code according to the relative position relationship, may include:

If the distance between the camera and the code scanner is greater than a preset threshold, the identification code is enlarged.

In this embodiment, the aforementioned preset threshold can be set reasonably according to actual needs, for example, 40 cm, 30 cm, etc. The above-mentioned distance between the camera and the code scanner, for example, can be detected by a distance sensor, or can be detected by TOF technology, which is not limited in this embodiment.

In practical applications, when the camera is far away from the code scanner, that is, the distance between the identification code on the mobile terminal and the code scanner is relatively long, the identification code can be enlarged to facilitate scanning and recognition by the code scanner. Thereby improving the efficiency of scanning codes.

Optionally, before amplifying the identification code, the method may further include: identifying an area where the identification code is located, and performing an amplifying operation on the identification code based on the area where the identification code is located. This can increase the scale of the identification code.

Optionally, the display screen is a foldable display screen;

In the case where the distance between the camera and the code scanner is greater than a preset threshold, amplifying the identification code may include:

Outputting an expansion instruction when the distance between the camera and the code scanner is greater than a preset threshold and the foldable display screen is in a folded state;

When the unfolding operation is received, the identification code is enlarged, and the enlarged identification code is displayed on the foldable display screen after unfolding.

In this embodiment, when the foldable display screen is in a folded state, the aforementioned identification code may be displayed on at least one of the at least two display screens obtained by folding the foldable display screen.

Wherein, the unfolding instruction is to instruct the user to unfold the folding display screen in the folded state, for example, it may output "please unfold the display screen" in the form of voice, or display the text "please unfold the display screen" on the display screen or display the folding screen Expand the animation to prompt the user to expand the display.

For example, the foldable display screen includes a first display screen C and a second display screen D. As shown in FIG. 8a, when the foldable display screen is in a folded state, the identification code is displayed on the first display screen C, as shown in the appendix As shown in Figure 8b, in the case of receiving the unfolding operation, the identification code is enlarged, and the enlarged identification code is displayed on the foldable display screen after unfolding, that is, through the first display screen C and The second display screen D collectively displays the enlarged identification code.

In practical applications, when the code scanner is far away from the identification code, for example, when the driver’s handheld mobile terminal is far away from the code scanner in the parking lot and is inconvenient to approach, the output of the mobile terminal is expanded Instruct, the driver can expand the foldable display screen based on the unfolding instruction, so that the identification code is enlarged and displayed on the unfolded foldable display screen, which facilitates the alignment of the identification code of the mobile terminal on the vehicle side with the code scanner in the parking lot.

Optionally, this embodiment may also upload the relative position relationship to the server. Therefore, the relative position relationship can be sent to the code scanner through the server, so that the code scanner can adjust its own position based on the relative position relationship, so as to realize the alignment of the code scanner and the identification code on the display screen of the mobile terminal.

In the code scanning method of the embodiment of the present disclosure, when the display screen of the mobile terminal displays the identification code, the external code scanner is recognized through a camera, and the recognition result includes the relative position of the camera and the code scanner In the case of a relationship, moving the identification code or outputting the movement instruction according to the relative position relationship can achieve rapid alignment between the identification code and the scanning area of the code scanner, or assist the user to realize the identification code and the code scanner Fast alignment between scanning areas improves scanning efficiency.

Refer to FIG. 9, which is a structural diagram of a mobile terminal provided by an embodiment of the present disclosure. As shown in FIG. 9, the mobile terminal 400 includes:

The identification module 401 is used to identify the external code scanner through the camera when the identification code is displayed on the display screen of the mobile terminal;

The control module 402 is configured to move the identification code or output a movement instruction based on the identification result, wherein the movement instruction is used to instruct to move the position of the identification code in the display screen or move the mobile terminal.

Optionally, the control module 402 includes:

The first control unit is configured to move the identification code to the target area of the display screen of the mobile terminal when the recognition result indicates that there is an external code scanner; wherein, the target area is located in the mobile terminal The first preset area of the display screen; at least one vertex of the first preset area coincides with the vertex of the display screen of the mobile terminal.

Optionally, the mobile terminal 400 further includes:

The obtaining module is used to obtain the user’s presence in the mobile terminal after the external code scanner is recognized through the camera and before the recognition code is moved based on the recognition result when the identification code is displayed on the display screen of the mobile terminal. The touch area on the display screen; wherein the above-mentioned first preset area is a preset area determined from at least two preset areas according to the touch area.

The control module includes:

The second control unit is configured to move the identification code or output the movement instruction according to the relative position relationship when the recognition result includes the relative position relationship between the camera and the code scanner.

The second control unit is specifically configured to:

Based on the relative position relationship, determine an alignment area on the display screen corresponding to the scanning area of the code scanner; move the identification code to the alignment area.

Optionally, the display screen includes a first display screen and a second display screen, the first display screen and the second display screen are in a state of being opposite to each other, and both the first display screen and the second display screen display The identification code, and the display position of the identification code on the first display screen corresponds to the display position of the identification code on the second display screen; wherein the first display screen is relatively close to the code scanner Side, the second display screen is relatively far away from the scanner side;

The second control unit is specifically configured to: based on the relative position relationship, determine the alignment area on the first display screen corresponding to the scanning area of the code scanner; The alignment area identifier is displayed on the display area corresponding to the alignment area; the movement operation for the identification code displayed on the second display screen is received; in response to the movement operation, the identification displayed on the second display screen is moved Code, wherein the identification code displayed on the first display screen moves following the identification code displayed on the second display screen.

Optionally, in the case where the relative position relationship includes the distance between the camera and the code scanner; the second control unit is specifically configured to: between the camera and the code scanner If the distance of is greater than the preset threshold, the identification code is enlarged.

Optionally, the display screen is a foldable display screen; the second control unit is specifically configured to: the distance between the camera and the code scanner is greater than a preset threshold, and the foldable display screen In the case of being in the folded state, an expansion instruction is output; in the case of receiving an expansion operation, the identification code is enlarged, and the enlarged identification code is displayed on the foldable display screen after expansion.

The mobile terminal 400 provided in the embodiment of the present disclosure can implement each process implemented by the mobile terminal in the method embodiment of FIG. 1 to FIG. 8. In order to avoid repetition, details are not described herein again.

The mobile terminal 400 of the embodiment of the present disclosure includes: an identification module, which is used to identify an external code scanner through a camera when the display screen of the mobile terminal displays an identification code; a control module, which is used to move the station based on the identification result The identification code or output movement instruction, wherein the movement instruction is used to instruct to move the position of the identification code in the display screen or move the mobile terminal. It can realize the quick alignment between the identification code and the scanning area of the code scanner, or assist the user to realize the quick alignment between the identification code and the scanning area of the code scanner, avoiding repeated attempts by the user in the scanning process, and improving the scanning efficiency .

FIG. 10 is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present disclosure. 10, the mobile terminal 500 includes but is not limited to: radio frequency unit 501, network module 502, audio output unit 503, input unit 504, sensor 505, display unit 506, user input unit 507, interface unit 508, memory 509, processing 510, power supply 511 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in FIG. 10 does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. Layout. In the embodiments of the present disclosure, mobile terminals include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.

Wherein, the processor 510 is configured to identify an external code scanner through a camera when the identification code is displayed on the display screen of the mobile terminal; based on the identification result, move the identification code or output a movement instruction, wherein the movement The indication is used to indicate to move the position of the identification code in the display screen or to move the mobile terminal.

The embodiment of the present disclosure recognizes an external code scanner through a camera, and based on the recognition result, moves the identification code or outputs a movement instruction, which can achieve rapid alignment between the identification code and the scanning area of the code scanner, or assist the user to realize the identification code The quick alignment with the scanning area of the code scanner avoids repeated attempts by the user during the scanning process and improves the scanning efficiency.

Optionally, the processor 510 is further configured to:

In the case where the identification result indicates that there is an external code scanner, move the identification code to the target area of the display screen of the mobile terminal; wherein, the target area is located in the first preset area of the display screen of the mobile terminal. Set area; at least one vertex of the first preset area coincides with the vertex of the display screen of the mobile terminal.

Optionally, the processor 510 is further configured to:

According to the recognition result, in the case that the display screen of the mobile terminal displays the identification code, after the external code scanner is recognized through the camera, and before the identification code is moved, obtain the user's information on the display screen of the mobile terminal Touch area

Optionally, the processor 510 is further configured to:

In a case where the recognition result is the relative position relationship between the camera and the code scanner, the identification code is moved or the movement instruction is output according to the relative position relationship.

Optionally, the processor 510 is further configured to:

The display screen includes a first display screen and a second display screen, the first display screen and the second display screen are in a state of being opposite to each other, and the identification code is displayed on both the first display screen and the second display screen , And the display position of the identification code on the first display screen corresponds to the display position of the identification code on the second display screen; optionally, the processor 510 is further configured to: The relative position relationship determines the alignment area on the first display screen corresponding to the scanning area of the code scanner;

The relative positional relationship includes the distance between the camera and the code scanner. Optionally, the processor 510 is further configured to: the distance between the camera and the code scanner is greater than a preset In the case of a threshold value, the identification code is enlarged.

Optionally, the processor 510 is further configured to:

It should be understood that, in the embodiment of the present disclosure, the radio frequency unit 501 can be used for receiving and sending signals in the process of sending and receiving information or talking. Specifically, the downlink data from the base station is received and processed by the processor 510; Uplink data is sent to the base station. Generally, the radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with the network and other devices through a wireless communication system.

The mobile terminal provides users with wireless broadband Internet access through the network module 502, such as helping users to send and receive emails, browse web pages, and access streaming media.

The audio output unit 503 may convert the audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output it as sound. Moreover, the audio output unit 503 may also provide audio output related to a specific function performed by the mobile terminal 500 (for example, call signal reception sound, message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.

The input unit 504 is used to receive audio or video signals. The input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042. The graphics processor 5041 is configured to monitor images of still pictures or videos obtained by an image capture device (such as a camera) in the video capture mode or the image capture mode. Data is processed. The processed image frame may be displayed on the display unit 506. The image frame processed by the graphics processor 5041 may be stored in the memory 509 (or other storage medium) or sent via the radio frequency unit 501 or the network module 502. The microphone 5042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 501 for output in the case of a telephone call mode.

The mobile terminal 500 also includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of the ambient light. The proximity sensor can close the display panel 5061 and the display panel 5061 when the mobile terminal 500 is moved to the ear. / Or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three-axis), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games , Magnetometer attitude calibration), vibration recognition related functions (such as pedometer, percussion), etc.; sensor 505 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.

The display unit 506 is used to display information input by the user or information provided to the user. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

The user input unit 507 may be used to receive inputted numeric or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. The touch panel 5071, also called a touch screen, can collect user touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 5071 or near the touch panel 5071. operating). The touch panel 5071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 510, the command sent by the processor 510 is received and executed. In addition, the touch panel 5071 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 5071, the user input unit 507 may also include other input devices 5072. Specifically, other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, and joystick, which will not be repeated here.

Further, the touch panel 5071 can be overlaid on the display panel 5061. When the touch panel 5071 detects a touch operation on or near it, it transmits it to the processor 510 to determine the type of the touch event. The type of event provides corresponding visual output on the display panel 5061. Although in FIG. 10, the touch panel 5071 and the display panel 5061 are used as two independent components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 5071 and the display panel 5061 can be integrated The implementation of the input and output functions of the mobile terminal is not specifically limited here.

The interface unit 508 is an interface for connecting an external device with the mobile terminal 500. For example, the external device may include a wired or wireless headset port, an external power source (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) port, video I/O port, headphone port, etc. The interface unit 508 can be used to receive input (for example, data information, power, etc.) from an external device and transmit the received input to one or more elements in the mobile terminal 500 or can be used to connect to the mobile terminal 500 and external Transfer data between devices.

The memory 509 can be used to store software programs and various data. The memory 509 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data (such as audio data, phone book, etc.) created by the use of mobile phones. In addition, the memory 509 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The processor 510 is the control center of the mobile terminal. It uses various interfaces and lines to connect the various parts of the entire mobile terminal, runs or executes software programs and/or modules stored in the memory 509, and calls data stored in the memory 509 , Perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 510 may include one or more processing units; optionally, the processor 510 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, and application programs, etc. The adjustment processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 510.

The mobile terminal 500 may also include a power source 511 (such as a battery) for supplying power to various components. Optionally, the power source 511 may be logically connected to the processor 510 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. Management and other functions.

In addition, the mobile terminal 500 includes some functional modules not shown, which will not be repeated here.

Optionally, an embodiment of the present disclosure further provides a mobile terminal, including a processor 510, a memory 509, a program stored in the memory 509 and running on the processor 510, and the program is executed when the processor 510 is executed. As described above, when the identification code is displayed on the display screen of the mobile terminal, the external code scanner is identified through the camera; based on the identification result, the identification code is moved or a movement instruction is output, wherein the movement instruction is used to instruct to move the The position of the identification code in the display screen or the various processes of moving the mobile terminal can achieve the same technical effect. To avoid repetition, details are not described here.

The embodiment of the present disclosure also provides a computer-readable storage medium, and a program is stored on the computer-readable storage medium. When the program is executed by the processor, the above-mentioned identification code is displayed on the display screen of the mobile terminal through a camera. Identify the external code scanner; based on the identification result, move the identification code or output a movement instruction, wherein the movement instruction is used to instruct to move the position of the identification code in the display screen or move each of the mobile terminal Process, and can achieve the same technical effect, in order to avoid repetition, I will not repeat it here. Wherein, the computer readable storage medium, such as read-only memory (Read-Only Memory, ROM for short), random access memory (Random Access Memory, RAM for short), magnetic disk or optical disk, etc.

It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, It also includes other elements not explicitly listed, or elements inherent to the process, method, article, or device. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article or device that includes the element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of the present disclosure essentially or the part that contributes to the related technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk). ) Includes several instructions to make a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present disclosure.

The embodiments of the present disclosure are described above with reference to the accompanying drawings, but the present disclosure is not limited to the above-mentioned specific embodiments. The above-mentioned specific embodiments are only illustrative and not restrictive. Those of ordinary skill in the art are Under the enlightenment of the present disclosure, many forms can be made without departing from the purpose of the present disclosure and the scope of protection of the claims, all of which fall within the protection of the present disclosure.

Claims

A code scanning method applied to a mobile terminal, wherein the method includes:

When the identification code is displayed on the display screen of the mobile terminal, the external code scanner is identified through the camera;

Based on the recognition result, move the identification code or output a movement instruction, wherein the movement instruction is used to instruct to move the position of the identification code in the display screen or move the mobile terminal.
The method according to claim 1, wherein the moving the identification code based on the identification result comprises:

If the identification result indicates that there is an external code scanner, move the identification code to the target area of the display screen of the mobile terminal;

Wherein, the target area is located in a first preset area of the display screen of the mobile terminal; at least one vertex of the first preset area coincides with a vertex of the display screen of the mobile terminal.
The method according to claim 2, wherein, when the identification code is displayed on the display screen of the mobile terminal, after the external code scanner is identified through the camera, and before the identification code is moved based on the identification result, The method also includes:

Acquiring the touch area of the user on the display screen of the mobile terminal;

Wherein, the first preset area is a preset area determined from at least two preset areas according to the touch area.
The method according to claim 1, wherein the moving the identification code or outputting a movement indication based on the identification result comprises:

In a case where the recognition result is the relative position relationship between the camera and the code scanner, the identification code is moved or the movement instruction is output according to the relative position relationship.
The method according to claim 4, wherein said moving said identification code according to said relative position relationship comprises:

Determining an alignment area on the display screen corresponding to the scanning area of the code scanner based on the relative position relationship;

Move the identification code to the alignment area.
The method according to claim 4, wherein the display screen comprises a first display screen and a second display screen, the first display screen and the second display screen are in a state of being opposite to each other, and the first display screen and the second display screen The identification code is displayed on the second display screen, and the display position of the identification code on the first display screen corresponds to the display position of the identification code on the second display screen;

The moving the identification code according to the relative position relationship includes:

Based on the relative position relationship, determining an alignment area on the first display screen corresponding to the scanning area of the code scanner;

Displaying an alignment area identifier on the display area corresponding to the alignment area on the second display screen;

Receiving a movement operation for the identification code displayed on the second display screen;

In response to the moving operation, the identification code displayed on the second display screen is moved, wherein the identification code displayed on the first display screen moves following the identification code displayed on the second display screen.
The method according to claim 4, wherein the relative position relationship includes the distance between the camera and the code scanner;

The moving the identification code according to the relative position relationship includes:

If the distance between the camera and the code scanner is greater than a preset threshold, the identification code is enlarged.
The method according to claim 7, wherein the display screen is a foldable display screen;

The amplifying the identification code when the distance between the camera and the code scanner is greater than a preset threshold includes:

Outputting an expansion instruction when the distance between the camera and the code scanner is greater than a preset threshold and the foldable display screen is in a folded state;

When the unfolding operation is received, the identification code is enlarged, and the enlarged identification code is displayed on the foldable display screen after unfolding.
A mobile terminal, including:

The identification module is used to identify the external code scanner through the camera when the identification code is displayed on the display screen of the mobile terminal;

The control module is configured to move the identification code or output a movement instruction based on the identification result, wherein the movement instruction is used to instruct to move the position of the identification code in the display screen or move the mobile terminal.
The mobile terminal according to claim 9, wherein the control module comprises:

The first control unit is configured to move the identification code to the target area of the display screen of the mobile terminal when the identification result indicates that there is an external code scanner;

Wherein, the target area is located in a first preset area of the display screen of the mobile terminal; at least one vertex of the first preset area coincides with a vertex of the display screen of the mobile terminal.
The mobile terminal according to claim 10, further comprising:

The obtaining module is used to obtain the user’s presence in the mobile terminal after the external code scanner is recognized through the camera and before the recognition code is moved based on the recognition result when the identification code is displayed on the display screen of the mobile terminal. Touch area on the display screen;

Wherein, the first preset area is a preset area determined from at least two preset areas according to the touch area.
The mobile terminal according to claim 9, wherein the control module comprises:

The second control unit is configured to move the identification code or output the movement instruction according to the relative position relationship when the recognition result includes the relative position relationship between the camera and the code scanner.
The mobile terminal according to claim 12, wherein the second control unit is specifically configured to:

Determining an alignment area on the display screen corresponding to the scanning area of the code scanner based on the relative position relationship;

Move the identification code to the alignment area.
The mobile terminal according to claim 12, wherein the display screen comprises a first display screen and a second display screen, the first display screen and the second display screen are in a state of being opposite to each other, and the first display screen And the second display screen both display the identification code, and the display position of the identification code on the first display screen corresponds to the display position of the identification code on the second display screen;

The second control unit is specifically configured to:

Based on the relative position relationship, determining an alignment area on the first display screen corresponding to the scanning area of the code scanner;

Displaying an alignment area identifier on the display area corresponding to the alignment area on the second display screen;

Receiving a movement operation for the identification code displayed on the second display screen;

In response to the moving operation, the identification code displayed on the second display screen is moved, wherein the identification code displayed on the first display screen moves following the identification code displayed on the second display screen.
The mobile terminal according to claim 12, wherein the relative position relationship includes the distance between the camera and the code scanner;

The second control unit is specifically configured to:

If the distance between the camera and the code scanner is greater than a preset threshold, the identification code is enlarged.
The mobile terminal according to claim 15, wherein the display screen is a foldable display screen;

The second control unit amplifies the identification code when the distance between the camera and the code scanner is greater than a preset threshold, including:

Outputting an expansion instruction when the distance between the camera and the code scanner is greater than a preset threshold and the foldable display screen is in a folded state;

When the unfolding operation is received, the identification code is enlarged, and the enlarged identification code is displayed on the foldable display screen after unfolding.
A mobile terminal, comprising a processor, a memory, and a program stored on the memory and capable of running on the processor, wherein the program is executed by the processor as in any of claims 1 to 8. One of the steps of the scanning method.
A computer-readable storage medium having a program stored on the computer-readable storage medium, wherein the program is executed by a processor to implement the steps of the code scanning method according to any one of claims 1 to 8.