WO2020034981A1

WO2020034981A1 - Method for generating encoded information and method for recognizing encoded information

Info

Publication number: WO2020034981A1
Application number: PCT/CN2019/100521
Authority: WO
Inventors: 梁文昭
Original assignee: 上海掌门科技有限公司
Priority date: 2018-08-14
Filing date: 2019-08-14
Publication date: 2020-02-20
Also published as: CN108985421A; CN108985421B

Abstract

A method for generating encoded information and a method for recognizing encoded information. A specific embodiment of the method comprises: adding a first preset number of positioning images at preset positions in a target image comprising encoded information, so as to generate a first encoded image (201); setting a center region of the first encoded image as a center, rotating the first encoded image by a second preset number of angular intervals, so as to respectively obtain the second preset number of second encoded images at different rotation angles (202); and generating a set of encoded images according to the obtained second encoded images, and outputting the set of encoded images (203). The embodiment provides further options for generating encoded information, helping to satisfy design requirements of different users, and increasing the ways in which encoded information can be presented.

Description

Generation method and identification method of encoded information

Technical field

The embodiments of the present application relate to the field of computer technology, and in particular, to a method for generating encoded information and a method for identifying the same.

Background technique

With the rapid development of the mobile Internet, it is becoming more and more common to read content by scanning information on mobile terminals. The current popular method is to construct a QR code. That is, the mobile device scans the constructed two-dimensional code, so that the user ID (identification), web address and other information can be identified. The form of the existing two-dimensional code is relatively single, usually a fixed square, and requires at least three positioning points.

Summary of the Invention

The embodiments of the present application provide a method for generating encoded information and a method for identifying the same.

In a first aspect, an embodiment of the present application provides a method for generating encoded information, including: adding a first preset number of positioning images to a preset position in a target image containing the encoded information to generate a first encoded image; Taking the central region of the first encoded image as a center, rotating the first encoded image by a second preset number of angles to obtain second encoded images at a second preset number of different rotation angles respectively; according to the obtained second encoded image To generate a coded image set and output a coded image set.

In some embodiments, the first preset number is not more than two, and adding the first preset number of positioning images at the preset position includes: adding a positioning image at an edge position of the target image; or at the edge of the target image Add two positioning images symmetrically or asymmetrically; or add one positioning image to the center and edge of the target image.

In some embodiments, generating a coded image set according to the obtained second coded image includes: taking the first coded image as a reference, and sequentially rotating the first coded image and The obtained second coded image is stored to generate a coded image set; or the first coded image is used as a reference, and the obtained second coded image is stored in the order of rotation angle from small to large or from large to small to generate a code Image collection.

In some embodiments, outputting the encoded image set includes: displaying the encoded images in the encoded image set one by one at a preset frame rate.

In some embodiments, displaying the coded images in the coded image set one by one at a preset frame rate includes: sequentially displaying the coded images in the coded image set at a preset frame rate in the order of rotation angle from small to large or from large to small. Encode the image.

In a second aspect, an embodiment of the present application provides an apparatus for generating encoded information, including: a first generating unit configured to add a first preset number of positionings at a preset position in a target image containing the encoded information Image to generate a first coded image; a second generation unit configured to rotate the first coded image by a second preset number of angles around the center region of the first coded image to obtain a second preset number of differences respectively A second coded image at a rotation angle; a third generating unit configured to generate a coded image set according to the obtained second coded image, and output the coded image set.

In some embodiments, the first preset number is not greater than two, and the first generating unit is further configured to: add one positioning image at the edge position of the target image; or add two symmetrically or asymmetrically at the edge position of the target image Position the image; or add a positioning image to the center and edge locations of the target image.

In some embodiments, the third generating unit includes: a first generating subunit configured to use the first coded image as a reference, and perform the first and second coded images in the order of rotation angle from small to large or from large to small. The obtained second coded image is stored to generate a coded image set; or the second generation subunit is configured to use the first coded image as a reference and perform a rotation on the obtained code in the order of small to large or large to small. The second encoded image is stored to generate a set of encoded images.

In some embodiments, the third generating unit further includes a display subunit configured to display the coded images in the coded image set one by one according to a preset frame rate.

In some embodiments, the display sub-unit is further configured to sequentially display the encoded images in the encoded image set at a preset frame rate in the order of the rotation angle from small to large or from large to small.

In a third aspect, an embodiment of the present application proposes a method for identifying encoding information for identifying an encoded image in an encoded image set generated by the method described in any one of the foregoing aspects of the first aspect, including: collecting each frame The displayed coded image identifies the first preset number of positioning images in the coded image, and determines position information of the positioning images, where the coded images in the coded image set are displayed one by one at a preset frame rate; the positioning determined according to each frame The position information sequence of the image is used to obtain the position information sequence; according to the position information sequence, the encoding information in the encoded image in the encoded image set is located and identified.

In some embodiments, locating and identifying the encoding information in the encoded images in the encoded image set according to the position information sequence includes: selecting two encoded images from the acquired encoded images, and selecting one of the two selected encoded images. A coded image is used as the pre-transformed image, and the other one of the two selected coded images is used as the transformed image to solve the affine transformation matrix; the solved affine transformation matrix is used to inverse the transformed image Transform to obtain a normalized image; determine the position of the center point of the normalized image according to the position information in the position information sequence; identify the encoded information in the normalized image according to the position information sequence and the position of the center point.

In some embodiments, identifying the encoded information in the normalized image according to the position information sequence and the position of the center point includes: performing polar coordinate transformation on the position information in the position information sequence with the center point as a pole; and according to the position information The polar coordinates in the sequence identify the encoded information in the normalized image.

In some embodiments, locating and identifying the encoding information in the encoded images in the encoded image set according to the position information sequence includes: selecting the encoded image from the collected encoded images, and marking the position information sequence in the selected encoded image. The position indicated by the position information of the image forming a positioning area; identifying information located in the positioning area in the selected coded image.

In some embodiments, obtaining the position information sequence according to the position information of the positioning image determined in each frame includes: determining whether there is a frame loss situation when collecting; when determining the frame loss situation, supplementing the loss location according to the position change rule of the positioning image. Position information of a positioning image in a frame-encoded image to obtain a position information sequence.

In some embodiments, before obtaining the position information sequence according to the position information of the positioning image determined in each frame, the method further includes: determining, in the position information of the determined positioning image, whether a positioning image determined with the current frame exists. The position information is the same as the position information; in response to determining the existence, the acquisition of the encoded image is stopped.

In some embodiments, before obtaining the position information sequence according to the position information of the positioning image determined in each frame, the method further includes: determining whether the current acquisition duration reaches a preset duration; and in response to the determination, stopping the acquisition of the encoded image.

In a fourth aspect, an embodiment of the present application provides a device for identifying encoding information, which is used to identify an encoded image in an encoded image set generated by a method described in any one of the foregoing aspects of the first aspect, including: an acquisition unit, Configured to collect the coded images displayed in each frame, identify the first preset number of positioning images in the coded image, and determine position information of the positioning images, where the coded images in the coded image set are displayed one by one at a preset frame rate; The sequence generating unit is configured to obtain a position information sequence according to the position information of the positioning image determined in each frame; the recognition unit is configured to locate and identify the coding information in the coded image in the coded image set according to the position information sequence.

In some embodiments, the identification unit includes a solving subunit configured to select two encoded images from the acquired encoded images, use one of the selected two encoded images as a pre-transformed image, and select the selected The other of the two encoded images is used as the transformed image to solve the affine transformation matrix; the transformation subunit is configured to use the solved affine transformation matrix to inversely transform the transformed image to obtain the normalized image. A normalized image; a center determination subunit configured to determine a position of a center point of the normalized image according to the position information in the position information sequence; a first identification subunit configured to be located according to the position information sequence and the position of the center point To identify the encoded information in the normalized image.

In some embodiments, the first recognition subunit is further configured to: perform polar coordinate transformation on the position information in the position information sequence using the center point as a pole; and identify the normalized image based on the polar coordinates in the position information sequence. Encoding information.

In some embodiments, the recognition unit further includes a marking subunit configured to select a coded image from the collected coded images, and in the selected coded image, mark the position indicated by the position information in the position information sequence and form Positioning area; a second identification subunit configured to identify information located in the positioning area in the selected coded image.

In some embodiments, the sequence generation unit includes: a determination subunit configured to determine whether there is a frame loss situation during acquisition; and a supplementary subunit configured to, when determining the presence of a frame loss situation, supplement the The position information of the positioning image in the framed encoded image is dropped to obtain the position information sequence.

In some embodiments, the method further includes: a first determining unit configured to determine, from the determined position information of the positioning image, whether there is position information that is the same as the position information of the positioning image determined by the current frame; Make sure it exists and stop collecting encoded images.

In some embodiments, the method further includes: a second determination unit configured to determine whether the current acquisition duration reaches a preset duration; and in response to determining that the acquisition duration is reached, stopping the acquisition of the encoded image.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: one or more processors; a storage device on which one or more programs are stored; when one or more programs are processed by one or more processors Execution causes one or more processors to implement the method as described in any one of the first aspect or the third aspect above.

According to a sixth aspect, an embodiment of the present application provides a computer-readable medium on which a computer program is stored, wherein when the computer program is executed by a processor, the computer program is implemented as in any one of the first or third aspects described above. Describe the method.

The method for generating and identifying the encoded information provided in the embodiments of the present application can generate a first encoded image by adding a first preset number of positioning images to a preset position in a target image containing the encoded information. Then, by rotating the first coded image by a second preset number of angles around the center area of the first coded image, second coded images at a second preset number of different rotation angles can be obtained. Then, based on the obtained second encoded image, an encoded image set can be generated. And can output coded image collection. This implementation mode enriches the manner in which the encoded information is generated. This can help meet the different design needs of users, and is conducive to enriching the presentation of encoded information.

BRIEF DESCRIPTION OF THE DRAWINGS

Other features, objects, and advantages of the present application will become more apparent by reading the detailed description of the non-limiting embodiments with reference to the following drawings:

FIG. 1 is an exemplary system architecture diagram to which an embodiment of the present application can be applied; FIG.

2 is a flowchart of an embodiment of a method for generating encoded information according to the present application;

3A-3D are schematic structural diagrams of four embodiments of a first encoded image in the present application;

4 is a flowchart of an embodiment of a method for identifying encoding information according to the present application;

5 is a flowchart of still another embodiment of a method for identifying encoded information according to the present application;

FIG. 6 is a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present application.

detailed description

The following describes the present application in detail with reference to the accompanying drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the related invention, rather than limiting the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The application will be described in detail below with reference to the drawings and embodiments.

FIG. 1 illustrates an exemplary system architecture 100 to which a method for generating and identifying encoding information according to an embodiment of the present application can be applied.

The system architecture 100 may include

terminals

101, 102, and 103,

networks

104, 105, and a server 106. The network 104 may be used to provide a medium for communication links between the

terminals

101, 102, 103. The network 105 may be used to provide a medium for a communication link between the

terminals

101, 102, 103 and the server 106. The

networks

104, 105 may include various connection types, such as wired, wireless communication links, or fiber optic cables, and so on.

Users can use

terminals

101, 102, and 103 to interact through the network 104 to receive or send messages and the like. At the same time, the user can also use the

terminals

101, 102, 103 to interact with the server 106 through the network 105 to obtain information and the like. A variety of client applications can be installed on the

terminals

101, 102, and 103, such as coded information generation and identification applications, web browsers, shopping applications, and instant messaging tools.

The user can also use the coded information generation application installed on the

terminals

101, 102, 103 to process the target image containing the coded information. Thereby, a set of encoded images can be generated. In addition, the user can also use the

terminals

101, 102, 103 to collect the encoded images in the encoded image set. In this way, the

terminals

101, 102, 103 can perform analysis processing on each encoded image. And the processing result (such as the identified encoding information) can be presented to the user.

The

terminals

101, 102, and 103 here may be hardware or software. When the

terminals

101, 102, and 103 are hardware, they can be various electronic devices with display screens, including but not limited to smartphones, tablets, wearable devices, e-book readers, MP3 players (Moving Pictures Experts Group Audio Layer III, motion picture expert compression standard audio layer 3), laptop portable computers and desktop computers, etc. When the

terminals

101, 102, and 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, to provide distributed services), or it can be implemented as a single software or software module. It is not specifically limited here.

The server 106 may be a server that provides various services, such as a background server that provides support for various applications installed on the

terminals

101, 102, and 103. The background server can analyze and process the user's operation behavior on the application, and send corresponding feedback information to the user according to the processing result. As an example, after receiving the encoding information generation instruction sent by the terminal, the background server may analyze and process the target image containing the encoding information. And the processing result (such as a set of encoded images) can be fed back to the terminal.

The server 106 here may also be hardware or software. When the server 106 is hardware, it can be implemented as a distributed server cluster composed of multiple servers or as a single server. When the server 106 is software, it can be implemented as multiple software or software modules (for example, to provide distributed services), or it can be implemented as a single software or software module. It is not specifically limited here.

It should be noted that the method for generating encoded information provided in the embodiments of the present application is generally performed by the

terminals

101, 102, 103 or the server 106. The identification method of the encoded information is generally executed by the

terminals

101, 102, and 103.

It should be understood that the numbers of terminals, networks, and servers in FIG. 1 are merely exemplary. According to implementation needs, there can be any number of terminals, networks, and servers.

Continuing to refer to FIG. 2, a flowchart 200 of an embodiment of a method for generating encoded information according to the present application is shown. The method for generating the encoded information may include the following steps:

Step 201: Add a first preset number of positioning images at a preset position to a target image containing the coding information to generate a first coded image.

In this embodiment, an execution subject (for example, the terminal 101, 102, 103, or the server 106 shown in FIG. 1) of the method for generating encoded information may add a first preset position at a preset position of the target image containing the encoded information Set a number of positioning images to generate a first coded image. That is, the target image after adding the first preset number of positioning images may be used as the first encoded image.

Here, the encoding information may be information generated by encoding a character string by using various encoding methods (such as binary encoding). The character string may be (but is not limited to) text information including at least one character such as a letter, a number, a symbol, and a Chinese character. The content of the character string may include, but is not limited to, a website address, an address, business card information, product information, transaction information, a Wi-Fi (WIreless-Fidelity, wireless broadband) password, and the like. The target image can be any image containing the encoded information. The target image here may be stored locally in the execution subject in advance; it may also be obtained by the execution subject from online resources or other electronic devices; or it may be input by the user into the execution subject.

In this embodiment, the positioning image may be an image for positioning a mark. And the positioning image usually has a different expression form from the coded information, so as to be easy to distinguish. For example, the positioning image may be a special shape image, such as a circle, a diamond hexagon, or the like. This can be different from the coded image shape such as a two-dimensional code or a barcode, so that it will not interfere with the content of the coded information. The preset position may be any position in the target image that does not affect the encoding information, such as a corner position of the target image. The preset positions and the first preset number can be set according to actual conditions.

In addition, the manner of adding the positioning image to the target image is not limited in this application. For example, the positioning image can be used as a layer to directly overlay the image at a preset position of the target image. As another example, a positioning image or the like may be drawn at a preset position of the target image.

In some optional implementations of this embodiment, the first preset number may not be greater than two. That is, the number of positioning images added to the target image may not be greater than two. In other words, compared with the traditional two-dimensional code, it does not need too many positioning points.

For example, the execution subject may add a positioning image to the edge position of the target image to generate a first coded image. As shown in FIG. 3A, if the encoded information is located in the area of the square frame, a ring image (that is, a positioning image) can be added to a corner (such as the upper left corner) of the square frame. The square frame here may be a square as shown in FIG. 3A, or may be a rectangle. In some application scenarios, the square box can be replaced with a round box, such as Tai Chi. The positioning image at this time may be (but is not limited to) a ring image located on a circular frame; it may also be a line segment such as a curve or a line located inside the circular frame and connecting the center and the edge.

As another example, the execution subject may add two positioning images symmetrically or asymmetrically at the edge positions of the target image, thereby generating a first encoded image. If the encoded information is located in the area of the square frame, as shown in FIG. 3B, a solid dot image can be added to any two adjacent corners (such as the upper left corner and the upper right corner) of the square frame. Alternatively, as shown in FIG. 3C, a positioning image may be added to any two diagonal corners of the square frame. In FIG. 3C, the positioning image may be an image of a donut plus a solid dot. The ring and the solid dot may have the same center.

For another example, the execution subject may add a positioning image to the central region and the edge position of the target image, respectively, thereby generating a first encoded image. As shown in FIG. 3D, if the encoding information is located between two concentric circular frames, a ring image can be added to the outer circular frame. At the same time, you can add a solid dot image to the inner round frame. Or you can add a positioning image at the center of the circle. The center points of the two positioning images may be coaxial or different axes.

It should be noted that, in general, the main role of the target image is to present the encoded information. Therefore, the encoded information often occupies most of the area of the target image. That is, the edge position of the target image is basically the edge position of the encoded information.

Step 202: Rotate the first encoded image by a second preset number of angles around the center area of the first encoded image to obtain second encoded images at a second preset number of different rotation angles, respectively.

In this embodiment, after the first encoded image is generated, the execution subject may rotate the first encoded image by a second preset number of different angles with the center area of the first encoded image as a center. Thereby, a second preset number of second encoded images at different rotation angles can be obtained. The rotation angle may include the direction of rotation and the size of the angle. Here, the second preset number and rotation angle can be set according to actual needs.

As an example, the execution subject may first rotate the first coded image by 60 °, 120 °, and 180 ° in a clockwise direction. After that, the execution subject can rotate the first coded image counterclockwise by 60 ° and 120 °, respectively. In this way, five second encoded images with equal angular differences can be obtained. As another example, the execution subject may rotate in a manner of increasing (or decreasing) the angle difference sequentially. For example, the first coded image is rotated clockwise (or counterclockwise) by 60 °, 130 °, 210 °, and 300 °, respectively. The angular differences are 60, 70, 80, and 90, respectively. For another example, in order to improve data processing efficiency and simplify the processing process, the execution subject may rotate the first coded image in a clockwise (or counterclockwise) manner with an equal angular difference.

It can be understood that the above-mentioned rotation process can be performed manually by a user, or can be implemented by an execution subject by executing a corresponding program. For example, the execution subject may perform affine transformation on the first encoded image according to parameters set by the user, so as to obtain the first second encoded image. Then, the first second encoded image can be used as the first encoded image to continue the affine transformation. Until the number of the second encoded images reaches a second preset number. Or until the currently obtained second coded image is the same as the original first coded image, it means that one rotation has been performed at this time. This can reduce manual operations and help improve data processing efficiency.

Step 203: Generate a coded image set according to the obtained second coded image, and output the coded image set.

In this embodiment, the execution body may generate a coded image set according to the second coded image obtained in step 202. And can output the coded image collection. The output here can be stored output. For example, the encoded image collection may be stored locally. Or you can store the encoded image collection to other electronic devices or the cloud.

As an example, the execution body may sequentially store the second encoded images in the generated collection file in the order in which the second encoded images are generated. Thereby, the set file can be used as a set of encoded images.

Optionally, the execution subject may use the first encoded image as a reference and store the first encoded image and the obtained second encoded image in the order of rotation angle from small to large or from large to small to generate a set of encoded images. That is, the coded image set may include a first coded image and a second coded image. Alternatively, the execution subject may use the first encoded image as a reference and store the obtained second encoded image in the order of rotation angle from small to large or from large to small to generate a set of encoded images. That is, the coded image set may include a second coded image. The rotation angle here refers to the rotation angle in the same direction.

In some embodiments, the output may also be a transmission output and / or a display output. For example, the execution body may send the encoded image set to the terminal. Or the execution subject may display the encoded images in the encoded image set. For example, the execution subject may display all the encoded images on the screen in any order or in the order in which the encoded images are stored. For another example, the execution body may display each coded image in the coded image set one by one at a preset frame rate in an arbitrary order or in a stored order of the coded images. That is, each coded image is displayed one by one at a preset frame rate.

Further, in order to facilitate subsequent recognition of the encoded image, the execution subject may use the first encoded image as a reference, and sequentially display the encoding image set in the encoded image set in the order of rotation angle from small to large or from large to small at a preset frame rate. Encode the image. This helps improve the recognition efficiency of the encoded information and reduces the waiting time of the user.

It should be noted that the preset frame rate (that is, the number of frames displayed per second) is not limited in this application. It can be set according to the number of encoded images, for example. In addition, the display of the coded image set by the execution subject may be displayed only once; it may also be displayed cyclically for a specified number of times (such as three times); it may also be displayed for a specified period of time (such as two seconds) or displayed continuously.

The method for generating encoded information provided in this embodiment can generate a first encoded image by adding a first preset number of positioning images to a preset position in a target image containing the encoded information. Then, by rotating the first coded image by a second preset number of angles around the center area of the first coded image, second coded images at a second preset number of different rotation angles can be obtained. Then, based on the obtained second encoded image, an encoded image set can be generated. And can output coded image collection. This implementation mode enriches the manner in which the encoded information is generated. This can help meet the different design needs of users, and is conducive to enriching the presentation of encoded information.

Please refer to FIG. 4, which illustrates a process 400 of an embodiment of a method for identifying encoded information according to the present application. The method for identifying encoding information may be used to identify an encoded image in an encoded image set generated by the method described in the foregoing embodiment, and includes the following steps:

Step 401: Collect a coded image displayed in each frame, identify a first preset number of positioning images in the coded image, and determine position information of the positioning image.

In this embodiment, an execution subject (for example, the

terminals

101, 102, and 103 shown in FIG. 1) of the method for identifying encoding information may collect an encoded image displayed in each frame. The encoded images in the encoded image set may be displayed one by one according to a preset frame rate. For example, when other electronic devices display the coded images in the coded image set one by one at a preset frame rate, the user may use a camera on the execution body to capture the coded images displayed in each frame. As another example, when the user triggers (eg, clicks or long presses, etc.) a specified area on the screen of the execution subject, the execution subject may display the encoded images in the encoded image set one by one in the specified area at the preset frame rate. At the same time, the execution subject can use screenshots and other methods to collect the encoded images displayed in each frame on the screen.

In this embodiment, the execution subject may identify the first preset number of positioning images in the acquired encoded image. And can determine the location information of the positioning image. For example, the execution subject may perform image recognition analysis on the encoded image to determine whether a first preset number of special shape images (that is, images with a shape different from most of the images) exist therein. If it is determined to exist, the special shape image may be determined as a positioning image.

As another example, the execution subject may perform image recognition analysis on the encoded image to determine whether there is an image matching the pre-stored image. The storage location of the pre-stored image is not limited. Matching here can mean that the similarity between image features reaches a threshold (such as 90% or 100%, etc.). If it is determined to exist, the matched image may be determined as a positioning image.

As another example, the execution subject may input the encoded image into a pre-trained recognition model. In this way, the execution subject can use the recognition model to identify the positioning image. And the position information of the positioning image can be output. Among them, the recognition model may be obtained by training the initial model with a large number of positive and negative samples. Positive samples can be sample coded images with localized images and sample locations for localized images. The negative sample may be a sample-encoded image without a localized image.

Here, the above-mentioned position information may be (but is not limited to) position information of the positioning image in the encoded image. For example, the position information of the positioning image in the specified area (or screenshot) may be used. And the position information may be (but not limited to) the coordinates of the center point of the positioning image. However, it should be noted that the position information of the positioning images in different encoded images may have the same coordinate origin. For example, the center point of any corner (such as the upper left corner) or any side of the encoded image can be used as the reference origin. This helps improve the efficiency of data processing.

It can be understood that when displaying each coded image in the coded image set, the position of the coded information in the coded image and the position of the positioning image often change. The screen or designated area where the coded image is displayed is fixed. That is, the size and shape of different encoded images are constant.

Step 402: Obtain a position information sequence according to the position information of the positioning image determined in each frame.

In this embodiment, the execution subject may obtain a position information sequence according to the position information of the positioning image determined by each frame. As an example, the execution subject may store the position information of the positioning image determined in each frame in order of the acquisition time to obtain the position information sequence. Wherein, the position information of each positioning image in the same coded image may form an array. For another example, if the encoded image includes at least two positioning images, the execution subject may store the position information of the at least two positioning images determined in each frame in the order of the acquisition time. For another example, the execution subject may analyze the position information of the positioning image determined in each frame to determine the relative position relationship. The position information of the positioning image determined in each frame can be stored in the order of the clockwise (or counterclockwise) direction.

Step 403: Locate and identify encoding information in the encoded images in the encoded image set according to the position information sequence.

In this embodiment, the execution subject may locate and identify the encoding information in the encoded images in the encoded image set according to the position information sequence obtained in step 402. As an example, the execution subject may mark the position indicated by the position information in the position information sequence in the currently acquired encoded image. And the positioning area can be formed according to the position of the mark. For example, a straight line or an arc can be used to connect the positions of the marks one after another. The area inside the connection line can be used as the positioning area. Alternatively, the center point can be determined according to each position of the mark. The positioning area is determined by taking the center point as the center of the circle and the distance from the center point to the position of any mark as the radius. In this way, the information (that is, the coding information) located in the positioning area in the currently acquired coded image can be identified.

Optionally, the execution body may first select a coded image from the collected coded images. For example, a coded image with relatively clear images can be selected. Alternatively, the first coded image (possibly the first coded image) collected may be selected. Then, in the selected coded image, the position indicated by the position information in the position information sequence may be marked, and a positioning area may be formed. After that, the information in the positioning area in the selected coded image can be identified.

It should be noted that, in order to reduce the impact on user usage, the above-mentioned positioning and identification process can usually be run in the background. In addition, in order to improve the recognition efficiency and reduce the user's waiting time, the process of collecting encoded images is not always continuous. In some cases, the executing subject may stop acquiring encoded images.

Optionally, in the acquisition process, the execution subject may determine, from the determined position information of the positioning image, whether there is position information that is the same as the position information of the positioning image determined by the current frame. If it is determined that the same position information exists, the acquisition of the encoded image may be stopped. It can be understood that if the same coded image includes at least two positioning images, the same position information mentioned above mainly refers to position information that is the same as the position information of at least two positioning images determined by the current frame.

In some embodiments, the execution subject may be timed when the acquisition begins. And during the acquisition process, it can be determined whether the current acquisition time reaches a preset time (for example, 5 seconds). If it is determined that the preset time period is reached, the acquisition of the encoded image may be stopped.

The method for identifying encoding information provided by this embodiment can identify the first preset number of positioning images in the encoded image by collecting the encoded images displayed in each frame, and can determine position information of the positioning images. The encoded images in the encoded image set may be displayed one by one according to a preset frame rate. Then, according to the position information of the positioning image determined in each frame, a position information sequence can be obtained. Finally, according to the position information sequence, the encoding information in the encoded images in the encoded image set can be located and identified. This implementation manner can realize identification of the encoded images in the encoded image set generated by the method described in the foregoing embodiment. It also enriches the identification of the encoded information. This can help meet the needs of different users.

Further referring to FIG. 5, it illustrates a flow 500 of still another embodiment of a method for identifying encoded information according to the present application. The method for identifying the encoded information may include the following steps:

Step 501: Collect a coded image displayed in each frame, identify a first preset number of positioning images in the coded image, and determine position information of the positioning image.

In this embodiment, an execution subject (for example, the

terminals

101, 102, and 103 shown in FIG. 1) of the method for identifying encoding information may collect an encoded image displayed in each frame. The encoded images in the encoded image set may be displayed one by one according to a preset frame rate. Thereby, the first preset number of positioning images in the encoded image can be identified, and the position information of the positioning images can be determined. Refer to the related description in step 401 of the embodiment in FIG. 4, and details are not described herein again.

In step 502, it is determined whether there is a case of collecting dropped frames.

In this embodiment, the execution subject may determine whether there is a case of frame loss due to collection according to the interval time between two adjacent encoded images. For example, according to the sequence of acquisition time, the acquisition interval between the first encoded image and the second encoded image, the second encoded image, and the third encoded image are 0.2 seconds. The acquisition interval between the third encoded image and the fourth encoded image is 0.4 seconds. At this point, the execution subject can determine that there is a frame drop condition between the third and fourth frames.

As an example, the execution subject may determine the position change rule of the positioning image according to the position information of the positioning image determined in each frame. In this way, according to the change rule of the position, the execution subject can determine whether there is a frame loss situation during acquisition. For example, the distance between any two adjacent positions is L. At this time, if the distance between two adjacent positions is not L, it can be explained that the position information of the positioning image is missing between the two positions. That is, there is a case of collecting dropped frames. That is, no encoded image can be acquired that can be used to describe the position information of the missing positioning image.

In this embodiment, if the execution subject determines that there is no frame loss, the position information sequence may be obtained according to the position information of the positioning image determined by each frame. For details, reference may be made to step 402 in the embodiment of FIG. 4, and details are not described herein again. If the execution subject determines that a frame loss situation exists, step 503 may be continued.

Step 503: When it is determined that a frame loss situation exists, according to the position change rule of the positioning image, supplement the position information of the positioning image in the coded image of the dropped frame to obtain a position information sequence.

In this embodiment, if it is determined that there is a frame dropping condition, the execution subject may supplement the position information of the positioning image in the encoded image of the dropped frame according to the position change rule of the positioning image. For example, the distance between any two adjacent positions is L. At this time, if the distance between two adjacent positions is not L, such a position can be determined between the two positions. The distance between this position and these two positions is L, and it conforms to the law of position change. That is, the position information of the supplemental positioning image. In this way, based on the position information of the supplemented positioning image, a position information sequence can be obtained. For details, reference may be made to step 402 in the embodiment of FIG. 4, and details are not described herein again.

Step 504: Select two encoded images from the collected encoded images, use one of the selected two encoded images as a pre-transform image, and use the other encoded image of the selected two encoded images as a post-transform image. Image, and solve the affine transformation matrix.

In this embodiment, the execution subject may select two encoded images from the acquired encoded images. After that, one of the selected two encoded images can be used as the image before transformation. And the other one of the selected two encoded images can be used as the transformed image. After that, the affine transformation matrix can be solved.

Here, the selection method is not limited in this application. For example, the execution subject may select any two adjacent coded images in the order of acquisition time. Alternatively, the execution subject may select the first coded image (possibly the first coded image) acquired, and select any subsequent coded image acquired. For example, select a clear encoded image of the collected image.

Among them, the affine transformation is defined geometrically as an affine transformation or an affine mapping between two vector spaces. Usually consists of a non-singular linear transformation (transformation using a linear function) followed by a translation transformation. That is to say, a vector space can be transformed into another vector space by performing a linear transformation followed by a translation. In the case of finite dimensions, each affine transformation can be given by a matrix A and a vector b, which can be written as A and an additional column b.

Here, the execution body can use various existing methods to complete the solution of the affine transformation matrix. As an example, the least squares method can be used to estimate the transformation matrix. For example, the position information of several identical pixels in two coded images can be taken as the position information before and after transformation. Then, a system of superlinear equations can be established. Therefore, the least square method can be used to solve the coordinate conversion coefficient (that is, the parameter of the affine transformation matrix). It can be understood that, in order to improve the data reuse rate, the aforementioned pixels may include a positioning image. This can simplify the processing process and improve processing efficiency.

For another example, the executing body can also use the ransac algorithm to solve the affine transformation matrix. Among them, ransac (RANdom Sample) Consensus is usually an algorithm that calculates the mathematical model parameters of the data based on a set of sample data sets containing abnormal data and obtains valid sample data. This algorithm is often used in computer vision. For example, in the field of stereo vision, the matching point of a pair of cameras and the calculation of the basic matrix are simultaneously solved. The method for solving the affine transformation matrix here is commercially available, and will not be repeated here.

Step 505: Inverse transform the transformed image using the solved affine transformation matrix to obtain a normalized image.

In this embodiment, the execution subject may use the solved affine transformation matrix to perform inverse transformation on the transformed image, so as to obtain a normalized image. Among the two coded images to be selected, the coded image as the transformed image is converted into the coded image as the before-transformed image.

Step 506: Determine the position of the center point of the normalized image according to the position information in the position information sequence.

In this embodiment, the execution subject may determine the center points of these positions based on the position information in the position information sequence. It can be understood that the second encoded image is obtained by rotating the center area of the first encoded image as a center. So the center point determined here is the center point of the normalized image.

Step 507: Identify coding information in the normalized image according to the position information sequence and the position of the center point.

In this embodiment, the execution subject may identify the encoded information in the normalized image according to the position information in the position information sequence and the position of the center point. For details, reference may be made to step 403 in the embodiment of FIG. 4, and details are not described herein again.

Optionally, the execution subject may use the center point determined in step 506 as a pole point to perform polar coordinate transformation on the position information in the position information sequence. That is, the coordinate origin of each position information in the position information sequence is transformed into the center point of the normalized image. At this time, the execution subject can identify the encoded information in the normalized image according to the polar coordinates of each position information in the position information sequence.

The method for identifying encoding information proposed in this embodiment adds a determination process of a frame loss situation. At the same time, the process of identifying the encoded information based on the position information sequence is described in detail. This can enrich and improve the identification method. Helps improve the accuracy of recognition results.

Referring to FIG. 6 below, a schematic structural diagram of a computer system 600 suitable for implementing an electronic device (such as the

terminals

101, 102, 103 or the server 106 shown in FIG. 1) according to the embodiment of the present application is shown. The electronic device shown in FIG. 6 is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present application.

As shown in FIG. 6, the computer system 600 includes a central processing unit (CPU) 601, which can be loaded into a random access memory (RAM) 603 according to a program stored in a read-only memory (ROM) 602 or from a storage portion 608. Instead, perform various appropriate actions and processes. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

The following components are connected to the I / O interface 605: an input portion 606 including a touch screen, buttons, a mouse, a microphone, a camera, etc .; an output portion 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; A storage section 608 of a hard disk or the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the Internet. The driver 610 is also connected to the I / O interface 605 as necessary. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage section 608 as needed.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing a method shown in a flowchart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 609, and / or installed from a removable medium 611. When the computer program is executed by a central processing unit (CPU) 601, the above-mentioned functions defined in the method of the present application are executed. It should be noted that the computer-readable medium of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the foregoing. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programming read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In this application, a computer-readable medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium may include a data signal that is included in baseband or propagated as part of a carrier wave, and which carries computer-readable program code. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, which contains one or more functions to implement a specified logical function Executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than those marked in the drawings. For example, two successively represented boxes may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified function or operation , Or it can be implemented with a combination of dedicated hardware and computer instructions.

The units described in the embodiments of the present application may be implemented by software or hardware. The described unit may also be provided in a processor, for example, it may be described as: a processor includes a first generation unit, a second generation unit, and a third generation unit. For another example, it can also be described as: a processor includes an acquisition unit, a sequence generation unit, and a recognition unit. Among them, the names of these units do not constitute a limitation on the unit itself in some cases. For example, the first generating unit can also be described as "adding the first A preset number of positioning images, a unit for generating a first coded image ".

As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the foregoing embodiments; or may exist alone without being assembled into the electronic device in. For example, the computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device causes the electronic device to add a first A preset number of positioning images generates a first coded image; the first coded image is rotated by a second preset number of angles around the center area of the first coded image to obtain a second preset number of different rotation angles, respectively A second coded image under the code; based on the obtained second coded image, a coded image set is generated, and a coded image set is output.

As another example, when the one or more programs are executed by the electronic device, the electronic device may be caused to: collect the coded image displayed in each frame, identify the first preset number of positioning images in the coded image, and determine the positioning image The position information of the coded image set is displayed one by one according to a preset frame rate; the position information sequence is obtained according to the position information of the positioning image determined by each frame; and the position of the coded image set is identified according to the position information sequence. Encoding information in the encoded image.

The above description is only a preferred embodiment of the present application and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solution of the specific combination of the above technical features, but it should also cover the above technical features or Other technical solutions formed by arbitrarily combining their equivalent features. For example, a technical solution formed by replacing the above features with technical features disclosed in the present application (but not limited to) with similar functions.

Claims

A method for generating encoded information includes:

Adding a first preset number of positioning images at a preset position to a target image containing encoding information to generate a first encoded image;

Taking the center area of the first encoded image as a center, rotating the first encoded image by a second preset number of angles to obtain second encoded images at a second preset number of different rotation angles, respectively;

According to the obtained second coded image, a coded image set is generated, and the coded image set is output.
The method according to claim 1, wherein the first preset number is not greater than two, and the adding a first preset number of positioning images at a preset position comprises:

Adding one positioning image to the edge position of the target image; or adding two positioning images symmetrically or asymmetrically to the edge position of the target image; or adding one positioning image to the center region and edge position of the target image respectively.
The method according to claim 1, wherein generating a coded image set based on the obtained second coded image comprises:

Taking the first encoded image as a reference, storing the first encoded image and the obtained second encoded image in the order of rotation angle from small to large or from large to small to generate a set of encoded images; or

Taking the first encoded image as a reference, the obtained second encoded image is stored in the order of rotation angle from small to large or from large to small to generate a coded image set.
The method according to any one of claims 1-3, wherein said outputting said set of encoded images comprises:

The coded images in the coded image set are displayed one by one at a preset frame rate.
The method according to claim 4, wherein the displaying the coded images in the coded image set one by one according to a preset frame rate comprises:

The coded images in the coded image set are sequentially displayed at a preset frame rate in the order of rotation angle from small to large or from large to small.
A method for identifying encoding information for identifying an encoded image in an encoded image set generated by the method according to any one of claims 1-5, comprising:

Collect the coded images displayed in each frame, identify the first preset number of positioning images in the coded images, and determine position information of the positioning images, wherein the coded images in the coded image set are displayed one by one at a preset frame rate;

Obtaining a position information sequence according to the position information of the positioning image determined by each frame;

According to the position information sequence, the encoding information in the encoded images in the encoded image set is located and identified.
The method according to claim 6, wherein the locating and identifying encoding information in the encoded images in the encoded image set according to the position information sequence comprises:

Select two coded images from the collected coded images, use one of the two coded images as the pre-transformed image, and use the other coded image of the two selected coded images as the transformed image. Solution of affine transformation matrix;

Using the solved affine transformation matrix to inversely transform the transformed image to obtain a normalized image;

Determining a position of a center point of the normalized image according to the position information in the position information sequence;

Identify the encoding information in the normalized image according to the position information sequence and the position of the center point.
The method according to claim 7, wherein the identifying the encoded information in the normalized image based on the position information sequence and the position of the center point comprises:

Perform polar coordinate transformation on the position information in the position information sequence using the center point as a pole;

Identify the encoded information in the normalized image according to the polar coordinates in the position information sequence.
The method according to claim 6, wherein locating and identifying encoding information in the encoded images in the encoded image set according to the position information sequence comprises:

Selecting a coded image from the collected coded images, marking the position indicated by the position information in the position information sequence in the selected coded image, and forming a positioning area;

Identifying information in the selected coded image that is located within the positioning area.
The method according to any one of claims 6 to 9, wherein the obtaining the position information sequence according to the position information of the positioning image determined in each frame includes:

Determine whether there is a frame loss situation; when it is determined that there is a frame loss situation, according to the position change rule of the positioning image, supplement the position information of the positioning image in the encoded image of the dropped frame to obtain the position information sequence.
The method according to any one of claims 6 to 10, wherein before obtaining the position information sequence based on the position information of the positioning image determined according to each frame, the method further comprises:

In the determined position information of the positioning image, it is determined whether there is the same position information as the position information of the positioning image determined in the current frame; in response to the determination, the acquisition of the encoded image is stopped.
The method according to any one of claims 6 to 10, wherein before obtaining the position information sequence based on the position information of the positioning image determined according to each frame, the method further comprises:

It is determined whether the current acquisition time reaches the preset time; in response to the determination, the acquisition of the encoded image is stopped.
An electronic device includes:

One or more processors;

A storage device on which one or more programs are stored;

When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1-12.
A computer-readable medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the method of any one of claims 1-12.