WO2022206172A1

WO2022206172A1 - Graphic code, graphic code recognition method, storage medium, and related apparatus

Info

Publication number: WO2022206172A1
Application number: PCT/CN2022/075367
Authority: WO
Inventors: 戴阳
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-04-02
Filing date: 2022-02-07
Publication date: 2022-10-06
Also published as: CN112949804A

Abstract

The present invention relates to the technical field of image processing, and provides a graphic code, a graphic code recognition method, a graphic code recognition apparatus, a graphic code recognition system, a computer readable storage medium, and an electronic device. The graphic code is disposed on a substrate. An infrared reflective layer is coated in a graphic area of the graphic code. The infrared reflectivity of the infrared reflective layer is greater than that of the substrate. The graphic code can be accurately recognized in a dark environment.

Description

Graphic code, graphic code identification method, storage medium and related device

This disclosure claims the priority of a Chinese patent application with application number 202110361385.4, filed on April 2, 2021, entitled "Graphic Code, Graphical Code Recognition Method, Storage Medium, and Related Apparatus", the entire contents of which are hereby incorporated by reference All incorporated herein.

technical field

The present disclosure relates to the technical field of image processing, and in particular, to a graphic code, a graphic code identification method, a graphic code identification device, a graphic code identification system, a computer-readable storage medium, and an electronic device.

Background technique

With the rapid development of Internet technology, in order to improve the convenience of obtaining information and information security, people propose to encode information through specific geometric figures to store or represent various types of data, such as two-dimensional codes or barcodes, etc. . In the prior art, graphic codes are usually obtained by ink printing on a paper substrate. In practical applications, the user identifies the graphic code by collecting the image of the graphic code through the camera, so as to obtain the information corresponding to the graphic code. However, the scene of this kind of graphic code recognition often has high requirements on the environment. When it is indoors or in an environment with poor lighting, it may be difficult or misidentified to recognize the graphic code based on the collected images. , affecting the accuracy of information acquisition.

public content

The present disclosure provides a graphic code, a graphic code identification method, a graphic code identification device, a graphic code identification system, a computer-readable storage medium and an electronic device, thereby improving the environmental requirements of graphic code identification in the prior art at least to a certain extent high, and identify problems with poor accuracy.

Other features and advantages of the present disclosure will become apparent from the following detailed description, or be learned in part by practice of the present disclosure.

According to a first aspect of the present disclosure, there is provided a graphic code, the graphic code is disposed on a substrate, a graphic area of the graphic code is coated with an infrared reflection layer, and the infrared reflection rate of the infrared reflection layer is higher than that of the substrate of infrared reflectance.

According to a second aspect of the present disclosure, there is provided a method for identifying a graphic code, comprising: acquiring an infrared reflection signal received by an infrared sensor, and the infrared reflection signal is transmitted by the infrared sensor to the infrared emission signal of the first aspect. It is formed by reflection at the graphic code; based on the infrared reflection signal, the graphic area of the graphic code is identified.

According to a third aspect of the present disclosure, there is provided a graphic code identification device, comprising: a reflection signal acquisition module for acquiring an infrared reflection signal received by an infrared sensor, where the infrared sensor transmits an infrared emission signal for the infrared reflection signal It is formed by reflection at the graphic code described in the first aspect; a graphic area identification module is configured to identify the graphic area of the graphic code based on the infrared reflection signal.

According to a fourth aspect of the present disclosure, there is provided a graphic code identification system, comprising: a graphic code, the graphic code is disposed on a substrate, a graphic area of the graphic code is coated with an infrared reflection layer, and the infrared reflection layer of the infrared reflection layer The reflectivity is higher than the infrared reflectivity of the substrate; the graphic code identification device is used to obtain the infrared reflection signal received by the infrared sensor, and based on the infrared reflection signal, identify the graphic area of the graphic code; the infrared reflection signal It is formed by the infrared sensor transmitting the infrared emission signal to the graphic code and reflecting.

According to a fifth aspect of the present disclosure, there is provided a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the graphic code identification method of the second aspect and possible implementations thereof.

According to a sixth aspect of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor. Wherein, the processor is configured to execute the graphic code identification method of the second aspect and possible implementations thereof by executing the executable instructions.

The technical solution of the present disclosure has the following beneficial effects:

In this exemplary embodiment, the graphic code is arranged on the substrate, the graphic area of the graphic code is coated with an infrared reflection layer, and the infrared reflection rate of the infrared reflection layer is higher than that of the substrate. On the one hand, the graphic code in this exemplary embodiment is coated with an infrared reflection layer in the graphic area, the graphic code can be scanned by an infrared sensor, and the graphic area can be identified according to the infrared reflection signal reflected by the infrared reflection layer, compared with In the prior art, the method of collecting the image of the graphic code to identify the graphic area, the identification process is simple, and the recognition accuracy of the graphic area is high; The signal is not affected by ambient light, and it can still accurately and quickly identify the graphic area at night or in an indoor environment with weak light, and has a wide range of applications.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

1 shows a schematic diagram of the system architecture of a method for identifying a graphic code in this exemplary embodiment;

FIG. 2 shows a structural diagram of an electronic device in this exemplary embodiment;

FIG. 3 shows a schematic diagram of a graphic code in this exemplary embodiment;

FIG. 4 shows a flowchart of a method for identifying a graphic code in this exemplary embodiment;

FIG. 5 shows a schematic diagram of a scene of scanning a two-dimensional code in this exemplary embodiment;

6 shows a schematic diagram of a user interface when scanning a two-dimensional code in this exemplary embodiment;

FIG. 7 shows a schematic diagram of another user interface when scanning a two-dimensional code in this exemplary embodiment;

FIG. 8 shows a schematic diagram of still another user interface when scanning a two-dimensional code in this exemplary embodiment;

FIG. 9 shows a structural block diagram of an apparatus for identifying a graphic code in this exemplary embodiment.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed. In other instances, well-known solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated descriptions will be omitted. Some of the block diagrams shown in the figures are functional entities that do not necessarily necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

Exemplary embodiments of the present disclosure provide a graphic code identification method. FIG. 1 shows a system architecture diagram of the operating environment of the present exemplary embodiment. As shown in FIG. 1 , the system architecture 100 may include a server 110 and a terminal 120 , and a communication interaction is formed between the two through a network. For example, the server 110 sends the identification result of the graphic area to the terminal 120 . The server 110 refers to a background server that provides Internet services; the terminal 120 includes, but is not limited to, smart phones, tablet computers, game consoles, wearable devices, and the like.

It should be understood that the number of devices in FIG. 1 is exemplary only. According to the implementation needs, any number of clients can be set, or the server can be a cluster formed by multiple servers.

The graphic code identification method provided by the embodiment of the present disclosure may be executed by the terminal 120, for example, an infrared sensor configured by the terminal 120 transmits an infrared emission signal to the graphic code, receives the infrared reflection signal, and identifies the graphic area according to the infrared reflection signal; It can also be executed by the server 110. For example, the terminal 120 uploads the infrared reflection signal to the server 110 after receiving the infrared reflection signal, so that the server 110 can identify the graphic area according to the infrared reflection signal, which is not limited in this disclosure.

An exemplary embodiment of the present disclosure provides an electronic device for implementing a method for identifying a graphic code, which may be the server 110 and the terminal 120 in FIG. 1 . The electronic device includes at least a processor and a memory, the memory is used for storing executable instructions of the processor, and the processor is configured to execute the graphic code identification method by executing the executable instructions.

The following takes the mobile terminal 200 in FIG. 2 as an example to illustrate the structure of the above electronic device. It will be understood by those skilled in the art that the configuration in Figure 2 can also be applied to stationary type devices, in addition to components specifically for mobile purposes.

As shown in FIG. 2, the mobile terminal 200 may specifically include: a processor 210, an internal memory 221, an external memory interface 222, a USB (Universal Serial Bus, Universal Serial Bus) interface 230, a charging management module 240, a power management module 241, Battery 242, Antenna 1, Antenna 2, Mobile Communication Module 250, Wireless Communication Module 260, Audio Module 270, Speaker 271, Receiver 272, Microphone 273, Headphone Interface 274, Sensor Module 280, Display Screen 290, Camera Module 291, Indication 292, a motor 293, a key 294, a SIM (Subscriber Identification Module, Subscriber Identification Module) card interface 295 and the like.

The processor 210 may include one or more processing units, for example, the processor 210 may include an AP (Application Processor, application processor), a modem processor, a GPU (Graphics Processing Unit, graphics processor), an ISP (Image Signal Processor, image signal processor), controller, encoder, decoder, DSP (Digital Signal Processor, digital signal processor), baseband processor and/or NPU (Neural-Network Processing Unit, neural network processor), etc. The encoder can encode (ie, compress) the image or video data; the decoder can decode (ie, decompress) the code stream data of the image or video to restore the image or video data.

In some embodiments, the processor 210 may include one or more interfaces through which connections are formed with other components of the mobile terminal 200 .

Internal memory 221 may be used to store computer executable program code, which includes instructions. The internal memory 221 may include volatile memory, nonvolatile memory, and the like. The processor 210 executes various functional applications and data processing of the mobile terminal 200 by executing instructions stored in the internal memory 221 and/or instructions stored in a memory provided in the processor.

The external memory interface 222 can be used to connect an external memory, such as a Micro SD card, to expand the storage capacity of the mobile terminal 200. The external memory communicates with the processor 210 through the external memory interface 222 to implement data storage functions, such as storing music, video and other files.

The USB interface 230 is an interface conforming to the USB standard specification, and can be used to connect a charger to charge the mobile terminal 200, and can also be connected to an earphone or other electronic devices.

The charging management module 240 is used to receive charging input from the charger. While charging the battery 242, the charging management module 240 can also supply power to the device through the power management module 241; the power management module 241 can also monitor the state of the battery.

The wireless communication function of the mobile terminal 200 may be implemented by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modulation and demodulation processor, the baseband processor, and the like. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. The mobile communication module 250 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the mobile terminal 200 . The wireless communication module 260 can provide applications on the mobile terminal 200 including WLAN (Wireless Local Area Networks, wireless local area network) (such as Wi-Fi (Wireless Fidelity, wireless fidelity) network), BT (Bluetooth, Bluetooth), GNSS (Global Navigation Satellite System, global navigation satellite system), FM (Frequency Modulation, frequency modulation), NFC (Near Field Communication, short-range wireless communication technology), IR (Infrared, infrared technology) and other wireless communication solutions. The mobile terminal 200 may implement a display function through a GPU, a display screen 290, an AP, and the like, and display a user interface.

The mobile terminal 200 can realize the shooting function through the ISP, the camera module 291, the encoder, the decoder, the GPU, the display screen 290 and the AP, etc., and can also realize the shooting function through the audio module 270, the speaker 271, the receiver 272, the microphone 273, the headphone interface 274, and the like. AP, etc. to implement audio functions.

The sensor module 280 may include a depth sensor 2801, a pressure sensor 2802, a gyro sensor 2803, an air pressure sensor 2804, etc., to realize different sensing detection functions.

The indicator 292 can be an indicator light, which can be used to indicate the charging status, the change of power, and can also be used to indicate messages, missed calls, notifications, and the like. The motor 293 can generate vibration prompts, and can also be used for touch vibration feedback and the like. The keys 294 include a power-on key, a volume key, and the like.

The mobile terminal 200 may support one or more SIM card interfaces 295 for connecting the SIM cards to realize functions such as calling and data communication.

First, the present exemplary embodiment provides a graphic code. As shown in FIG. 3 , a schematic diagram of a graphic code in the present exemplary embodiment is shown. The graphic code 310 is arranged on the base 320 . The pattern area 311 is coated with an infrared reflection layer, and the infrared reflection rate of the infrared reflection layer is higher than that of the substrate. The user can scan the graphic code 310 provided on the base 320 through the mobile terminal to obtain the information contained in the graphic code 310 .

The above-mentioned graphic codes 310 may include various types of graphic codes, such as two-dimensional codes, barcodes, or other graphic codes that can acquire information through scanning or image capture. The substrate 320 refers to a medium for carrying the graphic code 310, which can be glass, a wall, etc. In particular, in this exemplary embodiment, the substrate 320 can be a transparent substrate, that is, a transparent material with high light transmittance, such as Completely transparent or transparent glass or plastic, etc. Disposing the graphic code 310 on the substrate 320 may include directly disposing the graphic code 310 on the substrate 320, or combining the pre-set graphic code 310 with the substrate 320, for example, coating the glass according to the graphic area; Graphic code film in the graphic area attached to the glass, etc.

The graphic area 311 refers to the area that can reflect the graphic code information, and the area other than the graphic area 311 in the graphic code can be used as the background area 312. Indicates the internal logic of "0" or "1", wherein the black area can be used as the graphic area 311, and the white area is the background area 312; in addition, the white area can also be used as the graphic area 311, then the black area is the background area 312. It should be noted that the above black area and white area are only for schematic illustration. In practical application, as long as the area can reflect the logic of "0" or "1" in the two-dimensional code, there is no specific limitation on the color.

In this exemplary embodiment, the graphic area 311 may be coated with an infrared reflection layer. Specifically, the graphic area 311 may be directly coated with an infrared reflection layer, or a film with infrared reflection properties that conforms to the graphic area 311 may be obtained. On the graphic area 311, etc., for example, coat the black area of the two-dimensional code on the glass with an infrared reflection layer, or paste the two-dimensional code film with an infrared reflection layer in the black area on the glass, or directly on the black area The area is pasted with a film with infrared reflective properties, etc. Other areas other than the graphic area 311, such as the substrate or the background area 312, may not be coated. For example, a "hollowed out" two-dimensional code film with only the black area coated can be pasted on the glass; or the complete two-dimensional code is transparent. In the film, only the black area is coated, and the complete two-dimensional code film is pasted on the glass, etc. In addition, the substrate or background area 312 can also be coated with other layers, for example, it does not have infrared reflection performance, or the infrared reflection performance is poor. other transparent layers, etc. Since the infrared reflectivity of the infrared reflection layer is higher than that of the substrate 320, when the graphic code 310 receives the infrared emission signal, the graphic area 311 can return the infrared reflected signal better, while the background area 312 and the substrate 320 cannot return The infrared reflection signal or the returned infrared reflection signal is weak, therefore, the mobile terminal can identify the graphic area based on the infrared reflection signal.

In an exemplary embodiment, the substrate 320 is a transparent substrate, and the infrared reflection layer is a transparent layer. There are two cases where the infrared reflection layer is a transparent layer. The first one is that the infrared reflection layer is colorless. After the graphic area is coated with the infrared reflection layer, the user cannot observe the existence of the graphic area with the naked eye, and the graphic code is realized. Completely "invisible" on a transparent substrate; second, the infrared reflective layer is a reflective layer with color but with a certain degree of transparency, the user can observe the existence of the graphic area with the naked eye, but it is not obvious, and the user can see through the graphic code The environmental state behind the transparent substrate was observed, and the graphic code basically did not affect the user's line of sight.

In this exemplary embodiment, a two-dimensional code is set on glass as an example, glass with a reflectivity of less than 30% for near-infrared light with a wavelength of 940 nm (nanometer) can be used as a transparent substrate, and the two-dimensional code The black area is coated with an infrared reflective layer. The infrared reflective layer has a reflectance of less than 30% for visible light with a wavelength of 450 to 650 mm, and has at least a 10 nm wavelength bandwidth for near-infrared light with a wavelength of 800 to 1600 nm (for example, 940nm±5nm) the reflectivity is greater than 50%, so that the two-dimensional code can visually achieve the effect of "invisible two-dimensional code". When the infrared emission signal is transmitted to the two-dimensional code, the graphic area reflects the infrared reflected signal, while the background area and the transparent substrate do not reflect the infrared reflected signal or the reflected infrared reflected signal is weak, and the mobile terminal can identify the graphic code based on the infrared reflected signal. "0", "1" area to restore the QR code.

To sum up, in this exemplary embodiment, the graphic code is disposed on the substrate, the graphic area of the graphic code is coated with an infrared reflection layer, and the infrared reflection rate of the infrared reflection layer is higher than that of the substrate. On the one hand, the graphic code in this exemplary embodiment is coated with an infrared reflection layer in the graphic area, the graphic code can be scanned by an infrared sensor, and the graphic area can be identified according to the infrared reflection signal reflected by the infrared reflection layer, compared with In the prior art, the method of collecting the image of the graphic code to identify the graphic area, the identification process is simple, and the recognition accuracy of the graphic area is high; The signal is not affected by ambient light, and it can still accurately and quickly identify the graphic area at night or in an indoor environment with weak light, and has a wide range of applications.

In addition, this exemplary embodiment also provides a method for identifying a graphic code. The application scenarios of the method may include, but are not limited to: in a navigation and positioning scenario, a user scans a graphic code in a shopping mall with a smartphone to obtain current positioning information or Shopping mall information, etc.; in an AR game scenario, the user wears a head-mounted device to identify and detect the graphic code in the environment, triggering game tasks or positioning information, etc., where the graphic code is the graphic code described above.

FIG. 4 shows an exemplary flow of the graphic code identification method, which can be executed by the above-mentioned server 110 or terminal 120, including the following steps S410 to S420:

Step S410 , acquiring the infrared reflection signal received by the infrared sensor, where the infrared reflection signal is formed by the infrared sensor transmitting the infrared emission signal to the above-mentioned graphic code and reflecting.

The graphic code refers to the above-mentioned graphic code provided on the substrate, and the graphic area is coated with an infrared reflective layer. The graphic code may be a two-dimensional code, a barcode, or other graphic codes containing information. The present exemplary embodiment can be applied to electronic devices equipped with infrared sensors, such as smart phones, notebook computers, tablet computers, VR (Virtual Reality, virtual reality)/AR (Augmented Reality, augmented reality) headsets and other electronic devices. The infrared sensor may be a sensor that only includes an infrared emission signal transmitting component and an infrared reflected signal receiving component; it may also be a sensor that includes an infrared transmitting signal transmitting component, an infrared reflected signal receiving component, a camera, etc., for example, an infrared camera module is configured. smartphones or VR/AR devices, etc. In addition, according to actual needs, components can also be added to the infrared sensor, such as adding infrared supplementary light to supplement infrared light in an environment with insufficient infrared light. The size of the graphic code can also be customized according to actual needs. For example, the length or width can be set within the range of 10cm (centimeter) to 1m (meter) to better match the spatial resolution of the infrared camera module.

The infrared sensor can transmit infrared emission signals to the environment, and receive the infrared reflection signals reflected by the graphic codes in the environment. For example, the infrared camera module can include an infrared emission component and an infrared reflection receiving component, and the infrared emission component can transmit to the front environment. Infrared pulse signal, after the infrared pulse signal reaches the graphic code in the environment, it will be reflected back a part, that is, the infrared reflection signal; the infrared reflection receiving component can receive the infrared reflection signal reflected from the environment, and then solve the infrared pulse based on the underlying algorithm The time of flight of the signal can determine the distance between the graphic code in the environment and the infrared sensor. In this exemplary embodiment, the above infrared sensor may include a TOF (Time of Flight) sensor, specifically an ITOF (Indirect TOF, indirect measurement of time of flight) sensor and a DTOF (Direct TOF, direct measurement of time of flight) sensor etc. Among them, ITOF adopts the method of measuring phase offset, and measures the time of flight by the phase difference between the transmitted sine/square wave and the received sine/square wave; while DTOF measures the transmitted infrared pulse and the received infrared pulse. Time interval of pulses to measure time of flight. When a TOF sensor is used, a VCSEL (Vertical-Cavity Surface-Emitting Laser) with an emission wavelength of 940nm can be used as the light source. Of course, other wavelengths, such as 845nm, 1350nm and other lasers, can also be used. In addition, the resolution can be in various forms such as 240*180, 320*240, 640*480, etc., which is not specifically limited in this disclosure, wherein the resolution of the processing chip in the electronic device is usually not less than the output high-resolution dense The resolution of the graph.

Step S420, based on the infrared reflection signal, identify the graphic area of the graphic code.

The infrared reflection signal refers to the photoelectric signal reflected by the infrared emission signal transmitted to the graphic code. Since the graphic code in this exemplary embodiment is coated with an infrared reflection layer in the graphic area, when the infrared emission signal is transmitted to the graphic code, The infrared reflection signal reflected by the graphic area is different from the infrared reflection signal reflected by the substrate. Therefore, based on the infrared reflection signal, the graphic area of the graphic code can be identified by the graphic code processing chip, and the numbers contained in the graphic code can be restored. For example, when the infrared emission signal is emitted to the QR code coated with the infrared reflection layer in the black area, the black area will reflect the infrared reflection signal, and the area outside the black area will not reflect the infrared reflection signal. The reflected infrared reflection signal identifies the position of the black area and encodes it (such as "0"), and then determines the boundary of the graphic code according to the position of the black area, such as according to the detection pattern in the two-dimensional code (three). (a small square) to locate the position and boundary of the graphic code, further, based on the position and boundary of the graphic code, it is possible to determine the white area in the graphic code that fails to reflect the infrared reflection signal, that is, the complement of the black area in the graphic code area, and encode it (such as "1"), so as to realize the identification of the graphic code.

Specifically, the present exemplary embodiment can identify the graphic area of the graphic code in the following two ways.

The first is to identify the graphic area of the graphic code based on the intensity of the infrared reflected signal. When the infrared emission signal is transmitted to the graphic code, the graphic area reflects the infrared reflected signal, while the background area and the substrate do not reflect the infrared reflected signal or the reflected infrared reflection. The signal is weak. Therefore, based on the intensity of the infrared reflection signal, the graphic area can be restored, that is, the area where the infrared reflection signal is received can be compared with the area that has not received the infrared reflection signal or received the infrared reflection signal by means of binarization. The weaker area is represented to identify the graphic area of the graphic code.

The second is to calculate the flight time of the infrared signal based on the received infrared reflection signal to further calculate the depth information of the graphic code, wherein the depth information refers to the data that can reflect the distance between the graphic code and the infrared sensor. A depth image including the graphics code is determined, and the graphics area of the graphics code is restored by the depth image.

In practical applications, any one of the above-mentioned manners may be used to identify the graphic area as required, which is not specifically limited in the present disclosure.

Considering that in practical applications, it may be difficult for users to keep parallel with the graphic code when scanning the graphic code, and scanning and identifying the graphic code in different directions and different angles will affect the accuracy of the graphic code recognition, such as When the user's mobile phone and the QR code plane are in a non-parallel state, the scanned QR code may be non-square (such as a trapezoid), that is, there is a tangential distortion of the graphic area, which affects the recognition of the QR code. Based on this, the present exemplary embodiment can obtain depth information at different positions in the graphics area through the TOF sensor, and perform tangential correction on the graphics area according to the depth information. According to the inclination angle of the two-dimensional code plane, the two-dimensional code is further tangentially corrected according to the inclination angle, etc., so as to avoid the situation of difficult or incorrect identification due to the distortion of the graphic area, and improve the identification accuracy of the graphic code. sex.

To sum up, in this exemplary embodiment, the infrared reflection signal received by the infrared sensor is obtained, and the infrared reflection signal is formed by the infrared sensor transmitting the infrared emission signal to the graphic code and reflecting; graphics area. On the one hand, this exemplary embodiment only configures an infrared sensor to receive the infrared reflection signal reflected by the graphic code, that is, the graphic area can be identified, without involving the process of image acquisition and image recognition, and avoids the abnormality of the acquired image. In the case that the image is difficult to identify or misidentified, the identification process is simple, and the identification accuracy of the graphic area is high; Due to the influence of ambient light, it can still accurately and quickly identify the graphic area at night or in an indoor environment with weak light, and has a wide range of applications.

In an exemplary embodiment, the above step S420 may include:

Analyze the intensity of the infrared reflection signals received by the components in different positions in the infrared sensor to obtain the graphic area of the graphic code.

Usually, an infrared sensor can include a plurality of elements in different positions to determine the infrared reflection signal of different pixel points, such as SPAD (Single Photon Avalanche Diode, single photon avalanche diode), elements in different positions can respond to the received infrared reflection signal Intensity analysis is performed to determine the pattern area of the pattern code.

Specifically, in an exemplary embodiment, performing intensity analysis on the infrared reflection signals received by elements at different positions in the infrared sensor to obtain the graphic area of the graphic code may include the following steps:

When the intensity of the infrared reflection signal received by the element at any position is greater than the preset intensity threshold, divide the image area corresponding to any position into the graphic area;

The above-mentioned graphic code identification method may further comprise the following steps:

When the intensity of the infrared reflection signal received by the element at any position is less than the preset intensity threshold, the image area corresponding to any position is divided into the background area.

Among them, the preset intensity threshold refers to the criterion for judging whether the infrared reflection signal is reflected from the graphic area, which can be customized according to needs. For example, when the infrared sensor is required to be close to the graphic code, the graphic When identifying the area, a larger preset intensity threshold can be set. When the infrared sensor needs to be far away from the graphic code, when the graphic area can still be identified, a smaller preset intensity threshold can be set according to the distance. Since the graphic area has an infrared reflection layer, it can better reflect the infrared reflection signal, while the background area and the substrate do not have an infrared reflection layer. Determines whether the area corresponding to the component position is a graphics area. When the intensity of the infrared reflection signal received by the element at any position is greater than the preset intensity threshold, the image area corresponding to the position can be divided into graphic areas; when the intensity of the infrared reflection signal received by the element at any position is less than the preset intensity threshold When the intensity threshold is set, the image area corresponding to the position can be divided into the background area, so that the graphic area and the background area of the graphic code can be identified.

In an exemplary embodiment, the above-mentioned graphic code is a two-dimensional code, and the above-mentioned step S420 identifies the graphic area of the graphic code, and may further include:

Identify the graphic area of the graphic code and obtain the QR code;

Parse the QR code to obtain the information of the current scene corresponding to the QR code.

This exemplary embodiment can be particularly applied to the scene of identifying the two-dimensional code. Specifically, the black area in the two-dimensional code can be used as the graphic area, and the black area is coated with an infrared reflection layer, and the two-dimensional code can be set On the transparent substrate, when the infrared emission signal is transmitted to the two-dimensional code, the black area reflects the infrared reflection signal, while the white area and the transparent substrate do not reflect the infrared reflection signal or the reflected infrared reflection signal is weak, so the infrared reflection signal can be based on the infrared reflection signal. Identify the "0" and "1" areas of the two-dimensional code, so as to restore the two-dimensional code. Further, by parsing the two-dimensional code, information of the current scene corresponding to the two-dimensional code can be obtained. It should be noted that the above black area and white area are only for schematic illustration. In practical applications, the two-dimensional code arranged on the transparent substrate may be a graphic code with no color difference, for example, the black area and the white area are both transparent. , the difference is that the black area is coated with the infrared reflective layer, while the white area is not coated.

Wherein, the current scene may be the scene where the user or the two-dimensional code is located, and the information of the current scene may include the location information of the scene, the recommendation information of the store, or the information of the hot-selling products, and so on. FIG. 5 shows a schematic diagram of a scene of scanning a two-dimensional code. A user uses a smartphone equipped with an infrared sensor to scan the two-dimensional code 510 on the glass of store A in a shopping mall, wherein the two-dimensional code 510 is for schematic illustration. , with a black area and a white area division. In the actual scene, the two-dimensional code 510 is in a state of "invisibility" or not easy to be observed on the glass.

In an exemplary embodiment, the above-mentioned parsing of the two-dimensional code to obtain information of the current scene corresponding to the two-dimensional code may include:

Parse the two-dimensional code, and display the preset information of the current scene corresponding to the two-dimensional code, or the virtual object matching the current scene.

The preset information of the current scene corresponding to the QR code may refer to preset information associated with the current scene. For example, when the user is at the entrance of a store in a shopping mall, the preset information of the current scene may be the information of the store. information, or information on hot-selling products or recommended products in the store, and the user scans the QR code on the store window to obtain the above-mentioned store information or product information. The virtual object matched in the current scene can be a pre-established cartoon character, game character or commodity, etc. After the user scans the QR code, the virtual object can be displayed at a specific position in the current scene. Figure 6 schematically shows a schematic diagram of the user interface when the user scans the two-dimensional code in the scene. After the two-dimensional code information is recognized, as shown in Figure 7, it can be displayed in a specific position of the user interface, for example, beside the shop window of A shop. A recommended virtual object 710 and detailed information of the virtual object 710 are displayed. The virtual object 710 may be a commodity to be displayed to the user, or a virtual character, an animal, etc., to realize interaction with the user and the like.

In particular, in an exemplary embodiment, the above-mentioned parsing of the two-dimensional code to obtain information of the current scene corresponding to the two-dimensional code may include:

Parse the two-dimensional code to obtain the positioning information of the current scene corresponding to the two-dimensional code.

The positioning information may include the user's current location information, such as the coordinate information in the mall, or the map information of the location in the scene, etc.; it may also include other navigation information or location information related to the user's current location information, such as the user's current location information. The location information of other stores of the same type in the store where the store is located, or the navigation route information from the current location to other stores of the same type, etc., can be personalized to provide users with positioning information of the current scene.

In this exemplary embodiment, a plurality of the above-mentioned two-dimensional code anchor points can be set in the scene to realize the positioning of the user in the scene. Compared with Bluetooth, WIFI (wireless communication technology) or UWB (Ultra Wide Band, ultra-wideband communication technology) ) and other methods, the positioning result is accurate, and the signal is stable, and there will be no positioning failure or position deviation due to weak signal.

In an exemplary embodiment, the above-mentioned graphic code identification method may further include:

The guidance information of the graphic code is prompted, and the guidance information is used to guide the infrared sensor to be moved to the graphic code.

The user interface may refer to the user interface such as the navigation interface or VR interface currently opened by the user. The user can observe the current scene through the user interface. As shown in Figure 6, the user can see the scene of store A in the user interface. In the exemplary embodiment, considering that the graphic code may be in an "invisible" state and is not easily observed by the user, therefore, the guidance information of the graphic code can be displayed in the user interface to provide the user with the guidance information of the graphic code, That is, it prompts the user which direction there is a graphic code or which direction the user needs to move the mobile phone, etc. The guidance information can be displayed in the form of arrows or other graphic signs. Arrow 810 moves the infrared sensor (ie, the mobile electronic device), enabling alignment of the graphic code. In addition, the guidance information may also be presented in the form of text or voice, which is not specifically limited in the present disclosure.

Exemplary embodiments of the present disclosure also provide a graphic code identification device. As shown in FIG. 9 , the graphic code identification device 900 may include: a reflected signal acquisition module 910, configured to acquire an infrared reflected signal received by an infrared sensor, and the infrared reflected signal is transmitted by the infrared sensor to an infrared emission signal at the reflected location of the graphic code. Formation; the graphic area identification module 920 is used for identifying the graphic area of the graphic code based on the infrared reflection signal.

In an exemplary embodiment, the graphic area identification module includes: an intensity analysis unit, configured to perform intensity analysis on the infrared reflection signals received by elements at different positions in the infrared sensor to obtain the graphic area of the graphic code.

In an exemplary embodiment, the intensity analysis unit includes: a first judging subunit, configured to classify the image area corresponding to any position when the intensity of the infrared reflection signal received by the element at any position is greater than a preset intensity threshold. Divided into a graphic area; the above-mentioned graphic code identification device also includes: a second judging subunit, for when the intensity of the infrared reflection signal received by the element at any position is less than the preset intensity threshold, the image area corresponding to any position is Divide to the background area.

In an exemplary embodiment, the graphic code is a two-dimensional code; the graphic area identification module further includes: a two-dimensional code acquisition unit for identifying the graphic area of the graphic code and acquiring the two-dimensional code; a two-dimensional code parsing unit for To parse the two-dimensional code, obtain the information of the current scene corresponding to the two-dimensional code.

In an exemplary embodiment, the two-dimensional code parsing unit includes: a positioning information obtaining subunit, configured to parse the two-dimensional code to obtain the positioning information in the current scene corresponding to the two-dimensional code.

In an exemplary embodiment, the two-dimensional code parsing unit includes: a display subunit configured to display preset information of the current scene corresponding to the two-dimensional code, or a virtual object matched with the current scene.

In an exemplary embodiment, the graphic code identification device further includes: a guide information display module for prompting guide information of the graphic code, the guide information being used to guide the infrared sensor to be moved to align with the graphic code.

Exemplary embodiments of the present disclosure also provide a graphic code identification system, including: a graphic code, the graphic code is disposed on a substrate, a graphic area of the graphic code is coated with an infrared reflection layer, and the infrared reflection rate of the infrared reflection layer is higher than that of the substrate. Infrared reflectivity; the graphic code identification device is used to obtain the infrared reflected signal received by the infrared sensor, and based on the infrared reflected signal, identify the graphic area of the graphic code; the infrared reflected signal is transmitted by the infrared sensor to the infrared emission signal to the reflector at the graphic code. form.

The specific details of each part in the above-mentioned apparatus have been described in detail in the method part of the implementation, and thus will not be repeated.

Exemplary embodiments of the present disclosure also provide a computer-readable storage medium, which can be implemented in the form of a program product, including program codes for causing the terminal device to execute this specification when the program product is run on a terminal device. The steps according to various exemplary embodiments of the present disclosure described in the "Example Method" section above, for example, the steps in FIG. 4 may be performed. The program product can take the form of a portable compact disk read only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory, read only memory (ROM), erasable programmable Read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

A computer readable signal medium may include a propagated data signal in baseband or as part of a carrier wave with readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable signal medium can also be any readable medium, other than a readable storage medium, that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.

Program code embodied on a readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming Language - such as the "C" language or similar programming language. The program code may execute entirely on the user computing device, partly on the user device, as a stand-alone software package, partly on the user computing device and partly on a remote computing device, or entirely on the remote computing device or server execute on. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (eg, using an Internet service provider business via an Internet connection).

As will be appreciated by one skilled in the art, various aspects of the present disclosure may be implemented as a system, method or program product. Therefore, various aspects of the present disclosure can be embodied in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, which may be collectively referred to herein as implementations "circuit", "module" or "system". Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common general knowledge or techniques in the technical field not disclosed by this disclosure . The specification and embodiments are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

A graphic code, characterized in that the graphic code is arranged on a base, the graphic area of the graphic code is coated with an infrared reflection layer, and the infrared reflection rate of the infrared reflection layer is higher than that of the base.
The graphic of claim 1, wherein the substrate is a transparent substrate, and the infrared reflection layer is a transparent layer.
The graphic according to claim 2, wherein the infrared reflection layer is a colorless and transparent layer.
A method for identifying a graphic code, comprising:

Obtaining the infrared reflection signal received by the infrared sensor, the infrared reflection signal is formed by the infrared sensor transmitting the infrared emission signal to the graphic code according to claim 1 and reflecting;

Based on the infrared reflection signal, a pattern area of the pattern code is identified.
The method according to claim 4, wherein the identifying the graphic area of the graphic code based on the infrared reflection signal comprises:

The intensity analysis of the infrared reflection signals received by the elements at different positions in the infrared sensor is performed to obtain the graphic area of the graphic code.
The method according to claim 5, wherein the intensity analysis of the infrared reflection signals received by elements at different positions in the infrared sensor to obtain the graphic area of the graphic code comprises:

When the intensity of the infrared reflection signal received by the element at any position is greater than the preset intensity threshold, dividing the image area corresponding to the any position into the graphic area;

The method also includes:

When the intensity of the infrared reflection signal received by the element at any position is less than the preset intensity threshold, the image area corresponding to the any position is divided into a background area.
The method according to claim 4, wherein the identifying the graphic area of the graphic code based on the infrared reflection signal comprises:

Calculate the flight time of the infrared signal based on the infrared reflection signal, and determine the depth information of the graphic code according to the flight time;

determining a depth image including the graphics code according to the depth information;

Based on the depth image, a graphics area of the graphics code is restored.
The method according to claim 4, wherein the graphic code is a two-dimensional code; and the identifying the graphic area of the graphic code further comprises:

Identify the graphic area of the graphic code, and obtain the two-dimensional code;

Parse the two-dimensional code to obtain information of the current scene corresponding to the two-dimensional code.
The method according to claim 8, wherein the analyzing the two-dimensional code to obtain the information of the current scene corresponding to the two-dimensional code, comprising:

The two-dimensional code is parsed to obtain positioning information of the current scene corresponding to the two-dimensional code.
The method according to claim 9, wherein the positioning information includes the current location information of the user, or navigation information or location information related to the current location information of the user.
The method according to claim 9, wherein the positioning information is determined by a plurality of two-dimensional code anchor points pre-set in the scene.
The method according to claim 8, wherein the analyzing the two-dimensional code to obtain the information of the current scene corresponding to the two-dimensional code, comprising:

Parse the two-dimensional code, and display preset information of the current scene corresponding to the two-dimensional code, or a virtual object matched with the current scene.
The method according to claim 4, wherein the method further comprises:

The guide information of the graphic is prompted, and the guide information is used to guide the infrared sensor to be moved to be aligned with the graphic code.
The method according to claim 13, wherein the guidance information is displayed in the form of arrows or graphic signs.
The method according to claim 4, wherein before identifying the graphic area of the graphic code, the method further comprises:

Obtain the depth information of different positions in the graphics area of the graphics code;

According to the depth information, tangential correction is performed on the graphics area.
The method of claim 4, wherein the infrared sensor comprises a time-of-flight TOF sensor.
A graphic code identification device, comprising:

a reflection signal acquisition module, configured to acquire an infrared reflection signal received by an infrared sensor, and the infrared reflection signal is formed by the infrared sensor transmitting an infrared emission signal to the graphic code according to claim 1 and reflecting;

A graphic area identification module, configured to identify the graphic area of the graphic code based on the infrared reflection signal.
A graphic code identification system, comprising:

a graphic code, the graphic code is arranged on a substrate, the graphic area of the graphic code is coated with an infrared reflection layer, and the infrared reflectance of the infrared reflection layer is higher than that of the substrate;

A graphic code identification device for acquiring an infrared reflection signal received by an infrared sensor, and identifying a graphic area of the graphic code based on the infrared reflection signal;

The infrared reflection signal is formed by the infrared sensor transmitting the infrared emission signal to the graphic code and reflecting.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the method according to any one of claims 4 to 16 is implemented.
An electronic device, comprising:

processor;

a memory for storing executable instructions for the processor;

wherein the processor is configured to perform the method of any one of claims 4 to 16 by executing the executable instructions.