WO2024053794A1

WO2024053794A1 - Method and user terminal for reading hologram security code

Info

Publication number: WO2024053794A1
Application number: PCT/KR2022/019269
Authority: WO
Inventors: 홍성희; 김영민; 홍지수
Original assignee: 한국전자기술연구원
Priority date: 2022-09-07
Filing date: 2022-11-30
Publication date: 2024-03-14
Also published as: KR20240034521A

Abstract

A method for reading a hologram security code is disclosed. This method comprises the steps of: acquiring a plurality of hologram images by scanning the hologram security code by a camera of a user terminal; restoring, by a processor of the user terminal, an original security code by combining the plurality of hologram images; and reading the original security code by the processor.

Description

Method and user terminal for reading hologram security code

The present invention relates to technology for reading security codes, and more specifically, to technology for reading security codes (e.g., QR codes) produced in the form of a hologram.

QR (Quick Response) code, one of the security codes, is a two-dimensional barcode in a matrix format that represents information in the shape of a black and white grid pattern. While existing one-dimensional barcodes only contain limited information such as price and product name due to capacity limitations, QR codes It has ample capacity and the ability to link with the Internet and multimedia via smartphones, so it is used in a variety of industrial media. In particular, it is becoming popular because it has the advantage of being able to easily read QR codes through a smartphone rather than a separate information reading device.

As such, the QR code, which has high usability and scalability as a code system, is also used as a marketing tool to easily inform consumers of various event and discount event information based on the logistics distribution industry, and is already widely used on business cards, signs, and advertisements. However, in the future, it can be actively used to authenticate items and electronic documents that require security.

In other words, by displaying QR codes on various items and electronic documents that require security, consumers can easily check authentication information with their smartphones by simply scanning or taking a photo of the QR code with their smartphone.

However, since applications and software for creating QR codes are easily available on the Internet, anyone can create a QR code. There is a high possibility of forgery and falsification through similar QR code generators, and it is implemented as a 2D image. Because existing QR codes can be easily copied by anyone using a camera, there are limits to their use in fields that require security.

The purpose of the present invention to solve the above-mentioned problems is to provide a method for reading using a security code in the form of a hologram that cannot be copied (hereinafter referred to as a hologram security code).

Another object of the present invention is to provide a user terminal that operates according to the above method.

A method for reading a hologram security code according to an aspect of the present invention for achieving the above-described object includes the steps of scanning the hologram security code with a camera of the user terminal to obtain a plurality of hologram images, the user It may include restoring the original security code by combining the plurality of holographic images by a processor of the terminal and reading the original security code by the processor.

According to an embodiment, the step of acquiring the plurality of hologram images may be a step of obtaining the plurality of hologram images by scanning the hologram security code in a predetermined scanning direction.

According to an embodiment, the step of acquiring the plurality of holographic images includes, after acquiring the plurality of holographic images, the processor assigning a number to each holographic image, and the processor storing the plurality of holographic images in the memory of the user terminal. It may include mapping and storing hologram images and numbers assigned to each hologram image.

According to an embodiment, the step of assigning a number to identify each holographic image includes, by a motion recognition sensor of the user terminal, measuring motion data of the user terminal that has acquired each holographic image, and adding the motion data to the motion data. It may include assigning a number defined accordingly to each hologram image.

According to an embodiment, the step of restoring the original security code includes the communication interface of the user terminal receiving information indicating the order of the numbers from the server and the plurality of hologram images according to the order included in the information. It may include restoring the original security code by combining them.

According to an embodiment, the step of acquiring the plurality of holographic images includes executing an app installed on the user terminal according to a user's operation, and the app displaying a predetermined scanning direction through the display of the user terminal. Step, the user moving the user terminal according to the scanning direction displayed on the display; and obtaining the plurality of hologram images by having the camera scan the hologram security code as the user terminal moves.

According to an embodiment, a method for reading a holographic security code wherein the scanning direction displayed through the display changes periodically.

A user terminal according to another aspect of the present invention restores the original security code by combining a camera that scans a hologram security code to obtain a plurality of hologram images and the plurality of hologram images obtained by the camera, and the restoration It may include a processor that reads the original security code.

According to an embodiment, the camera may acquire the plurality of hologram images by scanning the hologram security code in a predetermined scanning direction.

According to an embodiment, the user terminal may further include a motion recognition sensor that measures motion data of the user terminal that has acquired the plurality of holographic images, and the processor may select a number defined according to the motion data. Each of the plurality of holographic images can be assigned.

According to an embodiment, the user terminal may further include a communication interface that receives information indicating the order of the numbers from the server.

According to an embodiment, the processor may restore the original security code by combining the plurality of hologram images according to the order of the numbers included in the information.

According to the present invention, by producing a security code (e.g., QR code) in a holographic method that records multiple images on one medium instead of a single image, at least two images are required when reading this holographic security code. Since the QR code can only be read by combining it, copying and reading of the security code can be fundamentally blocked.

1 is a block diagram of a user terminal according to an embodiment of the present invention.

Figure 2 is a diagram for explaining an example of a QR code divided into multiple channels according to an embodiment of the present invention.

Figure 3 is a diagram for explaining a method of scanning a hologram security code according to an embodiment of the present invention.

Figure 4 is a diagram showing a guide text for the scanning direction provided by a user terminal according to an embodiment of the present invention.

Figure 5 is a diagram for explaining the restoration process of the original security code according to an embodiment of the present invention.

Figure 6 is a flowchart illustrating a method for reading a hologram security code according to an embodiment of the present invention.

The terms used herein are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an idealized or excessively formal sense. No.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the attached drawings. In order to facilitate overall understanding when describing the present invention, the same reference numerals are used for the same components in the drawings, and duplicate descriptions for the same components are omitted.

Figure 1 is a block diagram of a user terminal according to an embodiment of the present invention, and Figure 2 is a diagram for explaining an example of a QR code divided into multiple channels according to an embodiment of the present invention.

First, referring to FIG. 1, the user terminal 100 scans a hologram-shaped security code (hereinafter referred to as a 'hologram security code') manufactured to be impossible to copy, and uses a 'computing device' to read the scanned hologram security code. It may be a ‘device’ or an ‘electronic device’.

Such user terminals 100, for example, smartphones, tablet personal computers, mobile phones, video phones, e-book readers, and desktop PCs. personal computer, laptop personal computer, netbook computer, personal digital assistant (PDA), portable multimedia player (PMP), medical device, security device, camera, or wearable device. )(For example, it may be called at least one of a head-mounted-device (HMD) such as electronic glasses, a smartwatch, or a scanner.

According to some embodiments, the user terminal 100 may be a smart home appliance equipped with a communication function. Smart home appliances, for example, include electronic devices such as televisions, DVD (digital video disk) players, stereos, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, and TVs. It may include at least one of boxes (e.g., Samsung HomeSync, Apple TV, or Google TV), game consoles, electronic dictionaries, electronic keys, camcorders, or electronic picture frames.

According to some embodiments, the user terminal 100 may be equipped with various medical devices (e.g., magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), imaging equipment, ultrasound equipment, etc.), navigation devices, GPS receiver (global positioning system receiver), EDR (event data recorder), FDR (flight data recorder), automotive infotainment devices, marine electronic equipment (e.g. marine navigation system and gyrocompass, etc.), avionics ), security devices, or industrial or household robots.

According to some embodiments, the user terminal 100 may be a piece of furniture or a building/structure including a communication function, an electronic board, an electronic signature receiving device, a projector, Or, it may include at least one of various measuring devices (e.g., water, electricity, gas, or radio wave measuring devices, etc.).

The user terminal 100 according to various embodiments may be one or a combination of more than one of the various devices described above. Additionally, it will be apparent to those skilled in the art that electronic devices according to various embodiments of the present disclosure are not limited to the above-mentioned devices.

The hologram security code scanned by the user terminal 100 according to an embodiment of the present invention may be, for example, a QR code, but is not limited thereto. The hologram security code according to an embodiment of the present invention may be obtained by dividing one original security code into multiple channels and encrypting the security codes separated into multiple channels in the form of a hologram.

By encrypting security codes separated into multiple channels in the form of a hologram, copying by third parties can be fundamentally blocked. For example, as shown in FIG. 2, the hologram security code separates one original QR code 10 into four channels (CH1 to CH4) and four channels (CH1 to CH4). It can be produced by encrypting the security codes (10A to 10B) in the form of a hologram. At this time, in each hologram-type security code, the box area (A, B, C, or D) is the area where the actual QR code value is recorded, and the other area is the area where the fake QR code value is recorded.

Referring again to FIG. 1, in order to scan a hologram security code and read the scanned hologram security code, the user terminal 100 includes a bus 110, a processor 120, a memory 130, and an input/output interface 140. , may include a display 150, a communication interface 160, a camera 170, and a motion recognition sensor 180.

The bus 110 may be a circuit that connects the above-described components 120 to 170 to each other.

The processor 120 is connected to the other components described above (e.g., the memory 130, the input/output interface 140, the display 150, the communication interface 160, and the voice interface module 170) through the bus 110. A command, data or signal may be received, the received command, data or signal may be decoded, and an operation or data processing may be performed according to the decoded command. The processor 120 may include, for example, at least one CPU, at least one GPU, a microcontroller unit (MCU), and/or a system on a chip (SoC).

In an embodiment, the processor 120 may control the camera 170 to scan a holographic security code (e.g., 10A, 10B, 10C, and 10D in FIG. 2), and the holographic security code scanned by the camera 170 You can run an application (or app) designed to read images (hereinafter referred to as 'holographic images').

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 combines multiple holographic images (e.g., 10A, 10B, 10C, and 10D) scanned by the camera 170 ( The original security code (for example, 10 in FIG. 2) can be restored by performing image processing (combination).

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 may read the restored original security code (eg, 10 in FIG. 2).

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 displays the plurality of hologram images (e.g., FIG. Numbers may be assigned to 2 (10A to 10D), and the numbers assigned to the plurality of hologram images and each hologram image may be mapped and stored in the memory 130.

Memory 130 may store instructions or data received from the processor 120 or other components 130 to 180 or generated by the processor 120 or other components 130 to 180. The memory 130 may provide an execution space for programming modules such as a kernel, middleware 132, an application programming interface (API), or an application. Here, the application programming interface (API) may be a specific scanning API that configures a link with the scanned corresponding holographic security code. Each of the programming modules described above may be comprised of software, firmware, hardware, or a combination of at least two of these.

The input/output interface 140 transmits commands or data input from a user through an input/output device (e.g., sensor, keyboard, or touch screen), for example, to the processor 120, memory 130, or the like through the bus 110. It can be transmitted to the communication interface 160, camera 170, or motion recognition sensor 180. For example, the input/output interface 140 may provide data about a user's touch input through a touch screen to the processor 120. In addition, the input/output interface 140 inputs and outputs commands or data received from the processor 120, memory 130, communication interface 160, or voice interface module 170 through, for example, the bus 110. Can be output through a device (e.g. speaker or display).

The display 150 can display various information to the user under the control of the processor 120. Here, the information may indicate the scanning direction of the user terminal 100. The user moves the user terminal 100 by referring to the scanning direction displayed on the display 150. In an embodiment, the display 150 may periodically change and display the scanning direction of the user terminal 100 under the control of the processor 120 for security purposes.

The communication interface 160 may connect communication between the user terminal 100 and the server 300. For example, the communication interface 160 may be connected to the communication network 200 and communicate with the server 300 through wireless or wired communication. Wireless communications include, for example, Wifi (wireless fidelity), BT (Bluetooth), NFC (near field communication), GPS (global positioning system), or cellular communications (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM, etc.) may be included. Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), or plain old telephone service (POTS). Here, the communication network 200 may include at least one of a computer network, the Internet, the Internet of things, or a telephone network. According to one embodiment, a protocol for communication between the user terminal 100 and the server 300 (e.g., transport layer protocol, data link layer protocol, or physical layer protocol) is an application, API, middleware, kernel, or communication interface ( 160) may be supported in at least one of the following.

In an embodiment, the communication interface 160 sends information indicating the order of numbers assigned to the plurality of holographic images (e.g., 10A, 10B, 10C, and 10D in FIG. 2) under the control of the processor 120. You can receive it from (300).

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 combines (combines) the plurality of hologram images according to the order of the numbers included in the information to obtain an original security code (e.g., 10) in FIG. 2 can be restored.

The camera 170 scans the hologram security code (e.g., 10' in FIG. 2) under the control of the processor 120 or an application (or app) executed by the processor 120 to create a plurality of hologram images (e.g. , 10A, 10B, 10C and 10D in Figure 2) can be obtained.

In an embodiment, the camera 170 scans the hologram security code (e.g., 10' in FIG. 2) in a predetermined scanning direction to create the plurality of hologram images (e.g., 10A, 10B, 10C, and 10D in FIG. 2). ) can be obtained.

The motion recognition sensor 180 may measure motion data of the user terminal 100 at camera viewpoints of the camera 170 that acquired the plurality of holographic images. Here, the motion data may include the current location value and posture value of the user terminal 100. In other words, motion data may be a measurement that allows you to know in what direction, what position or/and what view point the hologram security code is being scanned.

In an embodiment, the processor 120 identifies each hologram image by assigning a number defined according to the measured motion data to each of the plurality of hologram images.

In order to measure motion data, the motion recognition sensor 180, such as an acceleration sensor, magnetic field sensor, or gyro sensor, measures changing values such as the current position value and posture value of the user terminal 100 according to the user's movement. It can include all types of sensors.

FIG. 3 is a diagram illustrating a method of scanning a hologram security code according to an embodiment of the present invention, and FIG. 4 is a diagram showing a scanning direction guidance text provided through a user terminal according to an embodiment of the present invention.

Referring to FIG. 3, the user scans the holographic security code recorded on the plate 30 while slowly moving the camera 170 of the user terminal 100 in a predetermined scanning direction 50.

The plate 30 on which the hologram security code is recorded includes a plate member 32 made of a specific medium (e.g., glass) and a film 34 coated on the plate member 34, and the film 34 includes a hologram. A security code is recorded.

When light (e.g., LED light) emitted from the light source 40 is irradiated to the holographic security code recorded on the film 34, different holographic images (e.g., 10A in FIG. 2) are generated from different viewpoints. , 10B, 10C and 10D) can be recognized.

Accordingly, when the camera 170 of the user terminal 100 scans the hologram security code recorded on the film 34 in a predetermined scanning direction, different hologram images (e.g., 10A, 10B, 10C and 10D in FIG. 2) are displayed. ) can be obtained.

The camera 170 may acquire

hologram images

10A, 10B, 10C, and 10D having actual QR code values according to the scanning direction of the user terminal 100. This scan direction may be displayed on the display 150 of the user terminal 100 when the app installed on the user terminal 100 is executed. Then, the user checks the scanning direction displayed on the display 150 of the user terminal 100 and then moves the user terminal 100 to start scanning the hologram security code.

Since holographic images with actual QR code values can be obtained by the scanning direction, the scanning direction is one of the important pieces of information in terms of security, and is shared with the server (300 in FIG. 1).

The scanning direction guided through the display 150 varies, for example, from top to bottom, from bottom to top, from left to right, from right to left, etc. can be decided. In FIG. 4 , guidance text for the scanning direction is provided through the display 150 of the user terminal 100. For example, guidance text such as “Please scan from top to bottom” may be displayed on the display 150. .

Each hologram image acquired during the scanning process is assigned a number identified according to the motion data (position value and/or posture value) of the user terminal 100. For example, as shown in FIG. 3, the number '①' is included in the motion data of the user terminal 100 measured at the viewpoint at which the holographic image 10A of the first channel (CH 1) is acquired. Number '②' is assigned to the motion data of the user terminal 100 measured at the time of acquiring the holographic image 10B of the second channel (CH 2), and the holographic image of the third channel (CH 3) The number '③' is assigned to the motion data of the user terminal 100 measured at the time of acquiring (10C), and the user terminal measured at the time of acquiring the hologram image 10C of the fourth channel (CH 4) ( The number '④' may be assigned to the motion data of 100).

The motion data of the user terminal 100 is a valid code value (actual QR) when the user terminal 100 scans the hologram security code at a certain point in time (which position, which direction, and which posture) during the scanning process of the user terminal 100. This is important information that indicates whether a hologram image with code values (A, B, C, and D) can be obtained.

The mapping relationship between the motion data and the number assigned to the holographic image is shared in advance between the user terminal 100 and the server 300, or the user terminal 100 sends the motion data and the number defined according to the motion data to the server ( 300) and may be shared between the user terminal 100 and the server 300.

Referring to FIG. 5, before explaining the restoration process, the number ① is assigned to the holographic image 10B of the second channel (CH 2), and the number ② is assigned to the holographic image 10C of the third channel (CH 3). is assigned, number ③ is assigned to the hologram image 10A of the first channel (CH 1), and number ④ is amplified to the hologram image 10D of the fourth channel (CH 4). Additionally, it is assumed that information regarding the combination (combination) order of the hologram images 10A to 10D, that is, the order of the numbers is “③→①→②→④” has been received from the server (300 in FIG. 1).

First, the image area where the actual code value (e.g., QR code value) is recorded is extracted from each hologram image obtained by scanning by a camera. For example, a partial image (B) is extracted by clipping the image area (B) where the actual code value is recorded in the hologram image (10B) of the second channel (CH 2), and the partial image (B) is extracted from the hologram image (10B) of the second channel (CH 2) A partial image (C) is extracted by clipping the image area where the actual code value is recorded in the holographic image (10C) of (CH 3), and the actual code value is recorded in the holographic image (10A) of the first channel (CH 1). Extract a partial image (A) by clipping the image area (A). Then, a partial image (D) is extracted by clipping the image area (D) where the actual code value is recorded in the hologram image (10D) of the fourth channel (CH 4).

The location of the clipping area may be included in information indicating the order of combination of the holographic images 10A to 10D and provided from the server 300, or may be determined according to prearranged rules. For example, in a holographic image (e.g., 10B) scanned at a view point defined by specific motion data, the image in the upper right area (e.g., B) within the holographic image (e.g., 10B) is used as a clipping area. In a holographic image (e.g., 10C) scanned at a time defined by other specific motion data, the image of the lower left area (e.g., C) within the holographic image (e.g., 10C) is used as a clipping area. Can be defined in advance.

Partial images (B, C, A, D) extracted from each hologram image are combined according to the order of the numbers, "③→①→②→④", which indicates the combination (combination) order received from the server 300 ( combination) can be achieved.

For example, the partial image (B) is placed in the upper right, the partial image (C) is placed in the lower left, the partial image (A) is placed in the upper left, and the partial image (D) is placed in the lower right. Afterwards, the original security code 10 can be restored by combining (combining) the partial images (B, C, A, D).

Afterwards, when the original security code 10 is restored, a reading process is performed to read the complete code value of the restored original security code 10.

Referring to FIG. 6, first, in S610, a process of executing an app installed on the user terminal 100 according to a user operation is performed.

Next, in S620, a process in which the app guides the scanning direction through the display 150 is performed. Here, the scan direction may be a predetermined scan direction and may be changed periodically at each reading.

Next, in S630, a process of scanning a holographic security code is performed while the user moves the user terminal according to the scanning direction guided through the display.

Next, a process is performed in which the camera 170 acquires a plurality of hologram images scanned from different viewpoints. Here, after acquiring the plurality of hologram images, the processor assigns a number to each hologram image, and then maps and stores the plurality of hologram images and the numbers assigned to each hologram image in the memory 130.

In an embodiment, the process of assigning a number to each holographic image includes the process of measuring motion data of the user terminal at the viewpoint at which the motion recognition sensor 180 of the user terminal acquires each holographic image. It may include a process of assigning a number defined according to motion data to each hologram image.

Next, the user terminal 100 or the processor 120 performs a process of restoring the original security code by combining the plurality of hologram images.

In an embodiment, the process of restoring the original security code includes the communication interface 160 of the user terminal 100 receiving information indicating the order of the numbers from the server 300 and the order included in the information. Accordingly, it may include a process of restoring the original security code by combining the plurality of hologram images.

Next, the user terminal 100 or the processor 120 performs a process of reading the restored original security code.

As described above, the present invention produces a security code (e.g., QR code) using a holographic method that records multiple images, rather than a single image, on one medium, so that when reading this holographic security code, at least two Since the QR code can only be read by combining two images, copying and reading of the security code can be fundamentally blocked.

The present invention can be used in the field of hologram-type security codes that can fundamentally block copying and reading of security codes.

Claims

In a method for reading a hologram security code using a user terminal,

Obtaining a plurality of hologram images by scanning the hologram security code using the camera of the user terminal;

Recovering the original security code by combining the plurality of hologram images, by the processor of the user terminal; and

reading, by the processor, the original security code

A method for reading a hologram security code including.
In paragraph 1:

The step of acquiring the plurality of holographic images is,

A method for reading a hologram security code, comprising the step of scanning the hologram security code in a predetermined scanning direction to obtain the plurality of hologram images.
In paragraph 1:

The step of acquiring the plurality of holographic images is,

After acquiring the plurality of holographic images, the processor assigns a number to each holographic image; and

The processor mapping and storing the plurality of hologram images and the numbers assigned to each hologram image in the memory of the user terminal.

A method for reading a hologram security code including.
In paragraph 3,

The step of assigning a number to each holographic image is,

Measuring, by the motion recognition sensor of the user terminal, motion data of the user terminal at the point in time when each hologram image is acquired; and

Assigning a number defined according to the motion data to each hologram image.

A method for reading a hologram security code including.
In paragraph 3,

The step of restoring the original security code is,

A communication interface of the user terminal receiving information indicating the order of the numbers from the server; and

Recovering the original security code by combining the plurality of hologram images according to the order included in the information

A method for reading a hologram security code including.
In paragraph 1:

The step of acquiring the plurality of holographic images is,

Executing an app installed on the user terminal;

Displaying a predetermined scanning direction by the app on the display of the user terminal;

The user moving the user terminal according to the scanning direction displayed on the display; and

Obtaining the plurality of hologram images by having the camera scan the hologram security code as the user terminal moves.

A method for reading a hologram security code including.
In paragraph 6:

A method for reading a holographic security code, wherein the scanning direction displayed through the display changes periodically.
A camera that scans a hologram security code and acquires multiple hologram images; and

A processor that combines the plurality of hologram images obtained by the camera to restore the original security code and read the restored original security code.

A user terminal for reading a hologram security code including.
In paragraph 8:

The camera is,

A user terminal that scans the hologram security code in a predetermined scanning direction to obtain the plurality of hologram images.
In paragraph 8:

Further comprising a motion recognition sensor that measures motion data of the user terminal that has acquired the plurality of holographic images,

The processor,

A user terminal that assigns a number defined according to the motion data to each of the plurality of holographic images.
In paragraph 10:

A user terminal further comprising a communication interface that receives information indicating the order of the numbers from the server.
In paragraph 11:

The processor,

A user terminal that restores the original security code by combining the plurality of hologram images according to the order of the numbers included in the information.
In paragraph 8:

The hologram security code is,

A user terminal that is a QR (Quick Response) code produced in the form of a hologram.
A computer that records a program for executing the steps of scanning a hologram security code on a computer to obtain a plurality of hologram images, combining the plurality of hologram images to restore the original security code, and reading the original security code. A medium that can be read.