WO2024128393A1

WO2024128393A1 - Hologram production method using video capturing function of user terminal, and method for reading hologram security code produced by same

Info

Publication number: WO2024128393A1
Application number: PCT/KR2022/021557
Authority: WO
Inventors: 홍성희; 김영민; 홍지수
Original assignee: 한국전자기술연구원
Priority date: 2022-12-15
Filing date: 2022-12-28
Publication date: 2024-06-20
Also published as: KR20240093270A

Abstract

A method for reading a hologram security code is disclosed. The method comprises the steps of: acquiring a plurality of holographic images by scanning a hologram security code, by means of a camera of a user terminal; restoring an original security code by combining the plurality of holographic images, by means of a processor of the user terminal; and reading the original security code by means of the processor.

Description

A method for producing a hologram using the video recording function of a user terminal and a method for reading a hologram security code produced by the method

The present invention relates to holographic content production technology, and more specifically, to technology for producing holographic content using a user terminal such as a smart phone.

Hologram technology is a technology that utilizes the interference effect of light. Holographic content can be obtained by recording the interference pattern of reference light and light reflected from an object on a special film.

The existing hologram production method is to model the images obtained by shooting real objects in a special environment where multiple cameras and lights are placed into a 3D computer graphics model based on 3D scanning technology, and then model the 3D computer graphics model. is captured with virtual cameras virtually implemented in computer graphics, rendered into tens of thousands to hundreds of thousands of viewpoints, and then the rendered tens to hundreds of thousands of viewpoint images are recorded on a special film using a hologram printer. It comes true.

As such, the existing hologram production method requires expensive 3D capture equipment such as multiple cameras and lights to model real objects into 3D computer graphics models, and tens to hundreds of thousands of images can be captured from the 3D computer graphics model. Since tens to hundreds of thousands of rendering processes are required to acquire viewpoint images, production costs, production time, and technical difficulty are very high.

One purpose of the present invention to solve the above-mentioned problems is to provide a hologram production method that can simply produce hologram content using the video capture function of a user terminal such as a smart phone.

Another object of the present invention is to provide a method for reading hologram content produced by the hologram production method according to the above object.

A hologram production method according to an aspect of the present invention for achieving the above-described object includes generating m viewpoint images by photographing a real object by a user terminal; generating n viewpoint images larger than m by rendering the m viewpoint images using an artificial intelligence model provided in a server; and manufacturing, by a hologram printer, a hologram recording medium on which hologram content corresponding to the n viewpoint images is recorded.

A method for reading a holographic security code according to another aspect of the present invention extracts m viewpoint images from a video in which the camera of the first user terminal captures the original security code, and extracts the m viewpoint images based on an artificial intelligence model. generating n viewpoint images larger than m by rendering them, and producing holographic security codes corresponding to the n viewpoint images using a hologram printer; Obtaining a plurality of hologram images by scanning the hologram security code with a camera of a second user terminal; restoring the original security code by combining the plurality of hologram images, by the processor of the second user terminal; and reading the original security code by the processor of the second user terminal.

According to the present invention, dozens of viewpoint images are acquired using the video recording function of a user terminal (e.g., a smart phone), and tens to hundreds of thousands of viewpoint images are easily obtained from the dozens of viewpoint images using artificial intelligence technology. By producing hologram content based on tens to hundreds of thousands of viewpoint images simply acquired in this way, the production cost and production time required for producing hologram content can be greatly reduced.

According to the present invention, since objects are photographed using the video capture function of a user terminal (e.g., a smart phone) without expensive cameras and lighting devices, hologram content for moving objects or large objects that are difficult to photograph can be easily created. It can be produced. In other words, even for target objects where it is very difficult to obtain tens or hundreds of thousands of viewpoint images from a specific location, such as moving people, landscapes, or large-scale cultural assets, tens of thousands of viewpoint images can be acquired through the video recording function of the user terminal (e.g., a smartphone). You can easily create hologram content with just images of dogs.

1 is a diagram for explaining a hologram production process according to an embodiment of the present invention.

FIG. 2 is a schematic configuration diagram of a hologram production system for implementing the hologram production process shown in FIG. 1.

Figure 3 is a flowchart for explaining a hologram production method according to an embodiment of the present invention.

FIG. 4 is a flowchart illustrating a method for reading a hologram security code as hologram content produced by the hologram production method shown in FIG. 3.

Figure 5 is a block diagram of a user terminal according to an embodiment of the present invention,

Figure 6 is a diagram for explaining an example of a QR code divided into multiple channels according to an embodiment of the present invention.

7 is a diagram for explaining a method of scanning a hologram security code according to an embodiment of the present invention;

Figure 8 is a diagram showing a scan direction guidance text provided through a user terminal according to an embodiment of the present invention.

Figure 9 is a diagram for explaining the restoration process of the original security code according to an embodiment of the present invention.

Figure 10 is a flowchart illustrating a method for reading a hologram security code according to an embodiment of the present invention.

The terms used in this specification are merely used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that it does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted in an ideal or excessively formal sense unless explicitly defined in the present application. No.

In order to improve the problems of existing holographic content production, which has very high production costs, production times, and technical difficulties, the present invention uses the video capture function of a user terminal such as a smart phone to capture tens to hundreds of thousands of viewpoint images of a target object. Provides a method for creating

Hereinafter, with reference to the attached drawings, a preferred embodiment of a method for generating tens to hundreds of thousands of viewpoint images required to generate holographic content for a target object using the video capture function of a user terminal will be described in more detail.

Referring to Figure 1, first, the user uses the video capture function of the user terminal (e.g., smart phone, etc.) 20 to move the user terminal 20 in a random direction 50 and capture the actual object 5 for several seconds ( (e.g., 3 to 5 seconds). At this time, the arbitrary direction 50 may be determined depending on the viewpoint from which the user wants to view the actual object 5 in the form of a hologram.

Next, a process of extracting m (e.g., 30 to 40) viewpoint images 22 corresponding to the viewpoints from the video obtained by photographing the actual object 5 is performed.

Next, the artificial neural network model 30 generates n (eg, 100,000) viewpoint images 32 using the extracted m viewpoint images 22 as input data. As such, in an embodiment of the present invention, the artificial neural network model 30 is used to generate tens to hundreds of thousands of viewpoint images 32 necessary for hologram production, thereby generating tens to hundreds of thousands of viewpoint images necessary for hologram production. The existing complicated 3D scanning process can be omitted.

The artificial neural network model 30 learns the color values, direction values, and feature values of the viewpoint images 22 taken at different viewpoints to render viewpoint images 32 having tens of thousands to hundreds of thousands of viewpoints. It may be an artificial neural network trained on .

The artificial neural network model 30 may be, for example, an artificial neural network implemented as a NeRF (Representing Scenes as Neural Radiance Fields for View Synthesis) model. The NeRF model is a model that uses multiple images of real objects as input data to create an object image from a new viewpoint (view synthesis).

The NeRF model is explained in detail in a paper introduced at CVPR (Computer Vision and Pattern Recognition) 2020 under the title 'Representing Scenes as Neural Radiance Fields for View Synthesis', so detailed explanation will be omitted.

Next, through the hologram printing process of the hologram printer 40, a hologram record in which hologram content corresponding to n (e.g., 100,000) viewpoint images 32 generated by the artificial neural network model 30 is recorded. Create media.

As such, the hologram production process according to an embodiment of the present invention produces hologram content based on viewpoint images simply captured using the video capture function of a smartphone at a point in time when the user wants to implement a real object as a hologram. , the existing complex 3D scanning process for generating tens to hundreds of thousands of viewpoint images required for hologram production can be omitted.

Referring to FIG. 2, the hologram production system according to an embodiment of the present invention includes a user terminal 20, a communication network 150, a server 200, and a hologram printer 40.

The user terminal 20 is a device that has a video recording function and a communication function, and communicates with the server 200 through the communication network 150.

The user terminal 20 is a computing device that has a video recording function and a communication function, and the computing device includes a processor, memory, a storage device, a camera, and a communication device that supports wired/wireless communication. The processor may include at least one of at least one CPU, at least one GPU, at least one application processor, at least one system on chip (SoC), at least one microcontroller unit, etc.

The user terminal 20 may be, for example, a smartphone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, or a desktop personal computer. computer, laptop personal computer, netbook computer, personal digital assistant (PDA), portable multimedia player (PMP), medical device, security device, camera with communication function, or wearable device. (wearable device) (e.g., may include at least one of a head-mounted-device (HMD) such as electronic glasses, a smartwatch, or a scanner.

The camera of the user terminal 20 generates a video of a real object (5 in FIG. 1) captured while moving in a random direction (50 in FIG. 1) and stores it in a storage device.

The processor of the user terminal 20 extracts m viewpoint images 22 corresponding to viewpoints at which the user wants to view a real object (5 in FIG. 1) in the form of a hologram from the video stored in the storage device.

The processor of the user terminal 20 generates a viewpoint image file including the extracted m (e.g., 30 to 40) viewpoint images (22 in FIG. 1), and sends the viewpoint image file to the communication network 150. It is transmitted to the server 200 through .

The communication network 150 includes mobile communication (3G, 4G, 5G, 6G) and wired/wireless Internet. In this specification, the communication network 150 is used as a concept including a gateway, router, base station, etc.

The server 200 may be a computing device installed at a hologram printing service company. The computing device implemented as the server 200 includes a processor, memory, storage device, and communication device supporting wired/wireless communication. The processor may include at least one of at least one CPU, at least one GPU, at least one application processor, at least one system on chip (SoC), at least one microcontroller unit, etc.

The server 200 receives a viewpoint image file from the user terminal 20 through the communication network 150. The server 200 includes a rendering module 210, and the rendering module 210 may be configured to include the artificial intelligence model 30 shown in FIG. 1.

The artificial intelligence model 30 renders the m (e.g., 30 to 40) viewpoint images (22 in FIG. 1) included in the viewpoint image file received from the user terminal 20 to n (e.g., 10) 10,000 viewpoint images (32 in FIG. 1) are generated.

The hologram printer 40 outputs a hologram recording medium 42 on which hologram content corresponding to the n viewpoint images is recorded. The hologram recording medium 42 may be a specific film on which hologram content is recorded. The hologram recording medium 42 output from the hologram printer 40 is delivered to the user of the user terminal 20.

Previously, the server 200 was described as a device installed at a hologram printing service company, but the server 200 is not limited to this and may be a cloud server. In this case, the cloud server generates n viewpoint images and transmits them to the user terminal 20, and the user terminal 20 can transmit the n viewpoint images received from the cloud server to the server installed at the hologram printing service company. . In this case, the server installed at the hologram printing service provider does not include a rendering module.

In FIG. 2, the server 200 and the hologram printer 40 are shown as separate components, but the hologram printer 40 may be included in the server 200.

Referring to FIG. 3, in S310, a process of generating m viewpoint images by photographing an actual object 5 is performed in the user terminal 200.

Next, in S320, the rendering module 210 implemented as an artificial intelligence model in the server 200 renders the m viewpoint images to generate n viewpoint images larger than m.

In S330, a process of manufacturing a hologram recording medium on which hologram content corresponding to the n viewpoint images is recorded is performed in the hologram printer 40.

Hereinafter, a method of reading hologram content recorded on a hologram recording medium produced by the hologram production method of FIG. 3 will be described. However, in the following embodiments, it is assumed that the hologram content recorded on the hologram recording medium produced by the hologram production method of FIG. 3 is a security code such as a QR code.

Referring to FIG. 4, in S410, the camera of the first user terminal (20 in FIGS. 1 and 2) extracts m viewpoint images from the video obtained by photographing the original security code, and the m viewpoint images are obtained based on an artificial intelligence model. A process is performed by rendering n viewpoint images to generate n viewpoint images larger than m, and producing hologram security codes corresponding to the n viewpoint images using a hologram printer.

Next, in S420, a process is performed in which the camera of the second user terminal (100 in FIG. 5) scans the hologram security code to obtain a plurality of hologram images.

Next, in S430, a process of restoring the original security code by combining the plurality of hologram images is performed by the processor of the second user terminal (100 in FIG. 5).

Next, a process in which the processor of the second user terminal 100 reads the original security code is performed.

In an embodiment, the process of producing the hologram security code (S410) is a process of obtaining a video of the original security code by photographing the original security code while the camera of the first user terminal moves in a random direction, the first user terminal A process of the processor of the user terminal extracting the m viewpoint images from the video, a process of the communication device of the first user terminal transmitting the m viewpoint images to a server, and the artificial intelligence model of the server generating the m viewpoint images. It may include a process of rendering images to generate n viewpoint images larger than m.

In an embodiment, the artificial intelligence model may be a Neural Radiance Fields (NeRF) model.

Hereinafter, S420, S430, and S440 will be described in detail with reference to FIGS. 5 to 10.

Figure 5 is a block diagram of a user terminal according to an embodiment of the present invention, and Figure 6 is a diagram for explaining an example of a QR code divided into multiple channels according to an embodiment of the present invention.

First, referring to FIG. 5, the user terminal 100 scans a security code in the form of a hologram (hereinafter referred to as a 'hologram security code') that is designed to be impossible to copy, and uses a 'computing device' to read the scanned hologram security code. It may be a ‘device’ or an ‘electronic device’. In the claims of this specification, the user terminal 100 may be described as a 'second user terminal', and the user terminal 20 shown in FIGS. 1 and 2 may be described as a 'first user terminal'.

Such user terminals 100, for example, smartphones, tablet personal computers, mobile phones, video phones, e-book readers, and desktop PCs. personal computer, laptop personal computer, netbook computer, personal digital assistant (PDA), portable multimedia player (PMP), medical device, security device, camera, or wearable device. )(For example, it may be called at least one of a head-mounted-device (HMD) such as electronic glasses, a smartwatch, or a scanner.

According to some embodiments, the user terminal 100 may be a smart home appliance equipped with a communication function. Smart home appliances, for example, include electronic devices such as televisions, DVD (digital video disk) players, stereos, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, and TVs. It may include at least one of boxes (e.g., Samsung HomeSync, Apple TV, or Google TV), game consoles, electronic dictionaries, electronic keys, camcorders, or electronic picture frames.

According to some embodiments, the user terminal 100 may be equipped with various medical devices (e.g., magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), imaging equipment, ultrasound equipment, etc.), navigation devices, GPS receiver (global positioning system receiver), EDR (event data recorder), FDR (flight data recorder), automotive infotainment devices, marine electronic equipment (e.g. marine navigation system and gyrocompass, etc.), avionics ), security devices, or industrial or household robots.

According to some embodiments, the user terminal 100 may be a piece of furniture or a building/structure including a communication function, an electronic board, an electronic signature receiving device, a projector, Alternatively, it may include at least one of various measuring devices (e.g., water, electricity, gas, or radio wave measuring devices, etc.).

The user terminal 100 according to various embodiments may be one or a combination of more than one of the various devices described above. Additionally, it will be apparent to those skilled in the art that electronic devices according to various embodiments of the present disclosure are not limited to the above-mentioned devices.

The hologram security code scanned by the user terminal 100 according to an embodiment of the present invention may be, for example, a QR code, but is not limited thereto. The hologram security code according to an embodiment of the present invention may be obtained by dividing one original security code into multiple channels and encrypting the security codes separated into multiple channels in the form of a hologram.

By encrypting security codes separated into multiple channels in the form of a hologram, copying by third parties can be fundamentally blocked. For example, as shown in FIG. 6, the hologram security code separates one original QR code 10 into four channels (CH1 to CH4) and four channels (CH1 to CH4). It can be produced by encrypting the security codes (10A to 10B) in the form of a hologram. At this time, in each hologram-type security code, the box area (A, B, C, or D) is the area where the actual QR code value is recorded, and the other area is the area where the fake QR code value is recorded.

Referring again to FIG. 5, in order to scan the hologram security code and read the scanned hologram security code, the user terminal 100 includes a bus 110, a processor 120, a memory 130, and an input/output interface 140. , may include a display 150, a communication interface 160, a camera 170, and a motion recognition sensor 180.

The bus 110 may be a circuit that connects the above-described components 120 to 170 to each other.

The processor 120 is connected to the other components described above (e.g., the memory 130, the input/output interface 140, the display 150, the communication interface 160, and the voice interface module 170) through the bus 110. A command, data or signal may be received, the received command, data or signal may be decoded, and an operation or data processing may be performed according to the decoded command. The processor 120 may include, for example, at least one CPU, at least one GPU, a microcontroller unit (MCU), and/or a system on a chip (SoC).

In an embodiment, the processor 120 may control the camera 170 to scan a holographic security code (e.g., 10A, 10B, 10C, and 10D in FIG. 2), and the holographic security code scanned by the camera 170 You can run an application (or app) designed to read images (hereinafter referred to as 'holographic images').

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 combines multiple holographic images (e.g., 10A, 10B, 10C, and 10D) scanned by the camera 170 ( The original security code (for example, 10 in FIG. 6) can be restored by performing image processing (combination).

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 may read the restored original security code (eg, 10 in FIG. 6).

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 displays the plurality of hologram images (e.g., FIG. Numbers may be assigned to 6 (10A to 10D), and the numbers assigned to the plurality of hologram images and each hologram image may be mapped and stored in the memory 130.

Memory 130 may store instructions or data received from the processor 120 or other components 130 to 180 or generated by the processor 120 or other components 130 to 180. The memory 130 may provide an execution space for programming modules such as a kernel, middleware 132, an application programming interface (API), or an application. Here, the application programming interface (API) may be a specific scanning API that configures a link with the scanned corresponding holographic security code. Each of the above-described programming modules may be comprised of software, firmware, hardware, or a combination of at least two of these.

The input/output interface 140 transmits commands or data input from a user through an input/output device (e.g., sensor, keyboard, or touch screen), for example, to the processor 120, memory 130, or the like through the bus 110. It can be transmitted to the communication interface 160, camera 170, or motion recognition sensor 180. For example, the input/output interface 140 may provide data about a user's touch input through a touch screen to the processor 120. In addition, the input/output interface 140 inputs and outputs commands or data received from the processor 120, memory 130, communication interface 160, or voice interface module 170 through, for example, the bus 110. It can be output through a device (e.g. speaker or display).

The display 150 can display various information to the user under the control of the processor 120. Here, the information may indicate the scanning direction of the user terminal 100. The user moves the user terminal 100 by referring to the scanning direction displayed on the display 150. In an embodiment, the display 150 may periodically change and display the scanning direction of the user terminal 100 under the control of the processor 120 for security purposes.

The communication interface 160 may connect communication between the user terminal 100 and the server 300. For example, the communication interface 160 may be connected to the communication network 200 and communicate with the server 300 through wireless or wired communication.

Wireless communications include, for example, Wifi (wireless fidelity), BT (Bluetooth), NFC (near field communication), GPS (global positioning system), or cellular communications (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM, etc.) may be included.

Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), or plain old telephone service (POTS). Here, the communication network 200 may include at least one of a computer network, the Internet, the Internet of things, or a telephone network. According to one embodiment, a protocol (e.g., transport layer protocol, data link layer protocol, or physical layer protocol) for communication between the user terminal 100 and the server 300 is an application, API, middleware, kernel, or communication interface ( 160) may be supported in at least one of the following.

In an embodiment, the communication interface 160 sends information indicating the order of numbers assigned to the plurality of holographic images (e.g., 10A, 10B, 10C, and 10D in FIG. 2) under the control of the processor 120. You can receive it from (300).

In an embodiment, the processor 120 or an application (or app) executed by the processor 120 combines (combines) the plurality of hologram images according to the order of the numbers included in the information to obtain an original security code (e.g., 10) in FIG. 6 can be restored.

The camera 170 scans the hologram security code (e.g., 10' in FIG. 6) under the control of the processor 120 or an application (or app) executed by the processor 120 to create a plurality of hologram images (e.g. , 10A, 10B, 10C and 10D in Figure 2) can be obtained.

In an embodiment, the camera 170 scans the hologram security code (e.g., 10' in FIG. 6) in a predetermined scanning direction to create the plurality of hologram images (e.g., 10A, 10B, 10C, and 10D in FIG. 6). ) can be obtained.

The motion recognition sensor 180 may measure motion data of the user terminal 100 at camera viewpoints of the camera 170 that acquired the plurality of holographic images. Here, the motion data may include the current location value and posture value of the user terminal 100. In other words, the motion data may be a measurement that allows you to know in what direction, what position or/and what view point the hologram security code is being scanned.

In an embodiment, the processor 120 identifies each hologram image by assigning a number defined according to the measured motion data to each of the plurality of hologram images.

In order to measure motion data, the motion recognition sensor 180, such as an acceleration sensor, magnetic field sensor, or gyro sensor, measures changing values such as the current position value and posture value of the user terminal 100 according to the user's movement. It can include all types of sensors.

FIG. 7 is a diagram illustrating a method of scanning a hologram security code according to an embodiment of the present invention, and FIG. 8 is a diagram showing a scanning direction guidance text provided through a user terminal according to an embodiment of the present invention.

Referring to FIG. 7, the user scans the holographic security code recorded on the plate 30 while slowly moving the camera 170 of the user terminal 100 in a predetermined scanning direction 50.

The plate 30 on which the hologram security code is recorded includes a plate member 32 made of a specific medium (e.g., glass) and a film 34 coated on the plate member 34, and the film 34 includes a hologram. A security code is recorded.

When light (e.g., LED light) emitted from the light source 40 is irradiated to the holographic security code recorded on the film 34, different holographic images (e.g., 10A in FIG. 2) are generated from different viewpoints. , 10B, 10C and 10D) can be recognized.

Accordingly, when the camera 170 of the user terminal 100 scans the hologram security code recorded on the film 34 in a predetermined scanning direction, different hologram images (e.g., 10A, 10B, 10C, and 10D in FIG. 2) are displayed. ) can be obtained.

The camera 170 may acquire

hologram images

10A, 10B, 10C, and 10D having actual QR code values according to the scanning direction of the user terminal 100. This scan direction may be displayed on the display 150 of the user terminal 100 when the app installed on the user terminal 100 is executed. Then, the user checks the scanning direction displayed on the display 150 of the user terminal 100 and then moves the user terminal 100 to start scanning the hologram security code.

Since holographic images with actual QR code values can be obtained by the scanning direction, the scanning direction is one of the important pieces of information in terms of security, and is shared with the server (300 in FIG. 1).

The scanning direction guided through the display 150 varies, for example, from top to bottom, from bottom to top, from left to right, from right to left, etc. can be decided. In FIG. 8 , guidance text for the scanning direction is provided through the display 150 of the user terminal 100. For example, guidance text such as “Please scan from top to bottom” may be displayed on the display 150. .

Each hologram image acquired during the scanning process is assigned a number identified according to the motion data (position value and/or posture value) of the user terminal 100. For example, as shown in FIG. 7, the number '①' is included in the motion data of the user terminal 100 measured at the viewpoint at which the holographic image 10A of the first channel (CH 1) is acquired. The number '②' is assigned to the motion data of the user terminal 100 measured at the time of acquiring the holographic image 10B of the second channel (CH 2), and the holographic image of the third channel (CH 3) The number '③' is assigned to the motion data of the user terminal 100 measured at the time of acquiring (10C), and the user terminal measured at the time of acquiring the holographic image 10C of the fourth channel (CH 4) ( The number '④' may be assigned to the motion data of 100).

The motion data of the user terminal 100 is a valid code value (actual QR) when the user terminal 100 scans the hologram security code at a certain point in time (which position, which direction, and which posture) during the scanning process of the user terminal 100. This is important information that indicates whether a holographic image with code values (A, B, C, and D) can be obtained.

The mapping relationship between the motion data and the number assigned to the holographic image is shared in advance between the user terminal 100 and the server 300, or the user terminal 100 sends the motion data and the number defined according to the motion data to the server ( 300) and may be shared between the user terminal 100 and the server 300.

Referring to FIG. 9, before explaining the restoration process, the number ① is assigned to the holographic image 10B of the second channel (CH 2), and the number ② is assigned to the holographic image 10C of the third channel (CH 3). is assigned, number ③ is assigned to the hologram image 10A of the first channel (CH 1), and number ④ is amplified to the hologram image 10D of the fourth channel (CH 4). In addition, it is assumed that information is received from the server (300 in FIG. 1) about the combination (combination) order of the hologram images 10A to 10D, that is, the order of the numbers is “③→①→②→④.”

First, the image area where the actual code value (e.g., QR code value) is recorded is extracted from each hologram image obtained by scanning by a camera. For example, a partial image (B) is extracted by clipping the image area (B) where the actual code value is recorded in the hologram image (10B) of the second channel (CH 2), and the partial image (B) is extracted from the hologram image (10B) of the second channel (CH 2) A partial image (C) is extracted by clipping the image area where the actual code value is recorded in the holographic image (10C) of (CH 3), and the actual code value is recorded in the holographic image (10A) of the first channel (CH 1). Extract a partial image (A) by clipping the image area (A). Then, a partial image (D) is extracted by clipping the image area (D) where the actual code value is recorded in the hologram image (10D) of the fourth channel (CH 4).

The location of the clipping area may be included in information indicating the combination (combination) order of the holographic images 10A to 10D and provided from the server 300, or may be determined according to prearranged rules. For example, in a holographic image (e.g., 10B) scanned at a view point defined by specific motion data, the image in the upper right area (e.g., B) within the holographic image (e.g., 10B) is used as a clipping area. In a holographic image (e.g., 10C) scanned at a time defined by other specific motion data, the image of the lower left area (e.g., C) within the holographic image (e.g., 10C) is used as a clipping area. Can be defined in advance.

Partial images (B, C, A, D) extracted from each hologram image are combined according to the order of the numbers, "③→①→②→④", which indicates the combination (combination) order received from the server 300 ( combination) can be achieved.

For example, the partial image (B) is placed in the upper right, the partial image (C) is placed in the lower left, the partial image (A) is placed in the upper left, and the partial image (D) is placed in the lower right. Afterwards, the original security code 10 can be restored by combining (combining) the partial images (B, C, A, D).

Afterwards, when the original security code 10 is restored, a reading process is performed to read the complete code value of the restored original security code 10.

FIG. 10 is a flowchart for explaining a method for reading a hologram security code according to an embodiment of the present invention, and is a flowchart for explaining steps S420 to S440 of FIG. 4 in detail.

Referring to FIG. 10, first, in S610, a process of executing an app installed on the user terminal 100 according to a user operation is performed.

Next, in S620, a process in which the app guides the scanning direction through the display 150 is performed. Here, the scan direction may be a predetermined scan direction and may be changed periodically at each reading.

Next, in S630, a process of scanning a hologram security code is performed while the user moves the user terminal according to the scanning direction guided through the display.

Next, a process is performed in which the camera 170 acquires a plurality of hologram images scanned from different viewpoints. Here, after acquiring the plurality of hologram images, the processor assigns a number to each hologram image, and then maps and stores the plurality of hologram images and the numbers assigned to each hologram image in the memory 130.

In an embodiment, the process of assigning a number to each holographic image includes the process of measuring motion data of the user terminal at the viewpoint at which the motion recognition sensor 180 of the user terminal acquires each holographic image. It may include a process of assigning a number defined according to motion data to each hologram image.

Next, the user terminal 100 or the processor 120 performs a process of restoring the original security code by combining the plurality of hologram images.

In an embodiment, the process of restoring the original security code includes the communication interface 160 of the user terminal 100 receiving information indicating the order of the numbers from the server 300 and the order included in the information. Accordingly, it may include a process of restoring the original security code by combining the plurality of hologram images.

Next, the user terminal 100 or the processor 120 performs a process of reading the restored original security code.

As described above, the present invention produces a security code (e.g., QR code) using a holographic method that records multiple images, rather than a single image, on one medium, so that when reading this holographic security code, at least two Since the QR code can only be read by combining two images, it can provide the effect of fundamentally blocking the duplication and reading of the security code.

The present invention is a technical field in which hologram content can be easily produced with only dozens of images acquired through the video capture function of a user terminal (e.g., a smart phone) even for a target object for which it is very difficult to obtain tens to hundreds of thousands of viewpoint images. It can be usefully used in .

Claims

generating m viewpoint images by photographing a real object using a camera of a user terminal;

generating n viewpoint images larger than m by rendering the m viewpoint images using an artificial intelligence model provided in a server;

manufacturing a hologram recording medium on which hologram content corresponding to the n viewpoint images is recorded using a hologram printer;

A hologram production method including.
In paragraph 1:

The step of generating the m viewpoint images is,

Obtaining a video of the real object by photographing the real object while the camera of the user terminal moves in a random direction;

Extracting, by the processor of the user terminal, the m viewpoint images from the video; and

transmitting, by the communication device of the user terminal, the m viewpoint images to the server through a communication network;

A hologram production method including.
In paragraph 1:

The step of generating the n viewpoint images is

A hologram production method that generates the n viewpoint images based on the NeRF (Neural Radiance Fields).
The camera of the first user terminal extracts m viewpoint images from the video in which the original security code is captured, renders the m viewpoint images based on an artificial intelligence model to generate n viewpoint images larger than m, and generates a hologram. producing a hologram security code corresponding to the n viewpoint images using a printer;

Obtaining a plurality of hologram images by scanning the hologram security code with a camera of a second user terminal;

restoring the original security code by combining the plurality of hologram images, by the processor of the second user terminal; and

Reading the original security code by the processor of the second user terminal

A method for reading a hologram security code including.
In paragraph 4,

Step of producing the hologram security code

Obtaining a video of the original security code by photographing the original security code while the camera of the first user terminal moves in a random direction;

Extracting, by the processor of the first user terminal, the m viewpoint images from the video;

transmitting, by the communication device of the first user terminal, the m viewpoint images to a server;

The artificial intelligence model of the server renders the m viewpoint images to generate n viewpoint images larger than the m.

A method for reading a hologram security code including.
In paragraph 4,

A method for reading a hologram security code, wherein the artificial intelligence model is a Neural Radiance Fields (NeRF) model.
In paragraph 4,

The step of acquiring the plurality of holographic images is,

A method for reading a hologram security code, comprising the step of scanning the hologram security code in a predetermined scanning direction to obtain the plurality of hologram images.
In paragraph 4,

The step of acquiring the plurality of holographic images is,

After acquiring the plurality of holographic images, the processor assigns a number to each holographic image; and

The processor mapping and storing the plurality of hologram images and the numbers assigned to each hologram image in the memory of the user terminal.

A method for reading a hologram security code including.
In paragraph 8:

The step of assigning a number to each holographic image is,

Measuring, by the motion recognition sensor of the user terminal, motion data of the user terminal at the point in time when each holographic image is acquired; and

Assigning a number defined according to the motion data to each hologram image.

A method for reading a hologram security code including.
In paragraph 8:

The step of restoring the original security code is,

A communication interface of the user terminal receiving information indicating the order of the numbers from the server; and

Recovering the original security code by combining the plurality of hologram images according to the order included in the information

A method for reading a hologram security code including.
In paragraph 4,

The step of acquiring the plurality of holographic images is,

Executing an app installed on the user terminal;

Displaying a predetermined scanning direction by the app on the display of the user terminal;

The user moving the user terminal according to the scanning direction displayed on the display; and

Obtaining the plurality of hologram images by having the camera scan the hologram security code as the user terminal moves.

A method for reading a hologram security code including.
In paragraph 11:

A method for reading a hologram security code, wherein the scanning direction displayed through the display changes periodically.