JP6999080B2 - Image recognition system, image recognition method, hologram recording medium, hologram reproduction device and image capture device - Google Patents

Description

The present invention relates to an image recognition system, an image recognition method, a hologram recording medium, a hologram reproduction device, and an image capturing device. In particular, the present invention relates to a technique for allowing a device for viewing a hologram to read data embedded in the hologram and access special contents that cannot be accessed without owning the hologram.

The hologram can reproduce a stereoscopic image (hologram image) by injecting the reproduced light. As this reproduced light, coherent light such as laser light may be required, but when reproducing a so-called rainbow hologram or Lipman hologram, for example, it is incoherent such as a halogen lamp or natural light. A white light source can be used as the reproduced light.

As a hologram capable of using a white light source as the reproduced light as described above, a hologram capable of reproducing a stereoscopic image has been widely used for the purpose of preventing forgery in a credit card, for example. However, there is a characteristic that the resolution and color change depending on the illumination light source, and although it looks like a hologram, it has a forgery deterrent effect, but it has not reached the level where anyone can easily judge the authenticity.

When the reproduced light is incident on the hologram, the wavefront of the object light at the time of recording is reproduced, and this wavefront is observed as a hologram image by the observer.

Further, as a kind of hologram, there is a so-called holographic stereogram. In the holographic stereogram, for example, a large number of images obtained by sequentially capturing images of a subject from different observation points are used as original images, and these are sequentially exposed as strip-shaped or dot-shaped element holograms on a single hologram recording medium. Produced by recording.

For example, in a holographic stereogram having parallax information only in the lateral direction, as shown in FIG. 5, a plurality of original images 101a to 101e obtained by sequentially photographing a subject 100 from different observation points in the lateral direction are predetermined. The interference fringes caused by the interference between the image-modulated object light and the reference light by sequentially displaying on the display in the holographic stereogram production device having the optical system of the above and irradiating the displayed image with laser light are strip-shaped. It is produced by sequentially exposing and recording on a hologram recording medium 102 as an element hologram.

The holographic stereogram produced in this way is observed because the image information obtained by sequentially shooting from different observation points in the horizontal direction is sequentially recorded in the horizontal direction as a strip-shaped element hologram. When a person sees this from a certain position with one eye, the aggregate of image information recorded as a part of each element hologram is identified as a two-dimensional image, and another position different from this position. When viewed with one eye, a collection of image information recorded as the other part of each element hologram is identified as the other two-dimensional image. Therefore, in the holographic stereogram, when the observer sees it with both eyes, the exposure recorded image is recognized as a three-dimensional image due to the parallax of the left and right eyes.

Further, for example, various hologram display devices are used as devices for displaying hologram images for viewing purposes.
Discloses a lighting device suitable for observing an image hologram or holographic stereogram for viewing. That is, as shown in FIGS. 6 and 7, by sequentially turning on a plurality of light sources from a predetermined position on the hologram, it is possible to make the stereoscopic image appear to move even to a stationary observer. can.

FIG. 7 shows a hologram reproduction device 1000 incorporating the audio reproduction mechanism disclosed in the above. It has a box shape, and when the lid portion 1001 is opened, the hologram 1002 attached to the back of the lid is irradiated with the LED built in the main body 1003 diagonally downward from a predetermined angle. The main body contains a voice data storage device, a voice data amplifier circuit, a speaker 1004, a battery 1006, an LED, an electronic circuit board 1007, and the like. The micro switch 1005 is arranged in an inconspicuous position of the main body, and the switch is pressed when the lid is closed, so that the so-called power supply is turned off. When the lid is opened, the switch moves to the open position and the power is turned on. The lid 1001 is fixed at a predetermined angle γ, for example, 115 ° by a stopper (not shown). A plurality of LEDs, for example, seven LEDs are arranged in advance at different positions, and by sequentially lighting them, it is possible to make the holographic image appear to be moving to a stationary observer. The positional relationship between the LED and the hologram is such that the central LED, L4, is arranged in the direction of an angle α, for example, 58 ° with respect to the normal from approximately the center of the hologram, and the line connecting the center of the hologram with the central LED, L4. L1 to L3 and L5 to L7 are arranged so as to look at the center of the hologram at different angles in the vicinity of the surface including the above.

As an example of control after the power is turned on, L1, L2, L3, L4, L5, L6, and L7 are lit in order, so that the eyes of a person observing the hologram from the direction of the central normal are observed. Is to reproduce the frame of the hologram image of the recorded image in the order of L1 to L7 in FIG. 8, and further, when it has a function to reproduce the stored audio data, the speed of the lighting control of the light is set. It is disclosed that the sound reproduction speed is synchronized with the sound reproduction speed.

However, it does not have a function to control these light sources from the outside, and if the lighting device does not have audio data information, it was difficult to link with the audio data in the first place, and no one. However, it was impossible to have an authenticity judgment function in real time.

In recent years, smartphones, portable music players, portable game machines, etc. that have a communication environment connected to the Internet have become widespread, but after downloading music and voice messages related to the contents of hologram media, There is no such thing as an LED that illuminates a hologram in synchronization with the timing of reproduction and the image of the hologram moves.

In addition, the utility value of such an ornamental hologram is high if only the person who owns it can access the special content related to the subject of the hologram. For example, from smartphones and handheld game consoles owned only by those who own the hologram medium, to messages of special voices of famous talents and characters related to the subject of the hologram, bonus tracks of short songs, etc. Being accessible will greatly increase the value of holograms.

On the other hand, let's focus on what is popular by using individual authentication codes. For prepaid cards such as music cards, international telephone cards, iTunes cards, and Google Play cards (each product name), the protective layer on the card is peeled off by scratching, and then the printed PIN code is read and entered. The function is enabled. In the medals of anime characters such as Yo-Kai Watch (registered trademark), various characters are stamped on the medals, and a barcode that can be individually recognized is stamped on the back side, and it is special by reading and registering the barcode. You can access the content. When the non-removable sticker attached to the beverage is peeled off, there is a barcode or number with an individual ID of about 6 to 16 digits, and it is used so that you can apply for a sweepstakes, and it is also used for marketing.

However, those using these numbers and barcodes are separated from the cards and products to which they are given, and the value of the medium itself on which the ID is written disappears or decreases. Furthermore, there is the trouble of having to input many characters, and even though it is encrypted, there are many troubles due to erroneous input.

There are examples of using non-contact or contact-type IC cards, RF tags, flash memories, etc. for authentication, but not only does the cost of the device increase, but also expensive dedicated devices are required to read each, and there is a limit to its widespread use. ..

On the other hand, various methods of using holograms for authentication are disclosed. Patent Document 2 discloses a hologram in which a different stereoscopic image can be seen depending on the viewing direction as a screen switching type, but it is not an image for authentication. Patent Document 3 discloses a hologram recording film with additional information, but the viewing angle is not limited, and it is not a bar code premised on machine reading. Patent Document 4 discloses a medium in which a control number or the like can be seen only from a certain limited angle for the purpose of facilitating management in a holographic stereogram printing process, but it is not authenticity determination information. Moreover, the information was not based on the premise that it could be read by a machine. Patent Document 5 discloses a kind of medium in which individual ID information can be observed as a hologram from a certain limited angle. However, since holograms cannot be observed unless not only the position of imaging but also the angle of illumination light is specified, it was difficult for a person without basic knowledge to perform machine reading without fail in a short time. In order to solve this problem, Patent Document 6 discloses an example in which an optical guide is displayed from an image pickup element in order to limit the position of an image pickup when reading a hologram having a narrow reproduction directivity angle. However, there is still a problem that the cost increases because the image pickup requires a knack and a device must be added to the reader. In Patent Document 7, in order to read the character information of the hologram recorded in the inspection process of manufacturing, a plurality of LED light sources arranged close to the hologram are illuminated in a time-divided manner, and a partially captured image is synthesized. Is disclosed. However, this conventional example is a technique for making it possible to read a hologram recorded in the back or front of the hologram surface when it is illuminated by a nearby light source, and when illuminated from different light sources at the same time, a so-called multiple image is reproduced. It is effective for removing crosstalk, but when a barcode is printed on the hologram surface, the multiple image is not reproduced in the first place and crosstalk does not occur, so it cannot be applied as it is, and it is an authenticity function. When used to strengthen the, it was necessary to add another element that could not be easily reverse engineered.

Japanese Unexamined Patent Publication No. 2014-146022 “Lighting Equipment and Image Recording Medium” Japanese Unexamined Patent Publication No. 2008-12670 "Screen switching type hologram manufacturing method and screen switching type hologram produced by the method" JP-A-11-258970, "Hologram recording film with additional information and its recording method" Japanese Unexamined Patent Publication No. 2001-337588 "Hologram Printing System and Holographic Stereogram" JP-A-2010-176116, "Image Recording Medium, Hologram Reproduction Device and Method" Japanese Unexamined Patent Publication No. 2012-145612 “Optical reading module and optical reading device” JP-A-2010-250191 "Hologram reproduction and imaging device, hologram reproduction and imaging method"

Using a hologram medium on which a machine-readable barcode is superimposed and recorded when illuminated from a certain angle at a certain wavelength, barcode information can be easily obtained from the medium from a portable information terminal such as a smartphone, a portable game machine, or a portable music player. Make it readable. Since the hologram cannot be easily forged, it can be used as a key that cannot be accessed unless the hologram medium is owned. Since many mobile information terminals have an image pickup device and a communication connection means to the Internet, various functions can be added without a large cost increase only by adding software.

However, it is difficult to read the barcode in a short time by simply capturing the hologram with a mobile information terminal. Therefore, simply facing the hologram with the mobile information terminal without any knowledge about the hologram. It is important to make it easy to read.

In addition, if there is a person who maliciously attempts to access with counterfeit data and the person knows the information contained in the legitimate hologram, the information is displayed on a hard copy or display that can be printed in two dimensions. If the data is taken and the data is returned as if there is a regular hologram, the authenticity judgment system will be weakened. Therefore, we have prepared a double-triple avoidance system to prevent the authenticity judgment algorithm and parameters from being decoded by reverse engineering, and to prevent the normal data from being returned to the authenticity judgment system even if it is decoded. It is important to keep it.

The present inventors have found the following means in order to solve the above-mentioned problems of the prior art. That is, only when illuminated with illumination light of a specific direction or wavelength, a bar code that can be imaged and decoded from the direction facing the hologram is recorded on a part of the viewing hologram, and the light source that illuminates this hologram and the image sensor that captures the image. The positional relationship with and the like is changed, and the reproduced image obtained according to the change is analyzed to perform a high-level authenticity determination.

For example, by attaching a medium having a hologram to a lighting device and controlling the lighting in the lighting device from a terminal such as a smartphone, authenticity can be determined based on whether or not image information corresponding to the lighting can be captured by the smartphone. I found an algorithm. The image information is preferably a two-dimensional bar code that can determine whether or not the image information can be clearly recognized.

In addition, by making it possible to judge the captured image in real time with illumination, even if there is a person who tried to judge the authenticity with a two-dimensional printed matter other than a hologram or a lenticular printed matter, the image change according to the lighting cannot be obtained, so it is a fake one. It is possible to reject as. Specifically, the image pickup apparatus decodes at regular intervals, and it is sufficient to determine whether or not the hologram actually exists by determining in real time whether or not the illumination light source can be switched and decoded. Even if a regular barcode is printed by hard copy, the captured image does not follow when illuminated from various directions.

If a plurality of barcodes are read by sequentially controlling a plurality of light sources, the authenticity determination function becomes stronger.

Furthermore, assuming that there was a person who sensed the illumination light, displayed an image corresponding to the hologram image using the display monitor at that timing, and even took a picture with a smartphone, from which direction the illumination light was emitted. While holograms have a function that accurately reproduces the above, it is difficult to create the same image as a regular hologram unless it can be sensed three-dimensionally. Even if it can be done, it takes time to sense it, create an image equivalent to it, and display it on the monitor. Therefore, it is of great significance to switch the illumination light at high speed to determine whether or not the captured image follows.

Furthermore, as a method of adding a function of determining authenticity at a high level, a method of split imaging of a holographic barcode and decoding after reconstruction have also been invented. If this method is used, real-time image analysis in a short time becomes impossible unless the parameters of image processing are known.

The authenticity determination algorithm, parameters, light emission control timing, etc. may be saved in the image pickup device or lighting device, but for higher security, these should be supplied from a remote server and changed as appropriate. You can also do it.

In addition, it is difficult to capture the barcode recorded on the holographic image with a smartphone etc. so that it can be read only from a limited range, but the barcode is printed or focused by the marking printed in two dimensions. By limiting the area where it should be, we made it possible to easily take images in a short time.

Furthermore, we tried to decode the barcode, and if it could not be decoded, we changed the position of the light source slightly and repeated decoding to make it easier to decode without moving the image sensor side.

Furthermore, we have invented an algorithm that can decode even a single portable information terminal equipped with an image sensor such as a smartphone and a light source for imaging, instead of combining it with a lighting device. That is, by shaking the smartphone held by hand from side to side, the positional relationship between the light source, the image sensor, and the hologram changes. At that time, we succeeded in reading out the information recorded on the hologram by analyzing the captured image.

The present invention is a method of performing image recognition using an information processing device having an image pickup element and a hologram, and creates at least two states in which the relative positional relationship between the hologram medium and the light source and the image pickup element or the light emission state of the light source is different. The above problem is solved by providing an image creation method including a procedure and a procedure in which the information processing apparatus acquires image information in different states from the image sensor.

Further, the present invention includes a procedure for comparing the information obtained by the above procedure with the information recorded on the hologram which is the recognized medium and determining the authenticity of the hologram in the image recognition method. The above problem is solved by providing the image recognition method described in the featured paragraph 0032.

Further, according to the present invention, in the above image recognition method, a procedure of sending the information obtained by the above procedure to another device and a procedure of acquiring a result of comparison with the information recorded on the hologram which is the recognized medium. The above problem is solved by providing the image recognition method described in paragraph 0032, which includes a procedure for performing different operations depending on the result.

The present invention also provides the image recognition method described in paragraph 0032, which further comprises a procedure for reading information recorded in the vicinity of the hologram and recorded by a method other than the hologram in the image recognition method. By doing so, the above problem is solved.

The present invention also provides the image recognition method described in paragraph 0032, further comprising a procedure for storing the unique ID information of the information processing apparatus including the image pickup device together with the image information in the image recognition method. By doing so, the above problem is solved.

Further, according to the present invention, in the image recognition method, the procedure in which the hologram reproducing device having a light source holds the medium so that the relative positional relationship between the light source and the hologram medium is determined can be separated from the hologram reproducing device. The procedure for controlling the light source in the hologram reproduction device and the at least two images obtained by the image pickup element arranged in the information processing device are analyzed or decoded while the information processing device is substantially stationary. The above problem is solved by providing the image recognition method described in paragraph 0032, which includes a procedure for determining the authenticity of the hologram medium.

Further, the present invention analyzes a procedure in which the information processing apparatus controls light emission of at least two light sources arranged in the hologram reproduction apparatus in the image recognition method, and changes in objects of the image to be captured accordingly. The above problem is solved by providing the image recognition method described in paragraph 0032, which is characterized by performing an authenticity determination.

Further, according to the present invention, in the above image recognition method, the hologram medium is holographically printed with at least one authentication image code, and the information processing apparatus uses a predetermined sampling interval with respect to the hologram medium. The authenticity is judged by at least one of the procedure of making the image receiving state in the image receiving state, decoding when irradiating a predetermined light source, decoding not being possible when not irradiating a predetermined light source, and being unable to decode when irradiating multiple light sources at the same time. The above problem is solved by providing the image recognition method described in paragraph 0032 including the procedure.

Further, in the above-mentioned image recognition method, the present invention uses a hologram medium in which a hologram is printed so that at least two different authentication image codes are reproduced under different lighting conditions, and the hologram medium is substantially stationary. The description in paragraph 0032, which includes a procedure for setting a focus using an image pickup device to bring the image into an image receiving state, a procedure for issuing a command to emit a different light source, and a procedure for determining authenticity by reading the corresponding authentication image code information. The above problem is solved by providing an image recognition system.

Further, the present invention uses a medium in which an authentication image code is encrypted and recorded in a holographic manner in the above image recognition method, and creates at least two states in which the positional relationship between the illumination light, the medium, and the image sensor is different. Paragraph 0032 including a procedure for imaging, a procedure for reconstructing an imaged partial area to regenerate one authentication image code, and a procedure for decoding from the regenerated authentication image code. The above problem is solved by providing the described image recognition method.

Further, according to the present invention, in the above image recognition method, the information processing apparatus having an image pickup element is a portable information terminal having a light source, and the procedure for controlling the light source and the entire portable information terminal are moved relative to the hologram medium. By providing the image recognition method described in paragraph 0032, which includes a procedure for capturing images in a plurality of different states and a procedure for analyzing or decoding the captured images to determine the authenticity of the hologram medium. Solve the above problems.

Further, according to the present invention, in the above image recognition method, the information processing device having an image pickup element is a portable information terminal having a light source, and the detection value of at least one of the acceleration sensor and the gyro sensor built in the mobile information terminal is detected. The above problem is solved by providing the image recognition method described in paragraph 0042, which includes a procedure for obtaining and a procedure for using the obtained detection value for image analysis.

Further, according to the present invention, in the above image recognition method, the information processing device having an image pickup element has a communication means with an authentication server at a remote location, and information regarding light emission control to the hologram reproduction device, an image pickup image, and a decoding conversion have been completed. The above problem is solved by providing the image recognition method described in paragraph 0032, which includes a procedure for sending and receiving information such as the data content and the time required for decoding to and from the server.

Further, the present invention relates to a procedure for reading a marking image displayed by printing or processing by a method other than holographic on a hologram medium, a hologram surface, or a nearby substrate in the above image recognition method. The image according to paragraph 0032, which includes a procedure for estimating the position of the hologram medium from the information obtained from the marking image, and a procedure for capturing or decoding the hologram image by limiting the area from the estimated information. The above problem is solved by providing a recognition method.

Further, according to the present invention, in the above image recognition method, the marking printed by two-dimensional printing is composed of a barcode, and the information processing apparatus decodes the barcode, and the focus is fixed at the stage where the barcode can be decoded. The above problem is solved by providing the image recognition method described in paragraph 0032, which includes a procedure for capturing a hologram image and then a procedure for capturing a hologram image.

Further, according to the present invention, in the above image recognition method, a procedure for displaying an image captured by an image pickup element on a display device in real time and a procedure for turning on the light source in an information processing device having an image pickup element, a light source, and a display device. The procedure for displaying the first guide mark on the display device and the guide mark on the display device are displayed on the hologram medium, on the hologram surface, or on the neighboring substrate by printing or processing in a non-holographic manner. A procedure for prompting the user to match the first marking image, a procedure for displaying the second guide mark on the display device after reading the first hologram information, and a second procedure on the hologram surface or a nearby substrate. The above problem is solved by providing the image recognition method described in paragraph 0032, which includes a procedure for prompting the matching of the marking images of.

Further, the present invention relates to the procedure for transmitting model data of an information processing device to a storage device in an information processing device having an image pickup element, a light source, and a display device in the above image recognition method, and a guide mark displayed on the display device. The above problem is solved by providing the image recognition method described in paragraph 0047, which includes a procedure for acquiring data regarding a position from the storage device and a procedure for displaying the data on the display device based on the acquired data.

Further, in the above-mentioned image recognition method, the present invention further stores an image of a holographic barcode on an image sensor when the holographic barcode can be decoded, or parameter information such as a position and an angle obtained from the image in the storage device. The above problem is solved by providing the image recognition method described in paragraph 0047, which includes a procedure for transmission.

Further, the present invention is a medium in which an authentication image code is holographically recorded, and when light is applied to the same position on the medium surface from different angles, at least two independent authentication image codes, or The above problem is solved by providing a medium characterized in that a part of the image code for authentication is recorded so as to be reproduced.

Further, the present invention is a medium in which an authentication image code is holographically recorded, and when light of different wavelengths is irradiated at the same position on the medium surface, at least two independent authentication image codes or The above problem is solved by providing a medium characterized in that a part of the image code for authentication is recorded so as to be reproduced.

Further, the present invention solves the above-mentioned problem by providing the image code-recorded medium for authentication of paragraph 0050 or paragraph 0051 that cannot be decoded by a kind of illumination light from one direction in the above-mentioned medium.

Further, the invention of the present application is characterized in that a marking image is displayed on the hologram medium, on the hologram surface, or on a nearby substrate by printing or processing by a method other than holographic, paragraph 0050 or paragraph 0051. The above problem is solved by providing the described medium.

Further, the present invention solves the above problem by providing the image recording medium described in paragraph 0053, wherein the marking image is an authentication image code in the image recording medium.

Further, the present invention is the image described in paragraph 0054, wherein the image recording medium is printed with a symbol indicating a direction in which the image sensor and the medium should be relatively moved when the image code for authentication is read. The above problem is solved by providing a recording medium.

The present invention also provides the image recording medium described in paragraph 0054, wherein at least one of the marking image and the image code for holographic authentication is printed with trapezoidal distortion in the image recording medium. By doing so, the above problem is solved.

Further, the present invention provides the medium described in paragraph 0050 or paragraph 0051, wherein the viewing image different from the holographic authentication image code is formed on the same medium in the image recording medium. By doing so, the above problem is solved.

Further, according to the present invention, in the above-mentioned image recording medium, the image recording medium is a part of a partition stand that can be installed upright on a floor surface provided with a partition belt, a housing that can accommodate the partition belt, or the partition. The above problem is solved by providing the medium according to paragraph 0050 or paragraph 0051, which is characterized by being formed on a part of a belt.

Further, the present invention is characterized in that the hologram reproducing device has a communication means and controls the light emission of the light source according to a control signal from the outside, or transmits a control signal for controlling the light emission of the light source to another device. The above problem is solved by providing the image reproduction device.

Further, according to the present invention, in a device for reading a medium in which an image code for authentication is holographically recorded, either an optical opening for aligning an image pickup lens portion or an optical aperture for aligning the holographic code portion. The above problem is solved by providing an information reading device in which the optical openings of either or both are formed.

Further, the present invention is characterized in that the information reading device has an image pickup element fixed inside, a portable information terminal having a built-in light source, and an optical opening for bringing a hologram medium close to each other. The above problem is solved by providing the described medium.

Further, the present invention is characterized in that the information reading device has an optical opening for bringing the medium of the holographic barcode fixed inside and the image pickup lens portion of the portable information terminal close to each other. The above problem is solved by providing the described medium.

Further, according to the present invention, in the above information reader, the line connecting the center of the medium of the holographic barcode and the opening of the image pickup lens portion is substantially symmetric with respect to the medium normal of the holographic barcode or its optics. The above problem is solved by providing the medium described in paragraph 0060, which comprises having a light source on an extension of the target.

According to the present invention, an authenticity determination function can be added to the viewing hologram. For example, you can download bonus tracks of music and voice messages that cannot be accessed without the actual hologram to the storage device built into your smartphone or hologram playback device, or you can get special character content for the game. It can have additional functions.

At this time, it is an advantage that it can be realized without a big cost-up factor in hardware, software, a medium manufacturing process, infrastructure construction for reading, and the like.

In particular, when reading hologram information with a mobile information terminal alone, there is a great advantage that even a person who is not familiar with the properties of the hologram can easily and clearly read the information simply by installing software. If you apply it to branded product tags or pharmaceutical packages, you can easily confirm that it is a genuine product at home, which is very useful.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present invention applies to systems, methods, media and devices that provide additional functionality to a medium of hologram or holographic stereogram.

Therefore, in the following, prior to the description of the device to which the present invention is applied, the holographic stereogram will be specifically described as an example of the hologram and the holographic stereogram attached to these devices.

First, the exposure recording principle of an element hologram for a hologram recording medium will be described.

As shown in FIG. 1, the hologram recording medium 3 is a recording layer made of a photopolymerizable photopolymer on a base film 4 which is a support material made of, for example, a polyethylene terephthalate (hereinafter referred to as PET) film. Along with the formation of the photopolymer layer 5, a cover film 6 as a support material made of, for example, a PET film is adhered and formed on the photopolymer layer 5, and is configured as a so-called film-coated recording medium.

In such a hologram recording medium 3, as shown in FIG. 2A, the photopolymerizable photopolymer constituting the photopolymer layer 5 is in a state in which the monoma M is uniformly dispersed in the matrix polymer in the initial state. be. As shown in FIG. 2B, the photopolymerized photopolymer was uniformly dispersed in the matrix polymer in the exposed portion by being irradiated with the laser beam LA having a power of 10 mJ / cm2 to 400 mJ / cm2. Is polymerized and becomes a polymer.

In the photopolymerization type photopolymer, as the polymer is polymerized, the monoma M moves from the surroundings, resulting in non-uniformity in the concentration of the monoma M, which causes the refractive index to be modulated between the exposed portion and the unexposed portion. After that, as shown in FIG. 2C, in the photopolymerization type photopolymer, the polymerization of the monoma M is completed in the matrix polymer by irradiating the entire surface with ultraviolet rays having a power of about 1000 mJ / cm2 or visible light LB.

In the hologram recording medium 3, as described above, the photopolymerizable photopolyma constituting the photopolyma layer 5 has an object light and a reference light by changing the refractive index according to the incident laser light LA. The interference fringes caused by the interference of the light are exposed and recorded as a change in the refractive index.

Further, since the hologram recording medium 3 is configured as a so-called film-coated recording medium, a step of performing a special development process after exposure recording is not required. Therefore, by recording the hologram image using such a holographic recording medium 3, the structure for performing the developing process in the holographic stereogram producing apparatus becomes unnecessary, the apparatus configuration can be simplified, and the holographic Stereograms can be produced quickly.

Here, a holographic stereogram producing apparatus for producing a holographic stereogram using the above-mentioned hologram recording medium 3 will be described.

In the following description, a holographic stereogram having lateral parallax information will be produced by exposing and recording a plurality of strip-shaped element holograms on one hologram recording medium 3. However, it is said that the holographic stereogram may have parallax information in the horizontal direction and the vertical direction by, for example, exposing and recording a plurality of dot-shaped element holograms on one hologram recording medium. Not to mention.

As shown in FIG. 3, the holographic stereogram producing apparatus 10 exposes and records a holographic stereogram image on a hologram recording medium 3 made of a photosensitive film. The holographic stereogram production device 10 includes an image data processing unit 11 that processes image data to be exposed and recorded, a control computer 12 that collectively controls the holographic stereogram production device 10, and a holographic stereogram. A holographic stereogram manufacturing unit 13 having an optical system for manufacturing is provided.

The image data processing unit 11 has at least an image processing computer 14 and a storage device 15, and capture image data including disparity information supplied from a disparity image sequence image pickup device 1 having, for example, a multi-lens camera, a mobile camera, or the like. The disparity image data string D3 is generated based on the image data such as the computer image data D2 including the disparity information generated by the image data generation computer 2 and D1.

The captured image data D1 is, for example, a plurality of image data obtained by simultaneous shooting by a multi-lens camera or continuous shooting by a mobile camera, and there is disparity information between the image data constituting the captured image data D1. included. Further, the computer image data D2 is a plurality of image data created as, for example, CAD (Computer Aided Design) or CG (Computer Graphics), and disparity information is included between the image data constituting the computer image data D2. ..

The image data processing unit 11 performs predetermined image processing for a holographic stereogram by the image processing computer 14 on the disparity image data string D3 based on the captured image data D1 and / or the computer image data D2. Generate hologram image data D4. The hologram image data D4 is temporarily stored in a storage device 15 such as a memory or a hard disk device. As will be described later, when the element hologram image is exposed and recorded on the hologram recording medium 3, the image data processing unit 11 exposes and records the element hologram image for each image from the hologram image data D4 stored in the storage device 15. The data D5 is sequentially read out, and these element hologram image data D5 are supplied to the control computer 12.

The control computer 12 controls the holographic stereogram production unit 13 to display an element display image based on the element hologram image data D5 supplied from the image data processing unit 11 into a part of the holographic stereogram production unit 13. The hologram recording medium 3 provided is sequentially exposed and recorded as a strip-shaped element hologram. At this time, the control computer 12 controls the operation of each mechanism of the holographic stereogram production unit 13, as will be described later.

In the holographic stereogram manufacturing unit 13, each member constituting the optical system is arranged and supported on a support substrate (optical surface plate) (not shown), and the support substrate is supported on the device housing via a damper or the like (not shown). It is said to have a structure. The holographic stereogram production unit 13 has an incident optical system, an object optical system, and a reference optical system as optical systems for producing holographic stereograms. Since the holographic stereogram production device 10 uses the hologram recording medium 3 which is a photosensitive material, the device housing has a structure that maintains at least the light-shielding property of the optical system.

As shown in FIG. 4A, the holographic stereogram manufacturing unit 13 arranges a laser light source 21 that emits a laser beam having a predetermined wavelength and a laser beam L1 from the laser light source 21 on the optical axis as an incident optical system. It has a shutter mechanism 22 for incident or blocking the laser beam L1 to the subsequent stage, and a half mirror 23 for dividing the laser beam L1 into an object light L2 and a reference light L3.

The laser light source 21 is composed of, for example, a laser device such as a semiconductor-pumped YAG laser device, a water-cooled argon ion laser device, or a water-cooled krypton laser device that emits a laser beam L1 having a single wavelength and good coherence.

The shutter mechanism 22 is opened and closed by the control signal C1 output from the control computer 12 in accordance with the output timing of the element hologram image data D5, and causes the laser beam L1 to be incident on the subsequent optical system. Alternatively, the incident on the optical system in the subsequent stage of the laser beam L1 is blocked.

The half mirror 23 splits the incident laser beam L1 into transmitted light and reflected light. As for the laser light L1, the transmitted light is used as the above-mentioned object light L2, while the reflected light is used as the reference light L3. The object light L2 and the reference light L3 are incident on the object optical system or the reference optical system provided in the subsequent stage, respectively.

Although not shown, the incident optical system may be provided with a mirror or the like for the purpose of appropriately changing the traveling direction of the laser beam L1 and making the optical path lengths of the object light L2 and the reference light L3 the same. .. Further, the shutter mechanism 22 may be configured to mechanically drive the shutter piece, or may be configured by an electronic shutter using an acousto-optic modulation (AOM). .. That is, the shutter mechanism 22 may be openable and closable so as to shield and transmit the laser beam L1.

Further, as shown in FIGS. 4A and 4B, the holographic stereogram manufacturing unit 13 includes a mirror 24, a spatial filter 25, a collimator lens 26, a projection lens 27, a cylindrical lens 28, a mask 29, and the like as object optical systems. It has optical components, and each of these optical components is sequentially arranged along the optical axis from the input side.

The mirror 24 reflects the object light L2 transmitted through the half mirror 23. The object light L2 reflected by the mirror 24 is incident on the spatial filter 25.

The spatial filter 25 is configured by, for example, combining a convex lens and a pinhole, and isotropically forms the object light L2 reflected by the mirror 24 corresponding to the display surface width of the transmissive liquid crystal display 30, which will be described later. Enlarge.

The collimator lens 26 converts the object light L2 magnified by the spatial filter 25 into parallel light and guides it to the transmissive liquid crystal display 30.

The projection lens 27 slightly diffuses the object light L2 and projects it onto the cylindrical lens 28. The projection lens 27 contributes to the improvement of the image quality of the produced holographic stereogram by slightly diffusing the object light L2.

The cylindrical lens 28 collects the parallelized object light L2 in the lateral direction.

The mask 29 has a strip-shaped opening, and of the object light L2 focused by the cylindrical lens 28, the light L2 that has passed through the opening is incident on the hologram recording medium 3.

Further, in the object optical system, a transmissive liquid crystal display 30 is arranged between the collimator lens 26 and the projection lens 27. The transmissive liquid crystal display 30 sequentially displays element hologram images based on the element hologram image data D5 supplied from the control computer 12. The control computer 12 supplies the drive signal C2 to the recording medium feeding mechanism 34 of the hologram recording medium 3 described later in accordance with the output timing of the element hologram image data D5, and controls the operation thereof. The feeding operation of the hologram recording medium 3 is controlled.

In such an object optical system, the object light L2, which is a thin beam divided and incident from the incident optical system, is magnified by the spatial filter 25 and incident on the collimator lens 26 to generate parallel light. Will be done. Further, in the object optical system, the object light L2 incident on the transmissive liquid crystal display 30 via the collimator lens 26 is image-modulated according to the element hologram image displayed on the transmissive liquid crystal display 30. At the same time, it is incident on the cylindrical lens 28 via the projection lens 27. Then, in the object optical system, while the shutter mechanism 22 is being opened, the image-modulated object light L2 is incident on the hologram recording medium 3 through the opening of the mask 29, and corresponds to the element hologram image. This is exposed and recorded.

Further, the holographic stereogram production unit 13 has a spatial filter 31, a collimator lens 32, and a mirror 33 as reference optical systems, and each of these optical components is sequentially arranged from the input side along the optical axis. There is.

The spatial filter 31 is different from the spatial filter 25 in the above-mentioned object optical system, and is configured by, for example, a combination of a cylindrical lens and a slit, and has a specific width of reference light L3 reflected and split by a half mirror 23. Is expanded in one dimension corresponding to the display surface width of the transmissive liquid crystal display 30.

The collimator lens 32 parallelizes the reference light L3 magnified by the spatial filter 31.

The mirror 33 reflects the reference light L3 and guides it to the rear of the hologram recording medium 3 to make it incident.

The holographic stereogram manufacturing unit 13 provided with such an optical system includes an object optical system, which is an optical system through which the object light L2 divided by the half mirror 23 passes, and reference optics, which is an optical system through which the reference light L3 passes. The optical path length is almost the same as that of the system. Therefore, the holographic stereogram production unit 13 can produce a holographic stereogram in which the coherence between the object light L2 and the reference light L3 is improved and a clearer reproduced image can be obtained.

Further, the holographic stereogram producing device 10 includes a recording medium feeding mechanism 34 that intermittently feeds the hologram recording medium 3 in the direction indicated by the arrow in FIG. 4B by the amount of one element hologram.

The recording medium feeding mechanism 34 intermittently drives the hologram recording medium 3 in a traveling manner based on the drive signal C2 supplied from the control computer 12. Further, in the holographic stereogram production device 10, the shutter mechanism 22 described above is operated based on the control signal C1 supplied from the control computer 12 in conjunction with the operation of the recording medium feed mechanism 34, and the laser beam L1 is operated. Open the optical path of.

In such a holographic stereogram producing device 10, a drive signal C2 corresponding to a one-element hologram is supplied from the control computer 12 to the recording medium feed mechanism 34 every time the exposure recording for one element image is completed. The hologram recording medium 3 is driven to travel along the traveling path by an amount corresponding to the one-element hologram, and the unexposed portion is made to correspond to the opening of the mask 29 and stopped. The holographic stereogram production device 10 is configured so that the vibration generated in the hologram recording medium 3 as the hologram recording medium 3 travels is quickly stopped. Here, the hologram recording medium 3 is made of a long photosensitive film, and although not shown, for example, the hologram recording medium 3 is wound around a supply roll rotatably provided inside a film cartridge held in a light-shielded state as a whole. There is. When the film cartridge is loaded into the holographic stereogram producing device 10, the hologram recording medium 3 is fed into the holographic stereogram producing device 10 and driven to travel on the traveling path by the recording medium feeding mechanism 34. ..

In the holographic stereogram production device 10, the shutter mechanism 22 is opened in this state to record the hologram recording medium 3 with the object light L2 and the reference light L3 image-modulated from the front and back surfaces of the hologram recording medium 3. The interference fringes corresponding to the element hologram image are exposed and recorded. When the exposure recording of the one-element image is completed, the holographic stereogram producing device 10 is supplied with the drive signal C2 from the control computer 12 to the recording medium feeding mechanism 34, and quickly travels the hologram recording medium 3 by a predetermined amount. Drive and stop.

Further, the holographic stereogram producing apparatus 10 performs a fixing process including an ultraviolet irradiation treatment on the hologram recording medium 3 and a heating treatment on the hologram recording medium 3 at a predetermined temperature by a fixing processing unit (not shown). The holographic stereogram image exposed and recorded on the hologram recording medium 3 is fixed. The holographic stereogram producing device 10 sequentially cuts out the holographic recording medium 3 subjected to the fixing process to a predetermined size for each holographic stereogram image, and discharges the holographic stereogram to the outside as one holographic stereogram.

The holographic stereogram producing apparatus 10 sequentially performs this operation to sequentially expose and record a plurality of holographic stereogram images on the long hologram recording medium 3, and one holographic stereogram. Produce a holographic stereogram in which a gram image is exposed and recorded.

When the same product is manufactured in large quantities, the holographic stereogram produced as described above is used as the original plate, and the unexposed holographic photosensitive material is adhered to the entire surface and then laser-exposed. It is also possible to duplicate in a short time.

Next, a specific example of a holographic stereogram configured as described above to which the present invention is applied, a medium to which various holograms are attached, and a lighting device thereof will be described below. Various holograms are not limited to the Lipman type (volume type) one-step holographic stereogram with lateral displacement as described above, but also a full paralux stereogram with vertical division, a live hologram taken by laser irradiation on a model, etc. It also includes holograms duplicated from them as original plates, surface relief type so-called embossed holograms, diffraction gratings, and the like. Also, not only the reflective type that illuminates the hologram medium from the same side as the observer, but also the transmissive type that illuminates from the opposite side of the observer, the hologram recording layer and the edge of the material whose refractive index is close to that of the base material. It also includes an edge-lit type that allows illumination light to enter. In the following, unless otherwise specified, a holographic stereogram is also included in the hologram as a kind of hologram.

FIG. 9 shows an example 900 of a medium to which the present invention is applied. A hologram 902 made by the above process is formed on a part or all of a credit card-sized medium 901 having a thickness of about 1 mm, a length of 85.4 mm, and a width of 54 mm. When a holographic stereogram is illuminated with a light source at a predetermined position and from a predetermined angle, it is possible to print a pre-designed and image-processed image so that a two-dimensional image is reproduced when viewed from the front. .. When illuminated from multiple known light source locations, each can reproduce a different image. In the case of this embodiment, an image in which the information at the position shown in 905 is converted into a two-dimensional bar code when illuminated from about 45 ° diagonally below 30 ° in the left direction is reproduced, and in the right direction. When illuminated from about 45 ° diagonally below 30 °, another barcode is played in the same place. Further, on the base material of the medium, two different barcodes 903 and 904 are printed in addition to the hologram region.

FIG. 10 shows an image reproduction device 950 to which the present invention is applied. The pedestal 913 of the image reproduction device 950 is formed with a slot into which a part of the medium 900 described with reference to FIG. 9 can be inserted. The cross section and the XX cross section are also shown. When the medium 900 is mounted in a fixed position, seven LED light sources, L1 to L7, are fixed so that the medium 900 can be irradiated from different positions at a predetermined angle toward the substantially center of the hologram.

Power can be supplied by connecting a household AC power supply to the inlet 910. However, even if power is not supplied from the outside, a dry battery or a rechargeable battery may be built in, or power may be supplied from a smartphone or the like.

A USB connector 911 is attached, and if the smartphone 914 is connected with a USB cable, it is possible to drive and control the LED from the smartphone side by wire. That is, if L1 to L7 are controlled to be turned on one by one in sequence, a moving stereoscopic image can be shown to a stationary observer who is almost facing the hologram. After L1 to L7 are turned on, they may be turned on in the reverse order such as L7, L6 ... L1, or may be repeatedly turned on like L1, L2 ... L7. At this time, if the light source can be controlled from the smartphone side, there is a great merit that the effect can be enhanced in conjunction with various applications from the smartphone side.

By connecting with a USB cable, the smartphone can be charged, so there is also the advantage that you can easily enjoy hologram viewing while charging. In other words, it can be said that the AC adapter for charging the smartphone has a hologram playback function.

If the image reproduction device is equipped with a secondary battery such as lithium ion, it can also function as a mobile battery and add a function that allows hologram viewing even if AC power is not always supplied. In other words, it can be said that the mobile battery has a hologram playback function.

The image reproduction device has a built-in speaker 915, and not only music and audio contents can be listened to with a smartphone but also can be listened to from the image reproduction device.

If the image playback device is equipped with a storage device such as a memory or a hard disk, the content downloaded by the smartphone can be transferred to the image playback device and saved, so that the image playback device alone can be used without the smartphone. In addition to driving the LED, voice reproduction can also be performed. On the contrary, the image reproduction device may not have a storage device and may transfer audio data or the like from the smartphone side in real time.

The light source control signal and voice data can be sent from the smartphone to the hologram playback device by wire via a USB cable, etc., Bluetooth (registered trademark), WiFi (registered trademark), infrared rays, NFC, etc. You may connect by non-contact communication means. Power can also be supplied wirelessly.

Smartphones are equipped with software that has the following functions.
A-1 ・ The image sensor mounted on the smartphone captures and decodes the two-dimensionally printed barcode information on the medium.
A-2 ・ Fix the autofocus function of the image sensor when decoding is possible. A-3 ・ Determine the known holographic barcode imaging area from the relative relationship with the position where the 2D printed barcode was imaged. Sampling starts at regular time intervals within that area.
A-4 ・ Issue a command to the holographic image reproduction device to illuminate the light source of L1.
A-5 ・ The holographic barcode is imaged and decoded at the sampling interval, and if it can be decoded, it moves to the next process. If it cannot be done, try decoding a limited number of times (for example, 10 times). If it still cannot be decoded, notify the user of the abnormality.
A-6 ・ After decoding, issue a command to illuminate the light source of L7, and perform the same procedure as A-3 to A-5 above.
A-7: The process proceeds to the next process based on the information decoded by A-5 and A-6.
For example, if URL information or encrypted password information that is not disclosed by other means is included in the decoded content, it cannot be accessed unless this medium is owned, so an authenticity judgment function can be added. become. Although the number of light sources has been described as 7 from L1 to L7, any number of light sources can be applied. In order to effectively express the continuity of the holographic stereogram image, the number may be increased to about 30 to 100.

If decoding is not possible in the steps A-4 and A-5, it is possible that the positional relationship between the smartphone and the hologram medium is not in a predetermined state. In that case, decoding can be attempted by irradiating an adjacent light source such as irradiating L2 instead of L1. Alternatively, moving the smartphone slightly makes it easier to decode, so the smartphone may notify the operator by screen display or voice.

In the above description, two types of barcodes recorded in the holographic are printed, but even one type can provide a function that can be realized only by a hologram. It is a unique feature of holographic barcodes that it can be decoded by illuminating it from one light source, but it cannot be decoded by illuminating it from another light source with the same illuminance.

On the contrary, three or more types of barcodes recorded on the holographic may be printed, and the corresponding playback device may be provided with more than the number of light sources. The larger the number, the higher the level of security features can be provided.

As a medium similar to hologram, there is a technique called lenticular photography. That is, due to the Kamaboko-shaped lens effect, different information and stereoscopic images are reproduced as multi-viewpoint images when viewed from different angles, but then the image seen from the front may change even if the illuminated light is changed. do not have. That is, it utilizes a phenomenon peculiar to holograms. Holograms can be forged because they can record at a much higher density than ordinary print media and lenticular photography, cannot be easily created, and the materials and devices are limited. Is difficult.

There are various measures to prevent the hologram itself from being forged, and it is possible to take them.

Here, even if there is no hologram medium, it is assumed that the same authentication can be performed maliciously, and double and triple prevention measures are prepared. If all of them are disclosed in the present invention, it may promote the act of camouflage, so here, only the main points and a few examples will be disclosed.

For example, it may seem that decoding can be performed at first glance by recording an image of the image taken and decoded as a moving image, displaying it on another display or smartphone, and taking the image. However, if the timing of illuminating L1 is variable each time, the light is emitted after waiting for a time determined by the random function, and the L1 is turned off as soon as decoding is possible, the timing of pre-recorded decoding does not match. Can be rejected. Not limited to light emission by random time, the mobile terminal side knows the light emission time, and decoding cannot succeed at the timing when light emission is not performed, so various authenticity judgment patterns should be used. Can be done. A strong authenticity determination function becomes effective for the first time by using a widely used mobile information terminal and performing a light emission command and imaging / decoding from the terminal.

The authenticity determination algorithm is not limited to the above, and various patterns can be considered. If they are encrypted and software and libraries based on the authenticity judgment algorithm are supplied from the host server using the network, even if one algorithm is found out, the authenticity judgment function will be provided by the new algorithm. It is also easy to update.

In the above example, two different types of barcodes can be recognized from two directions, but the number may be 1 or 3 or more. As the number increases, the authenticity judgment function becomes even stronger. This is because, for example, a malicious person installs a light receiving element in a lighting device, encodes a barcode image that should be reproduced by a hologram, displays it on another display in real time, and reads it with a smartphone for decoding. Even if you try to do something, it is difficult to accurately detect from which direction the light is coming.

Further, an example in which image processing is intentionally performed so that only a part of one barcode is reproduced with one illumination and the image data reproduced with a plurality of illuminations is reconstructed will be described with reference to FIG.

For example, it is assumed that a part of the barcode as in (a) is reproduced when L1 is illuminated. Similarly, assuming that the images of (b) are captured when the L4 is illuminated and the images of (c) are captured when the L7 is illuminated, they are connected on the memory of the mobile information terminal and completed as in (d). It is possible to reconstruct the 2D barcode. In this way, if a complete two-dimensional bar code is reconstructed, decoded, and entered into authenticity judgment or the next program operation, further anti-counterfeiting measures can be taken. Since what kind of image reconstruction algorithm is used is related to the image processing process of the holographic stereogram, the conditions of the optical system to be reproduced, and the timing of illumination, this information is kept confidential. The order of light emission is not limited to the order of L1 → L4 → L7, and can be changed in any way, and if it is changed for each judgment, it can be a countermeasure against forgery.

By incorporating a light source with high-speed response characteristics such as LED into an image reproduction device and using an image sensor with high-speed response characteristics such as CMOS in the image image pickup device, for example, if the image is switched at a high speed of 1 millisecond or less. Even if the control method of the light source is reverse engineered, it is very difficult to disguise it with another light source in real time. By using this, it is possible to add it to the point of authenticity judgment.

Since the appearance of the hologram changes depending on the type, angle, diffusivity, etc. of the illumination light for reproduction, the conditions for recording on the hologram are specified not only in this embodiment but are not disclosed. Various modifications can be considered by checking whether the recording conditions and the consistency are taken by the positional relationship between the light source and the image pickup device during reproduction based on the conditions.

An application example using this authenticity determination function will be described below.
Mainly,
Form (A) When a person who owns a portable hologram medium reads it with a portable information terminal,
Form (B) The information terminal for reading is fixed at a certain place, and when the person who owns the hologram medium reads at that specific place Form (C) The hologram medium is fixed at a certain place without assuming portability. When reading the holographic medium with an information terminal owned by the user
Since the purpose, required configuration requirements, etc. differ depending on the type, the classification will be clearly explained.

First, an example of using the access key to the special content will be described on the premise of the form (A). Portraits of famous talents, animated characters, etc. are displayed on the hologram card, and by scanning the two-dimensional bar code with a smartphone, you can listen to the sound data related to the content, that is, the voices of the talents and characters and bonus tracks. ing.

Traditional music cards, which replace music CDs, are used to allow artists' songs to be downloaded by reading and entering a PIN code that is printed after the protective layer on the card has been peeled off by scratching. However, by using a card with a hologram attached as a medium and attaching it to a hologram reproducing device, it is possible to reproduce the hologram in conjunction with the reproduction of music. Not only will it enhance the design of the music card, but it will also add functionality. For example, songs can be downloaded by a number unique to the music card, and can be saved on a smartphone, for example, but some of the data can only be accessed by scanning the holographic barcode. When downloading, the dedicated software on the smartphone allows the user to download if the access right is automatically obtained without taking complicated steps in the process like A-1 to A-7 above. Become. The data once downloaded may be accessible at any time thereafter, or the above access right may be determined each time the data is listened to. In addition, by determining the access right to the content that is updated every day, the user can listen to the new content data without having to bother to enter the password or the like. If the light sources for hologram lighting are sequentially turned on and controlled according to the music and voice, it is possible to produce an effect as if talking in synchronization with the hologram image. For up-tempo songs, it is possible to increase the speed of lighting in sequence, and for slow-tempo ballads, it is possible to decrease the lighting speed.

As another application to which the present invention is applied, a medal-shaped hologram-related toy will be described. A hologram of an animated character is attached to the medal, and when attached to a wristwatch-shaped toy, the character's bark and name are reproduced as voice. A light source is built in at an appropriate position in this toy, and it is imaged on a medal-shaped hologram part with a portable game machine. If the portable game machine also has an image sensor and communication means, the data in the server that can only be accessed by the person who has this hologram can be accessed by the same process as the combination of the hologram playback device and the smartphone as described above. It becomes possible to do.

A second embodiment to which the present invention is applied will be described with reference to FIGS. 11 to 13. By applying the present invention, it is possible to determine the authenticity of a hologram by using a portable information terminal having an image pickup device and a light source for illumination without a special reproduction device.

A barcode as shown in FIG. 13 is two-dimensionally printed on the above-mentioned music card, various certificates, pharmaceutical packages, branded product tags, etc., and a holographic barcode is partially attached. .. In the case of FIG. 13A, long arrows on the left and right and two-dimensional bar codes PB1a and PB1b are printed on the left and right by a normal two-dimensional printing method, and a bar code HB1 recorded in a holographic manner is attached to the center. ing. Similarly, in FIG. 13B, the holographic barcode HB2 and the two-dimensional printing barcode PB2 are arranged above and below the arrows. In the example of FIG. 13C, a large two-dimensional bar code is printed in the arrow, and a holographic bar code is affixed inside the large two-dimensional bar code. The term “attachment” as used herein means that the medium containing the hologram recording material layer is adhered using a pressure-sensitive adhesive or a heat-sensitive adhesive, and it is desirable that the hologram layer cannot be separated from the substrate without being destroyed. It has become.

The arrow indicates the direction of relative movement when reading the holographic barcode. The reason why the inside of the arrow image is composed of fine textures is to facilitate the autofocus of the image sensor.

The reading method of the example of FIG. 13A will be described with reference to FIG. For example, in Apple's iPhone 6, an image sensor capable of high-speed shooting and a light source LED for illumination that can be driven at high speed are arranged at a distance of about 10 mm. Consider holding such a smartphone horizontally and reading a holographic barcode. If you try to image the printed barcode area from the direction facing the medium, that is, from the normal direction, the hologram must read the reproduced image by the light incident at almost 0 degrees, and it is attached to the hologram surface with the smartphone. When the LED is illuminated, its direct specular reflection is incident on the image sensor, making it difficult to read the barcode. Therefore, the image is tilted so as to aim at the back by about 20 ° from the front so that the specular reflection image does not enter. In the case of facing each other, it is easiest to print an image as shown in FIG. 11 (A), but the one with a slight trapezoidal distortion as shown in (B) is actually printed. When tilting the smartphone, if the two-dimensional print barcode that should be aimed at is made to look like a square on the monitor screen, it will inevitably be possible to take an image at an ideal angle as shown in (C). FIG. 11D is a monitor image seen on the image of the smartphone. At the time of imaging, a square guide mark is displayed in (a), and if the size is adjusted so as to eliminate trapezoidal distortion, the holographic barcode can be displayed in the area of (b) with an ideal tilt angle. Can be stored inside. At this time, it is possible to make the holographic barcode easy to read, to read the holographic barcode without distortion when it is in the positional relationship of (D), or to make it difficult to read as described later. be. In the case of FIG. 11D, the square two-dimensional bar code is distorted so that it can be easily read even though it is read from an angle.

In general, smartphones often have an image sensor and a light source arranged on the surface opposite to the monitor. In order to check how the holographic barcode is read on the monitor, it is easy to work intuitively if the user's eyes, the smartphone, and the holographic barcode are lined up in this order. On the other hand, if they are lined up in a straight line, the hologram and the specular reflection of the base material enter the image sensor, making it difficult to read. Therefore, it was designed so that it can be read when tilted up or down by about 10 to 30 °. So far, the explanation has been made mainly on the assumption that it is read from below. This is easy to read when the card is placed on a table or the like. However, there is a possibility that ceiling lighting or the like may be reflected, and in that case, there is a drawback that it may be difficult to read. As another example, it can be read from above. This is suitable when the holographic barcode is affixed to the wall or when the affixed card is held on a display as shown in the figure. It is possible to read from the bottom if it is placed on the top of the poster, but to make it easier for people of various heights to read, place it on the bottom of the poster and face it from top to bottom. It is preferable to read it. If a tall person reads the holographic barcode placed at the bottom and reads from above, it is possible to crouch down, but the holographic barcode placed at the top is read by a short person. This is because it may not be possible.

Users may be confused if specifications that should be read from diagonally above and those that should be read from diagonally below are mixed. Therefore, in the present invention, as shown in FIG. 21, the arrow indicates the shape of the medium of the holographic barcode so that the direction can be understood, which also serves to clearly indicate from which side the holographic barcode should be read. I made it into a shape. This also has the effect of preventing the top and bottom from being mistaken when affixed to a poster or card.

The base material of the holographic barcode is black to improve the contrast. However, it may be intentionally made transparent so that the printed matter on the lower surface can be seen through. In addition to the effect of maintaining the design of posters, it is also possible to print a two-dimensional bar code on the bottom surface and read and decode both of them. If two-dimensional printing barcodes other than the holographic barcode described in the present invention are overlapped on a flat surface, the area required for this function can be reduced, and the holographic barcode has high adhesiveness. If it is attached to the base material with a transparent adhesive material, the base material will be damaged at the same time when the holographic barcode is peeled off, and it is possible to produce a tamper evidence effect.

As a modification of the embodiment in the form shown in FIG. 10, an image hologram of a device illuminated from diagonally below is arranged in order to appreciate the image hologram, and the holographic barcode is displayed from diagonally above. What is recorded in a readable manner will be described. When a smartphone is used to read two or more pieces of information written in a hologram or a print code in the vicinity from diagonally above to diagonally downward, special content related to the image hologram is played back from the smartphone. In this case, the viewing device does not require a communication means or the like and can have a simple configuration. Further, since the holographic barcode for reading information is not reproduced by the light source for image viewing, there is an advantage that even if the image is printed on the same material as the image hologram, it does not interfere with the viewing.

As an authenticity judgment process
B-1: Hold the smartphone to the user and tell the user by voice or on-screen message so that PB1a fits in the frame of (D) and (a) so as to form a square.
B-2: Decode the barcode in the frame of (D) (a) B-3: Temporarily fix the autofocus etc. when the above decoding is completed B-4: Have the holographic barcode in the area (D) (b) Imaging at sampling intervals Decode B-5: Tell the user by voice or on-screen message to move the smartphone to the right and align PB1b into a square within the frame of (E) and (c).
B-6: When the above decoding is completed, the holographic barcodes in the areas (E) and (b) are imaged at a certain sampling interval, and the holographic barcode data read in the decoding B-4 and the holographic barcodes read in B-6. Although the graphic barcode data is data that can be decoded from the same area on one medium, it can be made different because it is a hologram.

As another example, the case of reading the design as shown in FIG. 13B will be described with reference to FIG. When reading face-to-face, a stamp like (A) may be used, but each barcode is stamped in a shape like (B) so that it is intuitively easy to understand when the image is tilted at an angle. When the barcode is held in the center of the smartphone, an image without distortion can be obtained as shown in (C). Here, when the two-dimensional print barcode PB2 is read, the autofocus of the image pickup element is fixed, and the user is instructed to reciprocate the smartphone in the direction of the arrow.

The information of the holographic barcode changes from moment to moment while going back and forth between the states (D) and (F) within the range that does not deviate from the screen. At this time, it is possible to use image-processed data such as (E) and (G) so that the barcode information recorded as a hologram can be easily read in advance, but it is a complete barcode on a certain time axis. You may assume reconstruction even if you cannot read. As described with reference to FIG. 14, one barcode can be obtained by cutting out and reconstructing a barcode portion from the positional relationship of a plurality of holograms, light sources, and image pickup elements, and by decoding it, a hologram can be obtained. The information recorded in the computer can be read by a machine. In other words, the moving image barcode is recorded as a hard copy, and encrypted information can be obtained by reading while controlling the light source of the mobile information terminal.

In addition, iOS and Android smartphones are equipped with accelerometers, gyro sensors, etc., and their detection values can be used. For example, it is possible to turn on the light source only when it is moving in one direction and to turn off the light source when it is moving in the opposite direction during the swing reciprocating motion. By doing so, it is possible to detect the contrast of the barcode recorded in the holographic.

Embossed holograms and Lipman holograms look different, especially when the lights are turned off or when they are illuminated with a monochromatic light source. Even if the Lipman hologram is legitimate and is forged with an embossed hologram, it can be excluded as an art forgery. In the case of the Lipman hologram, light other than the light that meets the conditions of Bragg diffraction is transmitted and absorbed by the base material in the back, whereas in the case of the embossed hologram, the transmitted light is reflected by the reflective layer such as silver on the back surface. The difference can be proved by analyzing the captured image. For example, when illuminating a hologram that is supposed to reproduce a green hologram with a red LED, the one made by the Lippmann method is not reproduced at all, while the one made by the embossing method is reproduced only in a different diffraction direction. Will be done.

When metal pieces, fluorescent materials, foreign chic materials, etc. are mixed with the hologram layer, its protective layer, base material, their adhesive layer, etc., if the presence of these is imaged together, not only the barcode but also the authenticity can be judged. It can also be an element.

The barcode may be printed with the same information for each content or product by a mass duplication method, or may be such that no two individual IDs are the same. Individual IDs and serial numbers have a wider range of applications such as tracking and traceability systems as well as authenticity judgment. The holographic barcode may be an individual ID, but even if the two-dimensional print barcode is an individual ID, the authenticity determination function can be utilized in addition to the fact that the holographic barcode is difficult to forge.

When swinging at high speed, it may be difficult to read due to difficulty in focusing or blurring of the image. Therefore, first, the mobile information terminal is focused on the marking image two-dimensionally printed near the hologram. After that, by shortening the shutter speed and taking an image at a high frame rate of about 240 fps, the sharpness of the captured image is improved. Sharpness can also be increased by turning the LED on or off at high speed without increasing the shutter speed or taking an image at a high frame rate.

Ideally, the mobile information terminal should be read at an angle of about 15 ° to 20 ° with respect to the surface on which the two-dimensional marking or holographic barcode is printed or affixed. Due to the structure of smartphones and game consoles, the light source for the purpose of flash is often located not far from the image sensor. When an image is taken facing the medium, the light directly reflected by the light source on the front surface or the back surface of the hologram medium directly enters the image sensor, and it is difficult to take an image with good contrast. If the angle is too steep, it will be difficult to read the barcode. Therefore, record a hologram fix barcode that can be imaged at an angle of about 10 ° to 45 °. In the examples of FIGS. 13B and 13C, it is clearly indicated from which side the image should be taken, including the optimum tilt angle. FIG. 15 shows an example in which the holographic barcode is in the shape of a sticker and is affixed to the card. However, since the hollow shape of the sticker is on the arrow, the image is taken from diagonally below. You can understand that intuitively.

In the above example, a square frame is displayed on the screen of the smartphone so as to match the 2D printing barcode, but it is possible to intuitively understand from which direction the light is emitted and in which direction the mobile information terminal should be moved. As long as a simple symbol mark is formed, it does not necessarily have to have this shape and method. Further, by forming two or more two-dimensional bar codes and symbol marks instead of one and performing image processing on the positional relationship, it is possible to use them as information on the orientation of the portable information terminal.

In addition, a two-dimensional bar code was used as a marking image for aligning the position of the smartphone, but it is not limited to this. The image may be such that the positional relationship with the image sensor can be easily obtained by image processing. For example, if a grid-like image is printed in two dimensions, the relative position and angle between the personal digital assistant and the hologram can be known by analyzing the trapezoidal distortion of the captured image. It can be determined whether the obtained hologram image is normal or not. If the marking image is a fine image with strong contrast, there is an advantage that it is easy to focus. The texture in the arrow of FIG. 13 (A) can also be used for this purpose.

As the marking image, an image in which the reading order such as 1 or 2 is simply described in a quadrangle can be used. It is preferable that the quadrangle has a trapezoidal shape in consideration of trapezoidal distortion. That is, the first marking guide 151, the second marking guide 152, and the two-dimensional bar code 154 are printed on the card 156 in the arrangement as shown in FIG. 15A, and the holographic bar code 153. Is affixed to the card as a sticker, and the shape of the sticker is an upward arrow. The two-dimensional bar code is printed with black ink on a white background, while the holographic bar code is a green bar code on a black background. Although it is easy to read and print, it may be negative-positive inverted or formed in a different color. A figure drawn as 1 in a rectangle is displayed on the screen of the smartphone, and the user is prompted to match the image with the image of the camera monitor of the smartphone. By matching the size of □, it is easy to match the distance between the smartphone and the hologram medium, and the printed rectangle is drawn with the lower side slightly shorter than the upper side, so to hold the smartphone from below and make it the optimum position. It has a suitable marking shape. After the first code is read, a figure drawn as 2 is displayed in the rectangle on the smartphone screen, and the second code is guided so that it is easy to read.

The positions of image sensors and light sources differ depending on the model of smartphones or personal digital assistants. In particular, smartphones that use the Android OS are designed by various manufacturers, so there is a big difference. As described above, whether or not the holographic barcode can be read properly depends on the positional relationship between the light source and the image sensor, so the guide display for easy reading needs to be changed for each model. Models with different specifications will be released one after another in the future, and based on this, the following operation was devised in the present invention. A series of flowcharts is shown in FIG.

That is, when the information of the own model is first sent from the application on the smartphone to the server on the network, it is collated with the list of registered models, and in the case of the registered model, the position coordinates of the recommended guide marking are returned to the smartphone application. The smartphone app displays recommended guide markings. If the model is not a registered model, information to that effect will be sent from the server, so a general guide marking will be displayed to the extent that the outline is matched. In this case, the user is not easy to read, but when it can be read over time, the coordinate information is sent to the server. As a result, the information when it can be read can be collected and stored as a database. At this time, the time taken for reading is also sent to the server. By analyzing this database, the position coordinates of the recommended guide markings are determined and added to the list of registered models along with the model information. Including the registered models, the position coordinates when all readings are successful and the time information taken to succeed in reading are sent to the server, for example, the average of the top 5 points from the one with the shortest time to succeed in reading. Automatic programming to list the coordinates as recommended guide marking coordinates can automatically provide a more readable guide display without the need for manual analysis. Using this system has the advantage that it is possible to automatically integrate conditions that are easy to decode for each model without having to spend time and manpower on experimenting and verifying the ever-increasing number of mobile information terminals.

Up to this point, an example of performing authenticity determination based on whether or not the holographic barcode can be read has been described, but it is also possible to use the characteristics of the hologram to control the light source so that it cannot be read as an authenticity determination element. Simply, since a hologram cannot be reproduced without illuminating it, it can be judged as an art forgery if it is read without illuminating the light source. On the contrary, even if a plurality of light sources are irradiated, the plurality of images are duplicated and imaged, so that the barcode cannot be decoded. If you control multiple LEDs and illuminate them with the same illuminance as if you lit one LED, you should be able to read it with a general 2D printed barcode without any problem, but you should be able to read it with a holographic barcode. Therefore, it is possible to add a judgment algorithm that is a fake if a large number of LEDs are illuminated at the same time and decoded. In other words, sampling for decoding is continued at a certain time interval, and the LED can be lit, not lit, or lit a lot, and it can be read at the timing that should be read if it is a genuine product, and it can be read at the timing that should not be read. Either or both can be used for authenticity.

When imaging is performed at a high speed such as 120 fps or 240 fps, it is easy to decode because an image without blurring can be obtained even with the data captured by moving quickly.

The built-in LED attached to the auxiliary light source for imaging with a personal digital assistant includes an LED that is pseudo-white by combining a blue LED and a phosphor, and an LED that combines three LED chips of red, green, and blue into one package. .. In the case of a red, green, and blue three-color LED, it is possible to illuminate red or green. Even if the holographic barcode is illuminated in white from the same position, if you record the code that diffracts red and the code that diffracts green, if you illuminate in red, you can decode the red barcode and illuminate in green. Then you can decode the green code. By doing so, the user can read the characteristics peculiar to the hologram by changing the time axis and sequentially illuminating in red and green without changing the relative positional relationship between the mobile information terminal and the hologram.

For example, a part of a barcode that can be reproduced in red and another part that can be reproduced in green may be sequentially or simultaneously imaged, combined by image processing, and decoded into one barcode. .. Although described in red and green, LEDs having wavelengths such as blue, near-infrared, and ultraviolet may be used to read holograms of the corresponding colors.

The device for imaging, that is, a smartphone, a game machine, or a mobile information terminal, utilizes the fact that it has a means of communication with an authentication server at a remote location, and converts a light emission control signal, an image captured at that time, and photoelectric data to a hologram reproduction device. Information such as the completed data contents and the time required for conversion may be sent and received with the server. As long as it is a mobile information terminal equipped with a GPS (Global Positioning System) function, the place where the reading is performed may be transmitted to and received from the server. Since information about the read location can be acquired, it can be effectively used depending on the application.

The control information of the light source for irradiating the hologram is sent from the authentication server in a remote place, the image captured in real time and the data content converted into photoelectric data are sent back to the authentication server, and the authenticity judgment is performed on the server side. You may do so. That is, the information obtained by reading the holographic barcode from the portable information terminal having the light source and the image pickup element is encrypted together with the reading conditions, parameters, and the like, and then sent to the authentication server on the network. On the authentication server side, if it can be determined that the hologram is a legitimate hologram by collating the read information with the reading conditions, it is possible to redirect to another content server or return the access right information to the terminal side. ..

At this time, the information sent from the terminal side to the authentication server may include the unique information of the terminal, the owner information of the terminal, and the like. By doing so, it is not possible to grant access rights unconditionally if there is a legitimate holographic barcode to which the present invention is applied, but to allow access only from a specific terminal or a specific person. Then, on the contrary, it is possible to operate such as making it inaccessible from a specific terminal or a specific person. For example, the terminal information at the time of the first activation is stored in the terminal or the authentication server side by associating the holographic barcode information and the print barcode information, and it is collated when there is an access. For example, it can be operated so that access from other than the terminal at the time of activation is invalidated. By doing so, even if the security card distributed is lost or stolen, the risk of misuse can be reduced.

Further, at least a part of the authenticity determination algorithm may be sent from the server side at a remote location to the photographing apparatus side, and the authenticity determination may be performed in the imaging apparatus in real time of imaging even if communication is not performed.

As described above, in the method of performing authenticity determination using an information processing device having an image sensor and a hologram, the procedure for creating at least two different states of the relative positional relationship between the hologram medium and the light source and the image sensor, or the light emission state of the light source, and the above description. The procedure in which the information processing apparatus obtains information defining different states by using a means other than the image pickup element and at least two images obtained by the information processing apparatus from the image pickup element are analyzed or decoded to obtain the different states. An image recognition method and a medium characterized by including a procedure for determining the authenticity of a hologram medium based on whether or not the information is consistent with the specified information have been described together with specific examples.

Here, the information processing device has been described as an embodiment centering on a portable information terminal including a smartphone, a mobile phone, a portable game machine, etc. However, any device having an image pickup element and having information processing capability can be used. Applicable.

In order to make the relative positional relationship between the hologram medium, the light source, and the image sensor different, it can be realized by moving one or two of these three devices.

Further, although the means by which the information processing device obtains information defining different states is mainly described as an example of controlling the light source from the information processing device, the light source is controlled from a device other than the information processing device or the hologram reproduction device side. Even so, information and control signals related to the control may be transmitted to the information processing apparatus by wire or wirelessly.

In order to realize this, it is preferable that the hologram reproduction device has a means of communication with an external device, and the hologram reproduction device and the information processing device share information on the state in real time when the light is emitted. .. When a light source for stropo purposes in the vicinity of the image pickup element is used for reproducing the hologram as in a smartphone, the light emission information and the image pickup information can be easily shared in the portable information terminal.

Although the preferred embodiment has been described above, the preferred specific example is not limited to the above description. For example, the mobile information terminal may be a wearable type such as a wristwatch type as well as a handheld form.

Since the hologram, the light source, and the image sensor may move relative to each other, the portable information terminal may be fixed and the hologram medium side may be moved to the left or right.

The above explanation is based on the assumption that it will be operated only with the mobile information terminal on hand, but in order to definitely hold the hologram information in a predetermined positional relationship, even if a simple adapter that can fix the hologram position is attached to the mobile information terminal. good. In other words, a transparent window or hole indicating the position of the hologram is formed in the protective case of the smartphone, and if the hologram is matched there, the positional relationship between the light source, the image sensor, and the hologram is uniquely determined, so accurate decoding can be performed. can.

An example in which this is developed into a stationary read-only device and a system is configured will be described with reference to FIG. The smartphone 161 is built-in and held inside the housing 160, and is designed so that light reaches the opening 165 from the image sensor 163 and the LED light source 162 attached to the smartphone via the reflector 164. When the card 157 with the holographic barcode as shown in FIG. 15B is moved so as to pass through the guide slot 166 formed in the housing, the holographic barcode and the print ID code on the card are opened. Information can be read when approaching 165. Since the angle and position can be fixed, it is possible to read more accurately, reliably and at high speed than when reading with a smartphone on hand. Since the distance from the image sensor to the card and the brightness inside the housing are constant, the focus and gain can be fixed. Further, since the reading area is limited as compared with the case of handheld, the decoding area can be made smaller, the image processing interval can be shortened, and high-speed reading becomes possible. The light turns on when you pass the guide. It may be stopped at positions 1 and 2 and read, but it may be scanned while it is being moved and the image information may be processed. The light turns on and off at high speed at a known speed. By image analysis, the card is formed with a line & space scale 155 or a marking indicating the position where the code is attached, so that the scan position and the scan speed can be known. Although FIG. 16 shows an example in which one reflector is used, two or more reflectors may be used. When using an odd number of reflectors, it is necessary to invert the image on the application software.

If such a device is used, not only the above-mentioned form (A) but also the form (B), that is, the information terminal for reading is fixed in a certain place, and the person who owns the hologram medium is in the specific place. It is also effective when reading with.

For example, it can be applied as an attendance / leaving system that also serves as a time card. A hologram barcode is attached to the employee ID card, etc., and the read information is sent to the authentication server, and the authentication server records the time stamp information, etc. after determining whether the data is legitimate data. The recording location may be in the authentication server, another server, a terminal that is a reading device, or the like.

Similarly, as an example of the form (B), reading information of a credit card or a cash card at a store or the like, or an additional authentication system of an ATM may be used. If the present invention is applied to a financial card and authenticated with a smartphone as described above, it can be used as an additional authentication key for online shopping on the Internet. Currently, when making a credit card withdrawal in online shopping, it is often the case that the credit card number and the security code information on the back side are sent electronically. Credit card numbers and security codes can be sent electronically even if you don't have the card, so there are many crimes. Measures have been taken to embed an IC card or non-contact IC card in a credit card, but a scanner for reading is required, which is expensive and difficult to spread to general consumers. On the other hand, the present invention, in which a smartphone with a high penetration rate can be used as a scanner, has a great advantage. On the other hand, there is also a demand to reliably read a credit card with a holographic barcode to which the present invention is applied at a store or the like at high speed. In that case, if a stationary read-only device as described with reference to FIG. 16 is used, there is an advantage that even an unskilled store clerk can easily perform reading work in a short time.

As another application (A) to which the present invention is applied, an example of using it as an access key to a network camera will be described. In places such as nursery schools, kindergartens, long-term care facilities, and nursing homes, there is a high demand for installing cameras connected to the network in the facilities so that only close relatives of the users can see them. On the other hand, if a malicious person other than a close relative can access it, there is a problem from the viewpoint of privacy protection and personal information management, and there is a risk of leading to a crime. Normally, it is managed by a password so that only people who know the password can access it, but in order to make it accessible to a specific large number of people, it is necessary to inform many people of the password. Yes, it was difficult to manage. By applying the present invention and giving a card with a holographic barcode to a close relative such as a guardian, only the person who has it can access it. Holograms have the advantage of not multiplying because they cannot be copied illegally.

Although the above description has been given as a portable information terminal in which both the image sensor and the light source are built-in from the beginning, the image sensor and the image sensor even if the information terminal does not have both the image sensor and the light source built-in. It can be applied if it can be connected by wire or wirelessly and can satisfy the object and function of the present invention after defining the relative positional relationship with the light source. For example, an adapter that connects an LED light source to a tablet, a notebook PC, or the like via USB and fixes the positional relationship between the image pickup element and the LED light source can also be used.

The above-mentioned form (C), that is, the hologram medium is not premised on portability, and an example in which a medium fixed in a certain place is read by an information terminal owned by a user will be described with reference to FIG. In this case, since the holographic barcode is easy to read if it is fixed to a non-moving member, the holographic barcode 172 and the two-dimensional printing barcode 173 are fixed inside the box 174 on the slope forming the optimum reading angle. Has been done. The outer shape of the smartphone, or the mark, opening, or alignment shape for aligning the LED or camera position may be formed so that the user can easily align the smartphone 171 with a predetermined position. For major smartphones on the market, templates such as TYPE A, TYPE B, etc. may be prepared, and the template of the model may be replaced and installed prior to reading. A plurality of openings may be opened according to the specifications of the holographic barcode. For example, if the reading is successful in accordance with the first opening 15, the application software may display the sound or screen so as to match the second opening 176. In addition, the opening is a slotted hole 177, and information during sliding the smartphone over a certain distance can be used continuously or discretely.

Here, the opening means that light is optically transmitted, and if the whole is a closed type and the opening is made of colorless transparent plastic or tempered glass that is not easily scratched, dust is not required and it is mischievous. It can be made difficult to be damaged.

When the sealed type is used, the security is further improved by adding a device to make the holographic barcode information difficult to read by a method other than the application software using the present invention. For example, under normal conditions, the holographic barcode is placed at a position where the illumination angle does not match or at a position where the LED light source directly enters the image sensor due to specular reflection, making it impossible to read. .. Only when reading with a legitimate application, encrypted information is transmitted by Bluetooth, voice, etc., and only when the information can be received by the receiving device built in the box side, it moves to a position where it can be read for a certain period of time. It may have a structure. Even if it does not move mechanically, another LED light source is placed inside the box at a position where the positively reflected light enters the image pickup element, and the LED light source lights up when the inside of the box becomes brighter than the specified amount of light. As a result, it becomes unreadable, and the LED in the box may be turned off and readable by informing the box side from the smartphone side by activating the legitimate application software. The position in the box where the specularly reflected light enters the image pickup element is approximately symmetrical to the medium normal line of the holographic bar code, which is the line connecting the center of the medium of the holographic barcode and the opening of the image pickup lens. On the line or its optical extension. The optical extension line is an extension line that takes into consideration the reflected light rays even when a mirror or the like is used. The means for communicating that the software is legitimate can be realized by high-speed modulation of the LED on the smartphone side and analysis of the modulation by the light receiving element built in the box side, even if it is not Bluetooth, voice, or the like.

It is also possible to blur, replace, lack, or add noise at least in part without displaying the reading time and reading status as they are on the screen of the smartphone. By doing so, it is possible to make it difficult to decipher the algorithm when the image is being taken.

The structure may be such that the hologram itself cannot be removed without destroying it. If the peel strength of the adhesive material that the hologram recording medium comes into direct contact with is higher than the cohesive force of the hologram recording medium itself, the hologram itself will inevitably be broken even if replacement is attempted. Even in this case, if a new regular holographic barcode is set, it can be used again without replacing the entire device.

Conversely, the administrator may be able to swap several holographic barcodes. After the replacement, the authentication server can know which code is in operation by activating it by the administrator. As a result, even if the holographic barcode cannot be read due to some trouble, it is not necessary to replace the entire device, and only the holographic barcode needs to be replaced and loaded.

When applied to hotel room keys, coin lockers, etc. used by many people, the administrator activates the association between the number indicating the location of the hotel room or locker and the information of the holographic barcode or 2D barcode. If you can redo it, you can raise the security level.

It may be a system in which the user reactivates without the intervention of the administrator. For example, safety boxes and safes installed in hotel rooms, lockers for sports facilities, umbrella stands in public facilities, etc., are convenient if only you can unlock them for a certain period of use. many. At present, these are used by using a physical key or by deciding and setting a personal identification number. There was a possibility of loss, theft, and oblivion, respectively, and it was difficult to use. Since smartphones are one of the most accessible things to carry around, it would be useful to be able to use them as these temporary keys.

For this purpose, an example in which the present invention is applied as the form (C) will be described. First, when the user reads the holographic barcode from the smartphone with the dedicated application software in the unlocked state, the device obtained by the holographic barcode alone or in combination with the two-dimensional bar code printed in the vicinity. The unique ID information and the unique ID information of the smartphone are sent to the authentication server and linked. After locking, if the user reads the holographic barcode from the same smartphone again, it will be unlocked if it matches the data at the time of linking, and it will not be unlocked if it does not match. You will be able to make it work.

As an application example of this form, it is possible to enable remote activation without actually reading the target holographic barcode. That is, the unique ID of a certain smartphone is acquired, and the smartphone is given the access permission right to the unique ID determined by the combination of the holographic barcode or the information such as the two-dimensional bar code printed in the vicinity thereof. do. The owner can confirm and enter the unique ID of the smartphone, prepare dedicated application software, and preferably use a holographic barcode reader for check-in to further improve security. Is also good. For example, when a customer checks in at the front desk of a hotel, if the customer's smartphone is registered with a sealed device as shown in Fig. 17 or a simple card-shaped registration holographic barcode, the unique ID of the smartphone is read and specified. It is associated with the unique ID attached to the key of the door of the room. It can be set so that it can be unlocked by granting access rights for a limited time.

It is also possible to transfer the key to a smartphone different from the one used for registration. In other words, the holographic barcode for registration and the first smartphone are linked using the unique ID of the smartphone, and another holographic barcode and the second smartphone are linked, and these holographic barcodes are linked. It is also possible to unlock with a smartphone different from the smartphone used for registration by linking the above on the authentication server. The advantage of being able to register on a smartphone without using personal information such as names and phone numbers is great.

As another example of applying the present invention to the form (C), it becomes a system that proves that a certain smartphone was at a certain time at a position where a holographic barcode having a device-specific ID information was present. sell. For example, the holographic barcode of the present invention is installed at the entrance of a store, near a cash register, a table of a restaurant, a facility in a tourist area, a station, etc., and the user can use the holographic barcode and accompanying information. By reading, apply to systems that can obtain incentives such as store visit points, coupons, service tickets, prizes, prizes, special contents, priority admission tickets to events and facilities, handshake tickets with artists, etc. be able to. It can also be applied to so-called O2O (online-to-offline) measures that attract consumers from online such as the Internet to offline such as real stores. Commercial facilities, restaurants, tourist facilities, and users do not have to bear the usage fee, but the operating entity may bear the cost as long as the purpose such as attracting customers can be achieved for the operating entity of the place where the equipment is installed. However, a business model in which the advertiser bears part or all of the cost by showing general advertisements is also conceivable.

Similar technologies applied to such applications include those that use short-range wireless communication technology such as Bluetooth, such as iBeacon (trademark), and those that generate ultrasonic waves and receive them using the microphone of a smartphone to recognize voice. , A device that authenticates using a non-contact IC has been proposed, but a special device is required on either or both of the transmitting side and the receiving side for introduction, and a lot of initial costs are required. In addition, although some use the GPS function of a mobile phone, there is a drawback that it cannot be used in an environment where GPS reception is difficult or a checkpoint is close. A system using this holographic barcode can provide a reliable solution even when the checkpoint is near, while keeping the introduction cost low.

For example, at a car dealer, if you install a holographic barcode in the place of the feature you want to appeal in the exhibition car and have the customer read it, you can get the information about the feature on the screen or voice on the smartphone. In addition, it is possible to build a system that gives incentives. This does not hold true only with systems such as GPS, iBeacon, and voice recognition. In conjunction with such a relatively wide area check-in function, each technology may be combined. For example, when approaching a certain store, GPS, iBeacon, or the like may prompt the user to have a secure check-in function using a holographic barcode.

It can also be fused with augmented reality and Augmented Reality applications to provide highly secure information. FIG. 19 shows an example of a glasses-type see-through display. Light sources 1, 2 and a small image sensor 3 are incorporated in these glasses. When the two-dimensional print code placed near the holographic barcode or other digital watermark information recognizes the holographic barcode, the guide is automatically displayed on the see-through display. When the guide is combined with a holographic barcode or another mark indicating a positional relationship, the positional relationship between the holographic barcode and the glasses is uniquely determined, so that the light source 1 is illuminated and the image detected by the image pickup element is decoded. Then, when the light source 2 is illuminated, the second image can be decoded, and the present invention can be applied.

If the present invention is applied as a form (C) to a place where people can gather and form a line, it is possible to provide a function of obtaining information, viewing an advertisement, or enjoying a game while waiting. become able to. For example, in a place where there is a queue for admission to attractions, events, stores, restaurants, etc. in theme parks, partition poles 201 and flat belts as shown in FIG. 20A are used to organize the queues. 203 and ropes are often used. The holographic barcode 205 can also be placed on the upper surface of the belt storage housing 202 of the partition pole so as to be enlarged in FIG. 20 (b). A holographic barcode is built under the clear tempered glass for durability and is not removable. Since the individual ID information is incorporated, if the holographic barcode is activated for a limited time, various contents can be provided only during the event period without changing the holographic barcode. It is possible to use a normal 2D barcode, but using a holographic barcode proves that you are there, so it provides a special incentive for users and attracts customers. There are many merits such as being able to be used for advertising and information provision to people who gather at a specific event, customer management, etc. for the operator. By arranging different holographic barcodes on multiple guide poles and checking in at several points, it is possible to give them a game-like appearance or give them special incentives. As an example, the example of arranging the partition guide pole above the partition guide pole has been described, but it may be arranged on the flat belt of the partition, an independent guide plate, a counter stand, a wall, etc., as long as it is a place where a queue can be formed. .. When fixing to the upper surface of the guide pole or the like, a horizontal surface may be used, but it is more preferable to attach a holographic barcode of a type that can be read from below to a slightly raised inclined surface. Also, when wearing it on a flat belt or wall, it is better to attach a holographic barcode that can be read from above.

Although the description has been made on the premise of decoding a so-called barcode, which is premised on machine reading, it can also be applied to OCR or image recognition of character information that is easy for humans to read and converting it as information.

Although the medium of the holographic barcode has been described as affixed, it may be formed as a transfer foil as well as affixed to the base material with an adhesive material.

It is sectional drawing used to explain the recording medium for hologram. It is a schematic diagram for demonstrating the photosensitive process of a hologram recording medium. It is a figure explaining the whole structure of the holographic stereogram production apparatus. It is a figure explaining the optical system of the holographic stereogram production apparatus. It is a figure which shows the concept of a holographic stereogram. It is a figure which shows the conventional example of the hologram reproduction apparatus which incorporated a large number of LEDs. It is a figure which shows the conventional example of the hologram reproduction apparatus which incorporated a large number of LEDs. It is a figure which shows the reproduction image which can be seen from the front when illuminated by a large number of LEDs. It is a figure which shows the example of the hologram medium to which this invention is applied. It is a figure which shows the example of the hologram reproduction apparatus to which this invention was applied. It is a figure which shows the reading state of the holographic bar code to which this invention is applied. It is a figure which shows the reading state of the holographic bar code to which this invention is applied. It is a figure which shows the example of the hologram medium to which this invention is applied. It is a figure which shows the reconstruction from the partial image pickup data of a holographic bar code. It is a figure which shows the example of the card which attached the holographic bar code. It is a figure which shows the example of the apparatus which makes it easy to read a holographic bar code. It is a figure which shows the example of the box which built-in a holographic bar code. It is a figure which shows the example of the flowchart which displays the guide on the mobile information terminal. It is a figure which shows the example which built-in the device which reads a holographic bar code in a glasses type see-through display. It is a figure which shows the example which built-in the device which reads a holographic bar code in a partition guide pole.

3 ... Hologram recording medium 4 ... Base film 5 ... Photopolymer layer 10 ... Holographic stereogram production device 900: Medium 901: Card-shaped support 902: Hologram 903, 904: Two-dimensional printed bar code 905: Holographic bar code 910: AC inlet 911: USB connector 913: Pedestal 914: Smartphone 915: Speakers L1 to L7: LED light sources HB1, HB2, HB3: Holographic bar codes PB1a, PB1b, PB2, PB3: Two-dimensional printed bar code 955: Battery storage part 960: Bracket part 965: Switch 969: Desk 980: Light source movable pen light 981: Slide rail 982: Slide unit L1 to L7: Light source LX1, LX2: LED

Claims (4)

It is a method of performing image recognition using an information processing device having a light source, an image sensor , and a display device , and a hologram.
The light source and the image sensor are arranged at a certain distance from each other, the positions of the light source and the image sensor in the information processing device are fixed, and the relative positional relationship between the information processing device and the hologram is changed. The relative positions of the light source for reproducing the hologram image, the image pickup device, and the hologram change,
The hologram of the recording medium on which the hologram in which the converted image converted with specific information is reproduced when irradiated with the light source from a predetermined position and a predetermined angle is irradiated with the irradiation light from the light source, and the hologram is reproduced. Play the converted image at the position where
The image sensor reads a marking image displayed in a non-holographic manner on the hologram medium of the hologram, on the hologram surface of the hologram, or on a substrate in the vicinity of the hologram.
The display device displays an image including the guide mark and the marking image read by the image sensor, and after the guide mark is aligned with the marking image, the image sensor captures the reproduced converted image.
An image recognition method comprising the procedure in which the information processing apparatus analyzes the converted image captured by the image pickup device and obtains the specific information. The image recognition method further comprises
A procedure for creating at least two states in which the relative positional relationship between the light source, the image sensor, and the hologram, or the light emitting state of the light source is different, and
The image sensor captures at least two converted images reproduced at the position where the hologram was recorded in the at least two states.
The image according to claim 1, wherein the information processing apparatus includes a procedure of analyzing at least two converted images captured by the image pickup device and obtaining information before being converted into the two converted images. Recognition method. The image recognition method according to claim 1 or 2, wherein the marking image is an image in which the positional relationship between the two-dimensional bar code or the image pickup element and the hologram can be easily obtained by image processing . The image recognition method further comprises
The procedure for reading the marking image and
A procedure for estimating the position of the hologram from the information obtained from the read marking image, and
The image recognition method according to claim 3, wherein the image pickup device includes a procedure for capturing the reproduced converted image by limiting a region from the estimated information.

Images