JP6167691B2 - AR marker and AR marker display medium - Google Patents

Description

The present invention relates to an AR marker and an AR marker display medium.

  In recent years, augmented reality systems (AR (Augmented Reality) systems) using augmented reality technology that superimposes virtual objects as if they exist in real space have come to be used. For example, when an image including an AR marker (AR marker) corresponding to the type of virtual object image to be displayed is captured in the terminal device, the captured image is displayed in correspondence with the type and position of the AR marker. Augmented reality systems that synthesize and display virtual object images are known.

  However, an augmented reality system using AR markers requires as many AR markers as there are virtual object images to be displayed. Therefore, for example, in Patent Literature 1, a plurality of types of AR markers and virtual object images are stored in association with each other in the marker posting portable terminal, and the AR marker selected by the user is stored in the marker posting portable terminal. A technique is described in which, by displaying, a virtual object image to be displayed can be selected from a plurality of types of virtual object images without carrying around a printed matter of a plurality of AR markers.

JP 2005-250950 A

  However, in order to realize the marker posting portable terminal as in Patent Document 1, initial costs and maintenance costs are required. Also in the technique described in Patent Document 1, only a single AR marker can display information (virtual object image) associated with the marker, and in order to display other information. The user has to perform a selection operation to switch the AR marker to be displayed on the marker posting portable terminal.

  An object of the present invention is to provide a plurality of different pieces of information without switching the AR marker itself.

In order to solve the above problem, the AR marker of the invention according to claim 1 is:
A AR marker to display information on the display unit by being read to the external terminal having a display unit, the first color region, the second color pattern corresponding to information to be provided is formed large the first color region of the first AR marker corresponding to the classification of information, enclosed in a second color frame, the corresponding to the first small classification information of smaller size than the AR marker 2 AR markers are arranged.

  According to the present invention, it is possible to provide different pieces of information without switching the AR marker itself.

It is a figure which shows the AR marker in this embodiment. It is a block diagram which shows the functional structure of the terminal device which recognizes AR marker. It is a figure which shows the example of a posting of AR marker display medium. It is a figure which shows the corresponding table of the AR marker and the information corresponding to each AR marker. It is a flowchart which shows the AR marker recognition process performed by the terminal device shown in FIG.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the illustrated example.

First, the AR marker 1 in the embodiment of the present invention will be described.
FIG. 1 is a diagram showing an AR marker 1. The AR marker 1 is an image for providing information to the terminal device 6 that has recognized the AR marker 1 and its user. As shown in FIG. 2, the terminal device 6 includes a CPU (Central Processing Unit) 60, a RAM (Random Access Memory) 61, a storage unit 62, a communication unit 63, a display unit (monitor) 64, an operation unit 65, an optical system ( Lens) and a digital camera 66 equipped with an imaging device. As the terminal device 6, for example, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a handy terminal, or the like is applicable.

  For example, as shown in FIG. 3, the AR marker 1 is posted on the side of a library shelf displaying books, CDs (Compact Discs), DVDs (Digital Versatile Disks), etc. Via the device 6 or directly, a large classification (for example, book, CD, DVD, etc.), medium classification (for example, magazine, book, comic book, dictionary, etc.), small classification (for example, book, CD, DVD, etc.) Information on the titles of books, etc. that are specifically displayed).

  As shown in FIG. 1, the AR marker 1 is displayed on the paper P, which is an AR marker display medium, with margin frames 1a provided vertically and horizontally. The paper P is preferably a non-glossy paper. The AR marker 1 is an image having an image area in a black square area 1b, and a white sign (a figure, a symbol, or the like) corresponding to information provided by the AR marker 1 is provided at the center of the area 1b. A pattern 1c is formed. The pattern 1c corresponds to information indicating a large classification of an object displayed on the shelf on which the AR marker 1 is posted.

  Note that “black” here means binarization with a predetermined threshold (threshold used for binarization in step S2 of the AR marker recognition process described later) after conversion to grayscale. The color that is converted to black. “White” is converted to white when binarization is performed with a predetermined threshold value (threshold value used for binarization in step S2 of the AR marker recognition process described later) after conversion to grayscale. Color.

  In addition, at the four corners in the area 1b of the AR marker 1 (first AR marker), the AR markers 2 to 5 (second AR marker) smaller than the AR marker 1 are surrounded by white frames 2a to 5a. Is arranged. As with the AR marker 1, each of the AR markers 2 to 5 is formed with patterns 2c to 5c, which are white signs corresponding to information provided by the AR marker, in the central portions of the black square regions 2b to 5b. Has been.

Each of the AR markers 2 to 5 provides information corresponding to the place where the AR marker is placed.
Specifically, the pattern 2c of the AR marker 2 arranged at the upper right is composed of characters indicating the middle classification of the objects displayed above the right shelf as viewed from the position where the AR marker 1 is posted, This corresponds to information indicating a small classification (such as a title of the displayed item) of the item displayed above the right shelf.
The pattern 3c of the AR marker 3 arranged in the lower right is composed of characters indicating the middle classification of the objects displayed below the right shelf as viewed from the position where the AR marker 1 is posted. Corresponds to information indicating a small classification (title of the displayed item, etc.).
The pattern 4c of the AR marker 4 arranged in the upper left is composed of characters indicating the middle classification of the objects displayed above the left shelf as viewed from the position where the AR marker 1 is posted. This corresponds to information indicating a small classification (such as a title of the displayed item) of the item displayed above.
The pattern 5c of the AR marker 5 arranged at the lower left is composed of characters indicating the middle classification of objects displayed below the left shelf as viewed from the position where the AR marker 1 is posted. It corresponds to information indicating a small classification (such as a title of the displayed item) of the item displayed on the lower side.

  FIG. 4 shows the AR markers 1 to 5 and a correspondence table 621 of information corresponding to each AR marker. As shown in FIG. 4, the AR marker 1 corresponds to information indicating a large classification of an object (for example, “book” here) displayed on the shelf on which the AR marker 1 is posted. Each of the AR markers 2 to 5 corresponds to information indicating a medium classification (for example, a book genre) and a small classification (for example, a book title) classified into the large classification of the AR marker 1. Note that the information corresponding to each AR marker may be a text or an image. Alternatively, it may be URL information or a command for accessing the information.

  The AR markers 1 to 5 are recognized and interpreted by the terminal device 6 by being read by the AR marker recognition process shown in FIG. 5 in the terminal device 6, and information corresponding to each AR marker is displayed. Is called. The storage unit 62 of the terminal device 6 has a correspondence table 621 shown in FIG. 4, a pattern file 622 in which the images in the areas 1 b to 5 b of the AR markers 1 to 5 are inverted and digitized, and an AR marker recognition process Is stored, and the CPU 60 activates the AR marker recognition application program 623 in response to an instruction from the operation unit 65, and cooperates with the activated program. Thus, the AR marker recognition process is executed.

Hereinafter, the AR marker recognition process will be described with reference to FIG.
First, the CPU 60 activates the digital camera 66, causes the digital camera 66 to focus on the AR marker as a subject, and acquires a captured image of the AR marker (step S1).
It should be noted that the user can adjust the positional relationship between the lens of the digital camera 66 and the AR marker 1 so that the digital camera 66 can focus on the desired AR marker among the AR markers 1 to 5 and obtain a captured image (see FIG. Adjust the distance. For example, when the AR marker 1 is desired to be recognized, the positional relationship between the lens of the digital camera 66 and the AR marker 1 is adjusted so that the entire AR marker 1 is within the imaging range and the AR marker 1 is focused. When it is desired to recognize any of the AR markers 2 to 5, the lens of the digital camera 66 and the AR marker 1 are set so that the AR marker to be recognized enters the imaging range and is focused on the AR marker to be recognized. Adjust the positional relationship.

  Next, the CPU 60 binarizes the acquired captured image (step S2). For example, the captured image is converted into a grayscale image, each pixel value of the converted image is compared with a predetermined threshold value, and the pixel value of each pixel is converted into white or black according to whether the threshold value is exceeded. . The threshold used in step S2 is preferably set according to the brightness around the digital camera 66.

Next, the CPU 60 inverts the black and white of the binarized image, and the white rectangular area surrounded by the black frame in the inverted image (that is, the black area surrounded by the white frames 1a to 5a before the inversion). The rectangular areas 1b to 5b) are recognized as AR marker areas, the pattern image in the recognized AR marker area is divided by resolution (step S3), and each divided area is digitized by the pixel value in the area. (Step S4).

Next, the CPU 60 compares the digitized data with each pattern file stored in the storage unit 62 to calculate the degree of coincidence (step S5).
When there is a pattern file with a matching degree equal to or higher than a predetermined threshold (step S6; YES), the CPU 60 recognizes that the captured AR marker is an AR marker corresponding to a pattern file with a matching degree equal to or higher than the threshold. Then, the information corresponding to the recognized AR marker is read from the correspondence table 621 stored in the storage unit 62 and displayed on the display unit 64 (step S8), and the CPU 60 performs the AR marker recognition process. finish. In the correspondence table 621, when information is associated with a recognized AR marker over a plurality of classifications, the CPU 60 is based on the information of the lowest layer classification among the plurality of associated information. The display unit 64 performs display. For example, in the correspondence table 621, when the information of the major classification to the minor classification is associated with the recognized AR marker, the display unit 64 is caused to display based on the minor classification information.
When there is no pattern file having a matching degree equal to or higher than a predetermined threshold (step S6; NO), the CPU 60 ends the AR marker recognition process.

  Here, when information corresponding to the AR marker 1 is to be displayed on the display unit 64, white frames 2a to 5a and patterns 2c to 5c of other small AR markers 2 to 5 appear in the captured image. In step S5, the degree of coincidence with the pattern file of the AR marker 1 is lowered, and the AR marker 1 is not recognized. Or the area | region of several AR marker will be recognized by step S3, and it will become impossible to process. Therefore, the size ratio between the AR marker 1 and the small AR markers 2 to 5 in the AR marker 1 is affected by the blurring of the AR markers 2 to 5 when the AR marker 1 is focused with the digital camera 66. The ratio is not given (the white frames and patterns of the markers 2 to 5 are recognized as black when binarized).

As an example, when the size of the large AR marker 1 is X1 × Y1, and the size of the small AR markers 2 to 5 is X2 × Y2, X1: X2 = 100: 1 and Y1: Y2 = 100 under the following conditions. If the ratio is 1: 1, the AR marker 1 can be correctly recognized when the AR marker 1 is focused.
(A) Number of pixels of the digital camera 66: 8 million pixels (b) Monitor resolution of the display unit 64: 960 × 640
(C) Illuminance near the AR marker: 1000 lx
(D) Focal length from the lens of the digital camera 66: 30 cm
(E) AR marker material: printed on recycled paper

  Alternatively, in the area recognized as the AR marker area in step S3 of the marker recognition process, a white rectangular area surrounded by a black frame (a black rectangular area surrounded by a white frame before inversion) May be detected as a part of the AR marker area or part of the AR marker pattern. This can prevent the AR marker 1 from being correctly recognized.

  As described above, according to the AR marker 1 in the present embodiment, the white pattern 1c corresponding to the information to be provided is formed in the black square area 1b, and further, the white pattern 1c is white in the black square area 1b. AR markers 2 to 5 that are smaller than the AR marker 1 and are surrounded by frames 2 a to 5 a are arranged.

Accordingly, only by adjusting the positional relationship between the lens of the digital camera 66 and the AR marker 1 in the terminal device 6 and recognizing the AR marker, a plurality of different pieces of information can be provided without switching the display of the AR marker itself. Is possible.

  Further, by providing a plurality of small AR markers arranged on the AR marker 1, more information can be provided from one AR marker 1.

  The AR marker 1 is formed with a pattern corresponding to information indicating the large classification, and the AR markers 2 to 5 having a smaller size than the AR marker 1 are formed with patterns corresponding to the information indicating the small classification. Therefore, one AR marker 1 can provide both information indicating the large classification and information indicating the small classification.

  Further, since the patterns of the AR markers 2 to 5 are composed of characters corresponding to the information indicating the middle classification, the user can recognize the information indicating the middle classification only by visual observation.

  In addition, the description content in the said embodiment is a suitable example of the AR marker of this invention, and is not limited to this.

  For example, in the above-described embodiment, the AR markers 2 to 5 having a size smaller than the AR marker 1 are arranged at the four corners of the AR marker 1, but the arrangement position of the small AR marker is one small AR. There is no particular limitation as long as other small AR markers do not enter the angle of view when the marker is photographed by the digital camera 66 and do not overlap the pattern of the large AR marker 1. Further, the number of small AR markers is not particularly limited.

In the above embodiment, the AR markers 2 to 5 as the second AR marker are all the same size. However, if the AR marker is smaller than the size of the AR marker 1 as the first AR marker, the AR marker The sizes 2 to 5 may be different from each other.
Moreover, in the said embodiment, although square AR marker was used, not only this but shapes, such as a star shape and a round shape, are not limited.
Further, the black part and the white part of the AR marker may be reversed.

  In the above embodiment, the AR marker 1 has been described as an image providing information on the large classification, medium classification, and small classification of objects displayed on the library shelf. However, the AR marker 1 is merely an example. The target of information to be provided is not limited to this.

  In addition, the detailed configuration and detailed operation of each apparatus constituting the image processing apparatus can be changed as appropriate without departing from the spirit of the invention.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
A second area of a size smaller than the first AR marker surrounded by a white frame in the black area of the first AR marker in which a white pattern corresponding to the information to be provided is formed in the black area. AR marker where the AR marker is placed.
<Claim 2>
The AR marker according to claim 1, wherein a plurality of the second AR markers are arranged.
<Claim 3>
The first AR marker is formed with a pattern corresponding to information indicating a large classification, and the second AR marker is formed with a pattern corresponding to information indicating a small classification. AR marker described in 1.
<Claim 4>
The AR marker according to claim 3, wherein the pattern of the second AR marker is configured by characters corresponding to information indicating middle classification.
<Claim 5>
The AR marker according to any one of claims 1 to 4, wherein the first AR marker and the second AR marker are square.
<Claim 6>
An AR marker display medium on which the AR marker according to any one of claims 1 to 5 is displayed with margin frames on the top, bottom, left, and right.

1-5 AR marker 6 terminal device 60 CPU
61 RAM
62 storage unit 621 correspondence table 622 pattern file 623 AR marker recognition application program 63 communication unit 64 display unit 65 operation unit 66 digital camera

Claims (6)

An AR marker that displays information on the display unit by being read by an external terminal including the display unit,
In the first color area, the second color is included in the first color area of the first AR marker corresponding to the large classification information in which the pattern of the second color corresponding to the information to be provided is formed in the first color area. surrounded by the frame, the first second AR AR marker marker is arranged corresponding to the small classification of information smaller than the AR marker. AR marker of claim 1 wherein the second AR marker that are arranged. The pattern of the second AR marker, the AR marker of claim 2, which is constituted by the character corresponding to information indicating the medium category. The first AR marker and the second AR marker AR marker according to any one of claims 1 to 3 is a quadrangle. The first color is a color that becomes black after binarization processing,
The AR marker according to claim 1, wherein the second color is a color that becomes white after binarization processing. AR marker display medium AR marker described is displayed a blank frame is provided vertically and horizontally to any one of claims 1 to 5.

Images