JP2023004518A - Merchandise information provision system using augmented reality - Google Patents

Abstract

To easily and quickly provide a user with additional information and update information on posted merchandise of a merchandise sales paper medium.SOLUTION: A barcode representing a paper medium identification code is printed on a merchandise sales paper medium 1, and a marker including identification information of merchandise is printed in a merchandise information posting column of the paper medium. The paper medium identification code and attribute information of the marker are registered in association with each other in a first database 6, and the identification information of the merchandise and additional information and/or update information on the merchandise are registered in association with each other for each paper medium identification code in a second database 7. A portable terminal communicates with a management server 8. The portable terminal 10 detects the marker on the basis of the attribute information of the marker to read the identification information of the merchandise after the paper medium identification code is detected. The portable terminal displays an AR image obtained by overlapping corresponding additional information and/or update information on a photographed image of the merchandise information posting column.SELECTED DRAWING: Figure 1

Description

The present invention uses augmented reality (AR) to provide additional information and updated information about products posted on paper media such as catalogs and leaflets for the purpose of product sales to the mobile terminal of the user. It is related to the system to provide.

Information necessary for users to select products to purchase is posted on paper media for product sales such as catalogs and flyers, but there are certain restrictions on the size and number of pages of paper media for product sales. However, the number of product information listing columns defined for each product is very limited.

In this case, if the size of printed characters is reduced, the amount of information that can be published increases, but considering the readability of the paper, characters of a certain size or larger must be used. , the amount of information published on the paper should be kept to the minimum necessary.

However, depending on the user, the information on the paper alone may not be sufficient for product selection, and additional information may be required. When the information of posted products is updated, there are cases where it is desired to provide users with updated information each time, and there are cases where it is desired to provide users with additional information for sales promotion.

Therefore, in the conventional technology, a QR code (registered trademark) is attached to each product information listing column of a product sales paper medium, and the user reads the QR code with a mobile terminal and accesses the URL indicated by the QR code. There is a system that makes it possible to obtain additional information and updated information regarding products posted on product sales paper media by accessing a website (see, for example, Patent Document 1).

However, according to this system, when a user needs to obtain additional information or updated information regarding a product listed in a product sales paper medium, the user must always access the relevant website using a mobile terminal. Otherwise, it takes time and effort to acquire product information, and there is a risk that the promotion of product sales will be hindered.

Utility Model Registration No. 3175609

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a user with additional information and updated information relating to merchandise on a merchandise sales paper medium in a simple and quick manner.

In order to solve the above problems, according to the present invention, a plurality of types of product sales paper media each having a product information listing column defined for each product on a paper surface are provided, and each of the plurality of types of product sales paper media A one-dimensional or two-dimensional barcode storing a paper medium identification code is printed on the product sales paper medium. a first database in which a marker unique to a product sales paper medium is printed, and in which the paper medium identification code and the attribute information of the marker are registered in association with each other; a second database in which identification information and additional information and/or update information relating to the product are associated and registered; a management server connected to the first and second databases; and a communication network connected to the management server. and a mobile terminal connected via a mobile terminal, wherein when the management server receives the paper medium identification code from the mobile terminal, the attribute of the marker corresponding to the paper medium identification code from the first database information is extracted and transmitted to the mobile terminal, and thereafter, when the identification information of the product is received from the mobile terminal, the addition corresponding to the paper medium identification code and the identification information of the product is obtained from the second database. Information and/or update information is extracted and transmitted to the mobile terminal, and the mobile terminal includes an imaging unit that captures the product sales paper medium, an image display unit that displays the image captured by the imaging unit, and the a communication unit that performs data communication with a management server; and a first detection unit that reads the one-dimensional or two-dimensional barcode of the product sales paper medium and detects the paper medium identification code in the barcode. , wherein the communication unit transmits the paper medium identification code detected by the first detection unit to the management server, receives attribute information of the corresponding marker from the management server, and transmits the mobile terminal further comprises an attribute information storage unit for storing the attribute information of the marker received by the communication unit; and the image captured by the imaging unit based on the attribute information of the marker stored in the attribute information storage unit. and a second detection unit that detects the marker in the marker and reads the identification information of the product in the marker, and the communication unit reads the identification information of the product read by the second detection unit. to said management server and corresponding from said management server said additional information and/or or update information, and the image display unit causes the imaging unit to capture the corresponding additional information and/or update information received by the communication unit when the second detection unit detects the marker. A product information providing system using augmented reality is provided, characterized in that it displays an AR image superimposed on the image that has been displayed.

According to a preferred embodiment of the present invention, the product identification information is a product identification code, and the marker is of a type different from the figures and symbols used for printing the product information listing column of the product sales paper medium. and the product identification code adjacent to the right side of the reference mark, and the attribute information of the marker is the image data of the reference mark and the number of digits of the product identification code.

According to another preferred embodiment of the present invention, the product identification information is a product name and/or product identification code, and the marker is used for printing the product information listing column of the product sales paper medium. The product name and/or the product identification code are printed in a font different from the character font, and the attribute information of the marker is the font information of the product name or the product identification code.

According to yet another preferred embodiment of the present invention, the product identification information is a product name and/or product identification code, and the marker has a predetermined size and shape and a color different from surrounding colors. and a product name and/or product identification code printed on the recognition area, and the attribute information of the marker is the size and shape of the recognition area.

According to yet another preferred embodiment of the present invention, said merchandise sales paper medium comprises catalogs and/or flyers.

Thus, according to the present invention, after the user specifies the type of product sales medium by reading the one-dimensional or two-dimensional bar code of the product sales paper medium with a portable terminal, When the product information listing column of the product to be purchased is photographed with a mobile terminal, additional information and/or update information regarding the product registered in the second database is superimposed on the photographed image of the product information listing column on the mobile terminal. be done.

As a result, the user can easily and quickly acquire additional information and/or update information regarding the products posted on the product sales paper medium without accessing the website.

1 is a block diagram showing the configuration of a product information providing system using augmented reality according to an embodiment of the present invention; FIG. 2 is a diagram showing an example of a product sales paper medium of the system of FIG. 1; FIG. 2 is a diagram showing an example of a product sales paper medium of the system of FIG. 1; FIG. (A) is a diagram showing the structure of a first database in the system of FIG. 1, and (B) is a diagram showing the structure of a second database in the system of FIG. 2 is a diagram showing an example of a screen displayed on the display of the mobile terminal of the system of FIG. 1; FIG. It is a figure which shows the modification of a marker. It is a figure which shows the modification of a marker.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the configuration of the present invention will be described based on preferred embodiments with reference to the accompanying drawings.
FIG. 1 is a block diagram showing the configuration of a product information providing system according to an embodiment of the present invention, and FIGS. 2 and 3 are plan views showing an example of a product sales paper medium in the product information providing system of FIG. be.

1 to 3, the product information providing system using augmented reality of the present invention includes a plurality of types of product sales paper media 1 each provided with a product information listing column 2 defined for each product. It has
The multiple types of merchandise sales paper media 1 are catalogs and/or flyers in this embodiment.

A plurality of types of product sales paper media 1 each have a two-dimensional barcode 3 that stores a paper medium identification code printed on the cover, and each product information listing column 2 contains the product listed in the product information listing column 2. A unique marker 4 is printed on a product sales paper medium 1 containing identification information (in this embodiment, a product identification code) 5 .

In this case, a one-dimensional barcode can be used instead of the two-dimensional barcode 3 as the barcode for storing the paper medium identification code.

In this embodiment, the marker 4 is a reference mark consisting of a figure or symbol different from the figures and symbols used for printing the product information listing column of the product sales paper medium 1 (in the illustrated product sales paper medium 1, "# ”) and a product identification code (four-digit number in the illustrated product sales paper medium 1) 5 adjacent to the right side of the reference mark “#”.

The product information providing system of the present invention further includes a first database 6 in which the paper medium identification code and the attribute information of the marker 4 are registered in association with each other.
The attribute information of the marker 4 consists of the image data of the reference mark and the number of digits of the commodity identification code 5 in this embodiment.

FIG. 4A is a diagram showing the structure of the first database 6. As shown in FIG.
As shown in FIG. 4A, in this embodiment, the first database 6 has a plurality of records _17a . . . _17n provided for each paper medium identification code.
_{Each record 17 a} , _. 18b stores the name of the paper medium, the third field "company name" _{18c stores} the name of the issuing company of the paper medium, and the fourth field "reference mark" _18d stores the image data of the reference mark of the marker 4. is stored, the number of digits of the product identification code 5 is stored in the fifth field "number of digits" _18e , and the release date of the paper medium is stored in the sixth field "publication date" _18f .

The product information providing system of the present invention further includes a second database in which the product identification code (product identification information) 5 and additional information and/or update information on the product are associated and registered for each paper medium identification code. 7.

FIG. 4B is a diagram showing the structure of the second database 8. As shown in FIG.
As shown in FIG. 4B, the second database 8 includes a plurality of records 19 _a , _{19 b} , . _n .
_{Each record 19 a} , _{19 b} , _. The product identification code is stored in the second field "product code" _20b , the first additional information and/or update information regarding the product is stored in the third field "display 1" _20c , and the fourth field "display 2" _20d stores second additional information and/or update information about the product.

The product information providing system of the present invention further comprises a management server 8 connected to the first and second databases 6 and 7, and a mobile terminal 10 connected to the management server 8 via a communication network 9. there is

When the management server 8 receives the paper medium identification code from the mobile terminal 10, the management server 8 extracts the attribute information of the marker 4 corresponding to the paper medium identification code from the first database 6 and transmits it to the mobile terminal 10. When the product identification code (product identification information) 5 is received from the terminal 10, additional information and/or update information ( First and second additional information and/or update information) are extracted and transmitted to the mobile terminal 10 .

The mobile terminal 10 includes an imaging unit 11 that captures the product sales paper medium 1 and a display, and performs data communication between the image display unit 12 that displays the image captured by the imaging unit 11 and the management server 8. and a first detection unit 14 that reads the two-dimensional bar code 3 of the product sales paper medium 1 and detects the paper medium identification code in the two-dimensional bar code 3 .
The first detection unit 14 consists of a bar code reader.

The communication unit 11 transmits the paper medium identification code detected by the first detection unit 14 to the management server 8 and receives attribute information of the marker 4 from the management server 8 .

The mobile terminal 10 further includes an attribute information storage unit 15 that stores the attribute information of the marker 4 received by the communication unit 11, and based on the attribute information of the marker 4 stored in the attribute information storage unit 15, the imaging unit 11 and a second detection unit 16 for detecting the marker 4 in the captured image and reading the product identification code (product identification information) 5 in the marker 4 .

In the detection by the second detection unit 16, an image (position) that matches the image of the reference mark stored in the attribute information storage unit 15 is detected in the image captured by the imaging unit 11 by pattern matching image processing. In an area adjacent to the right side of the image, the character string corresponding to the number of digits of the product identification code stored in the attribute information storage unit 15 is read by OCR (optical character recognition).

The communication unit 11 transmits the product identification code (product identification information) 5 read by the second detection unit 16 to the management server 8 and receives corresponding additional information and/or update information from the management server 8 .
Furthermore, when the second detection unit 16 detects the marker 4, the image display unit 12 superimposes the corresponding additional information and/or update information received by the communication unit 11 on the image captured by the imaging unit 11. Display an image.

Next, the operation of the product information providing system of the present invention will be described.
First, when the user reads the two-dimensional barcode 3 of the product sales paper medium 1 with the mobile terminal 10, the first detection unit 14 of the mobile terminal 10 detects the paper medium identification code (exemplified in the drawing) in the two-dimensional barcode 3. In the example, “001-0001”) is detected, and the paper medium identification code “001-0001” is transmitted from the portable terminal 10 to the management server 8 .

Next, the management server 8 retrieves the attribute information of the marker 4 corresponding to the paper medium identification code " _001-0001 " from the first database 6 (record 17a; the image data of "#" in the fourth field "reference mark" 18d). , and “four digits” of the fifth field “number of digits” 18 _e ) are extracted and transmitted to the portable terminal 10 . The attribute information of the marker 4 received by the mobile terminal 10 is stored in the mobile terminal 10 .

Then, as shown in FIG. 5, for example, the user takes an image of the product information listing column 2 of interest on the paper surface of the product sales paper medium 1 with the portable terminal 10. FIG. In the situation shown in FIG. 5, two product information listing columns 2, and thus two markers 4, are photographed simultaneously.
At this time, based on the attribute information of the marker 4, the second detection unit 16 of the mobile terminal 10 detects the reference mark "#" present in each of the two product listing columns 2 and the The product identification code “0002” and the product identification code “0005” attached to the other reference mark “#” are detected, and the product identification codes “0002” and “0005” are transmitted from the mobile terminal 10 to the management server 8. be.

Furthermore, the management server 8 obtains additional information and/or update information (record 19 _n−1 ; third field “ Display 1” 20 _c and fourth field “Display 2” 20 _d ), additional information and/or update information (record 19 _n ; each information of the third field “display 1” 20 _c and fourth field “display 2” 20 _d ) is extracted and transmitted to the mobile terminal 10 .

Then, as shown in FIG. 5, on the display 22 of the mobile terminal 10, the corresponding additional information and/or update information received by the mobile terminal 10 is superimposed on the image of the product sales paper medium 1 already displayed. An AR image is displayed.

Thus, according to the present invention, the user reads the two-dimensional bar code 3 of the product sales paper medium 1 with the portable terminal 10 to specify the type of the product sales medium 1, and then reads the paper surface of the product sales paper medium 1. When the product information listing column of the product you want to purchase is photographed with the mobile terminal 10, the display 22 of the mobile terminal 10 displays an AR image in which additional information and/or update information related to the product is superimposed on the photographed image of the product information listing column. is displayed.

As a result, the user can easily and quickly obtain additional information and/or update information regarding the products posted on the product sales paper medium 1 without accessing the website.
On the other hand, if the seller wants to add information to the information posted on the product sales paper medium 1, or if the posted information is updated after the product sales paper medium 1 is distributed, the additional information and updated information will be sent to the third party. By registering it in the database 7 of No. 2, it can be provided for the convenience of the user.

Although preferred embodiments of the present invention have been described above, the configuration of the present invention is not limited to the above-described embodiments, and a person skilled in the art can make various modifications within the scope of the configuration described in the claims of the present application. It goes without saying that

For example, in the above embodiment, the product identification information is the product identification code, the marker 4 is a reference mark made of a different type of figure or symbol from the figure or symbol used for printing the product sales paper medium 1, The marker 4 can be any marker unique to the product sales paper medium 1 containing the product identification information posted in the product information listing column 2. You may have such a configuration.

According to another embodiment of the present invention, the product identification information is the product name (and/or product identification code) 23 and the marker 4' is printed on the product sales paper medium 1 as shown in FIG. Product name (and/or product identification) printed in a font (in this example, HC Soei Kaku Pop font) different from the font used for the characters (in this example, Gothic and Mincho are mixed) code) 23.
In this embodiment, the attribute information of the marker 4 is the font information of the printed product name (and/or product identification code) 23 .

According to yet another embodiment of the present invention, the product identification information is the product identification code (and/or product name) 24 and the marker 4'' has a predetermined size and shape, as shown in FIG. a recognition area (in this embodiment, a white rectangular area of a predetermined size) 25 having a color different from the surrounding color; a product identification code (and/or product name) 24 printed on the recognition area 25; consists of
In this embodiment, the attribute information of marker 4 is the size and shape of recognition area 25 .

1 Product sales paper medium 2 Product information listing column 3 Two-dimensional barcode 4, 4′, 4″ marker 5 Product identification code 6 First database 7 Second database 8 Management server 9 Communication network 10 Mobile terminal 11 Imaging unit 12 Image display unit 13 Communication unit 14 First detection unit 15 Attribute information storage unit 16 Second detection unit 17 _a to 17 _n record 18 _a to 18 _d field 19 _a to 19 _n record 20 _a to 20 _d field 21 product information image 22 Display 23 Product name 24 Product identification code 25 Recognition area

Claims (5)

Equipped with multiple types of product sales paper media, each of which has a product information listing column defined for each product,
A one-dimensional or two-dimensional barcode storing a paper medium identification code is printed on each of the plurality of types of product sales paper media, and the product information listing column of the product sales paper medium is printed with a one-dimensional or two-dimensional barcode. A unique marker is printed on the product sales paper medium containing the identification information of the posted product, and
a first database in which the paper medium identification code and the attribute information of the marker are associated and registered;
a second database in which the product identification information and additional information and/or update information related to the product are associated and registered for each of the paper medium identification codes;
a management server connected to said first and said second databases;
a mobile terminal connected to the management server via a communication network,
The management server is
When the paper medium identification code is received from the mobile terminal, the attribute information of the marker corresponding to the paper medium identification code is extracted from the first database and transmitted to the mobile terminal. extracting the additional information and/or update information corresponding to the paper medium identification code and the product identification information from the second database when the product identification information is received, and transmitting the additional information and/or update information to the portable terminal;
The mobile terminal is
an imaging unit that captures the product sales paper medium;
an image display unit that displays an image captured by the imaging unit;
a communication unit that performs data communication with the management server;
a first detection unit that reads the one-dimensional or two-dimensional barcode of the product sales paper medium and detects the paper medium identification code in the barcode;
The communication unit transmits the paper medium identification code detected by the first detection unit to the management server, receives attribute information of the corresponding marker from the management server,
The mobile terminal further
an attribute information storage unit that stores the attribute information of the marker received by the communication unit;
a second detection unit that detects the marker in the image captured by the imaging unit based on the attribute information of the marker stored in the attribute information storage unit and reads identification information of the product in the marker; , has
The communication unit transmits the identification information of the product read by the second detection unit to the management server, receives the corresponding additional information and/or update information from the management server,
The image display unit superimposes the corresponding additional information and/or update information received by the communication unit on the image captured by the imaging unit when the second detection unit detects the marker. A product information providing system using augmented reality characterized by displaying images. the product identification information is a product identification code;
the marker
a reference mark consisting of a figure or symbol of a type different from the figures and symbols used for printing the product information listing column of the product sales paper medium;
and the product identification code adjacent to the right side of the reference mark,
2. A product information providing system using augmented reality according to claim 1, wherein the attribute information of said marker is the image data of said reference mark and the number of digits of said product identification code. the product identification information is a product name and/or a product identification code;
The marker consists of the product name or the product identification code printed in a font different from the font used for printing the product information listing column of the product sales paper medium,
2. A product information providing system using augmented reality according to claim 1, wherein the attribute information of said marker is information of said font of said product name and/or said product identification code. the product identification information is a product name and/or a product identification code;
the marker
a recognition area having a predetermined size and shape and having a different color than the surrounding color;
the product name and/or the product identification code printed in the recognition area;
2. The product information providing system using augmented reality according to claim 1, wherein the attribute information of said marker is said size and said shape of said recognition area. 5. The product information providing system using augmented reality according to any one of claims 1 to 4, wherein the product sales paper medium is a catalog and/or leaflet.

Images