JP2012215989A - Augmented reality display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an augmented reality display method for displaying augmented reality on a terminal including a camera and a screen and for switching various types of content to provide the content without changing a marker.SOLUTION: A condition storage unit 32 of an AR content server 1 stores each marker added to a product package in association with plural types of content and conditions for providing each of the plural types of content. When a terminal 22 transmits a request for providing content to the AR content server 1, one of the plural types of content is selected on the basis of the providing conditions stored in the condition storage unit 32. The AR content server 1 transmits the selected content to the terminal 22. The terminal 22 superimposes the content received from the AR content server 1 on an image obtained by a camera 23 and displays the superimposed image on a display 28.

Description

  The present invention relates to an augmented reality display method for displaying augmented reality on a terminal device having a camera and a display device and accessible to a server via a network.

  In addition to barcodes used in the POS system on the outer surface of product packaging materials, two-dimensional codes such as URLs and QR codes (registered trademarks) of sites that provide product information are known. . In particular, with the spread of camera-equipped mobile phones and smartphones in recent years, the use of two-dimensional codes that can easily obtain product information and campaign access destinations simply by reading with a camera is increasing.

  Further, augmented reality (AR) is known as a technique for adding and presenting other information such as characters and images to an image (real environment) photographed by a camera (for example, Patent Document 2 and Patent Document 2). 3).

JP 2010-286860 A JP 2009-2111251 JP 2010-272085 A

  The URL described on the packaging material is not convenient because it is difficult to see small characters and it is necessary to input characters one by one from a key, a touch panel, or the like. By reading the 2D code with a camera, it is possible to easily acquire embedded information such as the access destination. However, since an operation to actually access the acquired access destination is required, it is necessary to obtain the desired information. It can be said that the procedure is still complicated. In addition, in the method of providing content by accessing a URL embedded in a two-dimensional code, the content expression method is limited to some extent.

  Further, if the augmented reality technology is used in Patent Documents 2 and 3, the terminal device can easily acquire additional information simply by printing a marker on the packaging material and photographing it with a camera. However, in order to switch the content of the additional information, a marker is prepared for each content to be displayed as described in Patent Document 2, or a marker and an identification number are combined as described in Patent Document 3. Therefore, it is necessary to make the marker part unique. In order to make the marker to be given to the packaging material of the product unique, it is necessary to change the design of the entire packaging material including the marker portion, which leads to an increase in the cost of the packaging material.

  Therefore, the present invention is an augmented reality display method for displaying augmented reality on a terminal device having a camera and a display screen, and can provide various contents by switching without changing the design of the product package. The purpose is to provide.

  The present invention relates to an augmented reality display method for displaying augmented reality on a terminal device that has a camera and a display device and is accessible to a server via a network. In the augmented reality display method according to the present invention, a server stores in advance a plurality of contents and provision conditions for each of the plurality of contents in association with each marker attached to a product package; Transmitting a product package marker photographed by the camera to the server from the device to the server, and requesting the provision of the content, and in the server, associated with the marker received from the terminal device based on the provision conditions The step of selecting one of a plurality of contents, the step of transmitting the content selected by the server from the server to the terminal device, and the content received from the server superimposed on the image photographed by the camera at the terminal device And displaying.

  According to the present invention, a plurality of contents are associated with one marker, and one provided content is selected based on the provision condition. Therefore, various contents can be displayed without changing the design of the product package. It becomes possible to provide by switching.

The figure which shows the apparatus structure for implement | achieving the augmented reality display method which concerns on this invention. The figure which shows the example of the packaging material which attached AR marker The figure explaining the specific example of the augmented reality display method which concerns on this invention Functional block diagram of the augmented reality display system according to the first embodiment The figure which shows the example of the condition table stored in the condition memory | storage part shown in FIG. Flowchart of the augmented reality display method according to the first embodiment Functional block diagram of the augmented reality display system according to the second embodiment The figure which shows the example of the condition table stored in the condition memory | storage part shown in FIG. Flowchart of augmented reality display method according to second embodiment

(Outline of the present invention)
FIG. 1 is a diagram showing a device configuration for realizing the augmented reality display method according to the present invention.

  The augmented reality display method according to the present invention is for presenting augmented reality on a display screen of a terminal device having a camera and a display device and accessible to a server via a network.

  In FIG. 1, a digital signage 7, a mobile phone 8, a smartphone 9, a notebook personal computer 10, and a tablet computer 11 as terminal devices that can be connected to the AR content server 1 via the AR content server 1 via a network. It is shown.

  The AR content server 1 includes a CPU 2, a memory 3, a storage device 4 such as a hard disk drive, and a network interface 5. The CPU 2, the memory 3, the storage device 4, and the network interface 5 are connected via a data bus 6.

  The digital signage 7 is an electronic signboard capable of variously changing display contents by communicating via a network. In addition to the camera 12 and the display 13, a communication device (not shown), a storage device, and a display control device Is provided. The mobile phone 8, the smartphone 9, the notebook personal computer 10, and the tablet computer 11 also include a camera and a display.

  FIG. 2 is a diagram illustrating an example of a packaging material provided with an AR marker.

  An AR marker 16 composed of a character string and an enclosure is printed on the package 15 in FIG. On the other hand, an AR marker 18 composed of a figure and a box is printed on the package 17 of FIG. The form, color, position, and size of the AR marker are not particularly limited, and various types can be used. In order to match the direction of the content and the direction of the image taken by the camera, the relative relationship between the camera and the AR marker It is necessary for the design to be able to uniquely identify a specific positional relationship (that is, the vertical and horizontal directions are uniquely determined). The AR marker may be printed on the package, or the one printed on the sticker may be attached to the package.

  FIG. 3 is a diagram for explaining a specific example of the augmented reality display method according to the present invention.

  As shown in FIGS. 3A to 3D, in the augmented reality display method according to the present invention, the AR marker 16 attached to the product package 15 is read using the camera of the terminal device, and the read AR The content corresponding to the marker 16 is transmitted from the AR content server to the terminal device, and the content downloaded from the AR content server is superimposed on the captured image of the camera and displayed on the display screen of the terminal device. Present augmented reality.

  In the example of FIG. 3A, the sale information is superimposed on the image of the package 15 photographed using the camera of the smartphone 9 (not shown, but disposed on the surface opposite to the display 20). It is displayed.

  In the example of FIG. 3B, the contents of the bonus or the present are superimposed on the image of the package 15 taken with the camera of the smartphone 9.

  In the example of FIG. 3C, a user holding the package 15 takes a picture of his / her face and the package 15 with the smartphone 9. The image of the image character downloaded from the AR content server is displayed on the screen of the smartphone 9 so as to overlap the captured image of the camera, and the user and the image character are photographed as if they were photographed side by side. be able to.

  In the example of FIG. 3D, the user holding the package 15 stands in front of the digital signage 7 and points the AR marker attached to the package 15 toward the camera 12. On the display 13 of the digital signage 7, product information is displayed superimposed on the image of the package 15 taken by the camera 12.

  As described above, in the augmented reality display method according to the present invention, the content corresponding to the AR marker 16 photographed by the camera is displayed together with the photographed image, but a plurality of contents are displayed for one AR marker 16. It is characterized in that it is prepared in advance and any one content is selected by the AR content server and provided to the terminal device. Hereinafter, features of the augmented reality display method according to the present invention will be described in detail.

(First embodiment)
In the first embodiment, the content to be provided from the AR server 1 to the terminal device 22 is selected depending on when the content transmission request is made from the terminal device 22 to the AR content server 1.

  FIG. 4 is a functional block diagram of the augmented reality display system according to the first embodiment, and FIG. 5 is a diagram illustrating an example of a condition table stored in the condition storage unit illustrated in FIG.

  The AR content server 1 includes a content storage unit 30, a marker identifier storage unit 31, a condition storage unit 32, a content request reception unit 33, a marker analysis unit 34, a system clock 35, a search unit 36, and content acquisition. A unit 37 and a content transmission unit 38 are provided.

  The content storage unit 30 stores a plurality of contents to be provided to the terminal device 22. The content stored in the content storage unit 30 is identified by a unique content identifier C_id.

  The marker identifier storage unit 31 stores a unique marker identifier M_id and an AR marker attached to the package in association with each other. The information of the AR marker photographed by the camera of the terminal device 22 is an image. Therefore, in order to easily identify the AR marker in the AR content server 1, this marker identifier M_id is used instead of directly handling the image information of the AR marker.

  The condition storage unit 32 stores provision conditions for contents to be provided to the terminal device 22. In the condition storage unit 32, for example, as shown in FIG. 5, a marker identifier M_id, an available period, and a plurality of content identifiers C_id are stored in association with each other. In this embodiment, the content provision period is defined by a combination of year, month, day of the week, and time. In FIG. 5, a blank represents that no condition is set.

  In FIG. 5, five content identifiers “C01A” to “C01E” are associated with the marker identifier “M01”, and a provisionable period is set for each content identifier. In the records in the first to fifth lines in FIG. 5, conditions are defined when content corresponding to the AR marker identified by the marker identifier “M01” is requested.

  In the record in the first row of FIG. 5, the date and time when the content transmission request is received is within the range of the period “2011/01/01 to 2011/03/31, Monday to Friday, 5:00:00 to 9:59”. In this case, it means that the content identified by the content identifier “C01A” is selected.

  In the record in the second row in FIG. 5, the date and time when the content transmission request is received is within the range of the period “2011/01/01 to 2011/03/31, Monday to Friday, 10: 0 to 16:59”. In this case, it means that the content identified by the content identifier “C01B” is selected.

  In the record in the third row in FIG. 5, the date and time when the content transmission request is accepted is within the period “2011/01/01 to 2011/03/31, Monday to Friday, 17: 00 to 4:59”. In this case, it means that the content identified by the content identifier “C01C” is selected.

  The record in the fourth row in FIG. 5 indicates that the content identifier “C01D” is obtained when the date and time when the content transmission request is received is within the period “2011/01/01 to 2011/03/31, Saturday / Sunday”. This means that the content identified by is selected.

  The record in the fifth line in FIG. 5 is identified by the content identifier “C01E” when the date and time when the content transmission request is received is within the period “2011/04/1 to 2011/06/30”. It means selecting content.

  In FIG. 5, two content identifiers “C02A” and “C02B” are associated with the marker identifier “M02”, and a provisionable period is set for each content identifier. The records on the 6th and 7th lines in FIG. 5 define conditions when a content corresponding to the AR marker identified by the marker identifier “M02” is requested.

  In the record on the sixth line in FIG. 5, the date and time when the content transmission request is received is within the range of “2011/04/01 to 2011/04/30, Saturday / Sunday, 12: 00 to 23:59”. This means that the content identified by the content identifier “C02A” is selected.

  The record on the seventh line in FIG. 5 means that the content identified by the content identifier “C02B” is selected as the default condition regardless of the date and time when the content transmission request is received. That is, when the condition of the sixth line is satisfied, the content identified by the content identifier “C02A” is selected, and in other cases, the content identified by the content identifier “C02B” is selected.

  Here, the case where a combination of year / month / day / day of the week / time is used as the provision condition is illustrated, but the table of FIG. 5 is merely an example, and the number and contents of the data items are arbitrary.

  Thus, the condition storage unit 32 according to the present embodiment stores one marker identifier M_id, a plurality of content identifiers C_id, and a provisionable period for each content identifier C_id in association with each other.

  Returning to FIG. 4, the content request receiving unit 33 receives the content transmission request “Req (Img)” transmitted from the terminal device 22 and selects the AR marker included in the content transmission request “Req (Img)”. The included image Img is output to the marker analysis unit 34.

  The marker analysis unit 34 analyzes the image Img output from the content request reception unit 33 and recognizes the AR marker included in the image Img. The marker analysis unit 34 refers to the marker identifier storage unit 31 and acquires the marker identifier M_id assigned to the recognized AR marker. The marker analysis unit 34 outputs the acquired marker identifier M_id to the search unit 36.

  The system clock 35 is a clock built in the AR content server 1.

  The search unit 36 acquires the marker identifier M_id from the marker analysis unit 34 and acquires the current time Tm from the system clock 35. The search unit 36 searches the table stored in the condition storage unit 32 for a record having a marker identifier equal to the acquired M_id and including the time Tm acquired in the available period, and the content identifier of the searched record Get C_id. The search unit 36 outputs the acquired content identifier C_id to the content acquisition unit 37.

  The content acquisition unit 37 acquires the content Ct identified by the content identifier C_id searched by the search unit 36 from the content storage unit 30, and outputs the acquired content Ct to the content transmission unit 38.

  The content transmission unit 38 outputs the content Ct acquired from the content storage unit 30 by the content acquisition unit 37 to the terminal device 22.

  Of the functional blocks of the AR content server 1 shown in FIG. 4, the content storage unit 30, the marker identifier storage unit 31, and the condition storage unit 32 are realized by the storage device 4 shown in FIG. The remaining content request reception unit 33, marker analysis unit 34, system clock 35, search unit 36, content acquisition unit 37, and content transmission unit 38 are expanded in the memory 3 by the CPU 2 shown in FIG. This can be realized by executing the program.

  Next, the terminal device 22 includes a camera 23, a marker detection unit 24, a content request transmission unit 25, a content reception unit 26, a display control unit 27, and a display 28.

  The camera 23 includes an imaging device and an imaging optical system, and converts an optical image formed on the light receiving surface of the imaging device by the imaging optical system into an electrical image Img.

  The marker detection unit 24 detects whether or not an AR marker is included in the image Img output from the camera 23. The AR marker recognition method is not particularly limited, and any known method can be used. When the marker detection unit 24 detects an AR marker from the image Img output from the camera 23, the marker detection unit 24 outputs the image Img to the content request transmission unit 25 and instructs transmission of the content request.

  The content request transmission unit 25 generates a content transmission request “Req (Img)” including the image Img including the AR marker in accordance with the instruction from the marker detection unit 24, and the generated content transmission request “Req (Img)” is AR. Transmit to the content server 1.

  The content receiving unit 26 receives the content Ct transmitted from the AR content server 1 in response to the content transmission request “Req (Img)” from the terminal device 22, and outputs the received content Ct to the display control unit 27. .

  The display control unit 27 generates an output image in which the content Ct transmitted from the content receiving unit 26 is superimposed on the image Img output from the camera, and causes the display 28 to display the generated output image.

  The display 28 is a liquid crystal display or an organic EL display, for example, and displays an output image on the display screen according to control by the display control unit 27.

  Of the functional blocks of the terminal device 22 shown in FIG. 4, the camera 23 and the display 28 are hardware, but the remaining marker detection unit 24, content request transmission unit 25, content reception unit 26, display The control unit 27 may be realized by hardware such as an LSI, or may be realized by a processor executing a program on a memory.

  FIG. 6 is a flowchart of the augmented reality display method according to the first embodiment.

  Hereinafter, the augmented reality display processing according to the present embodiment will be described with reference to FIGS. 4 and 6 together. Although illustration is omitted, before execution of the control flow shown in FIG. 6, the marker storage unit 30, the marker identifier storage unit 31, and the condition storage unit 32 shown in FIG. The contents are registered in association with the provision conditions.

  In step S <b> 1, the marker detection unit 24 performs a process of detecting an AR marker from the image Img captured by the camera 23. When AR is detected from the image Img captured by the camera 23, the marker detection unit 24 passes the image Img to the content request transmission unit 25 and instructs transmission of the content request.

  In step S2, the content request transmission unit 25 creates a content transmission request “Req (Img)” including the image Img received from the marker detection unit 24, and sends the created “content transmission request Req (Img)” via the network. Transmit to the AR content server 1.

  In step S <b> 3, the content request receiving unit 33 of the AR content server 1 receives “content transmission request Req (Img)”. The content request reception unit 33 passes the image Img of the AR marker included in the received “content transmission request Req (Img)” to the marker analysis unit 34.

  In step S <b> 4, the marker analysis unit 34 recognizes the AR marker included in the image Img received from the content request reception unit 33, and acquires the marker identifier M_id corresponding to the recognized AR marker from the marker identifier storage unit 31. The marker analysis unit 34 passes the acquired marker identifier M_id to the search unit 36.

  In step S5, the search unit 36 acquires the content identifier C_id of the content satisfying the condition storage unit provision condition using the marker identifier M_id received from the marker analysis unit 34 and the current time Tm acquired from the system clock 35. Pass to part 37.

  In step S <b> 6, the content acquisition unit 37 acquires content corresponding to the content identifier C_id searched by the search unit 36 from the content storage unit 30.

  In step S7, the content transmission unit 38 transmits the content Ct acquired by the content acquisition unit 37 to the terminal device 22 via the network.

  In step S <b> 8, the content receiving unit of the terminal device 22 receives the content Ct transmitted from the AR content server 1.

  In step S <b> 9, the display control unit 27 superimposes the content Ct received by the content receiving unit 26 on the image Img output from the camera 23 and causes the display 28 to display the superimposed image.

  By performing the above control processing, the content that can be provided at the time of receiving the content transmission request is selected from a plurality of contents that have been provided in advance according to the provision conditions stored in the condition storage unit 32, and the terminal The device 22 can be provided. As a result, using one type of AR marker, various augmented reality can be switched and displayed on the display screen of the terminal device 22 according to the year, month, day of the week, and time.

  In the present embodiment, the search unit 36 acquires the time Tm at which the content request is received at the time of the search, but this reception time may be performed by the content request receiving unit 33. Alternatively, the request time may be further included in the content transmission request transmitted from the terminal device 22. In this case, the content request transmission unit 25 may acquire the time from the system clock of the terminal device 22.

(Second Embodiment)
In the second embodiment, location information for specifying the location of the terminal device 22 is transmitted from the terminal device 22 to the AR content server 1, and the AR server 1 sends a terminal depending on where the content transmission request is made. The content to be provided to the device 22 is selected.

  The basic configuration of the augmented reality display system according to the present embodiment is the same as that described in the first embodiment. Therefore, hereinafter, the description will focus on the differences between the second embodiment and the first embodiment.

  FIG. 7 is a functional block diagram of the augmented reality display system according to the second embodiment, and FIG. 8 is a diagram illustrating an example of a condition table stored in the condition storage unit illustrated in FIG.

  First, the terminal device 22 according to the present embodiment is obtained by replacing the content request transmission unit 25 of the terminal device (FIG. 4) according to the first embodiment with a content request transmission unit 42 and further adding a position information acquisition unit 41. It is.

  The position information acquisition unit 41 acquires the position information Pos of the terminal device 22 and outputs the acquired position information Pos to the content request transmission unit 42. As the position information acquisition unit 41, for example, a GPS receiver can be used. Further, the location information acquisition unit 41 may accept location information of the terminal device 22 specified by the radio base station, and user input such as an address, a telephone number, and a postal code as location information. When an address, a telephone number, and a postal code are registered in advance as position information, the position information acquisition unit 41 may acquire these pieces of information from a storage device included in the terminal device 22.

  The content request transmission unit 42 acquires the content transmission request “Req (Img, Pos) including the image Img including the AR marker acquired from the marker detection unit 24 and the position information Pos of the terminal device 22 acquired from the position information acquisition unit 41. ) ”And transmits the created Req (Img, Pos) to the AR content server 1.

  Next, the AR content server 1 according to the present embodiment includes the condition storage unit 32, the content request reception unit 33, and the search unit 36 of the terminal device (FIG. 4) according to the first embodiment. The request receiving unit 44 and the search unit 45 are replaced. In the AR content server 1 according to the present embodiment, the system clock is not indispensable for searching the condition storage unit 43.

  Similarly to the first embodiment, the condition storage unit 43 stores the provision conditions of the content to be provided to the terminal device 22, but the first point is that a content provision area is defined for each content identifier. Different from the embodiment. In the condition storage unit 43, as shown in FIGS. 8A and 8B, a marker identifier M_id, an available area, and a content identifier C_id are stored in association with each other.

  In the example of FIG. 8A, the available area is defined by latitude and longitude as a condition when a content corresponding to the AR marker identified by the marker identifier “M03” is requested.

  The record in the first line of FIG. 8A is a content identifier when the position of the terminal device 22 specified by the position information is within the range of “latitudes of 35 to 36 ° and longitudes of 135 to 137 °”. This means that the content identified by “C03” is selected.

  The record on the second line in FIG. 8B indicates that the position of the terminal device 22 specified by the position information is the content identifier “when the position of the terminal device 22 is included in the“ zone of longitude 135 ° or more ”. This means that the content identified by “C04” is selected.

  On the other hand, in the example of FIG. 8B, as a condition when a content corresponding to the AR marker identified by the marker identifier “M04” is requested, an available area is defined by the name of a prefecture or city. .

  The record in the first line of FIG. 8B includes a content identifier “C05” when the position of the terminal device 22 specified by the position information is included in any of “Osaka Prefecture, Kyoto Prefecture, Hyogo Prefecture”. This means that the content identified by is selected.

  The record on the second line in FIG. 8B shows the contents when the position of the terminal device 22 specified by the position information is included in any of “Tokyo 23 Wards, Yokohama City, Nagoya City, Osaka City”. This means that the content identified by the identifier “C06” is selected.

  In the case where the available area is specified as shown in FIG. 8B, the position information acquired by the position information acquisition unit 41 is numerical data such as latitude and longitude, a postal code, and a telephone number. In this case, a conversion table for converting the acquired numerical data into a provisionable area may be further prepared.

  In addition, when a postal code or a telephone number is used as position information, an available area may be defined by a postal code or a telephone number.

  Returning to FIG. 7, the content request receiving unit 44 receives the content transmission request “Req (Img, Pos)” transmitted from the terminal device 22 and includes the AR included in the “content transmission request Req (Img)”. The image Img including the marker is output to the marker analysis unit 34, and the position information Pos is output to the search unit 45.

  The search unit 45 acquires the marker identifier M_id from the marker analysis unit 34 and acquires the position information Pos from the content request reception unit 44. The search unit 45 searches the table stored in the condition storage unit 43 for a record having the marker identifier equal to the acquired M_id and including the positional information Pos acquired in the available area, and the content identifier C_id of the searched record To get. The search unit 45 outputs the acquired content identifier C_id to the content acquisition unit 37.

  FIG. 9 is a flowchart of the augmented reality display method according to the second embodiment.

  Hereinafter, the augmented reality display processing according to the present embodiment will be described with reference to FIGS. Although not shown, before the execution of the control flow shown in FIG. 9, the content identifier 30, the marker identifier storage unit 31, and the condition storage unit 43 shown in FIG. A process of associating and registering a plurality of contents and provision conditions is performed.

  In step S <b> 11, the marker detection unit 24 performs processing for detecting an AR marker from the image Img captured by the camera 23. When AR is detected from the image Img taken by the camera 23, the marker detection unit 24 passes the image Img to the content request transmission unit 42 and instructs transmission of the content request.

  In step S <b> 12, the position information acquisition unit 41 acquires position information Pos for specifying the current location of the terminal device 22.

  In step S <b> 13, the content request transmission unit 42 creates a content transmission request “Req (Img, Pos)” including the image Img received from the marker detection unit 24 and the position information Pos acquired from the position information acquisition unit 41. The created content transmission request “Req (Img, Pos)” is transmitted to the AR content server 1 via the network.

  In step S14, the content request receiving unit 44 of the AR content server 1 receives the content transmission request “Req (Img, Pos)”. The content request reception unit 44 passes the image Img of the AR marker included in the received content transmission request “Req (Img, Pos)” to the marker analysis unit 34 and passes the position information Pos to the search unit 45.

  In step S <b> 15, the marker analysis unit 34 recognizes an AR marker included in the image Img received from the content request reception unit 44, and acquires a marker identifier M_id corresponding to the recognized AR marker from the marker identifier storage unit 31. The marker analysis unit 34 passes the acquired marker identifier M_id to the search unit 45.

  In step S <b> 16, the search unit 45 uses the marker identifier M_id received from the marker analysis unit 34 and the position information Pos received from the content request reception unit 44, and the content identifier of the content that satisfies the provision condition from the condition storage unit 43. C_id is searched, and the searched content identifier C_id is passed to the content acquisition unit 37.

  In step S <b> 17, the content acquisition unit 37 acquires content corresponding to the content identifier C_id searched by the search unit 45 from the content storage unit 30.

  In step S18, the content transmission unit 38 transmits the content Ct acquired by the content acquisition unit 37 to the terminal device 22 via the network.

  In step S <b> 19, the content receiving unit 26 of the terminal device 22 receives the content Ct transmitted from the AR content server 1.

  In step S <b> 20, the display control unit 27 superimposes the content Ct received by the content receiving unit 26 on the image Img output from the camera 23 and causes the display 28 to display the superimposed image.

  By performing the above control processing, the content that can be provided according to the current location of the terminal device 22 is selected from a plurality of contents in which the provision area is set in advance according to the provision conditions stored in the condition storage unit 43, It can be provided to the terminal device 22. As a result, it is possible to switch and display various augmented reality on the screen of the terminal device 22 according to the current location of the terminal device 22 using one AR marker.

(Other variations)
In each of the above-described embodiments, the AR marker is added to the package and the augmented reality is displayed based on the recognition of the AR marker. However, instead of the AR marker dedicated to augmented reality display, the package design The present invention can also be applied to an augmented reality expression method using a so-called natural marker that uses part or all of the above as a marker.

  In addition, by combining the above-described embodiments, it is possible to further define content provision conditions in both a provisionable period and a provisionable area. In this case, the system clock shown in FIG. 4 may be added to the AR content server 1 shown in FIG. 7, and the condition storage unit may be searched using the marker identifier, the current time, and the position information. The provision conditions stored in the condition storage unit may be a combination of the items in the tables of FIGS.

  Furthermore, in each of the above-described embodiments, an example in which one AR marker is photographed by the camera has been described. However, when two or more AR markers are photographed simultaneously, this is displayed when one AR marker is photographed. You may make it display content different from what. In this case, when two or more AR markers attached to the product package are simultaneously photographed, or when one AR marker attached to the product package and one AR marker attached to the storefront poster are photographed simultaneously, Since the augmented reality displayed on the terminal device can be changed, the expression method can be further expanded.

  The present invention can be used for a system that presents augmented reality on a terminal device that includes a camera and a display screen.

1 AR content server 15 package 16 AR marker 17 package 18 AR marker 22 terminal device 23 camera 24 marker detection unit 25 content request transmission unit 26 content reception unit 27 display control unit 28 display 30 content storage unit 31 marker identifier storage unit 32 condition storage Unit 33 content request reception unit 34 marker analysis unit 35 system clock 36 search unit 37 content acquisition unit 38 content transmission unit 41 position information acquisition unit 41 content request transmission unit 43 condition storage unit 44 content request reception unit 45 search unit

Claims (3)

An augmented reality display method for displaying augmented reality on a terminal device having a camera and a display device and accessible to a server via a network,
In the server, for each marker attached to the product package, a plurality of contents and a provision condition of each of the plurality of contents in association with each other are stored in advance.
Sending the product package marker photographed by the camera to the server from the terminal device to the server, and requesting the provision of content;
In the server, based on the provision condition, selecting one of a plurality of contents associated with the marker received from the terminal device;
Transmitting the content selected in the server from the server to the terminal device;
An augmented reality display method comprising: a step of superimposing and displaying content received from the server on an image captured by the camera in the terminal device. As the provision condition, a period that can be provided for each of the plurality of contents is defined,
2. The augmented reality according to claim 1, wherein, in the step of selecting one of the plurality of contents, the time when the provision of the content is requested from the terminal device is acquired, and the content that can be provided at the acquired time is selected. Display method. An area that can be provided for each of the plurality of contents is defined as the provision condition,
In the step of requesting provision of the content, the terminal device further acquires position information indicating the location of the own device, and transmits the acquired position information together with the photographed marker to the server,
The augmented reality display method according to claim 1, wherein in the step of selecting one of the plurality of contents, a content that can be provided to an area represented by the position information transmitted from the terminal device is selected.

Images