GB2598913A

GB2598913A - Augmented reality messaging

Info

Publication number: GB2598913A
Application number: GB2014670.0A
Authority: GB
Inventors: Osborne John; Edward Suzanne
Original assignee: 1616 Media Ltd
Current assignee: 1616 Media Ltd
Priority date: 2020-09-17
Filing date: 2020-09-17
Publication date: 2022-03-23
Also published as: GB202014670D0; WO2022058709A1

Abstract

Provided are methods and devices for transmitting and receiving messages enabling access to augmented reality (AR) content. A first device generates a message and tags the message with a geographic location. The message is transmitted to a second device and the first device stores media content associated with the message in an AR repository associated with the geographic location. A second device receives a message from a first device, the message being tagged with a geographic location. The second device’s current location is determined and if the second device is determined to be present at the geographic location, the second device accesses an AR repository associated with the geographic location and generates and displays an AR image combining an image captured by the second device and media content associated with the message obtained from the AR repository. The media content may be included in the transmitted/received message and the content may only be viewable in a specified time window.

Description

AUGMENTED REALITY MESSAGING

[0001] The present invention relates generally to augmented reality (AR) messaging. In particularly, certain aspects of the present disclosure relate to sending messages to enable a recipient to interact with an augmented reality repository for accessing and adding to augmented reality media content. Particular examples relate to storing content in augmented reality repositories that are keyed to a particular location or time.

BACKGROUND

[0002] Messaging, particularly the exchange of media messages containing text, images, video or audio, between electronic devices is well known. Messages may be sent, for instance to communicate information or to express emotions and sentiments. Conventionally, one user may use a first electronic device to generate and send a message to a second electronic device used by another user. Typically, the other user is able to access the message using the second electronic device from any location. Typically, that message may be a private exchange between those users or between a defined group of users.

[0003] The concept of augmented reality, in which the real world is augmented by virtual content detectable only by electronic devices, is becoming increasingly important and leading to new ways of working and experiencing the world. At the same time, the amount of data and content available is rapidly increasing, and new technologies for storing, accessing and sharing information are required.

[0004] In previous centuries information about a given person or family group, history, genealogy, and expressions of personal emotion, introspection, or events was aggregated in personal journals or the family bible as a persistent local store of information. In today's media-rich environment the personal elements of this emotional aggregate have been lost to instant messaging or other temporary forms of communication or buried so deep within the Internet and successive layers of content that they may be very difficult for their creators or their descendants to ever find again. That is, where information is exchanged through messaging, the content of that message may be ephemeral and difficult for the recipient or other people to access in future.

[0005] A new methodology of storing and sharing content while making the most of emerging technology is needed.

BRIEF SUMMARY OF THE DISCLOSURE

[0006] According to a first aspect of the present invention there is provided a method of transmitting a message by a first device enabling access to augmented reality, AR, content, the method comprising: generating a message; tagging the message with a geographic location; transmitting the message to a second device; and storing media content associated with the message in an AR repository associated with the geographic location.

[0007] The method may further comprise including the media content in the message.

[0008] The method may further comprise the tagged geographic location being a current location of the first device, a previous or stored location of the first device, or a location entered or selected by a user of the first device.

[0009] According to a second aspect of the present invention there is provided a first device for transmitting a message enabling access to augmented reality, AR, content, the device comprising: an input/output unit configured to receive a user input to generate a message and to generate or select media content; and a processor configured to tag the message with a geographic location; wherein the input/output unit is further configured to be controlled by the processor to: transmit the message to a second device; and store media content associated with the message in an AR repository associated with the geographic location.

[0010] The first device may further comprise a location unit configured to determine a location of the device and to use that location as the geographic location tagged to the message.

[0011] According to a third aspect of the present invention there is provided a system for interacting with an augmented reality, AR, repository, the system comprising: a first device according as described above; and a server comprising: an input/output unit configured to receive the media content to be stored in the AR repository from the first device; and a processor configured to store the media content in the AR repository such that the stored media content is accessible by another device that requests access to the AR repository.

[0012] According to a fourth aspect of the present invention there is provided a method of receiving a message enabling access to augmented reality, AR, content, the method comprising: receiving, by a second device, a message from a first device, the message being tagged with a geographic location; determining a current location of the second device; and determining, based on the determined current location of the second device, if the second device is present at the geographic location; wherein if the second device is present at the geographic location, the method further comprises: accessing an AR repository associated with the geographic location; and generating and displaying an AR image combining an image captured by the second device and media content associated with the message obtained from the AR repository.

[0013] The method may further comprise the media content being included in the message, the method further comprising receiving a user input to display the media content irrespective of the location of the second device.

[0014] The method may further comprise indicating the geographic location to a user of the second device; or calculating a direction from the determined current location to the tagged geographic location and providing a direction indication or instruction to the user.

[0015] The method may further comprise storing further media content in the AR repository such that the stored content is accessible by another device that accesses the AR repository.

[0016] The method may further comprise the second device being determined to be present at the geographic location if: the determined location of the second device is within a predetermined threshold distance of the geographic location; an area corresponding to the first location and an area corresponding to the determined location of the second device overlap; or a volume corresponding to the geographic location and a volume corresponding to the determined location of the second device overlap.

[0017] The method may further comprise determining a current time; determining if the current time corresponds to an allowed viewing time of content stored in the AR repository; wherein the content is not viewable if the current time does not correspond to an allowed viewing time of that content.

[0018] The method may further comprise generating and displaying an AR image comprising outputting at least one AR tag indicating to a user the presence of the AR repository.

[0019] The method may further comprise outputting an alarm or notification in response to determining that the second device is at a location where an AR repository is present.

[0020] According to a fifth aspect of the present invention there is provided a second device for receiving a message enabling access to augmented reality, AR, content, the device comprising: an input/output unit configured to receive a message from a first device, the message being tagged with a geographic location; a location unit configured to determine a current location of the second device; a camera; a processor configured to determine, based on the determined current location of the second device, if the second device is present at the geographic location, and if so to access an AR repository associated with the geographic location; and a display configured to generate and display an AR image combining an image captured by the camera and media content obtained from the AR repository.

[0021] According to a sixth aspect of the present invention there is provided a system for interacting with an augmented reality, AR, repository, the system comprising: a second device as described above; and a server comprising: an input/output unit configured to receive a request to access the AR repository from the second device and to transmit media content obtained from the AR repository to the second device.

[0022] The system may further comprise the first device as described above; wherein the server input/output unit is further configured to receive the media content to be stored in the AR repository from the first device; and wherein the server processor is further configured to store the media content in the AR repository such that the stored media content is accessible by another device that requests access to the AR repository.

[0023] It should be appreciated that this Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to be used to limit the scope of the claimed subject manner. [0024] It is an aim of certain embodiments of the invention to solve, mitigate or obviate, at least partly, at least one of the problems and/or disadvantages associated with the prior art.

Certain embodiments aim to provide at least one of the advantages described below. [0025] Another aspect of the invention provides a computer program comprising instructions arranged, when executed, to implement a method in accordance with any one of the above-described aspects. A further aspect provides machine-readable storage storing such a program.

BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different figures indicates similar or identical components or features.

[0027] Examples of the disclosure are further described hereinafter with reference to the accompanying drawings, in which: [0028] FIG.1 shows an example method of interacting with an augmented reality (AR) repository according to certain examples of the present disclosure; [0029] FIG. 2 illustrates an example device for interacting with an AR repository according to

certain examples of the present disclosure;

[0030] FIG. 3 illustrates an example system for interacting with an AR repository according to certain examples of the present disclosure; [0031] FIG.s. 4A, 4B, and 4C illustrate examples of determining, based on the location of the device, if the device is present at the location of an AR repository according to certain

examples of the present disclosure;

[0032] FIG. 5 illustrates an example method involving time limits according to certain examples of the present disclosure; [0033] FIG. 6 illustrates an example of generating and displaying an AR image according to

certain examples of the present disclosure;

[0034] FIG. 7 illustrates an example of storing content in an AR repository according to certain examples of the present disclosure; [0035] FIG. 8 illustrates an example method involving indications according to certain examples of the present disclosure; [0036] FIG.s. 9A, 9B, 9C, and 9D illustrate an example of detecting an AR repository with a hierarchical layering of locations according to certain examples of the present disclosure; [0037] FIG. 10 illustrates an example of an AR repository attached to an item according to certain examples of the present disclosure; [0038] FIG. 11 illustrates a method of transmitting a message according to an embodiment of the present invention; and [0039] FIG. 12 illustrates a method of receiving a message according to an embodiment of the present invention.

DETAILED DESCRIPTION

[0040] The following detailed description illustrates embodiments of the invention by way of example and not by way of limitation. The description clearly enables one skilled in the art to make and use the disclosure, describes several embodiments, adaptations, variations, alternatives, and use of the disclosure, including what is currently believed to be the best mode

of carrying out the disclosure.

[0041] While the following written description of the invention enables one of ordinary skill to make and use what is considered presently to be the best mode thereof, those of ordinary skill will understand and appreciate the existence of variations, combinations, and equivalents of the specific embodiment, method, and examples herein. The invention should therefore not be limited by the described embodiments, method, and examples, but by all embodiments and methods within the scope of the invention as defined by the appended claims. Further, different illustrative embodiments may provide different benefits as compared to other illustrative embodiments. The embodiment or embodiments selected are chosen and described in order to best explain the principles of the embodiments, the practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated. [0042] As used herein, an element or step recited in the singular and preceded with the word "a" or "an" should be understood as not excluding plural elements or steps, unless such exclusion is explicitly recited. Furthermore, references to "one example" of the present disclosure are not intended to be interpreted as excluding the existence of additional examples that also incorporate the recited features. "A number" should be understood as meaning one or more, while "some number" should be understood as meaning zero or more unless such exclusion is explicitly recited.

[0043] Certain examples of the present disclosure relate to techniques for generating, transmitting and receiving messages that enable access to an augmented reality (AR) repository so that a recipient of the message, when at a geographic location associated with the message (or tagged to the message), can access media content stored in the AR repository to generate an AR image. First, however, techniques for locating, interacting with, and updating an AR repository, which may take place subsequent to receiving such a message, will be described.

[0044] FIG.1 shows an example method of interacting with an AR repository according to certain examples of the present disclosure. In step 101 a first device 200 detects an AR repository that is present at a first geographic location. The first device 200 may previously have received a message that may have caused the user of the first device 200 to travel to the first location, as will be described later in the present description. For instance, the message may include the first location or instructions or directions on how to find the first location. The message may include the media content stored in AR repository, or the media content may only be available to the user when they have travelled to the first location. The AR repository is a repository for data that is linked or keyed to a certain location in the real world, meaning that the AR repository may be found at that location by AR capable devices. In step 102 a location of a first device 200 is determined. That is, the location of the first device 200 in the real world may be detected and determined. In step 103 it is determined, based on the determined location of the first device 200, if the first device 200 is present at the first location. That is, the real-world location of the first device 200 may be compared with the real-world location to which the AR repository is linked to determine if the first device 200 is present at the location of the AR repository. If the first device 200 is determined not to be present at the first location, the method returns to step 102 and continues to detect the location of the device 200. If the first device 200 is determined to be present at the first location, the method proceeds to step 104 which comprises accessing the AR repository, and then proceeds to step 105 which comprises generating and displaying an AR image combining an image captured by the first device 200 and image data or other media content obtained from the AR repository. In step 106, optionally content is stored in the AR repository. The stored content may be accessible by a second device 200 that connects to the AR repository. That is, the first device 200 updates the AR repository by adding to the stored media for a given geographic location.

Optionally, the first device may be able to edit media content already stored in the AR repository. That is, the content may be stored in the AR repository so that it can be interacted with by devices that subsequently connect to the AR repository. In some examples, these subsequent devices may also store content in the AR repository, such that the content of the AR repository may grow with each successive visit and visitor.

[0045] In some examples, if the first device 200 is determined not to be present at the first location, the method may return to step 101 instead of step 102 and may attempt to detect an AR repository. Detecting an AR repository may thus comprise awaiting receipt of a future message indicating that an AR repository including media content is available to the first device at a geographic location. In some examples, if the first device 200 is repeatedly determined not to be present at the first location, the method may return to step 102 a predetermined number of times, or for a predetermined time period, and once the predetermined number of times or predetermined time period has been exceeded, the method may instead return to step 101, or may end.

[0046] FIG. 2 illustrates an example device 200 for interacting with an AR repository according to certain examples of the present disclosure. The device 200 may be any mobile computing device, for example a mobile phone, tablet, laptop, smart watch, smart glasses or any other suitable wearable and/or mobile computing device. The device 200 may comprise at least one processor 210 and at least one location unit 220. The location unit 220 may be configured to detect a location of the device 200. The location unit 220 may comprise any suitable sensor, sensors or system for determining a location of the device 200, for example a geomagnetic sensor, a navigation satellite system receiver (e.g. GPS receiver), Wi-H positioning system (WPS), GSM localization, indoor positioning system (IPS), or any other suitable sensors, systems or techniques for determining a location of the device 200. The processor 210 may be configured to detect an augmented reality (AR) repository that is present at a first location. The processor 210 may be further configured to access and store content in the AR repository when the location unit 220 determines that the device 200 is present at the first location. That is, the processor 210 may be further configured to, when the location unit 220 determines that the device 200 is present at the first location, access the AR repository and store content in the AR repository. The stored content may be accessible by another device that accesses the AR repository. The device may further comprise a camera 230, and a display 240. The display may comprise one or more display screens and/or touch screens and may be configured to generate an AR image combining an image captured by the camera 230 and image data obtained from the AR repository. The device 200 and its components may further be configured to implement any of the described examples of the disclosure.

[0047] The device 200 may further comprise at least one memory 250, at least one input/output unit 260, and at least one communication unit 270. The memory 250 may be configured to store data in order to enable any of the described examples of the disclosure.

The input/output unit 260 may comprise any combination of input units and output units. Input units may be any suitable sensors for receiving input, such as touch sensors, buttons, switches, motion sensors, image sensors, audio sensors, pressure sensors, or any other suitable input sensors. The input unit/s may be configured to receive user inputs in order to enable any of the described examples of the disclosure. Output units may be any suitable systems for providing output to a user, such as display screens, speakers, hapfic units, LEDs, or any other suitable output systems. The output unit/s may be configured to provide information or feedback to the user in order to enable any of the described examples of the disclosure. The communication unit 270 may comprise any combination of communication systems suitable for communicating with other devices, servers, and networks. The communication unit 270 may be configured to send and/or receive data to enable any of the described examples of the disclosure.

[0048] In some examples, the content to be stored in the AR repository may be entered via the same device utilized to detect and/or access the AR repository. In another example, a first device such as a wearable device (e.g. smart glasses or a watch), may be suitable for detecting the AR repository but may not be equipped with sound recording, video recording, or text entry capabilities. In this case entry to the repository may be made via a second device such as a mobile device which does have one or more of these capabilities. In some examples, the first device may have the necessary capabilities but the user may find it more convenient to use the second device. The skilled person will appreciate that in any of the examples described below, actions may be performed on a single device or split across multiple device 200s according to the capabilities of the devices and the user's requirements. That is, references to the device 200 below may refer to a first device and/or a second device.

[0049] One feature that differentiates the AR repository from previously known augmented reality techniques is this additional capability to add content, such as comments, media, thoughts, and experiences, to the repository. While user created content is also a feature in most social media applications, the necessity to update while at or near the repository in space adds an immediacy to the experience and the commentary.

[0050] FIG. 3 illustrates an example system for interacting with an AR repository according to certain examples of the present disclosure. The system may comprise the device 200 of FIG. 2 and a server 300. The server may comprise a processor 310 and a communication unit 370. The device 200 and server 300 may be connected by a communication network 301. For example, the device 200 and server may be connected to the internet, or any other suitable communication network. In some examples, the server may provide an AR hosting service and the device 200 may transmit and receive AR data to and from the AR hosting service. AR data may comprise locations of AR repositories, content stored in AR repositories, or any other characteristics of or data concerning AR repositories. In some examples, the device 200 may download AR data from the AR hosting service on a real-time basis as necessary. For example, accessing the AR repository may comprise requesting content that has previously been stored in the AR repository from the AR hosting service, and storing content in the AR repository may comprise transmitting the content to the AR repository. In some examples, some AR data may be stored in a memory 230 of the device 200 and some AR data may be downloaded as necessary from an AR hosting service. For example, the locations of AR repositories within a certain area frequented by the device 200 may be stored in a memory 230, while the contents of these AR repositories and the locations of more distant AR repositories may be downloaded from an AR hosting service as necessary. In some examples, a constant connection with the AR hosting service may not be required. For example, the device 200 may synchronise locally stored AR data with the AR hosting service at periodic intervals or only when connected to the internet via W-Fi. The device 200 may thus be able to detect, access, and store content in AR repositories even when a connection to the AR hosting service is unavailable. In some examples, the device 200 may determine its location, detect an AR repository at a first location and transmit a request to access the AR repository and store content in the AR repository to the AR hosting service. The server may receive the request to access the AR repository and store content in the AR repository and may access the AR repository and store content in the AR repository. In some examples, accessing the AR repository may comprise transmitting content previously stored in the AR repository to the device 200. In some examples, storing the content in the AR repository may comprise transmitting a request for content to be stored to the device 200 and receiving the content to be stored from the device 200.

[0051] It will be appreciated that a server is not necessary to carry out the disclosure. For example, in some examples, the AR data such as the locations of AR repositories and their contents may be entirely stored in a memory 230 of the device 200. In some examples, AR data may be synchronised with other devices by direct or peer-to-peer connection to the other devices. For example, devices may connect via Bluetooth in order to transmit and receive AR data from each other.

[0052] In some examples, there may be a predetermined distance threshold which must be met in order for the device 200 to be determined as present at the location of the AR repository (the first location). That is, the device 200 may be determined to be present at the location of the AR repository if the determined location of the first device 200 is within a predetermined threshold distance of the location of the AR repository. For example, the device 200 may be determined as present at the location of the AR repository if the distance between the location of the AR repository and the determined location of the device 200 is less than 10 metres. It will be appreciated that this is just an example, and any distance threshold may be used. The distance threshold may be the same for all AR repositories or may be individually set for certain AR repositories by creators or administrators of those AR repositories.

[0053] It will be appreciated that the first location and determined location may comprise areas or volumes. The areas or volumes may be defined, based upon, or limited by the accuracy of location detection. For example, the determined location of the device 200 may be a circular area or volume of 5 metres diameter, representing a determination that the device 200 is most likely located somewhere inside that area or volume. In some examples, the device 200 may be determined to be present at the first location if there is any overlap between the areas or volumes of the AR repository location and the areas or volumes of the device location. In some examples, the device 200 may be determined to be present at the first location if the overlapping area or volume between the areas or volumes of the AR repository location and the device location exceed a certain threshold area or volume, respectively. That is, the device 200 may be determined to be present at the location of the AR repository if the overlap between an area corresponding to the location of the AR repository and an area corresponding to the determined location of the device 200 exceeds a threshold area, or if the overlap between a volume corresponding to the location of the AR repository and a volume corresponding to the determined location of the device 200 exceeds a threshold volume. [0054] FIG.s. 4A, 4B, and 4C illustrate examples of determining, based on the location of the device 200, if the device 200 is present at the location of an AR repository according to certain

examples of the present disclosure.

[0055] FIG. 4A shows an AR repository and a device 200. The AR repository is located at first location 410. First location 410 may be a set of coordinates, for example. The location of device 200 is determined as an area 420. The size of area 420 may be determined by the accuracy of the location determination method or technology. In the example of FIG. 4A, the device 200 is determined to be present at the first location 410 if the first location 410 is within the area 420.

[0056] In FIG. 4B, the first location 410 (location of the AR repository) is an area of predetermined size. The location of device 200 is determined as an area 420. In the example of FIG. 4B, the device 200 is determined to be present at the first location 410 if there is any overlapping area between the area of first location 410 and the area 420.

[0057] In FIG. 40, the first location 410 (location of the AR repository) is an area of predetermined size. A predetermined threshold distance creates an area 415 around the first location 410. The location of device 200 is determined as an area 420. In the example of FIG. 4C, the device 200 is determined to be present at the first location 410 if there is any overlapping area between the area 420 and the area 415 of threshold distance or the area of first location 410.

[0058] Although FIG.s. 4A, 4B, and 40 illustrate 2D areas, it will be appreciated that the illustrated areas may represent 3D volumes in some examples.

[0059] In some examples, accessing the AR repository may further comprise interacting with content that has previously been stored in the AR repository. The content may have been stored by a creator or administrator of the AR repository or may have been stored by devices that have previously encountered the AR repository. Interacting with the stored content may comprise selecting the content, viewing the content, downloading the content, editing the content, sharing the content, reviewing the content, following links in the content, or any other way of interacting with the stored content. In some examples, accessing the AR repository may further comprise the user of the device 200 manually selecting the AR repository once the AR image has been displayed. In some examples, the AR repository may be automatically selected when it is determined that the device 200 is present at the location of the AR repository.

[0060] In some examples, viewing the content stored in the AR repository may further comprise filtering the stored content. For example, the stored content might be filtered by subject, mood, occasion, time period, or any other suitable filter. For example, the stored content might be filtered so that only content from or related to the second world war is displayed, or be filtered so that only content from the last month, year, or decade etc. is displayed. As another example, the content may be filtered so that only 'happy' content is displayed, or so that only content relating to weddings is displayed. The filtering may be performed on the basis of content metadata, including metatags manually added by users that store or interact with the content or automatically added by tools and/or algorithms such as latent semantic analysis. Some content is implicitly tagged via its title or content. These metatags can be derived via simple word recognition or algorithms such as, but not limited to, latent semantic analysis or Deep Learning big data neural network derivation tools. In another example humans may be utilized to review content and add metatags. In another example autonomous "spiders" might constantly crawl content stored in AR repositories to add metatags.

[0061] In some examples, the stored content may be multimedia content and may comprise, for example, one or more of text, comments, thoughts, forms, buttons, images, video, audio, games, or any other content. The content may instead or additionally comprise one or more virtual or directional links to other web sites, locations, phone numbers, social media accounts, persons, coupons, clues, riddles, game play instructions, help groups, social workers, or welfare organizations. The content may be created at the time of visiting the AR repository, or may be previously created content.

[0062] In some examples, there may be time limits for detecting the AR repository, accessing the AR repository and/or storing content in the AR repository. The time limits may comprise allowed times for detecting, accessing, and/or storing content in the AR repository. That is, at least one of detecting the AR repository, accessing the AR repository, and storing content in the AR repository may only be performed at certain allowed times. For example, the AR repository may only be detectable or accessible or content may only be storable at certain times of the day, certain days of the week/month/year, certain religious or state holidays, or any other suitable limitations. At other times, it may not be possible to detect, access or store content in the AR repository, for example the AR repository may be closed for detection, access or storage outside of the time limits. When closed for storage, it may still be possible to detect the AR repository and/or access the AR repository to interact with stored content. In other examples, it may not be possible to detect and/or access the AR repository outside of the time limits. In some examples, the time limit may not be a repeating time period. For example, after a day, week, month, year (or any other time period) of being open for storing content the AR repository may be closed to new content, meaning that no new content may be stored in the AR repository after the expiration of the time limit. In some examples a creator or administrator of the AR repository may manually set time limits and choose when to open and close the repository for detection, access and/or storing content by other users. In some examples, the time limit may be a time period in the future. For example, the AR repository may be set to only be detectable, accessible or open to content storage on the coming New Year's Eve, or at the turn of the century, or any other point or period of time in the future.

[0063] FIG. 5 illustrates an example method involving time limits according to certain examples of the present disclosure. In the example of FIG. 5, there is a time limit for storing content in the AR repository. Steps 501-505 are identical to respective steps 101-105 of FIG. 1. In step 506 a current time is determined. For example, the device 200 may determine the current time using a hardware or software clock which may be part of the device 200 or may be part of a device 200 or server with which the device 200 communicates. In step 507, it is determined whether content may be stored in the AR repository at the current time. For example, it may be determined if the current time corresponds to an allowed storage time of the AR repository (i.e. a time at which storing content is allowed). If content may be stored in the AR repository at the current time, the method proceeds to step 508 and content is stored in the AR repository. If content may not be stored in the AR repository at the current time, the method ends.

[0064] In some examples, there may be no time limits for detection, access, and/or storage.

The AR repository may be persistently open for detection, access, and/or storing content.

[0065] In some examples, time limits as described above may apply to some or all of the content stored in the AR repository instead of, or as well as, applying to the AR repository itself. That is, even at times when the AR repository is detectable and accessible, some of the stored content may not be viewable outside of a specific time limit or period applying to that content. In some examples content time limits may be set by the creator or administrator of the AR repository. In some examples, the user that stores content in the AR repository may set a time limit for that content to be viewable. For example, the content may be set to only be viewable at certain times of the day, certain days of the week/month/year, certain religious or state holidays, or any other suitable limitations. In some examples, the time limit may be a time period in the future. For example, the content may be set to only be viewable on the coming New Year's Eve, or at the turn of the century, or any other point or period of time in the future. In some examples time limits when content is accessible, or a date! time when it is accessible, may be communicated to the first device within the message which first alerts the first device to an available AR repository.

[0066] In some examples, generating the AR image comprises outputting one or more tags for the AR repository. The AR repository itself may be tagged with a discoverable media structure which may or may not be representational of the AR repository information or intent, and may be of a structure known only to those who are allowed to access it or may be available for anyone to encounter. That is, the tag may comprise one or more outputs for indicating to a user the presence of the AR repository. In some examples a tag may inform the user of other information about the AR repository. In some examples the tags might be 2D or 3D text, ghost writing, icons, images, renderings, avatars (human analogues or cartoon images), video clips and/or animations such as, but not limited to, books, statues, greeting cards, awards, ribbons, or medals. In some examples the tag might be an actual image of the person that created or is the administrator or subject of the AR repository, or a cartoon version of that person or a 3D rendered virtual reality construct. In some examples the tags may instead or additionally comprise audio or hapfic outputs.

[0067] FIG. 6 illustrates an example of generating and displaying an AR image according to certain examples of the present disclosure. In FIG. 6, a real scene 601, here shown as a cemetery, is viewed with an augmented reality capable mobile device 200. For example, the scene 601 is imaged by a camera of the device 200 and an AR image 602 of the scene 601 is displayed on a display screen of the device 200. Tags, such as text and/or icons 603, 604, 605 are mapped onto the image of the scene 601 in the AR image 502. That is, each tag 603, 604, 605 in the example of FIG. 6 comprises a visual output in the form of text and/or an icon on the display. In the example of FIG. 6 the information of one headstone 606 is visible as a tag 603 comprising text "John Adams 1826" indicating that an AR repository exists for this subject at this location, and one might deduce from that tag that the information is of interest to everyone. In one example the AR repository is open to anyone wishing to share media, thoughts, or comments regarding John Adams. In another example a tag 604 comprising an icon of a book and the text "Harris Family" would again indicate that an AR repository exists at this location, but the title would give the connotation that the information might be available to anyone but may not be of interest to everyone. In another example a tag 605 comprising a 3D rendered animation of a ghost floats above the scene with the text "Spooky Stories", indicating that an AR repository containing spooky stories exists at this location. Although the example visual tags 603, 604, 605 of FIG. 6 all include text, it is to be understood that visual tags may not include text in some examples. An icon in itself may be sufficient, or additional text, audio or other media may be included in any combination.

[0068] FIG. 7 illustrates storing content in an AR repository according to certain examples of the present disclosure. In FIG. 7, the user has selected the AR repository represented by tag 604 in FIG 6. A screen 701 is displayed on the display of the mobile device 200. The screen 701 comprises the tag 604, and content stored by a creator or administrator of the AR repository, the content comprising text 702 including link 703, a text entry box 704, an attachment button 705, and a post button 706. The text 702 informs the user that they are viewing the Harris Family Bible and requests that they post content or view content stored by other users. The user may select the link 703 to view the content stored by other users. The user may use the text entry box 704 to enter text and may store the text in the AR repository by selecting the post button 706. Selecting the attach button 705 may allow the user to create or select additional content to be stored in the AR repository. For example, the user may select photos from a memory 230 of the device 200 to store in the AR repository.

[0069] In some examples, a tag is located at the location of the AR repository. In some examples, one or more tags are located in other locations. In some examples, detecting and outputting the tags may comprise outputting indications that provide information to the user identifying the location of the AR repository. For example, the indications may comprise outputs which may lead the user towards a given location, such as the location of the AR repository, or the location of further tags or indications to lead the user to the location of the AR repository. The indications may comprise visual, audio, haptic, or any other outputs suitable for providing information for identifying a location. Output of indications may be triggered by the current location of the user. For example, the location of the repository may be detectable from a greater distance than direct viewing with augmented reality might afford by producing audio indications in stereo with the direction of the tag discernible by human hearing processes and/or the volume, pitch, or other audio characteristics may be varied as the orientation or location of the device 200 changes in order to guide a user of the device 200 to the location. In some examples, audio indications may be spoken directions. In other examples, the tags may be detectable by a haptic indication or response such as, but not limited to, vibration of a mobile device 200 when pointed in, or when detecting movement of the device 200 in, the direction of the repository. In some examples, tags or indications to lead the user to a location may be visual text directions or animated icons or arrows, or interactive elements such as riddles, games, or game play results. For example, a user might have to solve a riddle or complete a challenge in a game in order to reveal directions to the location. Each tag or indication may only reveal itself when the user is within a given radius of the location of the tag or indication, for example when the device 200 is determined to be present at the location of the tag or indication. In some examples, an AR repository may have no visible tags or indications, and all tags or indications for that AR repository may be audio or haptic tags or indications. Audio and/or haptic tags, or tags detectable by audio or haptic indications may allow devices without display screens or cameras to detect the AR repository, or may allow devices to detect the AR repository without the user activating or using displays or cameras of a device 200.

[0070] FIG. 8 illustrates an example method involving indications according to certain examples of the present disclosure. In step 801, a tag is detected and an indication is output to a user of the device 200. Particularly, this process may comprise the device 200 receiving a message that indicates the availability of an AR repository and optionally also the tag information to indicate the location or direct the user to the location, through which the user of the first device 200 is able to access media content to generate an AR image when at that location. Based on the indication, the user of the device 200 may change their location with the aim of finding the location of the AR repository. Steps 802-806 are identical to respective steps 102-106 of FIG. 1, with the exception that if the device 200 is determined not to be present at the location of the AR repository, the method proceeds to step 807. In step 807 it is determined if a new tag or indication is detected at the current location. If a new tag or indication is detected, the method proceeds to step 808 where the new tag or indication is output and the method then returns to step 802. If a new tag or indication is not detected at step 807, the method returns to step 802.

[0071] In some examples, a tag may 'open' and reveal contents when the user is within a predetermined range of the tag. For example a visual tag for an AR repository at a restaurant may be displayed in the form of a closed menu book and may be displayed as opening to reveal the menu when the user approaches the location of the tag.

[0072] In some examples, a device 200 may output an alarm or notification whenever it is determined that the first device is at a first location where and AR repository is present. In some examples, a device 200 may output a notification or alarm whenever a tag or indication is detected. The alarm or notification may be a visual, audio, haptic, or any other type of output suitable for informing the user. The notification or alarm may be the same output for all detected tags or indications. In some examples, user preferences set in a device 200 may request an alarm or notification under certain circumstances such as, but not limited to, particular restaurants, general or specific subjects, particular areas of study, particular historical periods, or particular persons or types of person in order to alert the user when passing near such corresponding repositories. In some examples, the user may request different notifications or alarms for different circumstances.

[0073] In some examples, a tag may be modified by a creator or administrator of the AR repository, or may be automatically updated. In some examples, the tag may be automatically updated based on content stored in the AR repository. For example, the tag may comprise a preview, selection or the entirety of the most recent content stored in the AR repository. In another example, a tag for a restaurant, hotel, or other business may display an average user review score that is updated automatically as user reviews are stored in the AR repository or may be updated automatically using data from a reviewing website. In another example, the staff of a bakery or other food supplier may manually update a tag to indicate that the hot or freshly prepared food products are currently available. In some examples, user preferences set in a device 200 may request an audio, haptic, or visual alarm or notification under certain circumstances, such as, but not limited to, passing location of a restaurant with a high user rating or passing within walking distance of a Krispy Kreme® doughnut shop with the 'Hot Now' light on.

[0074] In some examples, tags that are detected by a device 200 may be stored within a memory 230 of the device 200 for perusal at a later time. As with the alarms, the user may set preferences for certain types of detected tags to be stored, for example a user may set a preference for the device 200 to only store detected tags relating to particular restaurants, general or specific subjects, particular areas of study, particular historical periods, or particular persons or types of person.

[0075] In some examples, devices that detect, access, and/or store content in an AR repository may be provided with a link that enables subsequent virtual access and/or storage to the AR repository from any location. That is, in some examples, it may be possible to store a link to the AR repository once it is encountered in order to continue to access add to it remotely and at later times. For example, without limitation, visiting the grave of an ancestor might be a once-in-a-lifetime event but the visit to the AR repository at the grave may provide a link which can then be used to access the AR repository for the rest of the user's life, and may also provide other linkages through the AR repository to additional content, users, ancestry web sites, social media pages, etc. to enhance the media content and social interactivity via the AR repository. In some examples, the stored link may be shared with other devices. In other examples, the stored link may be restricted to the device that encountered the AR repository.

[0076] In some examples, detecting, accessing, and/or storing content in an AR repository may be performed by any device or user. In some examples, the ability to detect, access and/or review and/or leave additional media in the repository is restricted to devices or users having access credentials, for example some form of permissions, password, encryption, and/or security. In some examples, at least one of detecting the AR repository, accessing the AR repository, and storing content in the AR repository requires validation of access credentials. For example, a family history AR repository located in a family home may be detectable and accessible by any device or user, but the ability to store content may be restricted by a password known only to family members, or may be restricted to devices that have access to the home's wireless network for example. In another example, AR repositories of a business may only be detectable by subscribers who have been authenticated as buyers of products or services from the business, or in another example AR repositories at a museum might be detectable by everyone but only users who have made a donation and received a password might be able to access and/or store content in the AR repositories. In another example, an AR repository might only be detectable and/or accessible by social media contacts of a particular user, for example a creator or administrator of the AR repository. In another example, an AR repository might only be detectable and/or accessible by users or devices on a view list set by a creator or administrator of the AR repository. For example, the creator or administrator of an AR repository may set a view list comprising devices or users that may detect and/or access the AR repository. Access credentials may be individual to each AR repository or may apply to multiple AR repositories. Access credentials may need to be validated each time a device 200 attempts to access or store content in each applicable AR repository, or once validated, may allow detection of, access to, or content storage in all applicable AR repositories. The necessary access credentials may be set by a creator or administrator of the AR repository.

[0077] An AR repository may be located in three dimensions, or may be denoted as four-dimensional, since a 3D coordinate system denoting geo-location may be utilized with time as the fourth dimension. As will be later described, the location (and optionally time) of an AR repository, or information enabling this to be found, may be communicated to the first device through a message. In some examples more or fewer coordinates may be used to denote location, for example the location may be 2D on a planar map, ignoring vertical height. In some examples, the location may link multiple coordinate systems together such as, but not limited to, some number of coordinates denoting a building, and then additional coordinates of location within the building, or a hierarchical layering of coordinates of increasing or decreasing accuracy. In some examples, the location of the AR repository may comprise a hierarchical layering of locations, and detecting the AR repository at the first location may comprise detecting the AR repository at each layer in the hierarchy.

[0078] FIG.s. 9A, 9B, 9C, and 9D illustrate an example of detecting an AR repository with a hierarchical layering of locations according to certain examples of the present disclosure. In FIG.s. 9A-9D the device 200 is depicted as a wearable device on the user's wrist 900 that outputs speech, but it will be appreciated that this is merely an example and any type of device 200 and tags or indications may be used. In FIG. 9A the device 200 detects an AR repository is present in the same area as the device 200. For example, the device 200 may detect that the AR repository is present in the same cell as the device 200 in a cellular network. The device 200 outputs audio 901 to inform the user that they should seek to find the building in which the AR repository is present.

[0079] In FIG. 9B the device 200 detects that the AR repository is present in the same building as the device 200. For example, the device 200 may detect that the AR repository is present at the same GPS coordinate as the device 200. The device 200 outputs audio 902 to inform the user that they should seek to find the floor of the building on which the AR repository is present.

[0080] In FIG. 90 the device 200 detects that the AR repository is present on the same floor of the building as the device 200. For example, the device 200 may detect that the AR repository is present at the same altitude as the device 200. The device 200 outputs audio 903 to inform the user that they should seek to find the room of the building in which the AR repository is present.

[0081] In FIG. 9D the device 200 detects that the AR repository is present in the same room as the device 200. For example, the device 200 may utilize a W-Fi positioning system to determine that it is in the same room as the AR repository. The device 200 outputs audio 904 to inform the user that the AR repository has been located and asks the user if they wish to access the AR repository.

[0082] In some examples, the location of the repository moves with an item to which it is attached, for example an object, device, person, creature, place, or any other thing, as long as the location of the item can be reported to an AR hosting service. That is, the location of the AR repository may be the location of an item. For example, the item may comprise a wireless transmitter for transmitting the current location of the item to the AR hosting service or another device or server that may communicate the location to the AR hosting service.

[0083] FIG. 10 illustrates an example of an AR repository attached to an item according to certain examples of the present disclosure. In the example of FIG. 10, the AR repository is attached to a cat 1001 by means of a collar 1002 with a wireless transmitter that reports the location of the collar 1002 to an AR hosting service. The cat 1001 may be imaged with a camera of the electronic device 200 and an AR image 1003 may be displayed on a display of the device 200. In the example of FIG. 10 the AR image 1003 comprises the image of the cat 1001 and the tag 1004 for the AR repository. The tag 1004 is displayed on a display of the device 200 when the device 200 accesses the AR repository. The tag 1004 is a speech bubble containing text providing details of the cat 1001 and a request to store content about the cat 1001 in the AR repository. For example, the user of the device 200 may store a comment about the cat or may capture and store a photo of the cat. In this example, the owners of the cat 1001 may access the AR repository when the cat 1001 retums home and review the stored content to discover the activities of the cat 1001 while it was away.

[0084] In some examples, an administrator of the AR repository may be able to manage the AR repository. Managing the AR repository may comprise creating or modifying settings and characteristics of the AR repository, such as setting the location of the AR repository, setting threshold distances for detecting the AR repository, setting time limits, setting access credentials, or any other settings or characteristics. In some examples, an administrator of the AR repository may remotely access, manage, and store content in the AR repository. An administrator may be the creator, owner, or organizer of the AR repository, or may be appointed and/or removed by the creator, owner, organizer, or other administrator of the AR repository, who may also determine the capabilities of the administrator. In some examples, the administrator may be notified whenever new content is stored in the AR repository. In some examples, the stored content itself may be transmitted to the administrator via email or any other suitable communication method, either as part of the notification or in addition to one or more separate notifications. In some examples, the administrator may set a user preference to only be notified about and/or sent stored content at certain times, for example once a week on a Monday morning.

[0085] In some examples, an administrator of the AR repository may be able to edit or remove content that is stored in the AR repository by other users. For example, an administrator may wish to remove or edit content which is deemed illegal, offensive, or to remove or edit content for any other reason. Automated tools may be used to monitor content that is stored in the AR repository and to automatically report, block, or remove content that is determined to be potentially illegal or offensive. For example, text content may be scanned for the occurrence of profanities and may be automatically removed if profanities are detected.

The administrator may also be able to block certain devices or users from detecting, accessing, or storing content in the AR repository, and automated tools may automatically block devices or users that store (or repeatedly store) offensive or illegal content in the AR repository. The user or device 200 may be blocked from multiple AR repositories if the administrator or automated tools monitor multiple repositories.

[0086] In some examples, the AR repository must be created by a device present at the desired location of the AR repository. In some examples, the creating device need not be present at the location. In some examples, a user may instantiate a repository either by being at that location, or remotely by entering the coordinates of the location, selecting the location from a virtual map, or any other suitable method of specifying a location. In some cases the AR repository may be copied to multiple coordinates by an administrator. That is, the AR repository may exist at multiple locations. The different locations of the AR repository may have equal or different access permissions. For example, it may only be possible to store content in the AR repository in one location, with the other locations only providing detection of and access to the AR repository for viewing stored content. That is, the AR repository may be detected and accessed at multiple locations, but content may only be stored in the AR repository in a single location. In some examples, the access credentials necessary to detect, access, or store content in the AR repository may be different in different locations. In some examples, a device 200 or user that detects, accesses, and/or stores content in the AR repository may be given the ability to create the above described copies of the AR repository in a limited number of additional coordinates. For example, a device 200 that stores content in the AR repository may be given the ability to create a copy of the AR repository in single new location, wherein it is only possible to detect and access the AR repository in the new location (i.e. content cannot be stored in the AR repository at the user-created location).

[0087] In some examples, the diverse methodology of the tagging media and process allows for more diverse usage of the technology. Games such as "Geo-Caching" where real objects are hidden at a given geographic location for others to find can now be elevated to a virtual objective and players may take (record) or leave additional thoughts or other media at the location once discovered.

[0088] In some examples the tagging and AR repository may be useful in law enforcement or social support groups, such as, but not limited to, a site in or near a school where a "Bullying" repository might be noted which in once case might offer support for the student from others who have dealt with the problem, and in some cases might be forwarded to school officials to have a record of the event. In other examples, without limitation, an AR repository might be set up where a crime has occurred, requesting anyone with knowledge to leave information in the repository, or an AR repository may be set up to help the victims of a mass shooting event which often creates instant memorials on the location. In some examples, an AR repository may be as simple as the marker often left at a location when someone dies in a traffic accident, but whereas a physical marker is eventually removed by officials, the AR repository may be persistent.

[0089] In some examples, remote access to and/or storage in the repository may be possible if the coordinates are known. That is, it may be possible to virtually encounter an AR repository if the coordinates of the AR repository are known, simply by entering the known coordinates of the AR repository into the device 200. In some examples this may be a desirable feature and a coordinate entry system may be provided to allow users to virtually encounter AR repositories if they know the coordinates of the AR repository. In other examples, virtual encounters may be an undesirable exploit. For example, a coordinate entry system may not be provided, but users might manually enter coordinates into a device 200 to trick the device 200 into detecting the current location as the entered coordinates. In some examples, this exploit may be prevented by various methods, including methods based on the access credentials described above. For example, detection of, access to and/or storage in an AR repository may be restricted to users who join a local network available only in the vicinity of the AR repository. In some examples, the device 200 may have to verify its location by various methods such as pointing a camera or detector of the device 200 at a certain local feature or transmitter respectively, or by answering questions about the surroundings.

[0090] An alternative option is that the AR repository may be closed to additional comment once constructed as might be the case in a museum, cemetery, school, university, or other venue where the information is being offered to the public but is not open for comment.

[0091] As noted previously, the above described techniques for locating, accessing and updating AR repositories may be closely integrated into a messaging system. Methods of generating, transmitting and receiving messages that enable access to AR repositories at particular geographic locations will now be described in connection with FIG.s 11 and 12.

Then, various use case scenarios for using messaging to enable access to AR content will be described.

[0092] FIG. 11 illustrates a method for transmitting a message by a first device which enables a second device receiving the message to access AR content from an AR repository.

At step 1101, the first device generates a message. This process may take place within a messaging app (application). The messaging app may enable the user to select or create media content to be stored within an AR repository for later retrieval by the recipient of the message. The media content may comprise text, images, video or audio content, or any combination thereof.

[0093] At step 1102 the first device tags the message with a geographic location. This may be a current location of the first device, a previous or stored location of the first device, or a location entered or selected by a user of the first device. The tagging of the message may comprise including information concerning the geographic location within the message, for instance latitude and longitude coordinates. Altematively, it may comprise providing a link such that the recipient of the message can obtain the geographic location or directions to the location from another device or server.

[0094] At step 1103 the message is transmitted to a second device. The second device corresponds to an intended recipient of the message. In some embodiments the message may be sent to a group of recipients, or may be broadcast or made public. Typically, the first device and the second device may be portable electronic devices, such as mobile telephones (optionally operating in conjunction with associated peripheral devices such as smart glasses).

Techniques for transmitting and receiving messages between devices will be well known to the skilled person, but may include peer to peer wireless communication (such as Bluetooth) or transmission across a cellular communication network. The message may be transmitted either directly from the messaging app or via another associated communication app or protocol such as VVhatsApp or email.

[0095] At step 1104 the first device stores the selected or created media content in an AR repository. As for the foregoing description, typically the AR repository may be located at a remote server, but the present disclosure encompasses peer to peer techniques whereby the AR repository may be located at either the first device or the second device.

[0096] The method illustrated in the flowchart of FIG. 11 thus allows a user of a first device to generate or select media content that may be presented to a user of a second device as an AR image when they are at a location tagged to the message (as will be described in connection with FIG. 12). The AR repository may be considered to be an asset or digital canvas, hosted or owned by the sender of the initial message, upon which the media content selected or generated by the user of the first device can be displayed. Furthermore, other parties, including the recipient of the message may be able to add their own media content to the digital canvas. However, additionally the media content may be included in the message itself. Thus the user of the second device may be able to view the media content in the messaging app irrespective of their location. Alternatively or in addition, the transmission of the media content in the message itself may enable a peer to peer mode of operation in which the media content is stored in a AR repository held upon the second device to enable the AR image to be generated when the second device is at the tagged geographical location.

[0097] Turning now to FIG. 12, this illustrates a method of receiving a message enabling access to AR content. At step 1201 a second device receives a message tagged with a geographic location. This may be the message generated by the first device and transmitted at step 1103 of FIG 11. At step 1202 the second device determines its location, for instance using an inbuilt location device such as a GPS unit. At step 1203 the second device determines if it is currently at the tagged geographic location (which may for instance be according to the techniques described in FIG.s 4A to 4C). It not, the method loops back to step 1202. If the second device is at the tagged geographic location, then at 1204 the second device accesses the AR repository to obtain the media content associated with the message previously stored in the AR repository by the first device at step 1104 of FIG. 11. This may typically comprise the second device communicating with a server using information provided in the message which identifies the location of the AR repository and the media content associated with the message [0098] At step 1205 the second device generates and displays an AR image combining an image captured by a camera built into or associated with the second device and the media content obtained from the AR repository. That is, the digital canvas established by the sender of the first message is displayed overlapping, or overlaid on real world imagery.

[0099] It will be apparent that while the messaging system described in FIG.s 11 and 12 enables a message recipient to access and AR repository to generate an AR image, the process of location determination, and AR image generation may generally be as described earlier in the present specification. Particularly, the process of steps 101 to 105 of FIG. 1 is applicable equally to the second device of FIG. 12 which has received a message.

Furthermore, the process of adding to AR content stored in the repository so that it is available to another device accessing the AR repository (step 106 of FIG. 1) may also be incorporated into FIG. 12. For instance, after viewing (at step 1205) the AR image brought about by the transmitted message, the user of the second device may wish to add comments, or further media content. This is then stored in the AR repository and viewable next time the second device accesses the AR repository. Additionally, if the message was transmitted to a group of recipients, or is tagged as being public, other devices accessing the AR repository will be able to view the additional media content stored by the second device.

[00100] The first device implementing the method of FIG. 11 and the second device implementing the method of FIG. 12 may be generally as described in FIG. 2. Similarly, the interaction between a device and a server hosting an AR repository for the methods of FIG.s 11 and 12 may be generally as described in FIG. 3. The system of FIG. 3 may be expanded to include the server and both the first device and the second device.

[00101] Furthermore, the enhanced techniques for accessing and AR repository, generating and viewing AR content of FIG.s 5 to 10 apply equally to the messaging methods of FIG.s 11 and 12.

[00102] As noted above in connection with FIG. 11, the message received by the second device at step 1201 may include the media content itself enabling the media content to be viewed immediately, irrespective of location, within a messaging app.

[00103] FIG.s 11 and 12 should not be interpreted as requiring strict ordering of the claimed processes, except where otherwise logically required. For instance, in FIG. 11, step 1104 (storing media content in the AR repository) may take place at any time after the content has been selected or created by the user.

[00104] A first use case scenario for the messaging of FIG.s 11 and 12 will now be described. The first scenario concerns an AR greeting card, for instance a birthday card. A first user associated with a first device may wish to send a birthday card to a second user associated with a second device. Following the process of FIG. 11 they may create or select media content for an AR birthday card, for instance a suitably selected image and a message that they compose. They may then select a suitable geographic location, such as the recipient's home. This location selection may be on the basis of an entered address, selecting on a map, or selecting from a stored list of locations. Altematively, if the first device (and the user) are currently at the recipient's home, they may select the current location of the first device. A messaged tagged with that location is then sent to the second device.

[00105] The recipient, on receiving the message on their second device, may be made aware of the presence of an AR message directed to them. They may be directed or encouraged to go to the tagged location Of not currently at home). When at the tagged location, they may use their device to view the digital canvas comprising the media content selected by the first user overlaid or superimposed on real world images.

[00106] It may be that the recipient is able to directly view the media content (the birthday message) within a messaging app regardless of location, if the media content is included in the message, as well as view as AR content when at the tagged location. It may be that access to the AR repository (and thus the AR birthday message) is time locked, such that it is only accessible from the day of their birthday. It may be that the AR birthday message is only accessible to the recipient. However, alternatively it may be publicly viewable (or to a predefined group, who may optionally have received a similar message). If the AR birthday message is viewable by others then the process of discovering and viewing the AR image may be generally as described in FIG. 1. The message recipient, and optionally other people, may be able to edit or append content to the birthday message, which may then be viewable by other devices.

[00107] A second use case scenario concerns a marriage proposal. A first person may send a message to their partner which is geotagged to a location of romantic importance to the couple. That message may direct the recipient to the location whereupon an AR marriage proposal is available to them. That AR content may be set to be publicly viewable (or for a group) allowing other people to add messages of congratulations.

[00108] A third use case scenario concerns a collaborative story, poem, speech or other text. A first person may send a message to a group enabling each recipient to access an AR repository, which may include a fragment of a story etc. The first person thus establishes an asset or digital canvas which may be used collaboratively. Each person viewing the AR repository may then add further text to expand the story. The sender of the original group message acts as the host for a messaging/story digital canvas which is viewable and editable as an AR message.

[00109] While the foregoing written description of the disclosure enables one of ordinary skill in the art to make and use what is considered presently to be the best mode thereof, those of ordinary skill veill understand and appreciate the existence of variations, combinations, and equivalents of the specific example, method, and examples herein. The disclosure should therefore not be limited by the above described example, method, and examples, but by all examples and methods within the scope of the disclosure as defined by the appended claims.

Further, different illustrative examples may provide different benefits as compared to other illustrative examples. The example or examples selected are chosen and described in order to best explain the principles of the examples, the practical application, and to enable others of ordinary skill in the art to understand the disclosure for various examples with various modifications as are suited to the particular use contemplated.

[00110] The flowcharts and block diagrams described herein illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various illustrative examples. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function or functions. It should also be noted that, in some alternative implementations, the functions noted in a block may occur out of the order noted in the figures. For example, the functions of two blocks shown in succession may be executed substantially concurrently, or the functions of the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.

[00111] It will be appreciated that examples of the present disclosure can be realized in the form of hardware, software or a combination of hardware and software. Any such software may be stored in the form of volatile or non-volatile storage, for example a storage device like a ROM, whether erasable or rewritable or not, or in the form of memory, for example RAM, memory chips, device or integrated circuits or on an optically or magnetically readable medium, for example a CD, DVD, magnetic disk or magnetic tape or the like. It will be appreciated that the storage devices and storage media are examples of machine-readable storage that are suitable for storing a program or programs comprising instructions that, when executed,

implement examples of the present disclosure.

[00112] Accordingly, examples provide a program comprising code for implementing apparatus or a method as claimed in any one of the claims of this specification and a machine-readable storage storing such a program. Still further, such programs may be conveyed electronically via any medium, for example a communication signal carried over a wired or wireless connection and examples suitably encompass the same.

[00113] Throughout the description and claims of this specification, the words "comprise" and "contain" and variations of them mean "including but not limited to", and they are not intended to (and do not) exclude other components, integers or steps. Throughout the description and claims of this specification, the singular encompasses the plural unless the context otherwise requires. In particular, where the indefinite article is used, the specification is to be understood as contemplating plurality as well as singularity, unless the context requires otherwise.

[00114] Features, integers or characteristics described in conjunction with a particular aspect, example or example of the disclosure are to be understood to be applicable to any other aspect, example or example described herein unless incompatible therewith. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive. The disclosure is not restricted to the details of any foregoing examples. The disclosure extends to any novel one, or any novel combination, of the features disclosed in this specification (including any accompanying claims, abstract and drawings), or to any novel one, or any novel combination, of the steps of any method or process so disclosed. It will be also be appreciated that, throughout the description and claims of this specification, language in the general form of "X for Y" (where Y is some action, activity or step and X is some means for carrying out that action, activity or step) encompasses means X adapted or arranged specifically, but not exclusively, to do Y. [00115] The reader's attention is directed to all papers and documents which are filed concurrently with or previous to this specification in connection with this application and which are open to public inspection with this specification, and the contents of all such papers and documents are incorporated herein by reference.

[00116] There now follows a series of numbered clauses defining further examples of the

disclosure:

1. A method of interacting with an augmented reality (AR) repository, the method comprising: detecting, by the first device, an AR repository that is present at a first location; determining a location of the first device; determining, based on the determined location of the first device, if the first device is present at the first location; and if the first device is present at the first location, the method further comprises: accessing the AR repository; generating and displaying an AR image combining an image captured by the first device and image data obtained from the AR repository; and storing content in the AR repository such that the stored content is accessible by a second device that accesses the AR repository.

2. The method of clause 1, wherein the first device is determined to be present at the first location if: the determined location of the first device is within a predetermined threshold distance of the first location; an area corresponding to the first location and an area corresponding to the determined location of the device overlap; or a volume corresponding to the first location and a volume corresponding to the determined location of the device overlap.

3. The method of any preceding clause, further comprising: determining a current time; and determining if the current time corresponds to an allowed storage time of the AR repository; wherein content may not be stored in the AR repository if the current time does not correspond to an allowed storage time of the AR repository.

4. The method of any preceding clause, further comprising: determining a current time; and determining if the current time corresponds to an allowed viewing time of content stored in the AR repository; wherein the content is not viewable if the current time does not correspond to an allowed viewing time of that content.

5. The method of any preceding clause, wherein generating and displaying an AR image comprises outputting at least one AR tag indicating to a user the presence of the AR repository.

6. The method of clause 5, wherein information contained in the tag is updated based on content stored in the AR repository.

7. The method of clause 5 or 6, further comprising storing detected tags at the first device.

8. The method of any preceding clause, further comprising outputting an alarm or notification in response to determining that the first device is at a first location where an AR repository is present.

9. The method of any preceding clause, further comprising storing a link to the AR repository, wherein the link enables at least one of accessing the AR repository when the first device is not present at the first location and storing content in the AR repository when the first device is not present at the first location.

10. The method of any preceding clause, wherein at least one of detecting the AR repository, accessing the AR repository, and storing content in the AR repository requires validation of access credentials.

11. The method of clause 10, wherein the access credentials are at least one of being a social media contact of a particular user, or being a member of a view list for the AR repository.

12. The method of any preceding clause, wherein the first location comprises a hierarchical layering of locations, and detecting the AR repository at the first location comprises detecting the AR repository at each layer in the hierarchy.

13. The method of any preceding clause, wherein the first location is the location of an item such that moving the item moves the first location.

14. A device for interacting with an augmented reality (AR) repository, the device comprising: a location unit configured to determine a location of the device; a camera; a processor configured to detect an AR repository that is present at a first location, and when the location unit determines that the device is present at the first location, to access the AR repository; and a display configured to generate and display an AR image combining an image captured by the camera and image data obtained from the AR repository; wherein the processor is further configured to store content in the AR repository such that the stored content is accessible by another device that accesses the AR repository.

15. A system for interacting with an augmented reality (AR) repository, the system comprising: a first device; and a second device; wherein the first device comprises: a location unit configured to determine a location of the first device; a camera; a processor configured to detect an AR repository that is present at a first location and when the location unit determines that the device is present at the first location, to access the AR repository; a display configured to generate and display an AR image combining an image captured by the camera and image data obtained from the AR repository; and a communication unit configured to transmit a request to store content in the AR repository to the second device; and wherein the second device comprises: a communication unit configured to receive the request to store content in the AR repository from the first device; and a processor configured to store content in the AR repository such that the stored content is accessible by another device that accesses the AR repository.

16. A system for interacting with an augmented reality (AR) repository, the system cornprising: a first device; and a server; wherein the first device comprises: a location unit configured to determine a location of the first device; a camera; a display configured to generate and display an AR image combining an image captured by the camera and image data obtained from the AR repository via the server; a processor configured to detect an AR repository that is present at a first location; and a communication unit configured to transmit, to the second device, a request to access the AR repository, a request to store content in the AR repository, and content to be stored in the AR repository; and wherein the server comprises: a communication unit configured to receive the request to access the AR repository and the request to store content in the AR repository, to transmit image data obtained from the AR repository to the first device; and to receive content to be stored in the AR repository; and a processor configured to store the content in the AR repository such that the stored content is accessible by another device that requests access to the AR repository.

Claims

CLAIMS: 1. A method of transmitting a message by a first device enabling access to augmented reality, AR, content, the method comprising: generating a message; tagging the message with a geographic location; transmitting the message to a second device; and storing media content associated with the message in an AR repository associated with the geographic location.
2. The method of claim 1, further comprising including the media content in the message.
3. The method of claim 1 or claim 2, wherein the tagged geographic location is a current location of the first device, a previous or stored location of the first device, or a location entered or selected by a user of the first device.
4. A first device for transmitting a message enabling access to augmented reality, AR, content, the device comprising: an input/output unit configured to receive a user input to generate a message and to generate or select media content; and a processor configured to tag the message with a geographic location; wherein the input/output unit is further configured to be controlled by the processor to: transmit the message to a second device; and store media content associated with the message in an AR repository associated with the geographic location.
5. The first device of claim 4, further comprising a location unit configured to determine a location of the device and to use that location as the geographic location tagged to the message.
6. A system for interacting with an augmented reality, AR, repository, the system comprising: a first device according to claim 4 or claim 5; and a server comprising: an input/output unit configured to receive the media content to be stored in the AR repository from the first device; and a processor configured to store the media content in the AR repository such that the stored media content is accessible by another device that requests access to the AR repository.
7. A method of receiving a message enabling access to augmented reality, AR, content, the method comprising: receiving, by a second device, a message from a first device, the message being tagged with a geographic location; determining a current location of the second device; and determining, based on the determined current location of the second device, if the second device is present at the geographic location; wherein if the second device is present at the geographic location, the method further 10 comprises: accessing an AR repository associated with the geographic location; and generating and displaying an AR image combining an image captured by the second device and media content associated with the message obtained from the AR repository.
8. The method of claim 7, wherein the media content is included in the message, the method further comprising receiving a user input to display the media content irrespective of the location of the second device.
9. The method of claim 7 or claim 8, further comprising: indicating the geographic location to a user of the second device; or calculating a direction from the determined current location to the tagged geographic location and providing a direction indication or instruction to the user.
10. The method of any one of claims 7 to 9, further comprising storing further media content in the AR repository such that the stored content is accessible by another device that accesses the AR repository.
11. The method of any one of claims 7 to 10, wherein the second device is determined to be present at the geographic location if: the determined location of the second device is within a predetermined threshold distance of the geographic location; an area corresponding to the first location and an area corresponding to the determined location of the second device overlap; or a volume corresponding to the geographic location and a volume corresponding to the determined location of the second device overlap.
12. The method of any one of claims 7 to 11, further comprising: determining a current time; determining if the current time corresponds to an allowed viewing time of content stored in the AR repository; wherein the content is not viewable if the current time does not correspond to an allowed viewing time of that content.
13. The method of any one of claims 7 to 12, wherein generating and displaying an AR image comprises outputting at least one AR tag indicating to a user the presence of the AR repository.
14. The method of any one of claims 7 to 13, further comprising outputting an alarm or notification in response to determining that the second device is at a location where an AR repository is present.
15. A second device for receiving a message enabling access to augmented reality, AR, content, the device comprising: an input/output unit configured to receive a message from a first device, the message being tagged with a geographic location; a location unit configured to determine a current location of the second device; a camera; a processor configured to determine, based on the determined current location of the second device, if the second device is present at the geographic location, and if so to access an AR repository associated with the geographic location; and a display configured to generate and display an AR image combining an image captured by the camera and media content obtained from the AR repository.
16. A system for interacting with an augmented reality, AR, repository, the system comprising: a second device according to claim 15-and a server comprising: an input/output unit configured to receive a request to access the AR repository from the second device and to transmit media content obtained from the AR repository to the second device.
17. The system of claim 16, further comprising the first device of claim 4 or claim 5; wherein the server input/output unit is further configured to receive the media content to be stored in the AR repository from the first device; and wherein the server processor is further configured to store the media content in the AR repository such that the stored media content is accessible by another device that requests access to the AR repository.