AU2018102024A4 - QRARI™ augmented reality marker for app-free, browser-based AR experiences - Google Patents

Abstract

Innovation Patent Application for QRARI code - A two-dimensional visual device that directs a mobile device to a web page where augmented reality (AR) media is hosted, and subsequently provides a target marker for the accompanying web-based AR software without the need for browser plug-ins or separate apps. QRARI TM augmented reality marker for app-free,browser-based AR experiences FIGURE 2: Working sample of QRARI code Use the QR scanning function of your mobile device: (Camera app in iOS, or Google Lens in Android). You will be directed to the page where the AR experience is hosted. If asked, allow the device's camera to be accessed by the web page. When you see the camera view, point it at the QRARI code. The AR experience will be activated and displayed on the screen of your mobile device.

Description

Innovation Patent Application for QRARI code - DESCRIPTION

At present, augmented reality (AR) employs one of two systems in order to place virtual objects in the real world: plane detection or marker detection. Plane detection analyses the output of the host device’s camera to identify trackable points to extrapolate the location of objects within the scene. In a similar fashion, marker detection analyses the output of the host device’s camera, but instead looks for a pre-programmed pattern contained within the real world. Once located, this AR marker subsequently acts as a unique identifier from which plane detection can be calculated.

Both systems have limitations that form a barrier to entry for users seeking to engage in augmented reality experiences, as follows:

• Plane detection isn’t included in the feature set of current internet browser software, and thus requires a separate piece of standalone software (or app) to be downloaded and activated before the user can access the content.

• Marker detection also needs a standalone app or, if browser-based, requires the user to enter a URL into their internet browser in order to access the content.

QRARI (an acronym of Quick Response Augmented Reality Indicator, pronounced “cue-rahree”) is specifically designed to remove these barriers to entry, making augmented reality more accessible to a wider audience.

QRARI markers comprise two functional components; a standard QR (quick response) code and a proportional-width border that identifies it as an AR marker to the web-based software being accessed by the host device.

This patent application does not make claim to any aspect or function of the QR code (which has been made freely available for use by the patent owner, Denso Wave), nor does the QRARI web application read the data stored in visual form by the QR code.

Because a standard QR code is too complex to be used as an accurate planar tracker using web-based pattern recognition, the addition of a solid, proportional border provides the necessary accuracy required for an effective AR planartracking experience. Through testing, a pattern to border ratio of 8:2 has been demonstrated to be the most effective combination of planar detection accuracy and aesthetics.

By relying on the QR scanning functionality present in the majority of mobile, cameraequipped devices in use today, QRARI codes can trigger usable, cross-platform, browserbased experiences that are immediately accessible to the user without the need for specific application downloads or complex interactions with their device.

Creating the QRARI code

The URL for the page that hosts the web application must be known in advance so that a QR code may be generated for it. Any standard QR code generator can be used to create this component and export the resulting digital image file.

Once created, the QR code is converted to a QRARI code using an application that adds a solid black border at the required 8:2 pattern to border ratio proportions (see diagram in Figure 1), and generates an AR pattern file (.PATT) and a usable image file (.PNG).

2018102024 07 Dec 2018

The .PATT file is stored online, and the related image file is deployed in the preferred medium (displayed on-screen, or printed onto physical media) for the intended AR experience.

Function

The user scans the QRARI code with their device which is typically, but not uniquely, a smartphone or other mobile device with an integrated camera. The URL data stored in the QR code component is read (1) and directs the browser to the online location where the web application is hosted.

The Javascript-based web application will then load into the browser and run (2), analysing the camera output for the QRARI code within the scene being captured and comparing it to the stored digital reproduction (.PATT file) file. Once a match is found between camera output and the stored pattern file for the associated AR experience, the software then determines the planar data of the QRARI code to establish its location and orientation.

The media assets (video files, 3D models, animation routines, etc) that are required for the AR experience are then displayed on the screen of the host device, using the QRARI code and its dynamic location and orientation in 3D space as an anchor and reference point.

(1) QR code scanning is built into iOS 11, Android 7, and Windows Phone 8.1 or later.

(2) For security reasons, the device will seek permission from the user before activating the device’s camera.

Claims (2)

1. The invention claimed is:

   1. A visual device comprising a fixed border with specific proportions added to a standard QR (quick response) code that allows it to be recognised by web-based augmented reality software providing a 3D planartracking reference to which the augmented reality media can be attached.
2. 2. The QRARI code as described in claim 1 can be deployed in all forms of visual media including, but not limited to, on-screen (digital) and printed media.