AU2022201217A1 - Integrated Platform for AR Control System. - Google Patents

Abstract

HVAC Services ABSTRACT An Augmented Reality automation and service tool platform and interface. A remote server with multi-vendor interface software, Niagara software, API's, and a master encryption key installed. Software encryption keys are created from the master encryption key and installed on the AR glasses. Remote access devices (Locks) paired with the master encryption key allow remote devices to be controlled by the remote server. A second interface is created between the AR Glasses and remote server and managed through encryption keys. The GUI controlled through the AR Glasses is made up of responsive widgets, elements, labels, hyperlinks, and buttons which allow graphics to be navigated without a mouse. Changing the web elements to responsive all voice-controlled API scripts to be used to navigate the different elements and widgets. The image is then projected in front of the user as graphic overlays. The central encryption key installed on the remote server controls the devices that connect through the AR glasses which can be any number of devices, buildings, or sites. February 21, 2022 1/2 Drawings Fig 1 Fig 2 FCU-04 Fig 3 Fig 4 Fig 5 Binded Encryption (7 Key AR Glasses - -------- - PLC .. -- HMI Master m Encryption' yMachinery Key AR GlasseO -------- - '- - -& Electronics <Binded Encryption Key

Description

1/2 Drawings

Fig 1 Fig 2

FCU-04

Fig 3 Fig 4

Fig 5 Binded Encryption (7 Key AR Glasses - -------- - PLC

Master m .. -- HMI

Encryption' yMachinery Key

AR GlasseO -------- - '- - -& Electronics

<Binded Encryption Key

EDITORIAL NOTE 2022201217 There are five pages of description only

H ))HVAC Controls Services

AUSTRALIA Patents Act 1990

Provisional Specification

AR Integrated Control System & UI

The invention is described in the following statement

DB Control Services & HVAC Services Pty Ltd Phone: 0401 627 271 Email: david@controlservices.com.au Web: www.dbcontrolservices.com.au ABN: 66 635 490 881

111 HVAC Services

1 AR Integrated Control System & UI Title: Integrated Platform for AR Control System. (0001) Technical Field: Augmented Reality, Automation, Industrial Internet of Things, Control System Integration. (0002) Background: The driving motivation behind the development of this invention can be best summarised from an article I wrote for Climate Control News published on the 7 th of September 2019. (0003) "HVAC technology is constantly changing which provides exciting new opportunities for energy reduction and improved building maintenance. As commercial HVAC becomes more reliant on digital technology, it also allows greater potential for improvements in reducing energy usage, decreased installation and commissioning times and better maintenance and serviceability. Many of the issues we commonly see are as easily resolved as flicking a switch. By embracing these changes, we can make simple informed decisions that will improve HVAC efficiency as we move into the future". (0004) This philosophy has driven a desire to innovate in the use of remote monitor technology, voice-controlled automation, and augmented reality to develop the Integrated Platform for AR Control System. The application of this invention provides a safter and more secure work environment, more efficient use of resources, improved machine performance, efficiencies and less time lost to breakdowns. (0005) Technical Problem: Current augmented reality (AR) remote support/assistance services offer either online support, over the phone support or both as a business-to-business service designed to allow onsite technicians to remotely share and stream live images and videos from the AR smart glasses cameras with a customer service representative who then provides troubleshooting support by uploading documentation in the form of PDF overlays. The customer service representative would need to contact the relevant manufacturer to acquire the engineering data and

February 21, 2022

111 HVAC Services

troubleshooting procedure specific to the task before relaying the correct information back to the technician. (0006) Solution to Problem: The Augmented Reality Integrated Control System (AR Control System) & User Interface (UI) developed by DB Controls & HVAC Services Pty Ltd (DB Controls) eliminates the need to share and stream live images and videos direct from site because of the potential security risk that this can present. It provides technicians with the ability to directly access data and control equipment handsfree making it easier and safer to troubleshoot issues. (0007) Advantageous Effects of Invention: By making it easier and safer for technicians to perform their roles in Resource sectors such as Mining and Oil & Gas, it reduces the need for outside support and encourages technicians to become further engaged and skilled in their role. (0008) Summary of the Invention: The AR Control System & UI developed by DB Controls in accordance with this invention is a control system interface program that allows mechanical and electrical equipment, controls systems and software to be remotely controlled and monitored from an unlimited number of sites around the world using a single pair of augmented reality smart glasses. (0009) The UI is made up of graphical user interface (GUI), voice controlled touchless interface for system control and menu navigation and was specifically developed by David Byrne and DB Controls as part of the AR control system. (0010) The AR Control System & UI is built to function as a remote service/assistance and control system integration tool that allows control system engineers, technicians, and equipment operators to access critical operating data using the most secure, efficient, and precise methods available. (0011) The controls are designed for building automation, process control, building maintenance, internet of things (IoT) industrial internet of things

February 21, 2022

111 HVAC Services

(hIoT) and similar applications for use in commercial, industrial, health and education, energy & resources industry sectors. (0012) The UI and programming developed by DB Controls allows mechanical and electrical equipment, control systems and software from different vendors and manufacturers to be controlled through the AR smart glasses without needing shared protocols or networks to achieve this. The integrated network platforms are scalable and can be configured as part of a cloud based or none cloud based IT infostructure. System integration and data standardisation is managed using the Niagara 4 framework. Tosibox Locks and keys are used to build encrypted key remote access platforms and Tosibox have released global case studies detailing DB Controls remote monitor innovations integrating Tosibox products with our own software systems. (0013) The AR Control System is the interface between site-based equipment and the AR smart glasses. The interface is not part of the site based controls, equipment or AR smart glasses and this connection cannot be achieved through any other means. (0014) The graphical user interface (GUI) and touchless interface used to navigate and control the AR Control Systems is custom built by DB Controls specifically for use on AR smart glasses and provides both voice control and simple button command navigation options. The GUI & UI control is achieved through the development of custom web elements, widgets, HTML script, Java script, CSS script and responsive panes. Android voice API scripts are also used to create customised voice commands. (0015) The processes used in DB Controls AR Control Systems to provide remote assistance and support using AR smart glasses fundamentally differs from other market competitors as described below. (0016) Brief Description of Drawings: The invention may be better understood with reference to GUI & UI elements, layout and graphical style used in the interface. Graphic pages will a made from a combination of the

February 21, 2022

111 HVAC Services

widgets and elements shown in drawings and can range from a few elements to full graphic pages. (0017) Fig 1: Shows the GUI layout, placement of control and hyperlink button, preferred widgets and elements and overall presentation used in the design of Chilled Water systems controlled through the interface. (0018) Fig 2: Shows the GUI layout, placement of control and hyperlink button, preferred widgets and elements and overall presentation used in the design of fan coil systems (FCU) controlled through the interface. Control and hyperlink buttons located on the page footer in this example. (0019) Fig 3: Shows the GUI layout, placement of control and hyperlink button, preferred widgets and elements and overall presentation used in the design of air handler systems (AHU) controlled through the interface. Control and hyperlink buttons located on the page footer in this example. (0020) Fig 4: Shows the GUI layout, placement of control and hyperlink button, preferred widgets and elements and overall presentation used in the design of VAV and fan systems controlled through the interface. Control and hyperlink buttons located on the page footer in this example. (0021) Fig 5: Network architecture diagram. (0022) Fig 6: Network architecture diagram including displayed graphics, dashboards, and alarm consoles. (0023) Fig 7: Projected image orientation to AR glasses wearer.

February 21, 2022

Claims (6)

1. EDITORIAL NOTE 2022201217 There is one page of claims only

   111&HVAC Services
2. 2 Claims 1. AR smart glasses control program able to interface with all vendors, manufacturers, and communications protocols. This achieved through data standardisation, application of vendor specific drivers and conversion of serial communication protocols to ethernet. 2. Connection to and control over an unlimited number of sites from a single pair of AR smart glasses. This is achieved by configuring encryption keys to allow separate protocols and networks to exist on the same control platform.
3. 3. Ability for the user to independently control and monitor remote equipment using a UI that allows users to navigate between sites, systems, graphic pages, live dashboards, and option menus.
4. 4. Provides voice controlled touchless Interface built into the AR Control System designed specifically for use with AR smart glasses.
5. 5. Integrated dashboards and alarm consoles allowing simultaneous monitoring of live data and alarms from different sites.
6. 6. Remote connection, control and monitoring for all sites connected to the AR glasses.

   February 21, 2022