TWI786348B - System and method for determining location and navigating a datacenter using augmented reality and available sensor data - Google Patents

Abstract

An information handling system for identifying equipment in a datacenter establishes a wireless communication link with an element of datacenter equipment, and receives identification information from the element. The identification information distinguishes the element from other elements of the datacenter equipment that are visibly indistinct from the first element. The information handling system further captures image data when the field of view of an imaging system includes the element, displays the image data on a display, matches a portion of the image data with an image object associated with the first and second elements, determines an identity of the element based upon the identification information and the image object, and displays an augmented reality overlay on the display over the image data. The augmented reality overlay co-locates the image object with the portion and includes the identity over the portion.

Description

System and method for positioning and navigating a data center through augmented reality and available sensor data

Cross reference to related applications

Relevant subject matter is contained in co-pending U.S. Patent Application No. 16/____ (DC- 112995), the above disclosure is hereby incorporated by reference. field of invention

The present invention relates to an information handling system (IHS). More specifically, the present invention relates to positioning and navigating a data center through augmented reality and available sensor data.

Background of the invention

As the value and application of information increase day by day, both individuals and businesses need to find additional ways to process and store information. Information handling systems are a viable option. Generally, an information processing system may process, compile, store and/or transmit information or data for business purposes, personal purposes or otherwise. In view of the different needs and requirements for technology and information processing between different applications, the information processing system can be based on the information processed, the method of processing information, the amount of information processed/stored/transmitted, and the amount of information processed/stored /The speed and availability of the information sent varies. The aforementioned changes in an information handling system can make an information handling system a general purpose system or a system configured for use by a specific user or a specific purpose, such as financial transaction processing, airline reservations, corporate data storage, or global communications. Additionally, an information handling system may also include various hardware and software components configured to process, store, and communicate information, and such an information handling system may also include one or more computer systems, data storage systems, and networking systems.

Summary of the invention

The present invention discloses an information processing system, the information processing system includes: a display; an image library, the image library includes a plurality of image objects related to different data center equipment in the data center; a wireless communication interface; and An image system is used for acquiring image data from a field of view of the image system. The information processing system is used for: establishing a first wireless communication link with the first component of the data center equipment through the wireless communication interface; receiving a first identification information from the first component through the first wireless communication link. The first identification information distinguishes a second element of the data center equipment from the first element, and the first element is visually different from the second element. When the field of view includes the first element, the information processing system acquires image data; displays the image data on a display; matches a first portion of the image data with a first image object, wherein the first image object is associated In the first element and the second element; determine the first mark of the first element based on the first identification information and the first image object; and display the augmented reality overlay on the image data on the display. The augmented reality overlapping layer utilizes the first part to be at the same position as the first image object, and the augmented reality overlapping layer includes the first logo located on the first part.

Detailed Description of the Preferred Embodiment

The following description in conjunction with the accompanying drawings is helpful for understanding the technical solutions disclosed in the present invention. The discussion below focuses on the specific embodiments and examples disclosed in the present invention. Rather, the discussion is intended to be illustrative of the invention and should not be construed as limiting the application or scope of the teachings of the invention. However, other techniques may also be used in this application. The teachings can also be used in other applications and have several different types of architectures, such as distributed computing architectures, client/server architectures, or middleware server architectures and related resources.

1 shows an embodiment of an information processing system 100. The information processing system 100 includes: a processor 102; a processor 104; a chipset 110; a memory 120; a graphics adapter 130 connected to a video display 134; System/extensible firmware interface (BIOS/EFI) module 142 non-volatile random access memory (NV-RAM, non-volatile RAM) 140; disk controller 150; hard disk drive (HDD, hard disk drive) 154; optical disc drive 156; connected to the disk emulator 160 of solid state drive (SSD, solid state drive) 164; connected to the input/input of additional resource 174 and trusted platform module (TPM, trusted platform module) 176 output (I/O) interface 170 ; network interface 180 and baseboard management controller (BMC) 190 . The processor 102 is connected to the chipset processor interface 110 through the processor interface 106 , and the processor 104 is connected to the chipset through the processor interface 108 . In a specific embodiment, the processor 102 and the processor 104 are connected together through a large-capacity related structure such as a "HyperTransport" link, a "QuickPath" interconnection, and the like. Chipset 110 may be embodied as an integrated circuit or group of integrated circuits for managing data between processor 102 , processor 104 and other elements of information handling system 100 flow. In a specific embodiment, chip set 110 may be embodied as a pair of integrated circuits such as north and south bridge components. In another embodiment, all functions and features of the chipset 110 or some functions and features of the chipset 110 may be integrated into one or more of the processor 102 and the processor 104 . The memory 120 is connected to the chipset 110 through the memory interface 122 . In one example, the memory interface 122 includes a memory channel that adopts a double data transmission mode (DDR, Double Data Rate), and the memory 120 can be embodied as one or more dual in-line memory channels that adopt a double data transmission mode. Memory module (DIMM, Dual In-Line Memory Module). In a specific embodiment, the memory interface 122 can be embodied as two or more channels adopting dual data transmission mode. In another embodiment, one or more of the processor 102 and the processor 104 includes a memory interface, which can provide memory dedicated to the processor. The dual data transfer mode channel and the dual data transfer mode DIP memory module can meet specific dual data transfer mode standards such as "DDR3 standard", "DDR4 standard" and "DDR5 standard". The memory 120 can be further embodied as a dual in-line memory module such as a dynamic random access memory (DRAM, Dynamic Random Access Memory), a dual in-line memory module of a static random access memory (SRAM, Static Random Access Memory) memory module, non-volatile dual in-line memory module (NV-DIMM, non-volatile DIMM), storage-class memory device, read-only memory (ROM, Read-Only Memory) device, etc. A combination of various memory types. The graphics adapter 130 can be connected to the chipset 110 through a graphics interface 132 and is equipped with a video display output device 136 connected to a video display 134 . In an example of the present invention, the graphics interface 132 may include a Peripheral Component Interconnect-Express (PCIe, Peripheral Component Interconnect-Express) interface, and the graphics adapter 130 may include a four-lane (x4) PCI Express interface as required or desired. adapter, eight-lane (x8) express peripheral component interconnect adapter, sixteen-lane (x16) express peripheral component interconnect adapter, or other configurations. In a specific embodiment, the graphics adapter 130 may be configured on a lower system printed circuit board (PCB, printed circuit board). The video display output device 136 may include: a digital video interface (DVI, Digital Video Interface), a high-definition multimedia interface (HDMI, High-Definition Multimedia Interface), a "DisplayPort" interface, etc., and the video display 134 may include a monitor, a smart TV , Built-in monitors such as laptop monitors, etc.

The non-volatile random access memory 140 , the disk controller 150 and the I/O interface 170 are connected to the chipset 110 through the I/O channel 112 . An example of I/O path 112 includes one or more point-to-point fast Peripheral component interconnect links. The chipset 110 may also include one or more other I/O interfaces, the I/O interfaces include: Industry Standard Architecture (ISA, Industry Standard Architecture) interface, Small Computer Serial Interface (SCSI, Small Computer Serial Interface) Interface, Inter-Integrated Circuit (I2C, Inter-Integrated Circuit) interface, System Packet Interface (SPI, System Packet Interface), Universal Serial Bus (USB, Universal Serial Bus) or other interfaces or a combination of the aforementioned interfaces. Non-volatile random access memory 140 includes BIOS/XFI 142 that stores machine-executable code for detecting resources of information processing system 100 (BIOS/Extensible Firmware Interface Code), so as to initialize the drivers of the aforementioned resources and provide a public access mechanism for the aforementioned resources. The functions and features of the BIOS/XFI module 142 will be further described below.

The disk controller 150 includes: a disk interface 152, which is used to connect the disk controller to a hard disk drive (HDD, hard disk drive) 154, an optical disk drive (ODD, optical disk drive) 156 and Disk emulator 160. Examples of the disk interface 152 include: an integrated drive electronics (IDE, Integrated Drive Electronic) interface; a serial advanced technology attachment (ATA, Advanced Technology Attachment) interface such as a parallel serial advanced technology attachment or a serial serial advanced technology attachment; Computer system interface; Universal Serial Bus interface; Peripheral interface or a combination of the aforementioned interfaces. The disk emulator 160 enables a solid-state drive (SSD, solid-state drive) 164 to be connected to the information processing system 100 through the external interface 162 . Examples of the external interface 162 include: a universal serial bus interface, an IEEE 1394 (FireWire) interface, a dedicated interface, or a combination of the aforementioned interfaces. In an alternative embodiment, the solid state drive 164 may be disposed within the information processing system 100 .

The I/O interface 170 includes a peripheral interface 172 that connects the I/O interface 170 to additional resources 174 , trusted platform module 176 , and network interface 180 . The peripheral interface 172 can be the same type or a different type of interface as the input/output channel 112 . When the peripheral interface 172 and the input/output channel type are the same, the input/output interface 170 can expand the capacity of the input/output channel 112; and when the peripheral interface 172 and the input/output channel type are different, the input/output interface can be adapted to The format of the input/output channel is converted to a format suitable for the peripheral interface 172 . The additional resource 174 may include: a data storage system, an additional graphic interface, a network interface card (NIC, network interface card), a sound/video processing card, other additional resources, or a combination of the aforementioned resources. Additional resource 174 may be located on the main circuit board, on a separate circuit board or add-in card within information handling system 100 , on a device external to the information handling system, or a combination of the foregoing.

The network interface 180 is embodied as a network communication device, which can be located in the information processing system 100, disposed on the main circuit board of the information processing system, integrated on other components such as the chipset 110, on another Appropriate location or a combination of the above methods for configuration. The network interface 180 includes a network channel 182 , and the network channel 182 provides an interface for devices outside the information processing system 100 . In an embodiment, the network channel 182 is of a different type than the peripheral channel 172, and the network interface 180 can convert a format suitable for the peripheral channel to a format suitable for the external device. In a specific embodiment, the network interface 180 includes: a network interface card or a host bus adapter (HBA, host bus adapter), and wherein examples of the network channel 182 include: InfiniBand (InfiniBand) channel, fiber channel, ten Gigabit Ethernet channels, dedicated channel architectures, or a combination of the aforementioned channels. In another embodiment, the network interface 180 includes: a wireless communication interface, and the network channel 182 includes: a WiFi channel; a near-field communication (NFC, near-field communication) channel; Bluetooth or Bluetooth Low Energy (BLE, Bluetooth-Low-Energy) channel; such as Global System for Mobile (GSM, Global System for Mobile) interface, Code Division Multiple Access (CDMA, Code-Division Multiple Access) interface, Universal Mobile Telecommunications System (UMTS, Universal Mobile Telecommunications System) interface . A long-range evolution (LTE, Long-Term Evolution) interface based on a cellular structure interface or other cellular-based interfaces or a combination of the aforementioned interfaces.

The network channel 182 can be connected to external network resources (not shown in the figure). The network resources may include: other information processing systems, data storage systems, other networks, grid management systems, other suitable resources or a combination of the aforementioned resources. The baseboard management controller 190 can be connected to various components of the information handling system 100 through one or more management interfaces 192, so as to monitor, maintain and control the components of the information handling system out of bandwidth. Therefore, the baseboard management controller 190 can be embodied as a processing device different from the processor 102 and the processor 104 , so as to provide various management functions for the information processing system 100 . For example, the baseboard management controller 190 may be responsible for power management, cooling management, and the like. Generally, the term "BMC" is used in the context of server systems; and in consumer devices, the BMC is called an embedded controller (EC). Meanwhile, a baseboard management controller included in a data storage system may be called a storage enclosure processor. A baseboard management controller included in a chassis of a blade server may be called a chassis management controller, and an embedded controller included in a blade of a blade server may be called a blade management controller.

Based on the type of information handling system, BMC 180 can have widely different capabilities and functions. The baseboard management controller 190 can operate according to the Intelligent Platform Management Interface (IPMI). Examples of the BMC 190 include an integrated Dell Remote Access Controller (iDRAC, Integrated Dell Remote Access Controller). The management interface 192 may be embodied as one or more out-of-band communication interfaces between the baseboard management controller 190 and the components of the information processing system 100, and may include an Inter-Integrated Circuit (I2C, Inter-Integrated Circuit) bus, a system management bus (SMBUS, System Management Bus), power management bus (PMBUS, Power Management Bus), low pin number (LPC, Low Pin Count) interface, such as Universal Serial Bus (USB) or serial peripheral device interface (SPI, Serial Peripheral Interface) serial bus, network interface such as Ethernet interface, high-speed serial data link such as fast peripheral component interconnection interface, network controller sideband interface (NC-SI, Network Controller Sideband Interface) and so on. In this specification, "out-of-band access" refers to operations on information processing system 100 that are executed separately from BIOS/OS and that are not related to the code executed by processor 102 and processor 104 and the response Executable code is a program executed on the information processing system 100 . BMC 190 operates to monitor and maintain system firmware such as code stored in BIOS/XFI module 142 or optionally stored as needed or desired Code in ROM of GUI 130 , disk controller 150 , additional resources 174 , network interface 180 , or other components in information handling system 100 . Specifically, the baseboard management controller 190 includes a network interface 194, which can be connected to a remote management system, so as to receive firmware update information as required or desired. Here, the baseboard management controller 190 can be used to receive firmware update information, store the firmware update information in a data storage device related to the baseboard management controller, and transmit the firmware update information to devices or systems that need to update firmware. Non-volatile random access memory to replace the currently operating firmware associated with a device or system and to restart the information processing system when the device or system uses an updated firmware image.

The baseboard management controller 190 can use various protocols and application programming interfaces (API, application programming interface) to guide and control the process for monitoring and maintaining system firmware. Examples of protocols or APIs for monitoring and maintaining system firmware include: a graphical user interface (GUI, graphical user interface) related to the baseboard management controller 190, through a distributed management team (DMTF, Distributed Management Taskforce) Interfaces defined by various vendors (e.g., Web Server Management Interface, Management Component Delivery Protocol, or the "Redfish" interface), interfaces defined by various vendors (e.g., the "Dell EMC" Remote Access Controller Administrator "RACADM" utility program, "Dell EMC" Open Management Server Manager "OMSS" utility, "Dell EMC" Open Management Storage Server "OMSS" utility, or "Dell EMC" Open Management Deployment Toolkit "DTK" suite), A BIOS setup utility (such as the utility invoked by the "F2" launch option) or other protocol or API as needed or desired.

In a specific embodiment, the baseboard management controller 190 is included on the main circuit board (for example, a baseboard, a motherboard, or any combination of the two) of the information processing system 100, or the baseboard management controller 190 can be configured as needed or desired. And integrated on another component of the information processing system, such as the chip set 110 or other suitable components. Through the aforementioned method, the baseboard management controller 190 can be used as a part of the integrated circuit or chip set in the information processing system 100 . An example of the baseboard management controller 190 includes an integrated Dell remote access controller (iDRAC, integrated Dell remote access controller) and the like. The baseboard management controller 190 can run on a power plane independent of other resources in the information processing system 100 . Therefore, the BMC 190 can communicate with the management system through the network interface 194 when the resources of the information processing system 100 are powered off. Here, information can be sent from the management system to the BMC 190, and the aforementioned information can be stored in random access memory or non-volatile random access memory associated with the BMC. After the power plane of the baseboard management controller 190 is powered off, the information stored in the random access memory may be lost, while the information stored in the non-volatile random access memory can be stored in the baseboard management controller. The device's power plane is preserved during power-down/power-up cycles.

In typical use cases, information processing system 100 may be embodied as an enterprise-level processing system such as those found in data centers or other compute-intensive processing environments. Here, an information processing system may be embodied as one of hundreds or thousands of other enterprise-level processing systems in a data center. In such an environment, an information processing system may be embodied as one of various types of information processing systems, such as computing devices (servers, modular blade systems, etc.), used to perform the primary processing tasks of a data center , switching equipment and routing equipment (network routers, top-of-rack switches, etc.), data storage equipment (storage servers, network attached storage devices, storage area networks, etc.) or other equipment used by data centers to perform tasks. In addition, the information processing system can also be embodied as a management device, which can be connected to the processing device through an independent management network and used to monitor, manage and maintain the processing device. Finally, the information processing system can also be embodied as data center servicing equipment, which can be used by maintenance technicians of the data center to monitor, manage, repair and maintain the processing and management equipment of the data center. In the past, the data center maintenance equipment included the information processing system on the "crash cart", but the data center maintenance equipment increasingly includes mobile devices such as tablet computing devices, smart phone devices and so on.

FIG. 2 shows a part of a data center 200 including a server rack 210 , a data center management system 250 and a mobile maintenance device 260 . The server rack 210 includes: data center equipment 220 , data center equipment 230 and data center equipment 240 . The data center equipment 220 , the data center equipment 230 and the data center equipment 240 are respectively embodied as computing equipment, switching-routing equipment, data storage equipment or other equipment of the data center 200 . For example, the data center equipment 220 may be embodied as a top-of-rack switch, the data center equipment 230 may be embodied as a blade server, and the data center equipment 240 may be embodied as a storage server. Each of the data center equipment 220 , the data center equipment 230 and the data center equipment 240 includes a main processing environment (not shown) for providing specific processing tasks to the data center equipment. The specific way of integrating the processing tasks of the data center equipment 220, the data center equipment 230, and the data center equipment 240 so as to execute the entire processing task by the data center 200 is known in the technical field of the present invention, so except for the necessary description, No further details will be given here. Each of the data center equipment 220, the data center equipment 230, and the data center equipment 240 includes an independent baseboard management controller 222, baseboard management controller 232, and baseboard management controller 242, respectively. Each of the BMC 222 , the BMC 232 and the BMC 242 includes a network interface device, so that all the BMCs are connected to the data center management system 250 through the management network 280 . The management network 280 can be embodied as a wired network, a wireless network, or a combination of wired and wireless networks as needed or desired.

The baseboard management controller 222 includes: configuration information 224 and a short-distance communication module 226 . The configuration information 224 is embodied as management information used by the data center management system 250 to monitor, manage and maintain the data center equipment 220 . The configuration information 224 can be embodied as physical information related to the model, style and hardware configuration of the data center equipment 220, and the configuration information 224 can also be embodied as information related to the logical configuration of the data center equipment. For example, where data center equipment 220 is embodied as a top-of-rack switch, configuration information 224 may include: switch model, model, service label, associated switch configuration, number of ports, and other physical information associated with the switch; configuration information 224 may also include location information of the switch in the server rack 210 and location information of the server rack in the data center 200; configuration information 224 may also include information related to the operating status of the switch, which information includes: physical operation status and logical operational status (eg, error and alarm status information); and configuration information 224 may also include physical switch mapping, logical switch mapping, port configuration, or other information identifying what the switch is configured for. The NFC module 226 can embody a wireless communication endpoint that can establish wireless communication to other similarly equipped devices (shown as the short-range communication module 262 of the mobile maintenance device). Communication link 282. The short-range communication module 226 is designed to provide a very short connection range compared to other wireless technologies such as "WiFi" or wireless cellular technology. Examples of the short-range communication module 226 may include communication endpoints conforming to the Bluetooth standard, the Bluetooth Low Energy (BLE, Bluetooth Low Energy) standard, or other short-range communication standards as required or desired.

The baseboard management controller 232 includes configuration information 234 and a short-range communication module 236 . Similar to the configuration information 224 , the configuration information 234 is embodied as management information used by the data center management system 250 to monitor, manage and maintain the data center equipment 230 . The configuration information 234 can be embodied as physical information related to the data center equipment 230 or as information related to the logical configuration of the data center equipment. For example, the data center equipment 230 can be embodied as a blade server, and the configuration information 234 can include: the model of the server, the style of the server, the maintenance label, the number of blades, and other physical information related to the server; the configuration information 234 can also It may include: the location information of the blade server in the server rack 210 and the location information of the server rack in the data center 200; the configuration information 234 may also include: information related to the operating status of the blade server, the information includes: Physical operation status and logical operation status (such as error status information and alarm status information); configuration information 234 may also include: information related to the installed operating system, workload and processing tasks performed by the blade server, and other information for Information identifying the purpose of the server. The near field communication module 236 is similar to the field communication module 226, and the near field communication module 236 can establish a wireless communication link to other devices assembled in a similar manner (shown as the short range communication module 262 in the figure) 282.

The baseboard management controller 242 includes: configuration information 244 and a short-distance communication module 246 . The configuration information 244 is similar to the configuration information 224 and the configuration information 234 , and the configuration information 244 is embodied as management information for the data center management system 250 to monitor, manage and maintain the data center equipment 240 . The configuration information 244 can be embodied as physical information related to the data center equipment 240 or as information related to the logical configuration of the data center equipment. For example, where data center equipment 240 is embodied as a storage server, configuration information 244 may include: server model, model, repair label, number of storage servers, and other physical information related to the server. For example, where data center equipment 240 is embodied as a storage server, configuration information 244 may include: model number of server, model of server, service label, number of storage drives, capacity of multiple storage drives, and other physical information related to the server; the configuration information 244 may also include the location information of the server in the server rack 210 and the location information of the server rack in the data center 200; the configuration information 244 may also include information related to the operating status of the server information, the information includes: physical operation status and logical operation status (such as error status information and alarm status information); and configuration information 244 can also include: related to the physical drive, logical drive and virtual drive configuration implemented on the storage drive information and other information used to identify the purpose of this server. The near field communication module 246 is similar to the near field communication module 226 and the near field communication module 236, and the near field communication module 246 can establish communication with other devices equipped in a similar way (the short-range communication shown in the figure). Module 262) wireless communication link 282. It should be understood that among various short-distance communication standards, the near-field communication module 226, the near-field communication module 236, the near-field communication module 246 and the short-distance communication module 262 can only establish short-distance communication with another at a time. A single wireless link between modules. The method of establishing a wireless communication link between short-distance communication modules and the method of establishing a link to other modules are known in the technical field of the present invention, so these are not described here except for the purpose of teaching. The method is described in detail. Although the communication link between the data center equipment and the mobile server device is shown as a wireless communication link, the aforementioned communication link need not be a wireless communication link. Specifically, in the embodiment in which the mobile maintenance device 260 is embodied as the computer system on the ambulance of the data center, it can be understood that, according to needs or expectations, the communication link between the mobile maintenance device and the data center equipment can also be embodied as Wired communication links such as via Ethernet, Universal Serial Bus, or other wired communication structures.

The data center management system 250 can be embodied as a centralized and unified processing resource, so as to communicate between the data center management system and the baseboard management controller 222, the baseboard management controller 232, and the baseboard management controller 242 through the management network 280. Each connection monitors, manages and maintains the data center equipment 220 , the data center equipment 230 and the data center equipment 240 . Wherein, the data center management system 250 may include a wireless communication module 252, and the wireless communication module 252 may be embodied as a wireless communication endpoint, which can be established to achieve similar devices (the mobile maintenance device shown in the figure 262 wireless communication module 264). Compared to other wireless technologies such as wireless cellular technology, the wireless communication module 252 can provide a medium-range connection range. Examples of short-range connectivity modules may include communication endpoints that comply with various IEEE 802.11 (Wi-Fi) standards or another medium-range communication standard, as needed or desired.

Mobile maintenance device 260 may embody a device used by data center maintenance personnel for monitoring, managing, and maintaining data center equipment 220, data center equipment 230, and data center equipment 240, and may be embodied as a laptop device such as and mobile devices such as smart phones. The mobile maintenance device 260 includes: a short-distance communication module 262 , a wireless communication module 264 , a camera/video system 266 , an accelerometer module 268 , an equipment image library 270 , an augmented reality evaluation module 272 and a display 274 . The short-distance communication module 262 is used to establish a communication link 282 with the short-distance communication module 226 , the near-field communication module 236 and the near-field communication module 246 . It should be understood that under certain short-distance wireless communication standards, the communication link 282 can only be embodied as a communication link for any of the short-distance communication module 226, the near-field communication module 236, the near-field communication module 246 and the wireless communication module 264. One-to-one point-to-point communication links, for example, a specific Bluetooth endpoint or Bluetooth low energy endpoint creates only one point-to-point communication link at a time. The method of switching between such point-to-point communication links is known in the technical field of the present invention, so unless it is necessary to describe the technical teaching, it will not be repeated here. The wireless communication module 264 can establish a communication link 284 with the wireless communication module 252 . Here, it can be understood that one or both of the wireless communication module 252 and the wireless communication module 264 can be embodied as an access point device, and this access point device can establish as many communication links as the communication link 284 according to needs or desires. communication links.

The camera/video system 266 may be embodied as an integrated device of the mobile maintenance device 260, which is used to capture still and dynamic images from the surrounding environment of the mobile maintenance device. The field of view of the camera/video system 266 can be limited to a specific area in front of the mobile maintenance device 260 . However, it will be appreciated that by moving the mobile maintenance device 260, other image spaces can be brought into the field of view of the camera/video system 266 which has the ability to stitch together a larger image of which The field of view covered is larger than that of a single camera/video system. The method and mechanism of configuring the camera/video system are known in the technical field to which the present invention belongs, so unless it is necessary to describe the technical teaching, it will not be repeated here. The accelerometer module 268 can be embodied as an integrated device of the mobile maintenance device 260, and the accelerometer module can be used to track the movement of the mobile maintenance device in three-dimensional space. Thus, at a particular location, the accelerometer module 268 can determine the relative position to which the mobile maintenance device 260 is moved based on the acceleration experienced by the mobile maintenance device. At the same time, the accelerometer module 268 can also have the capability of locating mobile maintenance devices in the data center 200 . For example, the accelerometer module 268 may include a Global Positioning System (GPS) function to determine the location, or the accelerometer module 268 may include a multi-communication link based on the establishment of a plurality of communication links similar to the communication link 284. Triangulating function. Accelerometer module 268 may also include a gyroscope mechanism to determine the orientation of mobile maintenance device 260 as needed or desired. The method and mechanism of configuring the accelerometer module are already known in the technical field of the present invention, so unless description of the technical teaching is required, no further description is given here.

The image library 270 can be embodied as an information structure, which can store image objects representing various data center devices, such as server racks 210, data center devices 220, data center devices 230 . Data center equipment 240 and other data center equipment that can be used in the data center 200 . In particular, image library 270 may be provided by the manufacturer of the data center equipment, where each image object may be associated with a specific piece of data center equipment or with a specific series of data center equipment. For example, where data center equipment 210 is embodied as a particular type of top-of-rack switch manufactured by a particular manufacturer, image repository 270 may contain one or more image objects associated with a top-of-rack switch, and specifically In other words, an image library may contain specific image objects associated with a specific type of top-of-rack switch. More specifically, specific image objects may be embodied as visible features of a specific type of top-of-rack switch in basic form. Image objects may also contain other types of visually distinguishable information, such as quick response matrix codes (QR-codes), barcodes, service labels, or Additional information for visual identification of storage racks and data center equipment.

In addition to image objects, image library 270 also includes database information related to each image object. The database information contains information related to the specific type of data center equipment depicted by the image object. Thus, also where data center equipment 210 is embodied as a specific type of rack switch, the associated database information may include: name, product code, database stock keeping unit (SKU), used for rack top Other information identifying the specific type of switch (such as the number of network ports, associated switch fabric, switching speed and data throughput information or other information about top-of-rack switches), such as installed optional equipment and the like configuration information or other information as needed or desired to identify the type of top-of-rack switch. In a specific embodiment, image library 270 is provided by multiple manufacturers of different parts of data center equipment and is routinely updated as new types of data center equipment are released. In general, image objects and associated database information in image library 270 may be compared with image data from the field of view of camera/video system 266 to assist assessment module 272 in determining the location of mobile maintenance device 260 in the following manner mentioned.

It can be appreciated that a typical data center may include hundreds or thousands of server racks similar to server rack 210, and each server rack may have data center equipment similar to data center equipment 220, data center equipment 230 and various data center equipment of data center equipment 240 . It should also be understood that certain server racks may contain a common set of data center equipment, for example, a specific model and style of top-of-rack switches contained in a top rack unit of a server rack, The specific model and style of blade server contained in the lower rack unit, the specific model and style of storage server contained in the bottom rack unit of the server rack. Thus, a typical data center may contain rows of server racks that are not visually distinguishable from one another or have only subtle visual differences that distinguish the server racks. In addition, the various styles of a particular type of data center equipment may also be visually identical or there may be only subtle visual differences that distinguish the style of such data center equipment. It is further understood that, even though the different server racks or data center equipment may not be visually differentiated, the data processing tasks performed on each server rack will be different from the data processing tasks performed on other server racks tasks, but the difference in data processing tasks does not provide visual cues to indicate which server rack is performing a specific data processing task.

The augmented reality assessment module 272 can be used to embody the processing functions of the mobile maintenance device 260 to provide an augmented reality visual depiction of the surrounding environment of the overlaid mobile maintenance device on the display 274 . Then, the augmented reality display signal can be generated by the augmented reality assessment module 272 based on various input signals to the mobile maintenance device 260, wherein the various input signals include image data from the camera/video system 266, accelerometer Location information of module 268, configuration information from one or more of data center equipment 220, data center equipment 230, and data center equipment 240 via communication link 282, configuration information from data center management system 250 via communication link 284 The information may be other input information available to the mobile repair device. Specifically, the evaluation module 272 is used to identify data center equipment in the server rack 210 . The evaluation module 272 can then present the image information from the camera/video system 268 on the display 274 and match the correct image objects with the components of the server rack 210, thereby making the augmented reality of the matched image objects An overlay is projected onto each component of the server rack. In addition to the projected image objects, the evaluation module 272 may also display relevant identification information in the projected image objects used to identify various components of the server rack.

FIG. 3 shows an embodiment of a display 300 similar to display 274 . The display 274 can present image information 302 from the camera/video system, wherein the image information 302 shows current conditions within the field of view of the camera/video system. Here, an evaluation module similar to evaluation module 272 may project augmented reality overlay 304 onto screen 300 . It should be noted that on top of the image information 302, the augmented reality overlay 304 provides information for identifying the server rack and the components within the server rack. At the same time, it should be understood that when the image information 302 changes (for example, the field of view of the camera/video system changes due to the mobile maintenance device being moved), the augmented reality overlay layer 304 also changes to match the image information. Matching to identify new components in the data center entering the camera/video system's field of view. Mechanisms and methods for creating augmented reality overlays for the display of image information are known in the art to which the present invention pertains, and therefore will not be described here unless necessary to describe the technical teachings. In addition to the benefits gained in the present invention through the use of augmented reality representations to enable maintenance technicians to identify data center equipment in their vicinity, the present invention can also be used by making information such as location information, visual information, and configuration information available for action. The availability of sensor data for maintenance devices improves the ability to identify data center equipment.

In addition to identifying components in the server rack 210, the evaluation module 272 can also identify the location of the mobile maintenance device 260 within the data center 200 and extend the location of the user within the data center. FIG. 4 illustrates a method for identifying a specific one of the data center devices within the data center 200 beginning at block 400 . In block 402 , the evaluation module 272 identifies available communication links for the short-range communication module 262 . In block 404, for each available communication link, the evaluation module 272 may query configuration information of each data center device. In block 406, the maintenance technician of the data center 200 can use the mobile maintenance device 260 to scan the area around the mobile maintenance device 266 through the camera/video system 266, and evaluate the image from the camera/video system 266 through the evaluation module 272 The image data is evaluated, and then the image data is compared with the image objects in the image database 270, so as to make a preliminary evaluation on the type of data center equipment near the mobile maintenance device 260. Specifically, the assessment module 272 can narrow down the range of types of data center equipment to a few possible types. Further, the range of types of data center equipment can be narrowed down as needed or desired based on the image target of each data center equipment or based on the known configuration of the data center equipment within the server racks.

In block 408 , the evaluation module 272 may apply heuristics to the configuration information 410 received from the data center equipment via the communication link 282 . Specifically, within the possible range of types of data center equipment determined in block 406, the first sub-step in block 408 enables the evaluation module 272 to further evaluate the types and types of data center equipment that may be generated The configuration information received from the data center equipment is compared. Here, the evaluation module 272 uses the received configuration information to eliminate possible types of data center equipment that are clearly not identified through the model/model/configuration information. In the next sub-step, the evaluation module 272 further compares the type of data center equipment that may be generated with the known type of data center equipment at the specific location identified through the location information. In the subsequent steps, the evaluation module 272 further compares the possible combinations of data center equipment with the received operating status information and logic information, so as to further evaluate the representation and location of data center equipment and server racks verify. In various sub-steps, the assessment module 272 is used to ascribe confidence scores to the identification and location of data center equipment and server racks. In one embodiment, the assessment module 272 may employ a confidence threshold so that when the confidence score is higher than the confidence threshold, a data center device or specific device in a server rack has been authenticated by being identified and located .

In decision block 412, based on the evaluation made in block 408, it is determined whether a single type of data center equipment has been identified. If the determination result is "Yes", then the branch of "Yes" in the decision box 412 can be executed, and then the data center equipment can be identified and located in the box 416, and the data center equipment can be displayed on the screen of the mobile maintenance device 260 and its location, so that the evaluation module can present an augmented reality overlay on the display 274, and then the method ends at block 420. If multiple types of data center equipment are still identified as possible matches or the data center equipment does not receive a confidence score above the confidence threshold, then the "no" branch of decision block 412 may be executed, followed by action on maintenance device 260. The user may be prompted to manually assign the type and location of the data center equipment at block 414, and the assessment module 272 may display an augmented reality of the data center equipment and its location on the screen of the mobile maintenance device 260 at block 416. The environment is depicted, and then the method ends at block 420.

FIG. 5 is an enlarged view of the data center 200 . As shown in FIG. 2 , the data center 200 includes: a server rack 210 , a data center management system 250 and a mobile maintenance device 260 . It should be noted that the illustrated data center 200 includes three rows of server racks. Each row of server racks shown includes eight server racks similar to server rack 210 with aisles between each row of server racks. In addition, each row of server racks contains an alley to allow maintenance technicians to move between rows. Here, the mobile maintenance device 260 may be identified as being located in front of the server rack 210 based on the evaluation performed by the aforementioned evaluation module 272 . Therefore, in addition to the benefits of depicting the identification of surrounding data center equipment and the location of maintenance technicians in the data center to maintenance technicians through augmented reality, by using data (such as location information, visual information, etc.) and configuration information) and data related to data center mapping, the present invention provides improvements in the ability to reliably identify and locate data center equipment.

FIG. 6 is an expanded view of a data center 600 similar to the data center 200 . The data center 600 includes three rows of server racks 610 . Each row is depicted as containing eight server racks 610 with aisles between columns of server racks. In addition, each row of server racks contains an alley to allow maintenance technicians to move between rows. Here, as indicated by dotted lines, the illustrated server racks 610 are arranged in a mesh network connected to each other. In one embodiment, the server rack 610 includes a mesh node capable of communicating with at least one mesh node of an adjacent server rack. The mesh network node can include a short-distance communication module, which is similar to the short-distance communication module shown in FIG. 2 . In another embodiment, a short-range communication module similar to that shown in FIG. 2 is used in a data center between each server rack 610 and other adjacent server racks. Create a mesh network between devices. In any one of the aforementioned two embodiments, the data center management system 620 is used to manage the mesh network. In a specific embodiment, the aforementioned mesh network may cover the management network determined by the data center management system 620 in the data center 600 . In this way, the data center management system 620 does not need to maintain a single communication link with each server rack 610 or portion of the data center equipment, but can use existing data routing technology to connect to each server rack 610 and the data center equipment. Search for the best path for data center equipment. Additionally, by overlaying the mesh network on the management network, network security and trust can be established based on known systems in the data center, and unknown systems can be prevented from joining the mesh network. In a specific embodiment, the data center management system 620 already knows the map of the data center 600 . Here, the known map can supplement the information derived from the determination of the mesh network. In another embodiment, the data center management system 620 does not know the map of the data center 600 . Here, the determination of the mesh network provides a relative map of the data center 600 since each node in the mesh network can know the neighboring nodes to which the first node is connected. Furthermore, by using existing distance determination methods, relative distances between nodes can be determined.

FIG. 6 also depicts a user with a mobile service device 630 similar to mobile service device 260 . As shown, users are at different locations in the data center 600 at different times (T0, T1, T2, T3, T4). The mobile maintenance device 630 in the server rack, the server rack 610 and the data center equipment are equipped with a short-distance communication module similar to the short-distance communication module shown in FIG. 2 . Here, when the user moves in the data center 600 , the short-distance communication module of the mobile maintenance device 630 can establish a communication link with the server rack 610 and the mobile maintenance device 630 within the range of the short-distance communication module. According to the aforementioned manner, the location of the mobile maintenance device 630 can be determined based on the established communication link with the mobile maintenance device. Here, in an embodiment where the map of the data center 600 is known, the absolute location of the mobile maintenance device 630 within the data center can be determined.

In an embodiment where the map of the data center 600 is unknown, the relative location of the mobile maintenance device 630 within the data center can be determined. In addition, the mobile maintenance device 630 can be used to convert the unknown relative map of the data center 600 into a known map of the data center. Here, when the mobile maintenance device 630 enters the data center 600 and establishes the first communication link with the data center equipment of the first server rack 610, the user of the mobile maintenance device can be prompted to input the first server in the data center. The absolute position of the machine frame. For example, a relative graph obtained from a mesh network can usually be flattened into a two-dimensional graph, but the specific corner nodes of the map can be located at the upper left corner of the data center 600, the upper right corner of the data center, the lower left corner of the data center, and the lower right corner. Here, the mobile maintenance device 630 may provide the user with four options for selection, and the user may select an orientation that reflects the absolute orientation of the data center 600 . In the case of inaccuracies in the relative map derived from the mesh network, provide the user with more specific input options on the mobile maintenance device 630, and then obtain a better absolute view of the data center 600 over a period of time map.

In an embodiment, mobile maintenance device 630 includes an accelerometer module similar to accelerometer module 264 . Here, in addition to the location information acquired through the communication link established with the server rack 610 or the equipment therein, the mobile maintenance device 630 can also use the accelerometer module to further specifically determine the location of the mobile maintenance device. In particular, as described above, by using the location signature of the accelerometer module, the absolute location of the mobile service device 630 can be used to verify the location derived from the communication link. More specifically, in a situation where the absolute map of the data center 600 is unknown, the absolute location of a corner of the data center can be automatically defined using the location feature without resorting to the aforementioned user input. Additionally, the use of the accelerometer feature of the accelerometer module provides motion-based input to further verify and refine the location of the mobile maintenance device 630 within the data center 600 . Here, when the accelerometer module indicates that the mobile maintenance device 630 is in a static state, the position can be determined through the methods described in the above-mentioned embodiments. However, when the accelerometer module indicates that the mobile maintenance device 630 is in motion, the range of movement before a new communication connection is established or before an existing communication connection is terminated can be used to better determine the location of the mobile maintenance device within the data center. Calibrated and used for further verification of the server rack 610 and the equipment therein. "Table 1" shows the movement of the mobile maintenance device 630 in the data center 600 at different times based on the communication link status and the accelerometer input. "Table 1" Location Tracking time link created Accelerometer T0 A0, A1, B0, B1 X=0, Y=0 T1 A1, A2, B1, B2 X=+1, Y=0 T2 A2, A3, B2, B3 X=+2, Y=0 T3 B3, B4 X=+3.5,Y=+1.5 T4 B4, B5, C4, C5 X=+5, Y=+3 T5 B5, B6, C5, C6 X=+6, Y=+3

In another embodiment, mobile maintenance device 630 includes: a camera/video system similar to camera/video system 266 , an image library similar to image library 270 , and an evaluation module similar to evaluation module 272 . Here, the mobile maintenance device 630 is used to compare the image data from the camera/video system and the image object from the image database, and further verify the location of the mobile maintenance device in the data center 600 through the comparison information.

FIG. 7 shows a method for navigating a specific device of a data center device starting from block 700 . In block 702, a location map may be created for server racks and data center equipment within a data center. Here, the location map of each server rack and data center can be determined in advance, or based on the communication link established between the data center equipment and the mobile maintenance device, received configuration information, movement information, GPS information Or other location information, virtual configuration information and other information to determine the location map of each server rack and data center. After the location map is determined, in block 704, assign each server rack and data center equipment as nodes; meanwhile, in block 704, path intersection points between adjacent nodes can be calculated. In block 706, the data center management system may identify one or more server racks or data center equipment that require the attention of a data center service technician. If a single component of the data center requires repair, the data center management system may be directed at block 708 to determine the shortest path between the current location of the service technician and the location of the single component of the data center. Here, the shortest path may be determined based on breadth-first search or other suitable path mapping algorithms as needed or desired. If repairs are required to multiple elements of the data center, then in block 710 the data center management system determines a route between the current location of the repair technician and the location of the multiple elements of the data center. For example, routes between multiple locations may be determined through traveling salesman search or other suitable route mapping algorithms, as needed or desired.

In block 712, the data center management system may send the routing information from one of blocks 708 and 710 to the mobile maintenance device of the maintenance technician to present an augmented reality visualization of the routing information. Here, the mobile service device's camera/video system can be run to display the camera/video system's field of view with an augmented reality overlay on the mobile service device's display to show the service technician the way to Path to the next server rack or data center equipment for maintenance. In block 714, a beacon may be provided to the service technician to identify the server rack or data center device as the service technician approaches the particular server rack or data center device. For example, augmented reality visualizations may provide indications, either through icons displayed on data center elements, or by flashing data center elements on an augmented reality overlay, or Displays data center components requiring repair by other methods. In another example, server racks or data center equipment requiring service may include individual signage devices, such as flashing lights or light emitting diodes, to indicate that the component requires service. The method ends in block 716 .

FIG. 8 shows an augmented reality visualization 800 on a mobile maintenance device for navigating to a specific piece of data center equipment 802 . Augmented reality visualization 800 shows an image of the field of view of a camera/video system in a mobile maintenance device that may embody target server rack 802 and server rack 810 . The route to the server rack 802 can be shown through the route indicator 804 , wherein the route indicator 804 is used to show the maintenance technician the route to reach the target server rack 802 . Here, it should be noted that although the route indicator 804 in the figure only shows a simple straight line path, the route indicator does not necessarily display a straight line. Specifically, augmented reality visualization 800 can display images from the field of view of the camera/video system in the center of a small portion of the display of the mobile maintenance device and externally display data centered outside the field of view of the camera/video system components. Here, the route indicator 804 may show the full range of paths to the components requiring repair in the different aisles of the data center, where the route indicator also shows the turns required to maintain the path. When the mobile maintenance device is close to the target server rack 802, the target server rack can be indicated by displaying the icon 806, and the marking device on the specific equipment of the target server rack or data center equipment that needs to be repaired can be used 808 for blinking. Thus, with available sensor data such as location information and movement information, visual information and configuration information available for mobile servos, and information related to data center maps, the present invention can be used to describe to maintenance technicians through augmented reality In addition to the benefits of data center equipment in its vicinity, the location of maintenance personnel within the data center, and the scheduling of multiple maintenance components in the data center, the present invention also provides reliable identification, location and The benefits of scheduling.

For the purposes of this invention, an information processing system may include any instrumentality, or collection of techniques, that enables the processing of information, intelligence, or data in any form for commercial, scientific, control, entertainment, or other purposes. Compute, classify, process, transmit, receive, retrieve, create, exchange, store, display, embody, detect, record, reproduce, process or use. For example, an information processing system may be a personal computer, a laptop computer, a smart computer, a desktop device, a consumer electronic device, a network server, a network storage device, a switch router, other network communication devices, or any other suitable device , At the same time, this information processing system can also have many different sizes, shapes, performances, functions and prices. In addition, the information processing system may include: processing resources such as a central processing unit (CPU, central processing unit) for executing executable machine-executable code; a programmable logic array (PLA, programmable logic array); such as a system-on-chip (SoC, System-on-a-Chip) built-in device or other control logic hardware. The information handling system may also include one or more computer-readable media for storing machine-executable code, such as software or data. Other components of an information handling system may also include: one or more memory devices, which may be used to store machine-executable code; one or more communication ports, which may be used to communicate with external devices; and various input and output (I/O) devices such as keyboards, keyboards and mice, and video monitors. An information handling system may also include one or more buses that may be used to transfer information between various hardware components.

According to various embodiments of the present invention, the disclosed methods are implemented by software programs executable by a computer system. In addition, for illustration purposes, in a non-limiting embodiment of the present invention, various embodiments disclosed in the present invention may include: distributed processing, component/object distributed processing, and parallel processing. Alternatively, one or more methods and functions disclosed in the present invention can be executed through a virtual computer system.

The present invention also relates to a computer-readable medium containing instructions, or the computer-readable medium can receive and execute instructions in response to transmitted signals, thereby enabling devices connected to the network to Communication in the form of voice, video or data. In addition, the aforesaid instructions can also be sent or received through the network via the network interface device.

Although the computer-readable medium disclosed in the specification of the present invention refers to a single medium, the term "computer-readable medium" may include: a single medium or multiple media such as a centralized database or a distributed database; and/or Cache memory and servers that store one or more sets of instructions. The term "computer-readable medium" may also include any medium that can store, encode, or carry a set of instructions, wherein the aforementioned instructions can be executed by a processor; or the aforementioned medium can enable a computer system to execute one or more of the methods disclosed in the present invention. method and function. In one non-limiting embodiment of the invention, the computer readable medium may comprise solid state memory such as a memory card or other package loaded with one or more non-volatile read-only memories.

Additionally, the computer readable medium can be random access memory or other volatile rewritable memory. In addition, computer readable media may include magneto-optical media or optical media, such as magnetic disks, tapes, or other storage devices, for storing information received via a carrier signal, such as a signal communicated through a transmission medium. Digital files attached to e-mail, stand-alone information files, or collections can be considered distribution media equivalent to tangible storage media. Accordingly, the present invention may be considered to include computer-readable media, distribution media, other equivalents, and replacement media storing data or instructions.

Although only certain exemplary embodiments have been described in detail above, those skilled in the art will appreciate that various modifications are possible in the exemplary embodiments of this invention without materially departing from the novel teachings and advantages of this invention. Accordingly, all such modifications fall within the scope of the embodiments of the present invention as defined by the claims. In the scope of the patent application, the means-plus-function clause used not only covers the structure described in this specification to perform the defined function, but also not only the equivalent of the structure, but also the equivalent Structure.

100: Information Processing System 102,104: Processor 106,108: Processor interface 110: chipset, chipset processor interface 112: Input/output channel 120: memory 122:Memory interface 130: Graphics Adapter 132: Graphical interface 134: video display 136: Video display output device 140: Non-volatile random access memory (NV-RAM, non-volatile RAM) 142: Basic Input Output System/Extensible Firmware Interface (BIOS/EFI) Module 150: Disk controller 152: Disk interface 154: hard disk drive (HDD, hard disk drive) 156: Optical disk drive (ODD, optical disk drive) 160:Disk Emulator 162: external interface 164: Solid state disk drive (SSD, solid state drive) 170: input/output (I/O) interface 172: peripheral interface, peripheral channel 174:Additional resources 176: Trusted platform module (TPM, trusted platform module) 180: Network interface 182: network channel, network channel 190: Baseboard Management Controller (BMC) 192: Management interface 194: Network interface 200: data center 210: server rack 220,230,240: data center equipment 222,232,242: Baseboard Management Controllers 224,234,244: configuration information 226,236,246: short distance communication module, near field communication module 250:Data center management system 252,264: Wireless communication module 260: mobile maintenance device 262: Short distance communication module, mobile maintenance device 266: Camera/Video System, Camera/Video System 268: Accelerometer module 270: Image library 272: Evaluation Module 274,600: displays 280: Manage network 282: Wireless communication link 284:Communication link 300: monitor, screen 302,602: Video information 304, 604: Augmented Reality Overlays 400-410,500-512: box 606,608:Module 702,706: Enlarged view 704,708: information

It should be understood that for simplicity and clarity of description, elements in the drawings of the present invention are not drawn strictly to scale. For example, the proportions of some elements are exaggerated relative to other elements. Embodiments of the invention incorporating the teachings of the invention are shown and described with reference to the accompanying drawings in which:

Fig. 1 is a block diagram of an information processing system in an embodiment of the present invention;

Fig. 2 is a block diagram of a data center in an embodiment of the present invention;

FIG. 3 is a screenshot of the display of an augmented reality overlay in an embodiment of the present invention;

4 is a flowchart of a method for identifying specific data center equipment in a data center in accordance with an embodiment of the present invention;

Fig. 5 is an illustration of the expanded view of the data center in Fig. 2;

FIG. 6 is an illustration of an expanded view of a data center in another embodiment of the present invention;

7 is a flowchart of a method for navigating to a specific data center device in an embodiment of the present invention; and

FIG. 8 shows an illustration of an augmented reality visualization of a method for navigating to a specific data center device in one embodiment of the invention.

The use of the same reference numbers in different drawings identifies similar or identical items.

200: data center

210: server rack

220,230,240: data center equipment

222,232,242: Baseboard Management Controllers

224,234,244: configuration information

226,236,246: short distance communication module, near field communication module

250: Data center management system

252,264: Wireless communication module

260: mobile maintenance device

262: Short distance communication module, mobile maintenance device

266: Camera/Video System, Camera/Video System

268: Accelerometer module

270: Image library

272: Evaluation Module

274: display

280: Manage network

282: Wireless communication link

284:Communication link

Claims (10)

An information processing system, the information processing system is used to identify a data center equipment, wherein the information processing system includes: a display; an image library, which contains a plurality of image objects related to various data center equipment; a first wireless communication interface; a second wireless communication interface; and an imaging system configured to acquire image data from a field of view of the imaging system; wherein the information processing system is configured to: via The first wireless communication interface establishes a first wireless communication link with a first component of the data center equipment; receives first identification information from the first component through the first wireless communication link, and uses the first identification information In distinguishing the first element from a second element of the data center equipment, the first element is visually indistinguishable from the second element, and the first identification information is used to identify a use in which the first element is passed assembled for the use; acquiring image data when the field of view includes the first element; displaying the image data on the display; matching a first portion of the image data to a first image object, wherein The first image object is associated with the first element and the second element, wherein upon matching the first portion of the image data with the first image object, the information processing system is further configured to the image comparing data with a plurality of image objects including the first image object; determining a confidence score for a first identification of the first element based on the first identification information and the first image object, wherein in determining the When scoring confidence scores, the information processing system is further configured to compare an identifier associated with the first identification information with an identifier associated with the first image object comparing; determining the first identification of the first component when the confidence score is higher than a threshold confidence score; and establishing a second wireless communication link with a data center management system via the second wireless communication interface; receiving a verification of the first identification of the first component from the data center management system; displaying an augmented reality overlay on the image data on the display, wherein the augmented reality overlay corresponds to the first portion located concurrently with the first image object, and including the first marker on the first portion, wherein the information handling system further includes a position device configured to determine a position of the information handling system; wherein the The information handling system is further configured to: receive a map of the data center including a first location associated with the first element; determine the information handling system when the field of view includes the first element a second location; and determining that the second location is adjacent to the first location, wherein the determination of the first identification of the first element is further based on the second location being adjacent to the first location. The information processing system as described in claim 1 is further used for: establishing a third wireless communication link with the second component through the first wireless communication interface; receiving from the second component through the third wireless communication link second identification information, the second identification information being different from the first identification information; matching a second portion of the image data to the first image object, wherein the field of view also includes the second element; and based on the The second identification information and the first image object determine a second identification of the second element, wherein the augmented reality overlay layer also locates the second part and the first image object simultaneously, and at the first image object The second part contains the second identification. The information processing system as described in claim 2, further configured to: establish a fourth wireless communication link with a third component of the data center equipment through the first wireless communication interface, wherein the field of view also includes the third element; receiving third identification information from the third element via the fourth wireless communication link, the third identification information distinguishing the third element from the first element, the third element being visually different from the third element the first element and the second element; matching a third portion of the image data to a second image object, wherein the second image object is associated with the third element; and based on the third identification information and the first image object The second video object determines a third logo of the third element, wherein the augmented reality overlay layer is positioned on the third part simultaneously with the second video object, and contains the third logo on the third part. The information processing system according to claim 1, wherein the location device includes at least one of a global positioning system locator and an accelerometer. An identification method, the identification method is used to identify data center equipment in a data center, the identification method includes: establishing a connection with a first component of the data center equipment through a first wireless communication interface of an information processing system A first wireless communication link; receiving first identification information from the first component via the first wireless communication link, the first identification information being used to distinguish the first component from a second component of the data center equipment , the first element is visually indistinguishable from the second element, and the first identification information is used to identify a use for which the first element is assembled; when a field of view includes the first In the case of an element, image data is acquired using a vision system of the information processing system configured to acquire image data from the field of view of the vision system; displaying the image data on a display of the information processing system; matching a first portion of the image data to a first image object, wherein the first image object is associated with the first element and the second element, Wherein when matching the first portion of the image data with the first image object, the method further includes comparing the image data with a plurality of image objects including the first image object; based on the first identification information and Determining a confidence score for a first identifier of the first element for the first image object, wherein in determining the confidence score, the method further includes associating an identifier with the first identification information and comparing with an identifier associated with the first image object; determining the first identifier of the first element and communicating via a second wireless communication with the information handling system when the confidence score is higher than a threshold confidence score interface with a data center management system to establish a second wireless communication link; receive a verification of the first identification of the first component from the data center management system; and display an expanded display on the image data on the display The augmented reality overlay layer, wherein the augmented reality overlay layer locates the first portion simultaneously with the first image object, and includes the first logo on the first portion, wherein the method further includes: receiving one of a data center a map including a first location associated with the first element; when the field of view includes the first element, by one of the information handling systems configured to determine a location of the information handling system location means for determining a second location of the information handling system; and determining that the second location is adjacent to the first location, wherein the determination of a first identification of the first element is also based on the second location being adjacent to in the first position. The identification method described in claim 5 also includes: Establish a third wireless communication link with the second component through the first wireless communication interface; receive second identification information from the second component through the third wireless communication link, and the second identification information and the first identification information information is different; matching a second portion of the image data with a first image object, wherein the field of view also includes the second element; and determining the second element based on the second identification information and the first image object A second logo, wherein the augmented reality overlay layer is also positioned on the second portion simultaneously with the first image object, and includes the second logo on the second portion. The identification method as described in Claim 6, further comprising: establishing a fourth wireless communication link with a third component of the data center equipment via the first wireless communication interface, wherein the field of view also includes the third component; via The fourth wireless communication link receives third identification information from the third element, the third identification information distinguishes the third element from the first element, the third element is visually distinct from the first element and the second element; matching a third portion of the image data with a second image object, wherein the second image object is associated with the third element; and determining the second image object based on the third identification information and the second image object A third logo of the third element, wherein the augmented reality overlapping layer further positions the third part and the second image object simultaneously, and contains the third logo on the third part. The identification method according to claim 5, wherein the location device includes at least one of a global positioning system locator and an accelerometer. An information processing system comprising: a first element of data center equipment including a first wireless communication interface; and The mobile maintenance device includes: a display; an image library containing a plurality of image objects related to various data center equipment; a second wireless communication interface via a first wireless communication link with the The first wireless communication interface is coupled; a third wireless communication interface is coupled to a data center management system via a second wireless communication link; and a video system is configured to receive data from one of the video systems Acquire image data within the field of view; wherein, the mobile maintenance device is configured to: receive first identification information from the first component via the first wireless communication link, and the first identification information is used to distinguish the first component and a second element of the data center equipment, the first element being visually indistinguishable from the second element and the first identification information identifying a use for which the element is assembled; when When the field of view includes the first element, acquiring image data; displaying the image data on the display; matching a first portion of the image data with a first image object, wherein the first image object is associated with The first element and the second element, wherein when matching the first portion of the image data with the first image object, the information processing system is further configured to match the image data with the first image object A plurality of image objects are compared; a confidence score for a first identification of the first element is determined based on the first identification information and the first image object, wherein when determining the confidence score, the information processing The system is further configured to compare an identifier associated with the first identification information with an identifier associated with the first image object; determine that the first image object is identified when the confidence score is greater than a threshold confidence score the first identification of a component receiving a verification of the first identification of the first element from the data center management system; and displaying an augmented reality overlay on the image data on the display, wherein the augmented reality overlay corresponds to the first element a portion is located contemporaneously with the first image object and includes the first marker on the first portion, wherein the information handling system further includes a position device configured to determine a position of the information handling system; wherein The information handling system is further configured to: receive a map of the data center including a first location associated with the first element; determine the information handling system when the field of view includes the first element a second location; and determining that the second location is adjacent to the first location, wherein the determination of the first identification of the first element is further based on the second location being adjacent to the first location. The information processing system as described in Claim 9, further comprising: the second component, which includes a fourth wireless communication interface, and the fourth wireless communication interface is connected to the second wireless communication interface through a third wireless communication link coupled; wherein the mobile maintenance device is also used to: receive second identification information from the second component via the third wireless communication link, the second identification information is different from the first identification information; and one of the image data A second portion is matched to the first image object, wherein the field of view further includes the second element; and determining a second identifier of the second element based on the second identification information and the first image object, wherein the expanded The augmented reality overlapping layer further locates the second part and the first image object at the same time, and includes the second logo on the second part.

Images