CN110049121B - Data center inspection system based on augmented reality technology - Google Patents
Data center inspection system based on augmented reality technology Download PDFInfo
- Publication number
- CN110049121B CN110049121B CN201910296728.6A CN201910296728A CN110049121B CN 110049121 B CN110049121 B CN 110049121B CN 201910296728 A CN201910296728 A CN 201910296728A CN 110049121 B CN110049121 B CN 110049121B
- Authority
- CN
- China
- Prior art keywords
- information
- equipment
- inspection
- background server
- inspector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Alarm Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a data center inspection system based on augmented reality technology, which comprises: the first equipment is used for being worn on the body of the inspector, acquiring preset equipment information of the second equipment and transmitting the acquired preset equipment information to the background server, wherein the acquired preset equipment information comprises: the environment information of the second equipment and the identification information of the second equipment; the background server is used for calling routing inspection information corresponding to the collected and received preset equipment information according to the stored equipment data information base and transmitting the routing inspection information to the first equipment; the first equipment is also used for receiving and displaying the patrol inspection information transmitted by the background server and prompting an inspector to execute corresponding patrol inspection operation according to the patrol inspection information. Through transferring the routing inspection information related to the preset equipment information, the inspection personnel can conveniently conduct routing inspection, and the routing inspection time is saved.
Description
Technical Field
The invention relates to the technical field of data inspection, in particular to a data center inspection system based on an augmented reality technology.
Background
The inspection of the machine room related to the data center is a more complicated project, and generally inspectors inspect equipment in the machine room one by one according to knowledge mastered by the inspectors, including equipment line inspection and the like, so as to visually inspect and judge whether parts in the machine room equipment are damaged or not, or some machine rooms are provided with corresponding alarm devices to remind inspectors of problems such as whether equipment fails, however, in the process of patrolling, artificial missing and omission can exist, each patrolling item can not be ensured, and errors can occur in the judgment of equipment in a machine room indirectly, so that, if the inspector only inspects the machine room equipment according to knowledge and experience mastered by the inspector, the requirement for determining whether the equipment is intact cannot be met, and the inspector wastes a large amount of manpower and inspection time.
Disclosure of Invention
The invention provides a data center inspection system based on an augmented reality technology, which is used for facilitating inspection of inspectors and saving inspection time by calling inspection information related to preset equipment information.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology, which comprises:
the first equipment is used for being worn on the body of the inspector, acquiring preset equipment information of the second equipment and transmitting the acquired preset equipment information to the background server, wherein the acquired preset equipment information comprises: the environment information of the second equipment and the identification information of the second equipment; the first device is an Augmented Reality (AR) device;
the background server is used for calling routing inspection information corresponding to the preset equipment information collected by the first equipment according to the stored equipment data information base and transmitting the routing inspection information to the first equipment;
the first equipment is also used for receiving and displaying the routing inspection information transmitted by the background server.
In one possible way of realisation,
the first equipment is further used for outputting the inspection operation prompt corresponding to the inspection information so as to prompt an inspector to perform inspection operation according to the inspection operation prompt.
In one possible way of realisation,
the background server comprises:
the background monitoring module is used for monitoring the running condition of the second equipment, obtaining running monitoring data of the second equipment and transmitting the running monitoring data of the second equipment to the background storage module;
and the background storage module is used for receiving the operation monitoring data of the second equipment transmitted by the background monitoring module and storing the operation monitoring information of the second equipment into the equipment data information base.
In one possible way of realisation,
the first device includes:
the camera shooting assembly is used for shooting the environment of the routing inspection area where the second equipment is located, obtaining corresponding environment information and uploading the environment information to the background server;
the sensing component is used for sensing a second equipment identifier on the second equipment, acquiring second equipment identifier information and transmitting the second equipment identifier information to the background server;
the positioning component is used for positioning the position information of the current routing inspection area of the first equipment, acquiring three-dimensional space data corresponding to the position information and uploading the three-dimensional space data to the background server;
the background server is further used for performing virtual enhancement processing on the environmental information transmitted by the camera shooting assembly, the second equipment identification information transmitted by the sensing assembly and the three-dimensional space data transmitted by the positioning assembly to obtain data which can be displayed on virtual augmented reality equipment;
the first device further comprises:
a display component for displaying the obtained data displayable on a virtual augmented reality device.
In one possible way of realisation,
the sensing component is further used for sensing the ambient temperature of the current environment of the second equipment when the inspection instruction input by the inspector is received, and transmitting the ambient temperature to the background server;
the background server is further used for judging whether the ambient temperature is within the preset temperature range according to the received ambient temperature, and if not, sending a temperature warning instruction to an alarm module;
the alarm module is used for receiving a temperature warning instruction transmitted by the background server and executing corresponding warning operation according to the temperature warning instruction;
and if so, judging that the environmental temperature is within the preset temperature range.
In one possible way of realisation,
the first device further comprises:
the voice recognition module is used for acquiring the voice information input by the inspector, recognizing the voice information to acquire a corresponding voice instruction and transmitting the voice instruction to the background server;
the background server is also used for processing the voice instruction transmitted by the voice recognition module according to a voice information database to obtain a corresponding control instruction;
meanwhile, the background server is further configured to execute a corresponding operation according to the control instruction, obtain a corresponding control result, and transmit the control result to the first device;
the first device is further configured to receive the control result transmitted by the background server, and display the control result.
In one possible implementation manner, the method further includes:
the moving module is arranged on the first equipment and used for detecting the moving displacement of the inspector in the inspection area;
the positioning module is used for positioning the current position information of the first equipment and acquiring three-dimensional space data corresponding to the position information;
the tracking module is used for dynamically tracking the inspector according to the movement displacement detected by the moving module and the three-dimensional space data acquired by the positioning module and transmitting corresponding dynamic tracking information to the background server;
and the background server is also used for calling a dynamic coordinate value corresponding to the dynamic tracking information transmitted by the tracking module according to the stored position coordinate database, and generating a corresponding running track of the dynamic coordinate value and transmitting the running track to the first equipment for displaying in real time.
In one possible way of realisation,
the first device is further configured to receive a start detection control instruction input by the user, and transmit the start detection control instruction to the background server;
the background server is further used for sending the current routing inspection information of the second equipment associated with the starting detection information control instruction to an augmented reality interface of the first equipment when the starting detection information control instruction transmitted by the first equipment is received;
meanwhile, the inspector carries out corresponding inspection operation according to the inspection flow on the inspection information on the augmented reality interface;
the background server is further used for receiving a polling result which is uploaded by the inspector through the first equipment and corresponds to the current second equipment when the inspector conducts polling according to the related polling process; judging whether the current inspection result detected and related to the second equipment is consistent with a preset inspection result or not, if not, recording the current inspection result related to the second equipment, sending related warning information to an augmented reality interface of the first equipment for reminding, and simultaneously transmitting related prompt information to a management end for prompting;
and the background server is also used for sending the routing inspection line and routing inspection information related to the next second equipment to the augmented reality interface of the first equipment when the inspector finishes inspecting the current second equipment according to the routing inspection process.
In the background server, the specific steps when the routing inspection information corresponding to the preset equipment information collected by the first equipment is called are as follows:
the background server is provided with an information database, the information database is provided with S records in total, and each record comprises environment information of different second equipment, second equipment identification information and corresponding routing inspection information; the environment information of the second device comprises n1 indexes such as environment area, environment temperature, environment humidity, environment noise, environment altitude and oxygen content in air, the second device identification information comprises n2 indexes such as the function of the second device, the production year of the second device and the working power of the second device, and an index information matrix X with S rows and n1+ n2 columns and a vector Y formed by corresponding S pieces of inspection information are formed;
for the index in the information matrix X, discretizing the index with continuous index value in the information matrix by using a formula (1); there are countless possibilities that the index value is a continuous value, and the index value is a value corresponding to the index, for example, the altitude of the environment may be 100,200 may be any decimal between 100 and 200, there are countless possibilities,
wherein XitIs the value of the ith row and the tth column of the matrix X, X1itIs XitDiscretized value, floor () rounded down, min (X)t) Is the minimum value of the t-th column of the matrix X, max (X)t) The maximum value of the t-th column of the matrix X is i 1, 2, 3 … … S, t 1, 2, 3 … … n1+ n2, all continuous values are changed into classification values through the formula (1), the formed new matrix is changed into a classification matrix X1, meanwhile, the inspection information has P values in common, P is less than or equal to S, and the set of the vector Y is Y { Y { (Y) } Y1、y2、…ypWhere yi is the i-th value of set y, i is 1, 2, … … p; an infinite number of possible continuous values can be converted into a finite number of possible discrete values using equation (1), and there can be a probability for each value when calculating the probability.
For the information collected by the first device, obtaining a classification vector a of the information by using formula (1), where a is { a ═ a }1,a2,…,an1,an1+1,,an1+2,…,an1+nIn which aiIs the discretized value of the ith index of A, and then the vector A is calculated by using a formula (2) to correspond to each type of routing inspectionA probability of the information;
wherein the P (A | y)i) The vector A is the probability of the corresponding i-th type routing inspection information; p (a)j|yi) The value of the j index to be solved is ajThe probability of the corresponding value appearing in the ith type of routing inspection information is determined; 1, 2, … … p; j is 1, 2, … … n1, n1+1, n1+2 and … … n1+ n2, the probability that the vector A is corresponding to each type of patrol inspection information can be solved by using the formula (2), and in the calculation, for the index of the environment information where the second equipment is located, because the importance of the identifier information of the second equipment is higher in the patrol inspection, the probability is calculated, the index of the environment information where the second equipment is located, and because the probability is a value smaller than 1, the value after the calculation is larger than the original value, so that the weight of the value of the index of the environment information where the second equipment is located is increased;
wherein p (a)j|yi) The solution of (1) is to extract the record with j index value aj in the information matrix X1 after the dispersion, assume that there are Dj pieces of extracted information, and extract the patrol information corresponding to the records, if there are Mi pieces of Yi in the patrol information, then p (a)j|yi) Is shown in expression (3);
all p (a) to be derived by equation (3)j|yi) Substituting into equation (2), all P (A | y) can be calculatedi) Then, obtaining routing inspection information corresponding to preset equipment information corresponding to the information acquired by the first equipment corresponding to the vector A by using a formula (4);
max{P(y1)*P(A|y1),P(y2)*P(A|y2),…,P(yp)*P(A|yp)}
(4)
wherein P (y)i) The probability of the routing inspection information in the ith information database is 1, 2 and … … p; the inspection information corresponding to the maximum value is the inspection information corresponding to the preset equipment information corresponding to the information acquired by the first equipment.
When the technology is used for calling the routing inspection information corresponding to the preset equipment information collected by the first equipment by the background server, the routing inspection information corresponding to the collected preset equipment information can be accurately obtained by using a simple probability algorithm, and the operation efficiency of the background server is greatly improved.
In one possible way of realisation,
the patrol information includes: any one or more of a routing inspection line associated with the second device, and operational monitoring data of the second device.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic structural diagram of a data center patrol system based on an augmented reality technology in an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology, which comprises the following components as shown in figure 1:
the first equipment is used for being worn on the body of the inspector, acquiring preset equipment information of the second equipment and transmitting the acquired preset equipment information to the background server, wherein the acquired preset equipment information comprises: the environment information of the second equipment and the identification information of the second equipment; the first device is an Augmented Reality (AR) device;
the background server is used for calling routing inspection information corresponding to the preset equipment information collected by the first equipment according to the stored equipment data information base and transmitting the routing inspection information to the first equipment;
the first equipment is also used for receiving and displaying the routing inspection information transmitted by the background server.
The first device is AR glasses based on an augmented reality technology or a carrier applying the augmented reality technology to a mobile terminal, such as a mobile phone, a tablet computer and the like; the second device may be, for example, a machine room device of a data center; the background server can be an independent server or a server cluster consisting of a plurality of servers.
The identification information may be, for example, an RF id electronic tag storing the information of the equipment room, or icon information representing the equipment room.
The equipment data information base is established based on equipment of a data center monitoring room, and the data included in the equipment data information base can be historical data of the first equipment and the second equipment, monitoring data associated with the first equipment and the second equipment, processing data associated with the first equipment and the second equipment and the like.
It should be noted that the second device uploads its own related running data to the background server, and stores the running data in the device data management library.
The inspection information can be displayed on an augmented reality interface through characters, pictures, videos and the like, so that an inspector can effectively master and analyze the inspection condition.
The routing inspection information transmitted by the background server is displayed based on the augmented reality interface corresponding to the first equipment, and the routing inspection information can be displayed on the augmented reality interface corresponding to the first equipment.
The polling information may be, for example, any one or more of a polling line related to the second device and operation monitoring data of the second device.
The inspectors inspect the equipment in the machine room according to the inspection information, if the items of the equipment in the machine room to be inspected are listed, the equipment in the machine room is inspected according to the item sequence and the requirements.
The beneficial effects of the above technical scheme are: through transferring the routing inspection information related to the preset equipment information, the inspection personnel can conveniently conduct routing inspection, and the routing inspection time is saved.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology,
the first equipment is further used for outputting the patrol operation prompt corresponding to the patrol information so as to prompt an inspector to carry out patrol operation according to the patrol operation prompt.
For example, when the inspector can perform the inspection operation according to the inspection operation prompt presented by the AR glasses, for example, when the second device is inspected in the machine room data center, the background server can push the inspection items such as "whether the second device running data is normal", and the like, and the AR glasses can present "yes/no", and at this time, the inspector can be prompted to click "yes/no".
And part of the corresponding examination items in the examination information are acquired by the background server according to the built-in algorithm, and part of the examination items are inspected and acquired by the AR glasses. When the inspector performs false detection or missing detection, the background server pushes corresponding warning information to the AR glasses.
The beneficial effects of the above technical scheme are: the inspector can accomplish the work normatively according to the operation suggestion of patrolling and examining, can save inspection time, improves inspection efficiency.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology, wherein a background server comprises:
the background monitoring module is used for monitoring the running condition of the second equipment, obtaining the running monitoring data of the second equipment and transmitting the running monitoring data of the second equipment to the background storage module;
and the background storage module is used for receiving the operation monitoring data of the second equipment transmitted by the background monitoring module and storing the operation monitoring information of the second equipment into the equipment data information base.
The operation monitoring data is based on network transmission and monitors data transmitted by the second equipment in the operation process.
The beneficial effects of the above technical scheme are: by acquiring and storing corresponding monitoring data, the volume capacity of the equipment data information base is effectively increased.
In one embodiment, the specific steps when the routing inspection information corresponding to the preset device information collected by the first device is called are as follows:
the background server is provided with an information database, the information database is provided with S records in total, each record corresponds to one second device, and each record comprises the environment information, the identification information and the corresponding inspection information of the corresponding second device; the environment information where the second device is located comprises n1 indexes; the identification information of the second device includes n2 indexes; forming an index information matrix X with S rows and n1+ n2 columns and a vector Y formed by corresponding S pieces of patrol information; wherein, the routing inspection information communicated in the vector Y is classified into one type;
for the index in the information matrix X, discretizing the index with continuous index value in the information matrix by using a formula (1);
wherein XitIs the value of the ith row and the tth column of the matrix X, X1itIs XitDiscretized value, floor () rounded down, min (X)t) Is the minimum value of the t-th column of the matrix X, max (X)t) Is the maximum value of the t-th column of the matrix X, i is 1,2. 3 … … S, t is 1, 2, 3 … … n1+ n2, all continuous values are changed into classification values through formula (1), a formed new matrix is changed into a classification matrix X1, the inspection information has P values, P is less than or equal to S, and the set of vectors Y is Y { Y ═ Y-1、y2、…ypWhere yi is the i-th value of set y, i is 1, 2, … … p;
obtaining a classification vector A of the preset device information by using a formula (1) aiming at the preset device information collected by the first device, wherein A is { a ═ a }1,a2,…,an1,an1+1,,an1+2,…,an1+n}; wherein, aiThe value of the ith index of A after discretization is obtained, and then the probability that the vector A corresponds to each type of routing inspection information is calculated by using a formula (2);
wherein the P (A | y)i) The probability that the vector A corresponds to the i-th type routing inspection information is obtained; p (a)j|yi) The value of the j index to be solved is ajThe probability of the corresponding value appearing in the ith type of routing inspection information is determined; 1, 2, … … p; j is 1, 2, … … n1, n1+1, n1+2, … … n1+ n2,
wherein, p (a)j|yi) The solution of (a) is to extract the record with the j-th index value aj in the information matrix X1 after the dispersion, assume that there are Dj records in the extracted record, and extract the patrol information corresponding to the Dj records, if there are Mi records in yi in the extracted patrol information, then p (a)j|yi) Is shown in expression (3);
all p (a) to be derived by equation (3)j|yi) Substituting into equation (2), all P (A | y) are calculatedi) (ii) a Then, the formula (4) is used to obtain the vector A corresponding to the vectorRouting inspection information corresponding to preset equipment information acquired by first equipment;
max{P(y1)*P(A|y1),P(y2)*P(A|y2),…,P(yp)*P(A|yp)}
(4)
wherein, P (y)i) The probability that the ith type of routing inspection information appears in the information database is 1, 2 and … … p; i.e. y corresponding to the maximum value in equation (4)iThe corresponding inspection information is the inspection information corresponding to the preset equipment information acquired by the first equipment.
The n1 indexes include environmental area, environmental temperature, environmental humidity, environmental noise, environmental altitude, and oxygen content in air.
Wherein the n2 indexes include the action of the second equipment, the production year of the second equipment, the working power of the second equipment and the like.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology, and first equipment comprises:
the camera shooting assembly is used for shooting the environment of the routing inspection area where the second equipment is located, obtaining corresponding environment information and uploading the environment information to the background server;
the sensing component is used for sensing a second equipment identifier on second equipment, acquiring second equipment identifier information and transmitting the second equipment identifier information to the background server;
the positioning component is used for positioning the position information of the current routing inspection area of the first equipment, acquiring three-dimensional space data corresponding to the position information and uploading the three-dimensional space data to the background server;
the background server is also used for performing virtual enhancement processing on the environmental information transmitted by the camera shooting assembly, the second equipment identification information transmitted by the sensing assembly and the three-dimensional space data transmitted by the positioning assembly to obtain data which can be displayed on the virtual augmented reality equipment;
the first device further comprises:
a display component for displaying the obtained data displayable on the virtual augmented reality device.
The data displayed on the virtual augmented reality device includes, but is not limited to, three-dimensional virtual reality scene information, actual scene information, second device operation monitoring information, and the like, where the displayed data may be a combination of characters, pictures, videos, and the like.
The camera component can be a high-definition camera, for example; a sensing component, which may be, for example, a sensing card reader; the positioning component, which may be a GPS positioning component or a WIFI positioning component, may be configured to position the location information of the patrol area where the first device is currently located, where the location information is, for example, two-dimensional coordinates, such as longitude and latitude coordinates, where the first device is currently located.
The inspection area may be, for example, all areas in the machine room where the second device is placed.
The environment information is environment information around a current location of the second device.
For the above three-dimensional spatial data acquisition, for example, the following method can be adopted, and the steps include:
a1, acquiring environment information of the second device through the camera assembly and acquiring position information of the first device through the positioning assembly;
step A2: calculating affine transformation from the virtual object coordinates to a first equipment view plane according to the position information of the first equipment and the positioning marks in the environment information, drawing the virtual object on the view plane according to an affine transformation matrix, and displaying through an optical perspective display component to obtain an augmented reality system image;
step A3: performing binarization segmentation on an image displayed by the optical perspective display assembly, and judging which parts in the image of the augmented reality system belong to the environmental information and which parts belong to the identification information according to the gray characteristic of the segmented image;
step A4: performing connected domain analysis on the binary image, and determining an identification projection region by searching a black pixel region with a larger area in the binary image;
step A5: extracting points with large curvature change on the marked projection region so as to accurately define the shape of the connected domain;
step A6: and corresponding the shape of the connected domain with the three-dimensional model to obtain a matching result, and obtaining three-dimensional space data corresponding to the first equipment according to the matching result.
The beneficial effects of the above technical scheme are: so that the obtained display information is more realistic.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology,
the sensing assembly is further used for sensing the environment temperature of the current environment of the second equipment when a routing inspection instruction input by an inspector is received, and transmitting the environment temperature to the background server;
the background server is also used for judging whether the ambient temperature is within a preset temperature range according to the received ambient temperature, and if not, sending a temperature warning instruction to the alarm module;
the alarm module is used for receiving the temperature warning instruction transmitted by the background server and executing corresponding warning operation according to the temperature warning instruction;
if yes, the environment temperature is judged to be within the preset temperature range.
The machine room types corresponding to the data center can be classified into the following four types, and the corresponding preset temperature ranges are shown in the following table:
when the environmental temperature exceeds the preset temperature range, the alarm module executes corresponding alarm operation according to the temperature alarm instruction, if the alarm instruction is yes, the temperature is reduced, and at the moment, the corresponding alarm operation is correspondingly executed, for example, the machine room is correspondingly radiated; if the warning instruction is heating, corresponding warning operation is correspondingly executed at the moment, for example, corresponding heating is carried out on the machine room. The sensing component in this case may be, for example, a temperature sensor.
The beneficial effects of the above technical scheme are: the possibility of the second equipment failure can be effectively prevented by sensing the ambient temperature of the second equipment.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology, which further comprises:
the voice recognition module is used for acquiring voice information input by an inspector, recognizing the voice information to acquire a corresponding voice instruction and transmitting the voice instruction to the background server;
the background server is also used for processing the voice instruction transmitted by the voice recognition module according to the voice information database to obtain a corresponding control instruction;
meanwhile, the background server is also used for executing corresponding operation according to the control instruction, obtaining a corresponding control result and transmitting the control result to the first equipment;
and the first equipment is also used for receiving the control result transmitted by the background server and displaying the control result.
The voice information may be, for example, in the process that the inspector inspects the second device according to the operation flow of the inspection information, it is assumed that text information of "whether to inspect the monitoring data" appears on the augmented reality interface of the AR device, at this time, the inspector only needs to answer "yes" or no "with voice, the background server can obtain a corresponding control instruction, that is, start the inspection instruction or close the inspection instruction, and if answer" yes "by the inspector, the background server obtains a corresponding inspection start instruction to inspect the monitoring data and sends" inspection being performed "to the first device for display; if the inspector answers the instruction, the background server obtains a related closing inspection instruction, does not inspect the monitoring data, and sends 'no inspection' to the first equipment for displaying, so that manual operation can be avoided, and time is saved.
The voice recognition is placed on the first device, and is convenient for an inspector to operate the first device.
The beneficial effects of the above technical scheme are: through carrying out the discernment of voice command to the inspector, can effectual improvement efficiency of inspection, avoid bringing the inspection mistake because of the action operation.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology, which further comprises:
the mobile module is arranged on the first equipment and used for detecting the mobile displacement of the inspector in the inspection area;
the positioning module is used for positioning the current position information of the first equipment and acquiring three-dimensional space data corresponding to the position information;
the tracking module is used for dynamically tracking the inspector according to the movement displacement detected by the movement module and the three-dimensional space data acquired by the positioning module and transmitting corresponding dynamic tracking information to the background server;
and the background server is also used for calling a dynamic coordinate value corresponding to the dynamic tracking information transmitted by the tracking module according to the stored position coordinate database, and generating a corresponding running track of the dynamic coordinate value and transmitting the running track to the first equipment for displaying in real time.
The inspection area is an area where all the second devices are stored.
The positioning module can be a GPS positioning module or a WIFI positioning module.
The dynamic coordinate value is obtained in real time from the coordinate information of the first device.
The operation track is obtained, so that the corresponding routing inspection line is compared and analyzed in the operation track and the routing inspection information, whether the inspector inspects according to the routing inspection line on the routing inspection information is judged, and the inspector is conveniently managed.
The beneficial effects of the above technical scheme are: by acquiring the dynamic coordinate values in real time, the running track of an inspector is conveniently acquired, and the management is convenient.
The embodiment of the invention provides a data center inspection system based on an augmented reality technology,
the first equipment is also used for receiving a starting detection control instruction input by a user and transmitting the starting detection control instruction to the background server;
the background server is further used for sending current routing inspection information of the second equipment, which is associated with the detection information starting control instruction, to an augmented reality interface of the first equipment when the detection information starting control instruction transmitted by the first equipment is received;
meanwhile, the inspector carries out corresponding inspection operation according to the inspection flow on the inspection information on the augmented reality interface;
the background server is also used for receiving the inspection result which is uploaded by the inspector through the first equipment and corresponds to the current second equipment when the inspector inspects according to the related inspection flow; judging whether the current detected inspection result related to the second equipment is consistent with a preset inspection result or not, if not, recording the current inspection result related to the second equipment, sending related warning information to an augmented reality interface of the first equipment for reminding, and simultaneously transmitting related prompt information to a management end for prompting;
and the background server is also used for sending the routing inspection line and routing inspection information related to the next second equipment to the augmented reality interface of the first equipment when the inspector finishes inspecting the current second equipment according to the routing inspection process.
The start detection control command is a command input by an inspector to the first equipment, and controls the first equipment to be started for inspection.
The management terminal is used for receiving the prompt information transmitted by the background server and executing corresponding prompt operation according to the prompt information;
for example, the prompt message indicates that the current operation monitoring data of the second device is incorrect, and at this time, a manager at the management end may make a corresponding execution countermeasure according to the current operation monitoring data of the second device, and find out a corresponding error source.
The computer room corresponding to the data center is provided with at least one second device.
The beneficial effects of the above technical scheme are: and further determining the possibility of the second equipment failure according to the judged polling result and the preset polling result.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (9)
1. The utility model provides a data center system of patrolling and examining based on augmented reality technique which characterized in that includes:
the first equipment is used for being worn on the body of the inspector, acquiring preset equipment information of the second equipment and transmitting the acquired preset equipment information to the background server, wherein the acquired preset equipment information comprises: the environment information of the second equipment and the identification information of the second equipment; the first device is an Augmented Reality (AR) device;
the background server is used for calling routing inspection information corresponding to the preset equipment information collected by the first equipment according to the stored equipment data information base and transmitting the routing inspection information to the first equipment;
the first equipment is also used for receiving and displaying the routing inspection information transmitted by the background server;
the background server comprises the following specific steps when routing inspection information corresponding to the preset equipment information collected by the first equipment is called:
the background server is provided with an information database, the information database is provided with S records in total, each record corresponds to one second device, and each record comprises environment information, identification information and corresponding routing inspection information of the corresponding second device; the environment information where the second device is located comprises n1 indexes; the identification information of the second device includes n2 indexes; forming an index information matrix X with S rows and n1+ n2 columns and a vector Y formed by corresponding S pieces of patrol information; wherein, the routing inspection information communicated in the vector Y is classified into one type;
for the index in the information matrix X, discretizing the index with continuous index value in the information matrix by using a formula (1);
wherein XitIs the value of the ith row and the tth column of the matrix X, X1itIs XitDiscretized value, floor () rounded down, min (X)t) Is the minimum value of the t-th column of the matrix X, max (X)t) The maximum value of the t-th column of the matrix X is i 1, 2, 3 … … S, t 1, 2, 3 … … n1+ n2, all continuous values are changed into classification values through the formula (1), the formed new matrix is changed into a classification matrix X1, meanwhile, the inspection information has P values in common, P is less than or equal to S, and the set of the vector Y is Y { Y { (Y) } Y1、y2、…ypWhere yi is the i-th value of set y, i is 1, 2, … … p;
obtaining a classification vector A of the preset device information by using a formula (1) aiming at the preset device information collected by the first device, wherein A is { a ═ a }1,a2,…,an1,an1+1,an1+2,…,an1+n}; wherein, aiThe value of the ith index of A after discretization is obtained, and then the probability that the vector A corresponds to each type of routing inspection information is calculated by using a formula (2);
wherein the P (A | y)i) The probability that the vector A corresponds to the i-th type routing inspection information is obtained; p (a)j|yi) The value of the j index to be solved is ajThe probability of the corresponding value appearing in the ith type of routing inspection information is determined; 1, 2, … … p; j is 1, 2, … … n1, n1+1, n1+2, … … n1+ n2,
wherein, p (a)j|yi) The solution of (1) is to extract the record of which j index value is aj from the information matrix X1 after the dispersion, assume that there are Dj records in the extracted record, and extract the Dj recordsRecording corresponding inspection information, if the extracted inspection information is yiThere are Mi entries, then p (a)j|yi) Is shown in expression (3);
all p (a) to be derived by equation (3)j|yi) Substituting into equation (2), all P (A | y) are calculatedi) (ii) a Then, obtaining routing inspection information corresponding to preset equipment information acquired by first equipment corresponding to the vector A by using a formula (4);
max{P(y1)*P(A|y1),P(y2)*P(A|y2),…,P(yp)*P(A|yp)} (4)
wherein, P (y)i) The probability that the ith type of routing inspection information appears in the information database is 1, 2 and … … p; i.e. y corresponding to the maximum value in equation (4)iThe corresponding inspection information is the inspection information corresponding to the preset equipment information acquired by the first equipment.
2. The data center inspection system according to claim 1,
the first equipment is further used for outputting the inspection operation prompt corresponding to the inspection information so as to prompt an inspector to perform inspection operation according to the inspection operation prompt.
3. The data center inspection system according to claim 1, wherein the background server includes:
the background monitoring module is used for monitoring the running condition of the second equipment, obtaining running monitoring data of the second equipment and transmitting the running monitoring data of the second equipment to the background storage module;
and the background storage module is used for receiving the operation monitoring data of the second equipment transmitted by the background monitoring module and storing the operation monitoring information of the second equipment into the equipment data information base.
4. The data center inspection system according to claim 1, wherein the first device includes:
the camera shooting assembly is used for shooting the environment of the routing inspection area where the second equipment is located, obtaining corresponding environment information and uploading the environment information to the background server;
the sensing component is used for sensing a second equipment identifier on the second equipment, acquiring second equipment identifier information and transmitting the second equipment identifier information to the background server;
the positioning component is used for positioning the position information of the current routing inspection area of the first equipment, acquiring three-dimensional space data corresponding to the position information and uploading the three-dimensional space data to the background server;
the background server is further used for performing virtual enhancement processing on the environmental information transmitted by the camera shooting assembly, the second equipment identification information transmitted by the sensing assembly and the three-dimensional space data transmitted by the positioning assembly to obtain data which can be displayed on virtual augmented reality equipment;
the first device further comprises:
a display component for displaying the obtained data displayable on a virtual augmented reality device.
5. The data center inspection system according to claim 4,
the sensing component is further used for sensing the ambient temperature of the current environment of the second equipment when the inspection instruction input by the inspector is received, and transmitting the ambient temperature to the background server;
the background server is further used for judging whether the ambient temperature is within the preset temperature range according to the received ambient temperature, and if not, sending a temperature warning instruction to an alarm module;
the alarm module is used for receiving a temperature warning instruction transmitted by the background server and executing corresponding warning operation according to the temperature warning instruction;
and if so, judging that the environmental temperature is within the preset temperature range.
6. The data center inspection system according to claim 1,
the first device further comprises:
the voice recognition module is used for acquiring the voice information input by the inspector, recognizing the voice information to acquire a corresponding voice instruction and transmitting the voice instruction to the background server;
the background server is also used for processing the voice instruction transmitted by the voice recognition module according to a voice information database to obtain a corresponding control instruction;
meanwhile, the background server is further configured to execute a corresponding operation according to the control instruction, obtain a corresponding control result, and transmit the control result to the first device;
the first device is further configured to receive the control result transmitted by the background server, and display the control result.
7. The data center inspection system according to claim 1, further comprising:
the moving module is arranged on the first equipment and used for detecting the moving displacement of the inspector in the inspection area;
the positioning module is used for positioning the current position information of the first equipment and acquiring three-dimensional space data corresponding to the position information;
the tracking module is used for dynamically tracking the inspector according to the movement displacement detected by the moving module and the three-dimensional space data acquired by the positioning module and transmitting corresponding dynamic tracking information to the background server;
and the background server is also used for calling a dynamic coordinate value corresponding to the dynamic tracking information transmitted by the tracking module according to the stored position coordinate database, and generating a corresponding running track of the dynamic coordinate value and transmitting the running track to the first equipment for displaying in real time.
8. The data center inspection system according to claim 1,
the first device is further configured to receive a start detection control instruction input by the inspector and transmit the start detection control instruction to the background server;
the background server is further used for sending the current routing inspection information of the second equipment associated with the starting detection information control instruction to an augmented reality interface of the first equipment when the starting detection information control instruction transmitted by the first equipment is received;
meanwhile, the inspector carries out corresponding inspection operation according to the inspection flow on the inspection information on the augmented reality interface;
the background server is further used for receiving a polling result corresponding to the current second equipment and uploaded by the inspector through the first equipment when the inspector conducts polling according to a related polling process, judging whether the current detected polling result related to the second equipment is consistent with a preset polling result or not, recording the current polling result related to the second equipment if the current polling result is inconsistent with the preset polling result, sending related warning information to an augmented reality interface of the first equipment for reminding, and simultaneously transmitting related reminding information to a management end for reminding;
and the background server is also used for sending the routing inspection line and routing inspection information related to the next second equipment to the augmented reality interface of the first equipment when the inspector finishes inspecting the current second equipment according to the routing inspection process.
9. The data center inspection system according to claim 1 or 8,
the patrol information includes: any one or more of a routing inspection line associated with the second device, and operational monitoring data of the second device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910296728.6A CN110049121B (en) | 2019-04-14 | 2019-04-14 | Data center inspection system based on augmented reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910296728.6A CN110049121B (en) | 2019-04-14 | 2019-04-14 | Data center inspection system based on augmented reality technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110049121A CN110049121A (en) | 2019-07-23 |
| CN110049121B true CN110049121B (en) | 2021-08-06 |
Family
ID=67277167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910296728.6A Active CN110049121B (en) | 2019-04-14 | 2019-04-14 | Data center inspection system based on augmented reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110049121B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111276232A (en) * | 2020-01-15 | 2020-06-12 | 于金明 | Medical accelerator quality assurance system and method based on virtual intelligent medical platform |
| CN111351789B (en) * | 2020-04-07 | 2023-05-16 | 中国联合网络通信集团有限公司 | Method, system and electronic device for detecting/maintaining equipment |
| CN112070923A (en) * | 2020-09-11 | 2020-12-11 | 山东浪潮商用系统有限公司 | Intelligent voice self-service inspection operation system and method |
| CN114489324A (en) * | 2021-12-28 | 2022-05-13 | 北京亮亮视野科技有限公司 | Information acquisition method and device, electronic equipment and storage medium |
| CN115361526A (en) * | 2022-08-16 | 2022-11-18 | 苏州数智赋农信息科技有限公司 | Pig farm inspection system and method based on image processing |
| CN116310236B (en) * | 2023-02-16 | 2023-09-05 | 北京华晨阳通信技术有限责任公司 | Visual intelligent management system and method for communication machine room |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236925A (en) * | 2011-05-03 | 2011-11-09 | 西安印钞有限公司 | System and method for offline secondary detection and checking of machine detected data of large-piece checker |
| CN104272260A (en) * | 2012-06-27 | 2015-01-07 | 国际商业机器公司 | Real time examination of conditions of physical machines using augmented reality in smarter data center |
| CN106681881A (en) * | 2015-11-05 | 2017-05-17 | 中兴通讯股份有限公司 | Data center routing inspection method and data center routing inspection device |
| CN107635133A (en) * | 2017-11-01 | 2018-01-26 | 广州供电局有限公司 | A kind of robot of data center inspection tour system based on augmented reality |
| CN107657682A (en) * | 2017-10-30 | 2018-02-02 | 成都极致空觉科技有限公司 | A kind of power transformation method for inspecting based on augmented reality |
| CN108346195A (en) * | 2018-03-08 | 2018-07-31 | 青岛理工大学 | A kind of train intelligent inspection system and method based on augmented reality |
| CN109272232A (en) * | 2018-09-21 | 2019-01-25 | 国家电网有限公司 | Visualized data management method based on substation's fining inspection business |
| CN109325605A (en) * | 2018-11-06 | 2019-02-12 | 国网河南省电力公司驻马店供电公司 | Electric power based on augmented reality AR technology believes logical computer room inspection platform and method for inspecting |
| US10207184B1 (en) * | 2017-03-21 | 2019-02-19 | Amazon Technologies, Inc. | Dynamic resource allocation for gaming applications |
| CN109360290A (en) * | 2018-10-31 | 2019-02-19 | 深圳供电局有限公司 | Power Line Inspection System |
| CN109500827A (en) * | 2018-11-23 | 2019-03-22 | 北京中大科慧科技发展有限公司 | Machine room intelligent crusing robot |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015006622A1 (en) * | 2013-07-10 | 2015-01-15 | Crowdcomfort, Inc. | System and method for crowd-sourced environmental system control and maintenance |
-
2019
- 2019-04-14 CN CN201910296728.6A patent/CN110049121B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236925A (en) * | 2011-05-03 | 2011-11-09 | 西安印钞有限公司 | System and method for offline secondary detection and checking of machine detected data of large-piece checker |
| CN104272260A (en) * | 2012-06-27 | 2015-01-07 | 国际商业机器公司 | Real time examination of conditions of physical machines using augmented reality in smarter data center |
| CN106681881A (en) * | 2015-11-05 | 2017-05-17 | 中兴通讯股份有限公司 | Data center routing inspection method and data center routing inspection device |
| US10207184B1 (en) * | 2017-03-21 | 2019-02-19 | Amazon Technologies, Inc. | Dynamic resource allocation for gaming applications |
| CN107657682A (en) * | 2017-10-30 | 2018-02-02 | 成都极致空觉科技有限公司 | A kind of power transformation method for inspecting based on augmented reality |
| CN107635133A (en) * | 2017-11-01 | 2018-01-26 | 广州供电局有限公司 | A kind of robot of data center inspection tour system based on augmented reality |
| CN108346195A (en) * | 2018-03-08 | 2018-07-31 | 青岛理工大学 | A kind of train intelligent inspection system and method based on augmented reality |
| CN109272232A (en) * | 2018-09-21 | 2019-01-25 | 国家电网有限公司 | Visualized data management method based on substation's fining inspection business |
| CN109360290A (en) * | 2018-10-31 | 2019-02-19 | 深圳供电局有限公司 | Power Line Inspection System |
| CN109325605A (en) * | 2018-11-06 | 2019-02-12 | 国网河南省电力公司驻马店供电公司 | Electric power based on augmented reality AR technology believes logical computer room inspection platform and method for inspecting |
| CN109500827A (en) * | 2018-11-23 | 2019-03-22 | 北京中大科慧科技发展有限公司 | Machine room intelligent crusing robot |
Non-Patent Citations (2)
| Title |
|---|
| "InspectAR: An Augmented Reality Inspection Framework for Industry";Ramakrishna Perla et al;《2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)》;20170202;全文 * |
| "数据中心AR运维技术";贺长宇等;《网络安全技术与应用》;20180827;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110049121A (en) | 2019-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110049121B (en) | Data center inspection system based on augmented reality technology | |
| CN111340126B (en) | Article identification method, apparatus, computer device, and storage medium | |
| CN112162930B (en) | Control identification method, related device, equipment and storage medium | |
| CN111754513A (en) | Product surface defect segmentation method, defect segmentation model learning method and device | |
| CN111652087B (en) | Car inspection method, device, electronic equipment and storage medium | |
| CN112100431B (en) | Evaluation method, device and equipment of OCR system and readable storage medium | |
| US10679054B2 (en) | Object cognitive identification solution | |
| US20230007831A1 (en) | Method for warehouse storage-location monitoring, computer device, and non-volatile storage medium | |
| CN112508109B (en) | Training method and device for image recognition model | |
| CN113052295B (en) | Training method of neural network, object detection method, device and equipment | |
| CN111401445A (en) | Training method of image recognition model, and image recognition method and device | |
| CN109558792B (en) | Method and system for detecting internet logo content based on samples and features | |
| CN112613569A (en) | Image recognition method, and training method and device of image classification model | |
| TW202009681A (en) | Sample labeling method and device, and damage category identification method and device | |
| CN111770450B (en) | Workshop production monitoring server, mobile terminal and application | |
| CN113010805A (en) | Index data processing method, device, equipment and storage medium | |
| CN115205883A (en) | Data auditing method, device, equipment and storage medium based on OCR (optical character recognition) and NLP (non-line language) | |
| CN111124863A (en) | Intelligent equipment performance testing method and device and intelligent equipment | |
| CN112529836A (en) | High-voltage line defect detection method and device, storage medium and electronic equipment | |
| CN112668365A (en) | Material warehousing identification method, device, equipment and storage medium | |
| CN114202804A (en) | Behavior action recognition method and device, processing equipment and storage medium | |
| CN113916899A (en) | Method, system and device for detecting large soft infusion bag product based on visual identification | |
| CN113807150A (en) | Data processing method, attitude prediction method, data processing device, attitude prediction device, and storage medium | |
| CN110738260A (en) | Method, device and equipment for detecting placement of space boxes of retail stores of types | |
| CN113642565B (en) | Object detection method, device, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |