CN113347408B - Interactive method, interactive device and storage medium for elevator fault handling - Google Patents
Interactive method, interactive device and storage medium for elevator fault handling Download PDFInfo
- Publication number
- CN113347408B CN113347408B CN202110667589.0A CN202110667589A CN113347408B CN 113347408 B CN113347408 B CN 113347408B CN 202110667589 A CN202110667589 A CN 202110667589A CN 113347408 B CN113347408 B CN 113347408B
- Authority
- CN
- China
- Prior art keywords
- elevator
- video
- hoistway
- dimensional model
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Geometry (AREA)
- General Engineering & Computer Science (AREA)
- Architecture (AREA)
- Indicating And Signalling Devices For Elevators (AREA)
Abstract
The invention discloses an interaction method, an interaction device and a storage medium for elevator fault processing, wherein the interaction method is applied to a virtual imaging terminal, the virtual imaging terminal is connected with a technical terminal of an elevator manufacturer through a cloud server, and the interaction method comprises the following steps: acquiring a video acquisition instruction; acquiring video information based on the video acquisition instruction, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault; uploading the video information; feedback information of the technical terminal based on the video information is obtained, wherein the feedback information comprises three-dimensional operation information corresponding to the elevator three-dimensional model; and displaying the three-dimensional operation information. The virtual imaging terminal is adopted to shoot the elevator site in real time, and the cloud server is used for real-time interaction with a remote technical worker of an elevator manufacturer, so that the fault diagnosis accuracy and the fault processing efficiency are effectively improved.
Description
Technical Field
The invention relates to the technical field of elevators, in particular to an interaction method for elevator fault handling, an interaction device for elevator fault handling and a computer readable storage medium.
Background
In modern society, elevators are used in buildings, especially high-rise buildings.
In the current elevator installation process, the following steps are generally performed: firstly, a customer provides a shaft sketch of a building, then an elevator manufacturer designs an elevator drawing, then corresponding elevator parts are produced, after the parts are subjected to trial assembly in the elevator manufacturer, the elevator parts are sent to a site, and are installed by technicians on the site.
However, in the actual installation process, on one hand, because the hoistway simplified diagram provided by the customer may have errors or deviations, and the manufacturing and installation processes of the elevator are long, and the number of processes is large, the situation that the elevator components are not matched with the site exists in the installation process, at this time, the elevator components must be sent to the elevator manufacturer to be produced again, the installation period of the elevator is prolonged, the installation efficiency is reduced, and meanwhile, the production, installation and maintenance costs of the elevator are greatly increased.
On the other hand, in the installation and use process, when a field technician encounters an unsolvable fault or problem, the elevator system is often communicated with a technician of an elevator factory through the modes of telephone contact and the like, however, because the elevator system is composed of a plurality of parts which are positioned at different spatial positions, great troubles are caused to the technician of the elevator factory and the field technician in the communication process, the communication complexity and the communication error probability are improved, and the actual requirements cannot be met.
Disclosure of Invention
In order to overcome the technical problems in the prior art, embodiments of the present invention provide an interaction method, an interaction apparatus, and a storage medium for elevator fault handling, in which a virtual imaging terminal is used to take a real-time picture of an elevator site, and a cloud server is used to interact with a remote technician of an elevator manufacturer in real time, so that the fault diagnosis accuracy and the fault handling efficiency are effectively improved.
In order to achieve the above object, an embodiment of the present invention provides an interaction method for elevator fault handling, which is applied to a virtual imaging terminal, where the virtual imaging terminal is connected to a technical terminal of an elevator manufacturer through a cloud server, and the interaction method includes: acquiring a video acquisition instruction; acquiring video information based on the video acquisition command, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault; uploading the video information; feedback information of the technical terminal based on the video information is obtained, wherein the feedback information comprises three-dimensional operation information corresponding to the elevator three-dimensional model; and displaying the three-dimensional operation information.
Preferably, the obtaining video information based on the video capture instruction includes: acquiring preliminary video information based on the video acquisition instruction; identifying the elevator in the preliminary video information to obtain elevator identification information; obtaining a three-dimensional model of an elevator; establishing a real-time mapping relation between the elevator identification information and the elevator three-dimensional model; and superposing the elevator three-dimensional model in the preliminary video information in real time based on the real-time mapping relation to generate the video information.
Preferably, the elevator three-dimensional model comprises a plurality of part three-dimensional models, and the interaction method further comprises: after the elevator video is obtained, judging whether a labeling operation aiming at the elevator three-dimensional model is obtained or not; under the condition that the labeling operation is obtained, obtaining a three-dimensional model of the specified part corresponding to the labeling operation; performing convex display processing on the three-dimensional model of the specified part in the elevator video to obtain a processed elevator video; and uploading the processed elevator video.
Preferably, the video information further includes hoistway video, and the interaction method further includes: after the video information is obtained, obtaining a shaft three-dimensional model based on the shaft video; obtaining a three-dimensional model of an elevator; performing elevator interference analysis based on the hoistway three-dimensional model and the elevator three-dimensional model to obtain a corresponding interference analysis result; and determining the defect of the elevator when the interference analysis result is that the elevator interferes with the shaft, and uploading the elevator video and the interference analysis result.
Preferably, a plurality of hoistway markers are disposed in the hoistway, the hoistway markers being used to characterize hoistway information, the obtaining a three-dimensional model of the hoistway based on the hoistway video includes: acquiring a preset origin, wherein the preset origin is positioned in a well; establishing a three-dimensional coordinate system of the well based on the preset origin; identifying a hoistway marker in the hoistway video to obtain a plurality of target markers; acquiring a plurality of corresponding target shaft information based on the plurality of target marks; generating the hoistway three-dimensional model based on the target hoistway information and a three-dimensional coordinate system of the hoistway.
On the other hand, the embodiment of the invention provides an interaction method for elevator fault processing, which is applied to a technical terminal, wherein the technical terminal is connected with a virtual imaging terminal through a cloud server, and the interaction method comprises the following steps: judging whether video information sent from the virtual imaging terminal is acquired or not, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault; under the condition of acquiring the video information, judging whether an operation instruction is acquired or not; under the condition that the operation instruction is obtained, generating three-dimensional operation information corresponding to the elevator three-dimensional model; and generating feedback information based on the three-dimensional operation information, and feeding the feedback information back to the virtual imaging terminal.
Preferably, the video information includes elevator video and hoistway video, the interactive method further includes: judging whether an interference analysis result generated based on the elevator video and the hoistway video is obtained or not; under the condition that the interference analysis result is obtained, obtaining modification operation on the elevator three-dimensional model; modifying the elevator three-dimensional model based on the modification operation to obtain a modified three-dimensional model; and feeding back the modified three-dimensional model.
Correspondingly, the embodiment of the invention also provides an interaction device for elevator fault processing, which is applied to a virtual imaging terminal, wherein the virtual imaging terminal is connected with a technical terminal of an elevator manufacturer through a cloud server, and the interaction device comprises: the instruction acquisition unit is used for acquiring a video acquisition instruction; the video acquisition unit is used for acquiring video information based on the video acquisition instruction, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault; the information uploading unit is used for uploading the video information; the feedback acquisition unit is used for acquiring feedback information of the technical terminal based on the video information, and the feedback information comprises three-dimensional operation information corresponding to the elevator three-dimensional model; and the display unit is used for displaying the three-dimensional operation information.
Correspondingly, the embodiment of the invention also provides an interaction device for elevator fault processing, which is applied to a technical terminal, wherein the technical terminal is connected with the virtual imaging terminal through a cloud server, and the interaction device comprises: the first judgment unit is used for judging whether video information sent from the virtual imaging terminal is acquired or not, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault; the second judging unit is used for judging whether an operation instruction is acquired or not under the condition that the video information is acquired; the operation unit is used for generating operation information corresponding to the elevator three-dimensional model under the condition of acquiring the operation instruction; and the feedback unit is used for generating feedback information based on the operation information and feeding the feedback information back to the virtual imaging terminal.
In another aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method provided by the embodiment of the present invention.
Through the technical scheme provided by the invention, the invention at least has the following technical effects:
by improving the existing elevator installation and maintenance mode, an additional virtual imaging terminal is configured for field technicians and is connected with a technical terminal of an elevator manufacturer through a cloud server, so that on one hand, the field technicians can be allowed to acquire three-dimensional video information of an elevator field, and the elevator fault display accuracy and visibility are improved; and on the other hand, the system allows a field technician to interact with a remote elevator factory technician in real time, so that the diagnosis accuracy and the processing efficiency of the elevator fault are improved.
Additional features and advantages of embodiments of the invention will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the embodiments of the invention and not to limit the embodiments of the invention. In the drawings:
fig. 1 is a flowchart of an interactive method for elevator fault handling according to an embodiment of the present invention;
fig. 2 is a flowchart of a specific implementation of acquiring video information based on a video acquisition instruction in the interactive method for elevator fault handling according to the embodiment of the present invention;
fig. 3 is a flowchart of an interactive method for handling elevator faults according to another embodiment of the present invention;
fig. 4 is a schematic structural diagram of an interactive device for elevator fault handling provided by the embodiment of the invention;
fig. 5 is a schematic structural diagram of an interactive device for elevator fault handling according to another embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating embodiments of the invention, are given by way of illustration and explanation only, not limitation.
The terms "system" and "network" in embodiments of the present invention may be used interchangeably. The "plurality" means two or more, and in view of this, the "plurality" may also be understood as "at least two" in the embodiments of the present invention. "and/or" describes the association relationship of the associated object, indicating that there may be three relationships, for example, a and/or B, which may indicate: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" generally indicates that the preceding and following related objects are in an "or" relationship, unless otherwise specified. In addition, it should be understood that the terms first, second, etc. in the description of the embodiments of the invention are used for distinguishing between the descriptions and are not intended to indicate or imply relative importance or order to be construed.
Referring to fig. 1, an embodiment of the present invention provides an interaction method for elevator fault handling, which is applied to a virtual imaging terminal, where the virtual imaging terminal is connected to a technical terminal of an elevator manufacturer through a cloud server, and the interaction method includes:
s10) acquiring a video acquisition instruction;
s20) acquiring video information based on the video acquisition instruction, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault;
s30) uploading the video information;
s40) feedback information of the technical terminal based on the video information is obtained, and the feedback information comprises three-dimensional operation information corresponding to the elevator three-dimensional model;
s50) displaying the three-dimensional operation information.
In the existing elevator installation and maintenance method, after an elevator manufacturer transports elevator parts to an installation site, a field technician installs an elevator according to written data of elevator installation, and maintains the elevator according to the written data of elevator maintenance in a maintenance stage, obviously, on one hand, because an elevator system belongs to a three-dimensional control system applied to a vertical space, the written data can not well show operation details of the elevator installation and maintenance stages, so that inconvenience is brought to the field technician, and the error probability of the field technician is increased; on the other hand, when technical problems which cannot be solved by field technicians occur, the field technicians often communicate with technicians of elevator manufacturers remotely through telephones and describe failure modes and solutions through spoken languages, so that actual requirements of the field technicians and the technicians of the elevator manufacturers still cannot be met.
In order to solve the above technical problem, in a possible implementation manner, an additional virtual imaging terminal is configured for a field technician, for example, the virtual imaging terminal may be a virtual imaging terminal based on VR or AR technology, for example, a virtual imaging terminal such as 3D glasses, VR helmets or AR glasses, an AR tablet computer, and an image acquisition device may be configured on the virtual imaging terminal, and the virtual imaging terminal may acquire video information through the image acquisition device.
For example, in one embodiment, a technician at the site discovers a fault during elevator installation, but the technician cannot resolve the fault, and therefore wears a virtual imaging terminal, such as AR glasses, and remotely interacts with the technician of the elevator manufacturer through the AR glasses. In the using process of the AR glasses, whether a video acquisition instruction of a technician is acquired or not is monitored in real time, at a certain moment, the AR glasses acquire the video acquisition instruction, so that video information is immediately acquired, the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, the elevator video is associated with an elevator fault, and for example, the elevator video is an elevator video shot by the field technician with the AR glasses facing a fault area of an elevator.
Referring to fig. 2, in the embodiment of the present invention, the acquiring video information based on the video capture instruction includes:
s21) acquiring preliminary video information based on the video acquisition instruction;
s22) identifying the elevator in the preliminary video information to obtain elevator identification information;
s23) obtaining a three-dimensional model of the elevator;
s24) establishing a real-time mapping relation between the elevator identification information and the elevator three-dimensional model;
s25) superposing the elevator three-dimensional model in the preliminary video information based on the real-time mapping relation to generate the video information.
In order to more vividly show a live elevator video, for example, an Augmented Reality (AR) technology can be used for processing the live elevator video, for example, after the preliminary video information is collected based on a video collection instruction, the elevator in the preliminary video information is firstly identified, for example, a target identification algorithm can be used for identifying the elevator, corresponding elevator identification information is obtained, at the moment, an elevator three-dimensional model is obtained, for example, the elevator three-dimensional model is an elevator three-dimensional model generated and provided by an elevator manufacturer based on the design data of the elevator, at the moment, a real-time mapping relation between the elevator identification information and the elevator three-dimensional model is established, for example, a real-time mapping relation is established between each elevator part identified in the elevator identification information and the three-dimensional model of each elevator part in the elevator three-dimensional model, at the moment, the elevator three-dimensional model is superimposed in the video information in real time according to the real-time mapping relation, and corresponding preliminary video information is generated.
For example, the elevator three-dimensional model can replace the elevator image in real time in the elevator video and perform enhanced display, for example, a field technician shoots a fault area of the elevator, and AR glasses replace the shot elevator fault area with the elevator three-dimensional model in real time to display while acquiring the elevator video, so that the enhanced display effect of the elevator is realized.
Then, the AR glasses upload the video information to a technical terminal of an elevator factory through the cloud server and perform online exchange with a technician of the elevator factory so as to assist the field technician to perform fault processing through the technician of the elevator factory, for example, feedback information based on the video information fed back from the technical terminal is obtained after the video information is uploaded, the feedback information comprises three-dimensional operation information of the three-dimensional model of the elevator, for example, after the technician of the elevator factory obtains the elevator video containing the three-dimensional model of the elevator, the fault reason of the elevator is diagnosed through the elevator video, for example, a connection error of two signal lines of a main control cabinet of the elevator is found, and therefore, the three-dimensional operation is performed on the three-dimensional model of the elevator through the technical terminal.
For example, the first signal line and the second signal line can be switched and connected by clicking the first signal line and moving to the position of the second signal line, and the second signal line and the first signal line can be clicked and moving to the position of the first signal line, at this time, the technical terminal generates corresponding feedback information according to the three-dimensional operation information, for example, the feedback information can also include voice information or text information of a technician of an elevator manufacturer, and the three-dimensional operation information, the voice information or the text information is superimposed on an elevator video to generate the feedback information, and then the feedback information is fed back to the virtual imaging terminal, and the virtual imaging terminal of the field technician displays the three-dimensional operation information after acquiring the feedback information.
In the embodiment of the invention, the virtual imaging terminal is adopted to perform three-dimensional reproduction and enhanced display on the on-site elevator fault, and real-time interaction is realized with the remote elevator manufacturer technical personnel through the cloud server, so that the fault processing capability of the on-site technical personnel is effectively improved, the fault processing time of the on-site technical personnel is greatly shortened, the fault processing efficiency and the fault processing accuracy are improved, and the use safety of the elevator is effectively ensured.
In an embodiment of the present invention, the elevator three-dimensional model includes a plurality of part three-dimensional models, and the interaction method further includes: after the elevator video is obtained, judging whether a labeling operation aiming at the elevator three-dimensional model is obtained or not; under the condition that the labeling operation is obtained, obtaining a three-dimensional model of the specified part corresponding to the labeling operation; performing convex display processing on the three-dimensional model of the specified part in the elevator video to obtain a processed elevator video; and uploading the processed elevator video.
In a possible implementation manner, the design precision of the elevator three-dimensional model can reach the minimum component level of an elevator, for example, the elevator three-dimensional model can be composed of basic elevator hardware units such as elevator screws, door panels, signal lines and the like, the elevator three-dimensional model comprises a plurality of component three-dimensional models, and after an elevator video is obtained, because the fault reason of the elevator is not obvious, the elevator components related to the fault are more and are located at different spatial positions, in order to sufficiently show the fault details of the elevator for a remote technician, the on-site technician can also mark the elevator video to assist the remote elevator manufacturer technician to better perform fault diagnosis.
For example, after the AR glasses generate the elevator video, it is determined whether a labeling operation for the elevator three-dimensional model is obtained, for example, in the embodiment of the present invention, a technician labels a plurality of elevator three-dimensional models in the elevator video, for example, in the case of a failure of an elevator car, a field technician labels elevator three-dimensional models such as a speed governor, a safety gear, a wire rope, a host, and a car bottom of the elevator at a flat floor position in the elevator video, and after the AR glasses obtain the labeling operation, the AR glasses perform a projection display process on the three-dimensional models of the parts, for example, the three-dimensional models of the specified parts may be slightly enlarged and displayed, or a projection display is performed by using a set color (for example, red) to obtain a processed elevator video, and at this time, the processed elevator video is uploaded to a technical terminal.
In the embodiment of the invention, better display and prompt of elevator faults are realized by further acquiring the marking operation of field technicians and further optimizing the elevator video based on the marking operation, so that the elevator faults are further conveniently identified and diagnosed by remote elevator manufacturer technicians, the fault diagnosis accuracy is effectively improved, the time waste caused by diagnosis deviation is reduced, and the fault diagnosis and processing efficiency is improved.
In an embodiment of the present invention, the video information further includes a hoistway video, and the interaction method further includes: after the video information is obtained, obtaining a hoistway three-dimensional model based on the hoistway video; obtaining a three-dimensional model of an elevator; performing elevator interference analysis based on the hoistway three-dimensional model and the elevator three-dimensional model to obtain a corresponding interference analysis result; and determining that the elevator has defects under the condition that the interference analysis result is that the elevator interferes with the shaft, and uploading the elevator video and the interference analysis result.
Further, in an embodiment of the present invention, a plurality of hoistway markers are disposed in a hoistway, and the hoistway markers are used for characterizing hoistway information, and the obtaining a hoistway three-dimensional model based on the hoistway video includes: acquiring a preset origin, wherein the preset origin is positioned in a well; establishing a three-dimensional coordinate system of the well based on the preset origin; identifying a hoistway marker in the hoistway video to obtain a plurality of target markers; acquiring a plurality of corresponding target shaft information based on the plurality of target marks; generating the hoistway three-dimensional model based on the target hoistway information and a three-dimensional coordinate system of the hoistway.
In the installation stage of an elevator, the traditional elevator installation method is to directly install corresponding elevator parts in an elevator hoistway or a machine room according to written guidance information of elevator installation, however, in the practical application process, the produced elevator is possibly not matched with the actual hoistway due to measurement deviation of the hoistway, normal installation cannot be performed in the elevator installation process, the working time and the energy of elevator installers are greatly consumed, and the installation efficiency of the elevator is greatly reduced. In a possible embodiment, therefore, it is also possible, in the installation phase of the elevator, to first diagnose the actual installation of the elevator in advance by means of the virtual imaging terminal.
For example, in the embodiment of the invention, a technician on site shoots a hoistway video through AR glasses, and obtains a three-dimensional model of the hoistway through the hoistway video. For example, a plurality of hoistway markers may be disposed in a hoistway, and each hoistway marker may be a photosensitive material, a reflective material, or an object with a specific shape, for example, each hoistway marker may be disposed at a specific point or a preset point of the hoistway, for example, hoistway markers are disposed at a starting point, a middle point, an inflection point, and a shape change point of the hoistway, so that hoistway information is represented by the hoistway markers, in the process of generating a hoistway three-dimensional model by using a hoistway video, a preset origin may be first obtained, for example, the preset origin may be a certain point (for example, a certain corner point at the bottom of the hoistway) specified by a field technician, then the AR glasses establish a three-dimensional coordinate system of the hoistway based on the preset origin, and at this time, the AR glasses identify the hoistway markers in the hoistway video, for example, the hoistway markers may be identified by using a target identification algorithm or a feature extraction algorithm, and obtain a plurality of corresponding target markers, and further extract a plurality of target information corresponding to each target marker, and then generate the hoistway three-dimensional model in the three-dimensional coordinate system of the hoistway based on the target information.
In the embodiment of the invention, the hoistway marker is arranged in the hoistway instead of a method for directly shooting and identifying the hoistway, so that the problem that the actual shape of the hoistway cannot be accurately identified due to poor light or more shelters in the hoistway can be effectively solved, the technical effect of quickly and accurately identifying the actual shape of the hoistway and generating the corresponding three-dimensional model of the hoistway is realized, and the analysis accuracy of subsequent elevator interference can be effectively improved.
After the hoistway three-dimensional model is obtained, the AR glasses further obtain the elevator three-dimensional model, for example, the elevator three-dimensional model of the elevator is obtained from a technical terminal directly through a cloud server, or the elevator three-dimensional model stored in advance is called directly from a storage device, then elevator interference analysis is performed based on the hoistway three-dimensional model and the elevator three-dimensional model, for example, the process that the elevator three-dimensional model runs up and down in the hoistway three-dimensional model can be simulated on the AR glasses, whether the interference phenomenon between the elevator and the hoistway exists in the simulation running process is verified, if the interference phenomenon exists, the interference analysis result that the elevator and the hoistway interfere is output, at the moment, the AR glasses can determine that the elevator has a defect, and therefore the elevator video and the interference analysis result are uploaded immediately, for example, the interference area between the elevator and the hoistway is displayed in a red mode, so that technicians of an elevator manufacturer can perform fault analysis and diagnosis conveniently.
After a technician of an elevator manufacturer obtains the interference analysis result and the corresponding elevator video through the technical terminal, the technician adjusts the elevator three-dimensional model according to the interference analysis result, for example, the elevator three-dimensional model is modified through the technical terminal, the modified three-dimensional model is obtained, then the technical terminal feeds back the modified three-dimensional model, and after the AR glasses located on the site obtain the modified three-dimensional model, the elevator three-dimensional model stored in the AR glasses can be updated in real time, and prompt is given to the site technology so as to optimize the installation process of the site technician.
In the embodiment of the invention, the actual well information of the elevator well is acquired through the virtual imaging terminal before the elevator is installed, and the virtual interference analysis is carried out according to the actual well information and the elevator three-dimensional model, so that the fault and the abnormity are found in advance for field technicians, the problem that the installation cannot be carried out and the fault finding and the elevator disassembly are required after the installation is carried out in a certain stage can be effectively avoided, and the corresponding adjustment or treatment can be carried out in advance, so that the elevator installation progress is effectively improved, the accuracy and the reliability of the elevator installation are ensured, the elevator fault treatment efficiency and the elevator treatment accuracy of the field technicians in the elevator installation and maintenance stages are improved, and the requirements of the field technicians and manufacturers are met.
On the other hand, referring to fig. 3, an embodiment of the present invention further provides an interaction method for elevator fault handling, where the interaction method is applied to a technical terminal, the technical terminal is connected to a virtual imaging terminal through a cloud server, and the interaction method includes:
s10) judging whether video information sent from the virtual imaging terminal is acquired or not, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault;
s20) judging whether an operation instruction is acquired or not under the condition of acquiring the video information;
s30) generating three-dimensional operation information corresponding to the elevator three-dimensional model under the condition of acquiring the operation instruction;
s40) generating feedback information based on the three-dimensional operation information, and feeding the feedback information back to the virtual imaging terminal.
In an embodiment of the present invention, the video information includes an elevator video and a hoistway video, and the interaction method includes: judging whether an interference analysis result generated based on the elevator video and the hoistway video is obtained or not; under the condition that the interference analysis result is obtained, obtaining modification operation on the elevator three-dimensional model; modifying the elevator three-dimensional model based on the modification operation to obtain a modified three-dimensional model; and feeding back the modified three-dimensional model.
The interactive device for elevator fault handling provided by the embodiment of the invention is described below with reference to the accompanying drawings.
Referring to fig. 4, based on the same inventive concept, an embodiment of the present invention provides an interaction device for elevator fault handling, which is applied to a virtual imaging terminal, where the virtual imaging terminal is connected to a technical terminal of an elevator manufacturer through a cloud server, and the interaction device includes: the instruction acquisition unit is used for acquiring a video acquisition instruction; the video acquisition unit is used for acquiring video information based on the video acquisition instruction, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault; the information uploading unit is used for uploading the video information; the feedback acquisition unit is used for acquiring feedback information of the technical terminal based on the video information, and the feedback information comprises three-dimensional operation information corresponding to the elevator three-dimensional model; and the display unit is used for displaying the three-dimensional operation information.
On the other hand, referring to fig. 5, an embodiment of the present invention further provides an interaction device for elevator fault handling, which is applied to a technical terminal, where the technical terminal is connected to a virtual imaging terminal through a cloud server, and the interaction device includes: the first judgment unit is used for judging whether video information sent from the virtual imaging terminal is acquired or not, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault; the second judging unit is used for judging whether an operation instruction is acquired or not under the condition that the video information is acquired; the operation unit is used for generating operation information corresponding to the elevator three-dimensional model under the condition that the operation instruction is obtained; and the feedback unit is used for generating feedback information based on the operation information and feeding the feedback information back to the virtual imaging terminal.
Further, the embodiment of the present invention also provides a computer readable storage medium, on which a computer program is stored, and the program, when executed by a processor, implements the method described in the embodiment of the present invention.
Although the embodiments of the present invention have been described in detail with reference to the accompanying drawings, the embodiments of the present invention are not limited to the details of the above embodiments, and various simple modifications can be made to the technical solutions of the embodiments of the present invention within the technical idea of the embodiments of the present invention, and the simple modifications all belong to the protection scope of the embodiments of the present invention.
It should be noted that the various features described in the above embodiments may be combined in any suitable manner without departing from the scope of the invention. In order to avoid unnecessary repetition, the embodiments of the present invention do not describe every possible combination.
Those skilled in the art can understand that all or part of the steps in the method according to the above embodiments may be implemented by a program, which is stored in a storage medium and includes several instructions to enable a single chip, a chip, or a processor (processor) to perform all or part of the steps in the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
In addition, any combination of various different implementation manners of the embodiments of the present invention is also possible, and the embodiments of the present invention should be considered as disclosed in the embodiments of the present invention as long as the combination does not depart from the spirit of the embodiments of the present invention.
Claims (7)
1. An interaction method for elevator fault processing is applied to a virtual imaging terminal, and is characterized in that the virtual imaging terminal is connected with a technical terminal of an elevator manufacturer through a cloud server, and the interaction method comprises the following steps:
acquiring a video acquisition instruction;
acquiring video information based on the video acquisition instruction, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault;
uploading the video information;
feedback information of the technical terminal based on the video information is obtained, wherein the feedback information comprises three-dimensional operation information corresponding to the elevator three-dimensional model;
displaying the three-dimensional operation information;
the acquiring of the video information based on the video acquisition instruction comprises:
acquiring preliminary video information based on the video acquisition instruction;
identifying the elevator in the preliminary video information to obtain elevator identification information;
obtaining a three-dimensional model of an elevator;
establishing a real-time mapping relation between the elevator identification information and the elevator three-dimensional model;
superposing the elevator three-dimensional model in the preliminary video information in real time based on the real-time mapping relation to generate the video information;
the video information further comprises hoistway video, and the interaction method further comprises the following steps:
after the video information is obtained, obtaining a hoistway three-dimensional model based on the hoistway video;
obtaining a three-dimensional model of an elevator;
performing elevator interference analysis based on the hoistway three-dimensional model and the elevator three-dimensional model to obtain a corresponding interference analysis result;
determining the defect of the elevator when the interference analysis result is that the elevator is interfered with a shaft, and uploading the elevator video and the interference analysis result; wherein the content of the first and second substances,
a plurality of hoistway markers are disposed within the hoistway, the hoistway markers being used to characterize hoistway information, the obtaining a three-dimensional model of the hoistway based on the hoistway video, comprising:
acquiring a preset origin, wherein the preset origin is positioned in a well;
establishing a three-dimensional coordinate system of the well based on the preset origin;
identifying a hoistway marker in the hoistway video to obtain a plurality of target markers;
acquiring a plurality of corresponding target shaft information based on the plurality of target marks;
generating the hoistway three-dimensional model based on the target hoistway information and a three-dimensional coordinate system of the hoistway.
2. The interaction method of claim 1, wherein the elevator three-dimensional model comprises a plurality of part three-dimensional models, the interaction method further comprising:
after the elevator video is obtained, judging whether a labeling operation aiming at the elevator three-dimensional model is obtained or not;
under the condition that the labeling operation is obtained, obtaining a three-dimensional model of the specified part corresponding to the labeling operation;
performing convex display processing on the three-dimensional model of the specified part in the elevator video to obtain a processed elevator video;
and uploading the processed elevator video.
3. An interaction method for elevator fault processing is applied to a technical terminal, and is characterized in that the technical terminal is connected with a virtual imaging terminal through a cloud server, and the interaction method comprises the following steps:
judging whether video information sent from the virtual imaging terminal is acquired or not, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault;
under the condition of acquiring the video information, judging whether an operation instruction is acquired or not;
under the condition that the operation instruction is obtained, generating three-dimensional operation information corresponding to the elevator three-dimensional model;
generating feedback information based on the three-dimensional operation information, and feeding the feedback information back to the virtual imaging terminal;
the video information is obtained through the virtual imaging terminal based on the following modes:
acquiring preliminary video information based on a video acquisition instruction;
identifying the elevator in the preliminary video information to obtain elevator identification information;
obtaining a three-dimensional model of an elevator;
establishing a real-time mapping relation between the elevator identification information and the elevator three-dimensional model;
superposing the elevator three-dimensional model in the preliminary video information in real time based on the real-time mapping relation to generate the video information;
the video information further comprises a hoistway video, and the virtual imaging terminal further executes the following operations:
after the video information is obtained, obtaining a shaft three-dimensional model based on the shaft video;
obtaining a three-dimensional model of an elevator;
performing elevator interference analysis based on the shaft three-dimensional model and the elevator three-dimensional model to obtain a corresponding interference analysis result;
determining the defect of the elevator when the interference analysis result is that the elevator is interfered with a shaft, and uploading the elevator video and the interference analysis result; wherein the content of the first and second substances,
a plurality of hoistway markers are disposed within the hoistway, the hoistway markers being used to characterize hoistway information, the obtaining a three-dimensional model of the hoistway based on the hoistway video, comprising:
acquiring a preset origin, wherein the preset origin is positioned in a well;
establishing a three-dimensional coordinate system of the well based on the preset origin;
identifying a hoistway marker in the hoistway video to obtain a plurality of target markers;
acquiring a plurality of corresponding target shaft information based on the plurality of target marks;
generating the hoistway three-dimensional model based on the target hoistway information and a three-dimensional coordinate system of the hoistway.
4. The interactive method of claim 3, wherein the video information comprises elevator video and hoistway video, the interactive method further comprising:
judging whether an interference analysis result generated based on the elevator video and the hoistway video is obtained or not;
under the condition that the interference analysis result is obtained, obtaining modification operation on the elevator three-dimensional model;
modifying the elevator three-dimensional model based on the modification operation to obtain a modified three-dimensional model;
and feeding back the modified three-dimensional model.
5. The utility model provides an interactive device of elevator fault handling, is applied to virtual image terminal, its characterized in that, virtual image terminal passes through cloud ware and is connected with elevator producer's technical terminal, interactive device includes:
the instruction acquisition unit is used for acquiring a video acquisition instruction;
the video acquisition unit is used for acquiring video information based on the video acquisition instruction, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault;
the information uploading unit is used for uploading the video information;
the feedback acquisition unit is used for acquiring feedback information of the technical terminal based on the video information, and the feedback information comprises three-dimensional operation information corresponding to the elevator three-dimensional model;
a display unit for displaying the three-dimensional operation information;
the video acquisition unit is configured to:
acquiring preliminary video information based on the video acquisition instruction;
identifying the elevator in the preliminary video information to obtain elevator identification information;
obtaining a three-dimensional model of an elevator;
establishing a real-time mapping relation between the elevator identification information and the elevator three-dimensional model;
the elevator three-dimensional model is superimposed in real time in the preliminary video information based on the real-time mapping relation to generate the video information, the video information further comprises a hoistway video, and the virtual imaging terminal is used for:
after the video information is obtained, obtaining a hoistway three-dimensional model based on the hoistway video;
obtaining a three-dimensional model of an elevator;
performing elevator interference analysis based on the shaft three-dimensional model and the elevator three-dimensional model to obtain a corresponding interference analysis result;
determining the defect of the elevator when the interference analysis result is that the elevator is interfered with a shaft, and uploading the elevator video and the interference analysis result; wherein the content of the first and second substances,
a plurality of hoistway markers are disposed within the hoistway, the hoistway markers being used to characterize hoistway information, the obtaining a three-dimensional model of the hoistway based on the hoistway video, comprising:
acquiring a preset origin, wherein the preset origin is positioned in a well;
establishing a three-dimensional coordinate system of the well based on the preset origin;
identifying a hoistway marker in the hoistway video to obtain a plurality of target markers;
acquiring a plurality of corresponding target shaft information based on the plurality of target marks;
generating the hoistway three-dimensional model based on the target hoistway information and a three-dimensional coordinate system of the hoistway.
6. An interaction device for elevator fault handling is applied to a technical terminal, and is characterized in that the technical terminal is connected with a virtual imaging terminal through a cloud server, and the interaction device comprises:
the first judgment unit is used for judging whether video information sent from the virtual imaging terminal is acquired or not, wherein the video information comprises an elevator video, the elevator video comprises an elevator three-dimensional model, and the elevator video is associated with an elevator fault;
the second judging unit is used for judging whether an operation instruction is acquired or not under the condition that the video information is acquired;
the operation unit is used for generating operation information corresponding to the elevator three-dimensional model under the condition that the operation instruction is obtained;
the feedback unit is used for generating feedback information based on the operation information and feeding the feedback information back to the virtual imaging terminal;
the video information is obtained through the virtual imaging terminal based on the following modes:
acquiring preliminary video information based on a video acquisition instruction;
identifying the elevator in the preliminary video information to obtain elevator identification information;
obtaining a three-dimensional model of an elevator;
establishing a real-time mapping relation between the elevator identification information and the elevator three-dimensional model;
the elevator three-dimensional model is superimposed in real time in the preliminary video information based on the real-time mapping relation to generate the video information, the video information further comprises a hoistway video, and the virtual imaging terminal further executes the following operations:
after the video information is obtained, obtaining a hoistway three-dimensional model based on the hoistway video;
obtaining a three-dimensional model of an elevator;
performing elevator interference analysis based on the hoistway three-dimensional model and the elevator three-dimensional model to obtain a corresponding interference analysis result;
determining the defect of the elevator when the interference analysis result is that the elevator is interfered with a shaft, and uploading the elevator video and the interference analysis result; wherein the content of the first and second substances,
a plurality of hoistway markers are arranged in a hoistway, the hoistway markers are used for representing hoistway information, and the obtaining a hoistway three-dimensional model based on the hoistway video comprises:
acquiring a preset origin, wherein the preset origin is positioned in a well;
establishing a three-dimensional coordinate system of the well based on the preset origin;
identifying a hoistway marker in the hoistway video to obtain a plurality of target markers;
acquiring a plurality of corresponding target shaft information based on the plurality of target marks;
generating the hoistway three-dimensional model based on the target hoistway information and a three-dimensional coordinate system of the hoistway.
7. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110667589.0A CN113347408B (en) | 2021-06-16 | 2021-06-16 | Interactive method, interactive device and storage medium for elevator fault handling |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110667589.0A CN113347408B (en) | 2021-06-16 | 2021-06-16 | Interactive method, interactive device and storage medium for elevator fault handling |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113347408A CN113347408A (en) | 2021-09-03 |
| CN113347408B true CN113347408B (en) | 2023-02-17 |
Family
ID=77476050
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110667589.0A Active CN113347408B (en) | 2021-06-16 | 2021-06-16 | Interactive method, interactive device and storage medium for elevator fault handling |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113347408B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113747111A (en) * | 2021-09-14 | 2021-12-03 | 广东电网有限责任公司 | Interactive power transformation defect elimination remote video consultation support system based on AR glasses |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105739704A (en) * | 2016-02-02 | 2016-07-06 | 上海尚镜信息科技有限公司 | Remote guidance method and system based on augmented reality |
| CN108322475A (en) * | 2018-02-27 | 2018-07-24 | 成都普望智能科技有限公司 | A kind of equipment remote collaboration method for maintaining and system based on MR live streamings |
| CN111526118A (en) * | 2019-10-29 | 2020-08-11 | 南京翱翔信息物理融合创新研究院有限公司 | Remote operation guiding system and method based on mixed reality |
| CN112002018A (en) * | 2020-08-18 | 2020-11-27 | 云南省第一人民医院 | Intraoperative position navigation system, device and method based on mixed reality |
| CN112265880A (en) * | 2020-10-26 | 2021-01-26 | 广州广日电梯工业有限公司 | Visual inspection method and visual inspection device for elevator |
-
2021
- 2021-06-16 CN CN202110667589.0A patent/CN113347408B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105739704A (en) * | 2016-02-02 | 2016-07-06 | 上海尚镜信息科技有限公司 | Remote guidance method and system based on augmented reality |
| CN108322475A (en) * | 2018-02-27 | 2018-07-24 | 成都普望智能科技有限公司 | A kind of equipment remote collaboration method for maintaining and system based on MR live streamings |
| CN111526118A (en) * | 2019-10-29 | 2020-08-11 | 南京翱翔信息物理融合创新研究院有限公司 | Remote operation guiding system and method based on mixed reality |
| CN112002018A (en) * | 2020-08-18 | 2020-11-27 | 云南省第一人民医院 | Intraoperative position navigation system, device and method based on mixed reality |
| CN112265880A (en) * | 2020-10-26 | 2021-01-26 | 广州广日电梯工业有限公司 | Visual inspection method and visual inspection device for elevator |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113347408A (en) | 2021-09-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111611855B (en) | Intelligent inspection system for three-dimensional visual robot of transformer substation | |
| CN110047150B (en) | Complex equipment operation on-site simulation system based on augmented reality | |
| CN110909898B (en) | AR (augmented reality) glasses-based system and AR glasses-based method for diagnosing, maintaining and guiding faults of bank machine room | |
| CN110865917A (en) | AR technology-based electric power machine room inspection operation method, system and application | |
| CN107498299A (en) | A kind of tool positioning system tightened applied to bolt and operating method | |
| CN108766081A (en) | A kind of automobile detachable training system based on VR | |
| CN109638959B (en) | Power equipment remote signaling function debugging method and system based on AR and deep learning | |
| CN113347408B (en) | Interactive method, interactive device and storage medium for elevator fault handling | |
| CN110146035B (en) | Embedded part detection method, device, equipment and system for component production line | |
| US20200136356A1 (en) | Method and system for the automated support of a connection process, in particular of components arranged in a control cabinet or on a mounting system | |
| CN108038910A (en) | The implementation method of substation's main equipment Virtual Reality Demonstration | |
| CN108628263A (en) | Control system, control device, computer readable storage medium and control method | |
| JPWO2019087870A1 (en) | Work support equipment, work support methods and programs | |
| CN100562134C (en) | A kind of test macro of digital display device and method of testing thereof | |
| CN112364423A (en) | Assembly type decoration construction method combining AR technology and BIM technology | |
| CN107480797B (en) | LNG dispenser fault diagnosis and elimination system and operation method thereof | |
| CN115331002A (en) | Method for realizing remote processing of heating power station fault based on AR glasses | |
| CN110889514A (en) | Air traffic control station equipment emergency repair remote support system and method | |
| KR102198028B1 (en) | Position Verification Method for Equipment Layout at 3D Design of Smart Factory | |
| CN110264818B (en) | Unit water inlet valve disassembly and assembly training method based on augmented reality | |
| CN102682282B (en) | Online model identification instrument based on DaVinci framework and embedded type image detection technology | |
| CN104298972A (en) | Household device state recognition method and system and mobile terminal | |
| CN107576665A (en) | A kind of underwater structure crack detection system based on machine vision | |
| CN110636256A (en) | Industrial fault diagnosis method, device, equipment and storage medium based on AR | |
| CN111062932A (en) | Monitoring method of network service program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |