CN115617234A - Operation and maintenance guiding method and system - Google Patents
Operation and maintenance guiding method and system Download PDFInfo
- Publication number
- CN115617234A CN115617234A CN202211638272.5A CN202211638272A CN115617234A CN 115617234 A CN115617234 A CN 115617234A CN 202211638272 A CN202211638272 A CN 202211638272A CN 115617234 A CN115617234 A CN 115617234A
- Authority
- CN
- China
- Prior art keywords
- image
- reference image
- equipment
- library
- selecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 73
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 8
- 230000010365 information processing Effects 0.000 claims description 3
- 230000015572 biosynthetic process Effects 0.000 claims description 2
- 238000003786 synthesis reaction Methods 0.000 claims description 2
- 238000007689 inspection Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an operation and maintenance guiding method and related equipment, wherein the method comprises the following steps: acquiring an equipment image, acquiring a corresponding reference image library according to the equipment image, selecting at least one first reference image from the reference image library, and synthesizing the at least one first reference image and the equipment image to obtain a first AR image and displaying the first AR image on a display screen; acquiring first gesture information, and determining a first image area of the first gesture information on the first AR image according to the first gesture information; and selecting a second reference image in the reference image library according to the first image area, obtaining a second AR image according to the second reference image and the equipment image, and displaying the second AR image on the display screen. The invention can lead the operation and maintenance personnel to conveniently obtain the operation and maintenance guidance.
Description
Technical Field
The invention relates to the technical field of AR, in particular to an operation and maintenance guiding method and system.
Background
Many large-scale equipment and production line need regularly patrol and examine, and the operation and maintenance production personnel find unusual and in time handle in the process of patrolling and examining, can guarantee enterprise's safety in production. At present, the skill improvement of operation and maintenance personnel is still mainly achieved in a text teaching mode, the operation and maintenance personnel are not visual, the site introduction sense is also lacked, and the operation and maintenance personnel are difficult to obtain operation and maintenance guidance in the inspection process.
Thus, there is a need for improvements and enhancements in the art.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides an operation and maintenance guidance method and system, aiming at solving the problem that operation and maintenance personnel cannot obtain operation and maintenance guidance in the inspection process in the prior art.
In order to solve the technical problems, the invention provides the following technical scheme:
in a first aspect of the present invention, an operation and maintenance guidance method is provided, including:
acquiring an equipment image, acquiring a corresponding reference image library according to the equipment image, selecting at least one first reference image from the reference image library, and synthesizing the at least one first reference image and the equipment image to obtain a first AR image and displaying the first AR image on a display screen;
acquiring first gesture information, and determining a first image area of the first gesture information on the first AR image according to the first gesture information;
and selecting a second reference image in the reference image library according to the first image area, obtaining a second AR image according to the second reference image and the equipment image, and displaying the second AR image on the display screen.
The operation and maintenance guiding method comprises the steps that the reference image library comprises a plurality of object images and operation images corresponding to the object images; the acquiring of the corresponding reference image library according to the device image comprises:
acquiring the shooting position of the equipment image, and selecting at least one candidate image library from a plurality of image libraries according to the shooting position;
and when any real object image in the candidate image library is matched with the equipment image, determining that the candidate image library is the reference image library corresponding to the equipment image.
The operation and maintenance guiding method, wherein each of the operation images corresponds to an operation option icon, and the selecting at least one first reference image from the reference image library includes:
selecting a real object image matched with the equipment image from the reference image library, and selecting a corresponding operation image from the reference image library according to the real object image matched with the equipment image;
and taking the operation option icon corresponding to the operation image as the first reference image.
The operation and maintenance guiding method, wherein the selecting a second reference image in the reference image library according to the first image region comprises:
when the first image area is an operation option icon area in the first AR image:
if the current mode is a first mode, taking a first image as the second reference image, wherein the first image is an image corresponding to an operation option icon in the first image area in the operation image corresponding to a real object image matched with the equipment image in the reference image library;
and if the current mode is a second mode, randomly selecting a second image, and taking the second image and the first image as the second reference image, wherein the second image is a teaching image corresponding to the preset operation option icon.
The operation and maintenance guiding method, wherein after obtaining a second AR image according to the second reference image and the device image, includes:
and if the current mode is the second mode, receiving second gesture information, determining a second image area in the second AR image according to the second gesture information, judging whether the second reference image corresponding to the second image area is the first image or not, and generating prompt information according to a judgment result.
The operation and maintenance guiding method, wherein the selecting a second reference image in the reference image library according to the first image region comprises:
and when the first image area is an equipment image area in the first AR image, selecting a real object image corresponding to the first image area in the reference image library as the second reference image according to the first gesture information.
An operation and maintenance guide device comprising:
the image acquisition module is used for acquiring an equipment image, acquiring a corresponding reference image library according to the equipment image, selecting at least one first reference image from the reference image library, and synthesizing the at least one first reference image and the equipment image to obtain a first AR image and display the first AR image on a display screen;
the gesture information processing module is used for acquiring first gesture information and determining a first image area of the first gesture information on the first AR image according to the first gesture information;
and the synthesis module is used for selecting a second reference image in the reference image library according to the first image area, obtaining a second AR image according to the second reference image and the equipment image, and displaying the second AR image on the display screen.
A terminal, wherein the terminal comprises: the operation and maintenance guidance system comprises a processor and a computer readable storage medium which is in communication connection with the processor, wherein the computer readable storage medium is suitable for storing a plurality of instructions, and the processor is suitable for calling the instructions in the computer readable storage medium to execute the steps of implementing the operation and maintenance guidance method.
A computer readable storage medium storing one or more programs, the one or more programs being executable by one or more processors to perform the steps of the operation and maintenance guidance method described above.
Compared with the prior art, the operation and maintenance guiding method and system provided by the invention have the advantages that the corresponding reference image library is obtained according to the equipment image, the first reference image and the equipment image are selected from the reference image library to be synthesized, the first AR image is obtained and displayed on the AR display screen, the first gesture information is further obtained, the second reference image selected from the reference image library based on the first gesture information is generated and displayed on the AR display screen, and therefore, the operation and maintenance personnel can obtain the reference image related to equipment inspection by photographing the equipment and can interact with the AR display screen by using gestures to further obtain more reference images, and the operation and maintenance personnel can conveniently obtain the operation and maintenance guiding information in the inspection process.
Drawings
FIG. 1 is a flowchart of an embodiment of an operation and maintenance guidance method provided by the present invention;
FIG. 2 is a schematic structural diagram of an embodiment of an operation and maintenance guidance device provided by the present invention;
fig. 3 is a schematic diagram of an embodiment of a terminal according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely below, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
In an embodiment of the present invention, an operation and maintenance guidance method is provided, where the method may be applied to a terminal with computing capability, and the terminal may be, but is not limited to, various computers, servers, mobile devices, wearable devices, and the like.
As shown in fig. 1, the method provided by this embodiment includes the steps of:
s100, acquiring an equipment image, acquiring a corresponding reference image library according to the equipment image, selecting at least one first reference image in the reference image library, and synthesizing the at least one first reference image and the equipment image to obtain a first AR image and displaying the first AR image on a display screen.
In the process of polling the equipment, when operation and maintenance personnel do not know the specific operation and maintenance operation of the equipment, the operation and maintenance personnel can photograph the equipment to obtain an equipment image and upload the equipment image to the terminal, and the terminal obtains a corresponding reference image library according to the equipment image. Specifically, in this embodiment, an image library is set in advance for various types of devices, reference data of corresponding devices during operation and maintenance are stored in the image library, specifically, the image library includes a plurality of object images and an operation image corresponding to each object image, the object image is an image obtained by directly shooting the devices, and the operation image is a related image in the operation and maintenance operation process of the devices, and includes an operation tool image and an operation demonstration image. The obtaining of the corresponding reference image library according to the device image comprises:
acquiring the shooting position of the equipment image, and selecting at least one candidate image library from a plurality of image libraries according to the shooting position;
and when any real object image in the candidate image library is matched with the equipment image, determining that the candidate image library is the reference image library corresponding to the equipment image.
The reference image library corresponding to the device image may be obtained by image matching, but a lot of devices are available in a factory, and it takes a long time to match the real object images in all the image libraries with the device images one by one, and the device position is fixed in the factory. Specifically, an equipment position map is constructed in advance, the shooting position of the equipment image is mapped to the coordinates in the equipment position map, in order to prevent positioning errors, a floating range is set for the shooting position of the equipment image, and image libraries corresponding to equipment in the floating range are all used as the candidate image libraries.
After the candidate image library is obtained, matching the real object image in the candidate image library with the device image, which can be specifically realized by adopting the existing image matching algorithm.
Each of the operation images has an operation option icon, and the selecting at least one first reference image in the reference image library comprises:
selecting a real object image matched with the equipment image from the reference image library, and selecting a corresponding operation image from the reference image library according to the real object image matched with the equipment image;
and taking an operation option icon corresponding to the operation image as the first reference image.
The operation option icon is an image, and the operation option icon is used for indicating the category of the operation image, for example, when the operation image is an operation tool image, the corresponding operation option icon may be an icon of a tool box or a "tool" character icon, and when the operation image is an operation demonstration image, the corresponding operation option icon may be an icon of a player or a "demonstration image" character icon, and the like.
And synthesizing the operation option icon with the equipment image to obtain the first AR image and displaying the first AR image on a display screen, so that a user can interact with the display screen and obtain a related reference image which the user wants by selecting the corresponding operation option icon.
The method provided by the embodiment further comprises the following steps:
s200, first gesture information is obtained, and a first image area of the first gesture information on the first AR image is determined according to the first gesture information.
Specifically, the first gesture information may be obtained by the display screen receiving a touch signal sent by a user touching the display screen, or may be obtained by shooting through a camera arranged on the display screen. And determining a first image area on the first AR image according to the first gesture information, for example, when the first gesture information is sent by a user touching the display screen, the first image area can be determined according to a position clicked on the display screen by the user.
S300, selecting a second reference image in the reference image library according to the first image area, obtaining a second AR image according to the second reference image and the equipment image, and displaying the second AR image on the display screen.
The selecting a second reference image in the reference image library according to the first image region comprises:
when the first image area is an operation option icon area in the first AR image:
if the current mode is a first mode, taking a first image as the second reference image, wherein the first image is an image corresponding to an operation option icon in the first image area in the operation image corresponding to a real object image matched with the equipment image in the reference image library;
and if the current mode is a second mode, randomly selecting a second image, and taking the second image and the first image as the second reference image, wherein the second image is a teaching image corresponding to the preset operation option icon.
In the present embodiment, two modes are set: the operation and maintenance mode and the teaching mode need to directly provide operation and maintenance guide data for operation and maintenance personnel in the operation and maintenance mode, provide more interaction in the teaching mode, provide various operation images, receive the selection of the operation and maintenance personnel on the operation images, provide a judgment result, provide on-site substitution feeling for the operation and maintenance personnel and improve the service skills of the operation and maintenance personnel. Specifically, the first mode is an operation and maintenance mode, and the second mode is a teaching mode.
In the operation and maintenance mode, according to the operation option icon selected by the operation and maintenance personnel, an image corresponding to the operation option icon in the operation image corresponding to the equipment image can be selected from the reference image library, namely the first image is used as the second reference image and is synthesized with the equipment image to obtain the second AR image and display the second AR image, so that the operation and maintenance personnel can visually see the shot operation image of the equipment to be used as a reference to inspect the equipment.
In the teaching mode, according to the operation option icon selected by the operation and maintenance staff, the first image and the teaching image corresponding to the operation option icon can be used as the second reference image, the second reference image and the equipment image are synthesized to obtain and display the second AR image, the teaching image corresponding to the operation option icon comprises various preset operation images corresponding to the operation option icon, and the preset operation images comprise images which are not matched with the equipment image.
Further, after obtaining a second AR image according to the second reference image and the device image, the method includes:
and if the current mode is the second mode, receiving second gesture information, determining a second image area in the second AR image according to the second gesture information, judging whether the second reference image corresponding to the second image area is the first image or not, and generating prompt information according to a judgment result.
In a teaching mode, after the generated second AR image is generated and displayed, the operation and maintenance person may send out the second gesture information, determine a second image area in the second AR image according to the second gesture information, where the second image area is a part of the second reference image in the second AR image, if the second reference image corresponding to the second image area is the first image, it indicates that the operation and maintenance person has selected a correct operation option, if the second reference image corresponding to the second image area is not the second image, it indicates that the operation and maintenance person has selected an incorrect operation option, and generate corresponding prompt information according to a determination result of whether the second reference image corresponding to the second image area is the first image.
When the second reference image corresponding to the second image area is not the second image, after the prompt information is generated, a face image in front of the display screen is acquired, and the face image is associated with the device image, and the face image may be acquired based on a camera installed on the display screen or acquired by reading an identification card (e.g., a work card) through reading equipment. And when the second mode is entered again, acquiring a new face image, reading the image associated with the face image, and increasing the probability of selecting the operation image corresponding to the equipment in the image associated with the face image when the second reference image is selected.
The selecting a second reference image in the reference image library according to the first image region further comprises:
and when the first image area is the equipment image area in the first AR image, selecting a real object image corresponding to the first image area in the reference image library as the second reference image according to the first gesture information.
When the first image area is an equipment image area in the first AR image, it indicates that an operation and maintenance person wants to adjust a display effect of the equipment image, for example, zoom in or zoom out, determines whether the operation is a zoom-in operation or a zoom-out operation according to the first gesture information, performs a zoom-in operation or a zoom-out operation on the equipment image with the first image area as a center, and selects a real object image matched with the first image area in the reference image library as the second reference image according to the zoomed-in equipment image. Therefore, the second AR image is generated and displayed on the display screen, and operation and maintenance personnel can conveniently check specific operation and maintenance guide data of parts in each position of the equipment.
In summary, according to the operation and maintenance guidance method provided by the invention, the corresponding reference image library is acquired according to the device image, the first reference image and the device image are selected from the reference image library to be synthesized, the first AR image is acquired to be displayed on the AR display screen, the first gesture information is further acquired, the second reference image selected from the reference image library based on the first gesture information is generated to be displayed on the AR display screen, and thus, the operation and maintenance person can acquire the reference image about the device inspection by photographing the device, can interact with the AR display screen by using gestures, further acquires more reference images, and is convenient for the operation and maintenance person to acquire the guidance information about the inspection in the inspection process.
Example two
Based on the above embodiment, the present invention further provides an operation and maintenance guiding device, as shown in fig. 2, the operation and maintenance guiding device includes:
an image obtaining module, configured to obtain an apparatus image, obtain a corresponding reference image library according to the apparatus image, select at least one first reference image in the reference image library, and synthesize the at least one first reference image and the apparatus image to obtain a first AR image, and display the first AR image on a display screen, as described in embodiment one;
the gesture information processing module is configured to acquire first gesture information, and determine a first image area of the first gesture information on the first AR image according to the first gesture information, which is specifically described in embodiment one;
and a synthesizing module, configured to select a second reference image from the reference image library according to the first image area, obtain a second AR image according to the second reference image and the device image, and display the second AR image on the display screen, which is specifically described in embodiment one.
EXAMPLE III
Based on the above embodiments, the present invention further provides a terminal, as shown in fig. 3, where the terminal includes a processor and a memory. It should be understood that more or fewer components may alternatively be implemented.
The storage may in some embodiments be an internal storage unit of the terminal, such as a hard disk or a memory of the terminal. The memory may also be an external storage device of the terminal in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the terminal. Further, the memory may also include both an internal storage unit and an external storage device of the terminal. The memory is used for storing application software and various data installed in the terminal. The memory may also be used to temporarily store data that has been output or is to be output. In one embodiment, the memory stores an operation and maintenance instruction program, and the operation and maintenance instruction program can be executed by the processor to implement the operation and maintenance instruction method of the present application.
The processor may be a Central Processing Unit (CPU), a microprocessor or other chip in some embodiments, and is used for running program codes stored in the memory or Processing data, such as executing the operation and maintenance guidance method.
Example four
The present invention also provides a computer readable storage medium, in which one or more programs are stored, the one or more programs being executable by one or more processors to implement the steps of an operation and maintenance guidance method as described above.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (9)
1. An operation and maintenance guiding method, which is characterized by comprising the following steps:
acquiring an equipment image, acquiring a corresponding reference image library according to the equipment image, selecting at least one first reference image from the reference image library, and synthesizing the at least one first reference image and the equipment image to obtain a first AR image and displaying the first AR image on a display screen;
acquiring first gesture information, and determining a first image area of the first gesture information on the first AR image according to the first gesture information;
and selecting a second reference image in the reference image library according to the first image area, obtaining a second AR image according to the second reference image and the equipment image, and displaying the second AR image on the display screen.
2. The operation and maintenance guiding method according to claim 1, wherein the reference image library comprises a plurality of object images and an operation image corresponding to each object image; the obtaining of the corresponding reference image library according to the device image comprises:
acquiring the shooting position of the equipment image, and selecting at least one candidate image library from a plurality of image libraries according to the shooting position;
and when any real object image in the candidate image library is matched with the equipment image, determining that the candidate image library is the reference image library corresponding to the equipment image.
3. The operation and maintenance guiding method according to claim 2, wherein each of the operation images corresponds to an operation option icon, and the selecting at least one first reference image in the reference image library comprises:
selecting a real object image matched with the equipment image from the reference image library, and selecting a corresponding operation image from the reference image library according to the real object image matched with the equipment image;
and taking an operation option icon corresponding to the operation image as the first reference image.
4. The operation and maintenance guiding method according to claim 3, wherein the selecting a second reference image in the reference image library according to the first image region comprises:
when the first image area is an operation option icon area in the first AR image:
if the current mode is a first mode, taking a first image as the second reference image, wherein the first image is an image corresponding to an operation option icon in the first image area in the operation image corresponding to a real object image matched with the equipment image in the reference image library;
and if the current mode is a second mode, randomly selecting a second image, and taking the second image and the first image as the second reference image, wherein the second image is a teaching image corresponding to the preset operation option icon.
5. The operation and maintenance guiding method according to claim 4, wherein after obtaining a second AR image according to the second reference image and the device image, the method comprises:
if the current mode is the second mode, receiving second gesture information, determining a second image area in the second AR image according to the second gesture information, judging whether the second reference image corresponding to the second image area is the first image or not, and generating prompt information according to a judgment result.
6. The operation and maintenance guiding method according to claim 3, wherein the selecting a second reference image in the reference image library according to the first image region comprises:
and when the first image area is the equipment image area in the first AR image, selecting a real object image corresponding to the first image area in the reference image library as the second reference image according to the first gesture information.
7. An operation and maintenance guide device, comprising:
the image acquisition module is used for acquiring an equipment image, acquiring a corresponding reference image library according to the equipment image, selecting at least one first reference image from the reference image library, and synthesizing the at least one first reference image and the equipment image to obtain a first AR image and display the first AR image on a display screen;
the gesture information processing module is used for acquiring first gesture information and determining a first image area of the first gesture information on the first AR image according to the first gesture information;
and the synthesis module is used for selecting a second reference image in the reference image library according to the first image area, obtaining a second AR image according to the second reference image and the equipment image, and displaying the second AR image on the display screen.
8. A terminal, characterized in that the terminal comprises: a processor, a computer readable storage medium communicatively connected to the processor, the computer readable storage medium adapted to store a plurality of instructions, the processor adapted to invoke the instructions in the computer readable storage medium to perform the steps of implementing the operation and maintenance guidance method of any one of claims 1-6.
9. A computer readable storage medium, storing one or more programs, the one or more programs being executable by one or more processors for performing the steps of the operation and maintenance guidance method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211638272.5A CN115617234A (en) | 2022-12-20 | 2022-12-20 | Operation and maintenance guiding method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211638272.5A CN115617234A (en) | 2022-12-20 | 2022-12-20 | Operation and maintenance guiding method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115617234A true CN115617234A (en) | 2023-01-17 |
Family
ID=84880333
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211638272.5A Pending CN115617234A (en) | 2022-12-20 | 2022-12-20 | Operation and maintenance guiding method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115617234A (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101196399A (en) * | 2007-11-23 | 2008-06-11 | 凯立德欣技术（深圳）有限公司 | Navigation system and its query and indication method for surrounding information |
| CN101340661A (en) * | 2008-08-14 | 2009-01-07 | 北京中星微电子有限公司 | Guide control implementing mobile apparatus and server, guide control method |
| CN101924992A (en) * | 2010-07-30 | 2010-12-22 | 中国电信股份有限公司 | Method, system and equipment for acquiring scene information through mobile terminal |
| CN106485956A (en) * | 2016-09-29 | 2017-03-08 | 珠海格力电器股份有限公司 | Method and device for demonstrating functions of electronic equipment and intelligent terminal |
| CN107784885A (en) * | 2017-10-26 | 2018-03-09 | 歌尔科技有限公司 | Operation training method and AR equipment based on AR equipment |
| CN108073277A (en) * | 2016-11-08 | 2018-05-25 | 罗克韦尔自动化技术公司 | For the virtual reality and augmented reality of industrial automation |
| CN108089696A (en) * | 2016-11-08 | 2018-05-29 | 罗克韦尔自动化技术公司 | For the virtual reality and augmented reality of industrial automation |
| CN109582147A (en) * | 2018-08-08 | 2019-04-05 | 亮风台（上海）信息科技有限公司 | A kind of method and user equipment enhancing interaction content for rendering |
| US20190362556A1 (en) * | 2018-05-22 | 2019-11-28 | Agilent Technologies, Inc. | Method and System for Implementing Augmented Reality (AR)-Based Assistance Within Work Environment |
| CN110609913A (en) * | 2019-09-18 | 2019-12-24 | 中国工商银行股份有限公司 | Information processing method and device, electronic device and medium |
| CN111612177A (en) * | 2020-05-18 | 2020-09-01 | 上海齐网网络科技有限公司 | Interactive semantic based augmented reality intelligent operation and maintenance system |
| US20210134065A1 (en) * | 2019-10-30 | 2021-05-06 | Purdue Research Foundation | System and method for generating asynchronous augmented reality instructions |
| US20210382559A1 (en) * | 2018-10-25 | 2021-12-09 | Beyeonics Surgical Ltd | Ui for head mounted display system |
-
2022
- 2022-12-20 CN CN202211638272.5A patent/CN115617234A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101196399A (en) * | 2007-11-23 | 2008-06-11 | 凯立德欣技术（深圳）有限公司 | Navigation system and its query and indication method for surrounding information |
| CN101340661A (en) * | 2008-08-14 | 2009-01-07 | 北京中星微电子有限公司 | Guide control implementing mobile apparatus and server, guide control method |
| CN101924992A (en) * | 2010-07-30 | 2010-12-22 | 中国电信股份有限公司 | Method, system and equipment for acquiring scene information through mobile terminal |
| CN106485956A (en) * | 2016-09-29 | 2017-03-08 | 珠海格力电器股份有限公司 | Method and device for demonstrating functions of electronic equipment and intelligent terminal |
| CN108089696A (en) * | 2016-11-08 | 2018-05-29 | 罗克韦尔自动化技术公司 | For the virtual reality and augmented reality of industrial automation |
| CN108073277A (en) * | 2016-11-08 | 2018-05-25 | 罗克韦尔自动化技术公司 | For the virtual reality and augmented reality of industrial automation |
| CN113703569A (en) * | 2016-11-08 | 2021-11-26 | 罗克韦尔自动化技术公司 | System and method for virtual reality and augmented reality for industrial automation |
| CN107784885A (en) * | 2017-10-26 | 2018-03-09 | 歌尔科技有限公司 | Operation training method and AR equipment based on AR equipment |
| US20190362556A1 (en) * | 2018-05-22 | 2019-11-28 | Agilent Technologies, Inc. | Method and System for Implementing Augmented Reality (AR)-Based Assistance Within Work Environment |
| CN109582147A (en) * | 2018-08-08 | 2019-04-05 | 亮风台（上海）信息科技有限公司 | A kind of method and user equipment enhancing interaction content for rendering |
| US20210382559A1 (en) * | 2018-10-25 | 2021-12-09 | Beyeonics Surgical Ltd | Ui for head mounted display system |
| CN110609913A (en) * | 2019-09-18 | 2019-12-24 | 中国工商银行股份有限公司 | Information processing method and device, electronic device and medium |
| US20210134065A1 (en) * | 2019-10-30 | 2021-05-06 | Purdue Research Foundation | System and method for generating asynchronous augmented reality instructions |
| CN111612177A (en) * | 2020-05-18 | 2020-09-01 | 上海齐网网络科技有限公司 | Interactive semantic based augmented reality intelligent operation and maintenance system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110189416B (en) | Remote guiding method and system for overhaul site | |
| KR101195446B1 (en) | A portable terminal providing maintenance guide based on augmented reality and the method of providing maintenance guide using the same | |
| US10395427B1 (en) | On-site visualization and modeling using P and ID drawings and augmented reality | |
| US9436274B2 (en) | System to overlay application help on a mobile device | |
| CN111812545B (en) | Line defect detection method, device, equipment and medium | |
| CN112559341A (en) | Picture testing method, device, equipment and storage medium | |
| JP2017162103A (en) | Inspection work support system, inspection work support method, and inspection work support program | |
| JP6672673B2 (en) | Information processing apparatus, control method, and program | |
| CN110826646A (en) | Robot vision testing method and device, storage medium and terminal equipment | |
| CN111597628B (en) | Model marking method and device, storage medium and electronic equipment | |
| CN112667212A (en) | Buried point data visualization method and device, terminal and storage medium | |
| CN110740315A (en) | Camera correction method and device, electronic equipment and storage medium | |
| WO2018158815A1 (en) | Inspection assistance device, inspection assistance method, and recording medium | |
| CN117252837A (en) | Data processing method and device for wafer test, medium and electronic equipment | |
| CN115617234A (en) | Operation and maintenance guiding method and system | |
| CN109712076B (en) | Image stitching method, device, equipment and storage medium | |
| CN115065604B (en) | Equipment topology map generation method, generation device, storage medium and terminal equipment | |
| CN113468355B (en) | Display mother board data management method and device | |
| CN115348441A (en) | Time delay measuring method, system, device, equipment and storage medium | |
| CN113760087B (en) | Method and device for determining hit point position information | |
| CN112559340A (en) | Picture testing method, device, equipment and storage medium | |
| JP6290743B2 (en) | Information processing apparatus and program | |
| CN114299809A (en) | Direction information display method, display device, electronic equipment and readable storage medium | |
| CN112181744A (en) | Fault detection method, system, terminal and storage medium of converter interface | |
| CN110968519A (en) | Game testing method, device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20230117 |