CN111858799B - Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant - Google Patents

Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant Download PDF

Info

Publication number
CN111858799B
CN111858799B CN202010594411.3A CN202010594411A CN111858799B CN 111858799 B CN111858799 B CN 111858799B CN 202010594411 A CN202010594411 A CN 202010594411A CN 111858799 B CN111858799 B CN 111858799B
Authority
CN
China
Prior art keywords
data
positioning
annotation
user
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010594411.3A
Other languages
Chinese (zh)
Other versions
CN111858799A (en
Inventor
杨强
吴晓程
徐霞军
秦绪涛
李连海
王定
雷德刚
张晓宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Nuclear Power Corp
Original Assignee
Jiangsu Nuclear Power Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Nuclear Power Corp filed Critical Jiangsu Nuclear Power Corp
Priority to CN202010594411.3A priority Critical patent/CN111858799B/en
Publication of CN111858799A publication Critical patent/CN111858799A/en
Application granted granted Critical
Publication of CN111858799B publication Critical patent/CN111858799B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations
    • G01C21/206Instruments for performing navigational calculations specially adapted for indoor navigation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9537Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Testing And Monitoring For Control Systems (AREA)

Abstract

The invention belongs to the technical field of nuclear power plant equipment positioning, and particularly discloses a method, a system and equipment for dynamically positioning panoramic images for a nuclear power plant, wherein the method comprises the following steps: establishing an incidence relation between the panoramic image and the label, performing positioning navigation on the panoramic image, acquiring searching positioning request data, and presenting labeling information and positioning information of the panoramic image; the dynamic image annotation system comprises a dynamic coordinate module, an annotation editing module, an annotation reading module, an annotation storage module, a local annotation library and a back-end database; the panoramic positioning navigation system comprises a model management module, a live-action link module, a navigation positioning module, a visual display module, an external integration module and a back-end database; the image labeling dynamic positioning navigation equipment comprises an interaction unit, an instruction execution unit, a remote service unit and a storage reading and writing unit. The invention can realize the panoramic roaming of the factory area, quickly and accurately position the target equipment and reduce the possibility of mistakenly moving the equipment at a wrong interval and mistakenly entering a high radiation dose area.

Description

Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant
Technical Field
The invention belongs to the technical field of nuclear power plant equipment positioning, and particularly relates to a method, a system and equipment for dynamically labeling and positioning panoramic images for a nuclear power plant.
Background
With the development of the nuclear power industry, more and more people are put into the nuclear power industry, and because the equipment system of the nuclear power plant is very large and the safety control is strict, when the plant is in a closed period, the corresponding equipment such as a specific valve, a pump and the like is often difficult to find through a system flow chart; in addition, some devices have a cross-room problem due to the large number of rooms; under the influence of on-site light and environmental factors, the staff has the following problem when patrolling and examining, overhauing equipment:
1. target equipment cannot be found quickly, a large amount of time is wasted, and an overhaul window is missed.
2. The compartment mistake is gone into easily by mistake and equipment is torn open by mistake, endangers the unit steady operation.
3. The patient mistakenly enters a high radiation dose area and is irradiated unnecessarily, so that physical and mental health is harmed.
4. Unfamiliar with the environment around the work area, the industrial risk is big.
In order to solve the problems, more and more nuclear power enterprises try to simulate the field environment by establishing three-dimensional models of systems and equipment in a factory building, information of various dimensions can be added on the models, users can be familiar with system processes and equipment arrangement in advance through the three-dimensional models, and in addition, previewing can be performed by means of the three-dimensional models before maintenance activities are carried out, so that the purposes of improving the field execution efficiency and reducing unnecessary safety risks are achieved.
As the current mainstream conventional technology, the method can play a better role in carrying out structural labeling and positioning on the positions and attributes of the objects in the factory building by relying on three-dimensional modeling. However, although the technology has advantages in system integration and function richness, it has disadvantages of many prepared data, large technical threshold, high cost investment, long implementation period, etc., for enterprises lacking budget investment, the difficulty of building the system is large, and different nuclear power plants cannot reuse models due to different reactor types, so that modeling design still needs to be performed again in new houses, which not only consumes huge cost, but also is difficult to assist field work in a short time.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a method, a system and equipment for dynamically labeling and positioning panoramic images for nuclear power plants, overcomes the defects that a large amount of resources are required to be invested, the technical development difficulty is high and the implementation period is long when the traditional method relies on three-dimensional modeling for positioning and even navigating equipment, and has the characteristics of small investment, easy technical realization and short development period.
The technical scheme for realizing the purpose of the invention is as follows: a dynamic marking and positioning method for panoramic images for nuclear power plants comprises the following steps:
step 1, executing a dynamic image annotation step for a nuclear power plant, and establishing an incidence relation between a panoramic image and annotation, wherein the step 1 comprises the following steps:
step 1.1, establishing a dynamic coordinate system of an image through a dynamic image labeling system;
step 1.2, when a user triggers a label editing behavior on an image, providing an inputtable label editing function and locally storing label data and coordinate data;
step 1.3, when a user browses the image, dynamically reading annotation data and coordinate data on the image from a localized storage by a dynamic image annotation system;
step 1.4, synchronizing the local storage data to a back-end database when the storage action is triggered, and establishing an association relation between the panoramic image and the label;
step 2, executing a panoramic image positioning and navigating step for the nuclear power plant, acquiring positioning request data sent by a user and searching positioning data; the step 2 comprises the following steps:
step 2.1, establishing a live-action shooting model and linking an equipment graph in the dynamic image labeling system with the live-action model;
2.2, associating relation data of the panoramic image and the annotation and received positioning request data of the user are obtained;
step 2.3, the panoramic image positioning navigation system finds out the specific corresponding position of the positioning data;
and 3, displaying the panoramic image marking information and the positioning information through the image marking dynamic positioning navigation equipment for the nuclear power plant to complete the dynamic marking and positioning of the panoramic image for the nuclear power plant.
The step 1.1 specifically comprises the following steps: step 1.1.1, a user opens a picture uploading page of the dynamic image annotation system, uploads a picture, and transmits picture data to the dynamic image annotation system through a network transmission channel; and 1.1.2, the dynamic image annotation system carries out dynamic analysis according to the uploaded picture data to obtain the resolution and the size of the picture. And establishing a two-dimensional coordinate system of the plane where the picture is located, storing the coordinates into a coordinate database of a dynamic image labeling system, and establishing a dynamic coordinate system of the picture.
The step 1.2 specifically comprises the following steps: step 1.2.1, when picture loading behaviors are executed, a dynamic image annotation system loads and displays pictures through a picture display component; step 1.2.2, the dynamic image marking system establishes an event monitoring mechanism on the picture through the picture display component; step 1.2.3, after the user triggers the double-click action on the picture, the dynamic image annotation system acquires the position coordinates of the event according to the event attached to the action, the picture display component records the coordinates of the event, and a marked data editing page is called for the user to input or edit the marked data.
The step 1.3 specifically comprises the following steps: step 1.3.1, the dynamic image annotation system prompts a user to select an annotation type; step 1.3.2, after the user selects the marking type as the detailed marking data of the equipment, the dynamic image marking system judges whether the coordinate point has marking data or not; step 1.3.3, after the user selects the marking type as the equipment position pointing data, the system judges whether the coordinate point has the equipment position pointing data or not; step 1.3.4, the user operates according to the result of the labeled data in the step 1.3.2 or the step 1.3.3, and the content is edited and then is stored; step 1.3.5: after the user executes the data editing behavior, the dynamic image annotation system initiates an asynchronous storage request, the back-end service receives the data modified by the user and executes storage operation, the data is stored in an annotation database of the dynamic image annotation system, a user page is refreshed through a callback method, and the picture and the corresponding annotation data are reloaded.
The step 1.4 specifically comprises the following steps: when a user triggers a click action behavior on a picture, the dynamic image annotation system acquires a position coordinate of an event according to the event attached to the behavior, reads specific annotation content data or annotation pointing data from an annotation database according to the width and height of the picture, displays related information through a dynamic side bar, synchronizes locally stored data to a back-end database of the dynamic image annotation system, and establishes an association relationship between a panoramic image and an annotation.
The step 2.2 specifically comprises the following steps: step 2.2.1, the user manages the annotation data on the live-action picture through the dynamic image annotation system, and the generated live-action annotation data is stored in a back-end database of the dynamic image annotation system; and 2.2.2, managing the position link data on the real scene model by the user, adding, modifying and deleting the position link data by the user, and storing the position link data generated or changed by operation in a back-end database of the positioning navigation system of the panoramic roaming equipment.
The step 2.3 specifically comprises the following steps: step 2.3.1, searching the position of the target equipment for navigation and positioning; and 2.3.2, step 2.3.2, the panoramic image positioning and navigation system carries out navigation positioning according to the type contained in the navigation positioning request data submitted by the user.
In the step 2.3.1, the user selects the following two ways to find the position of the target device for navigation and positioning: and searching the position of the target device for navigation positioning by inputting the device code of the device to be searched in the search bar or searching the position of the target device for navigation positioning by inputting the marked content in the search box.
The navigation positioning request types in the step 2.3.2 comprise two request types of a positioning request and a navigation request; for the positioning type request, the nuclear power plant panoramic roaming equipment positioning navigation system searches the position information of corresponding equipment from the model link data of the dynamic image annotation system and the nuclear power plant panoramic roaming equipment positioning navigation system; for the navigation type request, the nuclear power plant panoramic roaming equipment positioning navigation system acquires the current position of a user through the local positioning capability of the positioning device of the mobile terminal equipment, and dynamically calculates and plans the arriving route by adopting a graph connectivity algorithm in combination with the position of the target equipment manually selected by the user.
A dynamic image labeling system for a nuclear power plant, the system comprising: the dynamic coordinate module receives image data uploaded and input by a user, dynamically analyzes the characteristic data of the picture and calculates the characteristic data to generate a coordinate system of the picture, and interacts with a local labeling library to realize the local storage of the coordinate data; the annotation editing module is used for acquiring the coordinate of the position from the event when the user triggers double-click behavior on the image, and reading data from the local annotation library to judge whether the coordinate has corresponding data; the annotation reading module is used for responding to the default display behavior of the annotation and the triggering of the clicking behavior of the user on the image; the label storage module is used for communicating with the data of the back-end database, executing data synchronization behaviors and executing specific storage behaviors; the local marking library is used for storing local temporary data; a back-end database for persistent data storage.
The label editing module dynamically displays different pages to users according to different label types; after the user finishes editing and selecting and saving, the detailed device labeling data or the device position pointing data and the coordinates of the corresponding position are stored in the local labeling library together.
And for default display behaviors in the label reading module, reading label data from a back-end database, and dynamically displaying the label data on an image in a layer form according to coordinate information corresponding to the label of the label data.
The data synchronization behavior in the annotation storage module is to read the annotation data of the currently operated image from the back-end database once and synchronize the annotation data in the local annotation database.
A panoramic positioning and navigation system for a nuclear power plant comprises: the model management module is used for managing a panoramic model of plants and equipment in the nuclear power plant, which is established by a user by adopting a modeling tool; the live-action linking module is used for realizing position linking on the panoramic model; the navigation positioning module is used for receiving a navigation positioning request generated by the behavior of a user on a visual display mode, and implementing the corresponding function of the specific function of positioning or navigation according to the type of the request; the visual display module is used for displaying the content of each module which is visible for the user in a centralized manner and providing interactive access experience for the user through layout and content organization; the external integration module is used for realizing the integration of data of a real-time data system for the production of the nuclear power plant equipment and the radiation monitoring equipment and realizing the function of synchronously seeing real-time operation parameters and monitoring data of the radiation monitoring equipment on an equipment image page; and the back-end database is used for storing all data of the system.
The link in the live-action link module adopts a hyperlink form on editable PDF to link files, and associates the image with the entity model.
And the navigation positioning module performs data interaction with the model management module and the dynamic image annotation system.
The visual display module supports displaying of model files and picture files.
And the external integration module receives data of an external system, performs logic processing on the data and displays the data through the visual display module.
An image annotation dynamic positioning navigation device for a nuclear power plant comprises: the interaction unit is used for interacting with the image marking system and the positioning navigation system by operating on a terminal touch screen by a user through the portable mobile terminal, and converting an operation event of the user into an input instruction; the instruction execution unit is used for analyzing the called distribution and input parameters and executing according to the logic of the code segment; the remote service unit is used for finishing the remote service operations of business database storage, user login authentication and user authority identification; and the storage read-write unit completes the read-write of the high-speed memory according to the input of the instruction execution unit.
And after the interaction unit transmits the instruction to the instruction execution unit, the behavior characteristics of the display page on the terminal are dynamically changed according to the output of the instruction execution unit.
If the instruction execution unit is involved in the call to the remote service unit, the input data is sent to the remote service unit, and the execution result is returned to the instruction execution unit after the code logic is executed; and if the storage read-write action is involved, sending the data to the storage read-write unit so as to complete the read-write action on the local storage or the external storage.
The remote service unit of the instruction execution unit returns the service execution result to the instruction execution unit by executing the service logic of the remote end.
The storage read-write unit. The read-write object of the high-speed memory includes an internal memory and an external memory.
The invention has the beneficial technical effects that: (1) According to the method, the system and the equipment for dynamically positioning the panoramic image for the nuclear power plant, the traditional method that business personnel of the nuclear power plant mark and look for the position of the equipment by holding drawings on a paper system flow chart is abandoned, so that a user can mark various images and input and store rich information quickly through movable image marking and dynamic positioning navigation equipment. The operation of anytime and anywhere is carried out through finger touch, the convenience and the real-time performance of the position marking of the field device are greatly improved, and the user experience is improved. The searching path of the equipment position is automatically planned by the equipment, so that the position searching efficiency in a complex space is effectively improved, and the user safety and the application convenience are improved. (2) The invention provides a method, a system and equipment for realizing the functions of panoramic roaming of nuclear power plant equipment pictures and positioning and navigation of equipment, which are low in cost and can be implemented quickly. The method has the advantages that the nuclear power plant system flow chart equipment codes are utilized, so that the method can be linked to the field real scene, and the position of the equipment can be quickly positioned; an optimal advancing path is given by using information such as preset factory building site environment and radiation dose, and a preview function is realized, so that the aims of quickly and accurately positioning target equipment, and reducing the possibility of mistakenly moving the equipment at wrong intervals and mistakenly entering a high radiation dose area are fulfilled. (3) The invention can help the staff to realize the panoramic roaming of the factory, is familiar with the field working environment, quickly and accurately positions the target equipment, and reduces the possibility of mistakenly moving the equipment at wrong intervals and mistakenly entering a high radiation dose area. (4) The dynamic image annotation method provided by the invention guides the realization of a dynamic image annotation system through the design of a coordinate system, the design of an annotation reading instruction, the design of an annotation action instruction and the design of an annotation storage instruction. (5) The dynamic image annotation system provided by the invention realizes the dynamic generation of a storage coordinate system according to the image file of any format selected by a user through the dynamic coordinate module, the annotation editing module, the annotation reading module and the annotation storage module, and realizes the dynamic addition of image layers on the image and the support of content annotation in a rich text form. (6) The panoramic image positioning and navigation system provided by the invention realizes the positioning of the equipment position by depending on technologies such as a dynamic image marking system, VR (virtual reality) and the like through the model management module, the live-action link module, the navigation positioning module and the external integration module, and can realize the dynamic navigation from a starting point to a final equipment position through route planning. (7) The movable image labeling and dynamic positioning navigation equipment provided by the invention realizes dynamic image labeling and dynamic positioning navigation equipment depending on a movable handheld terminal through the interaction unit, the instruction execution unit, the remote service unit and the storage read-write unit. (8) According to the plant viewing mode provided by the invention, the panoramic model of the nuclear power plant and equipment is established through the real-scene shooting of the nuclear power plant, so that the panoramic roaming of the plant can be realized through VR glasses. (9) The method associates factory building and equipment model labels of the nuclear power plant with codes corresponding to the site, links equipment on a system flow chart with a real scene model, and can see the site position and the surrounding environment of the equipment by clicking the flow chart equipment. (10) The autonomous programming software development system provided by the invention has the systems of picture marking, search marking and positioning marking, is different from the methods of 3D factory building modeling and the like on the market, has the characteristics of low investment cost, less occupied resources and high engineering speed, and can be used for various desktop terminals and mobile phone terminals.
Drawings
FIG. 1 is a flowchart of a method for dynamically labeling and positioning a panoramic image for a nuclear power plant according to the present invention;
FIG. 2 is a flowchart of a dynamic image annotation procedure for a nuclear power plant according to the present invention;
FIG. 3 is a schematic diagram of a dynamic image annotation system for a nuclear power plant according to the present invention;
FIG. 4 is a flowchart of a panoramic image positioning and navigating step for a nuclear power plant according to the present invention;
FIG. 5 is a schematic diagram of a panoramic image positioning and navigation system for a nuclear power plant according to the present invention;
fig. 6 is a schematic diagram of a mobile image annotation dynamic positioning navigation device for a nuclear power plant according to the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention and the accompanying drawings. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
As shown in fig. 1, 2 and 4, the method for dynamically labeling and positioning the panoramic image for the nuclear power plant provided by the invention comprises the following steps:
step 1, executing a dynamic image annotation step for the nuclear power plant as shown in FIG. 2, and establishing an association relationship between the panoramic image and the annotation.
Step 1.1, establishing a dynamic coordinate system of the image through a dynamic image labeling system.
Step 1.1.1, a user opens a picture uploading page of the dynamic image annotation system, selects a local picture or a terminal to shoot a picture for uploading, and transmits picture data to the dynamic image annotation system through a network transmission channel after clicking an uploading button.
And 1.1.2, the dynamic image annotation system carries out dynamic analysis according to the uploaded picture data to obtain the resolution and the size of the uploaded picture data. Establishing a two-dimensional coordinate system of a plane where the picture is located, wherein the x axis is positive towards the right, the y axis is positive downwards, the top left corner vertex is a point (0, 0), the top right corner vertex is a point (picture width, 0), the bottom left corner vertex is a point (0, picture height), and the bottom right corner vertex is a point (picture width, picture height), storing the coordinates of the four vertices into a coordinate database of a dynamic image labeling system, and establishing the dynamic coordinate system of the picture.
And step 1.2, when a user triggers an annotation editing behavior on the image, providing an inputtable annotation editing function and locally storing annotation data and coordinate data.
And step 1.2.1, when the picture loading behavior is executed, the dynamic image annotation system loads and displays the picture through the picture display component.
The position of the displayed image is determined according to the coordinate data of the image, the coordinates of four vertexes are used as the drawing basis of the rectangular matrix, and the size of the image display assembly draws the image according to the coordinate data. The image display component reads the label data contained in the image from the back-end label database, the label data comprises the position coordinate of the label and the detailed label content, and the image display component dynamically creates a layer control in the position coordinate area of the label and displays the brief information of the labeled data. The dynamic layers are independent controls, and an unlimited number of layers can be covered on the same picture. The layer display style is controlled by CSS.
Step 1.2.2, the dynamic image annotation system establishes an event monitoring mechanism on the picture through the picture display component
The monitoring mechanism can identify and receive two actions of clicking and double clicking of a user, and the monitoring program provides a callback mechanism and can dynamically respond according to the actions.
Step 1.2.3, after the user triggers the double-click action on the picture, the dynamic image annotation system obtains the position coordinates (x, y) of the event according to the event attached to the action, the picture display component records the coordinates of the event according to the (x/picture width, y/picture height), and a marked data editing page is called for the user to input or edit the marked data.
And 1.3, when a user browses the image, dynamically reading the annotation data and the coordinate data on the image from the local storage by the dynamic image annotation system.
And step 1.3.1, the dynamic image annotation system prompts a user to select an annotation type of the operation.
The dynamic image annotation system provides two annotation types, including detailed equipment annotation data and equipment position pointing data, and after a user selects different types, a page is automatically switched to a corresponding editing window.
And 1.3.2, after the user selects the marking type as the detailed marking data of the equipment, judging whether the coordinate point has marking data or not by the dynamic image marking system. If the label data does not exist, a blank input window pops up, the user inputs the label data, if the label data exists, the label data is extracted from a back-end database, the input window pops up, and the data is loaded into an input text box of the window.
And 1.3.3, after the user selects the marking type as the equipment position pointing data, judging whether the coordinate point has the equipment position pointing data or not by the system. And if the equipment position pointing data does not exist, popping up the equipment picture file existing in the system for selection by a user, and if the equipment position pointing data exists, extracting the equipment position pointing data from the back-end database and selecting the corresponding equipment picture file by default.
And step 1.3.4, the user operates according to the labeling data result of the step 1.3.2 or the step 1.3.3, and the content is edited and then is stored.
Step 1.3.5, after the user finishes the data editing behavior, the dynamic image annotation system initiates an asynchronous storage request, the back-end service receives the data modified by the user and executes the storage operation, the data is stored in an annotation database of the dynamic image annotation system, the user page is refreshed through a callback method, and the picture and the corresponding annotation data are reloaded.
And step 1.4, synchronizing the locally stored data to a back-end database when the storage action is triggered, and establishing the association relationship between the panoramic image and the annotation.
When a user triggers a click action behavior on a picture, the dynamic image annotation system acquires position coordinates (x, y) of an event according to the event attached to the behavior, reads specific annotation content data or annotation pointing data from an annotation database according to the (x/picture width, y/picture height), displays related information through a dynamic sidebar, synchronizes locally stored data to a back-end database of the dynamic image annotation system, and establishes an association relationship between a panoramic image and an annotation.
And 2, executing the positioning and navigation steps of the panoramic image for the nuclear power plant shown in the figure 4, acquiring positioning request data sent by a user and searching positioning data.
And 2.1, establishing a live-action shooting model and linking the equipment graph in the dynamic image labeling system with the live-action model.
The user shoots the real scene through various types of model acquisition tools. On the basis of a picture file formed by shooting, a panoramic model of a plant and equipment in the nuclear power plant is established by adopting a modeling tool, the model comprehensively shows the equipment arrangement information and the environmental information of the plant, and the dynamic image marking system provides a maintenance function of multi-type model data.
And 2.2, receiving the positioning request data of the user through the incidence relation data of the panoramic image and the annotation.
And 2.2.1, managing the annotation data on the live-action picture by the user through the dynamic image annotation system, and storing the generated live-action annotation data in a back-end database of the dynamic image annotation system.
And 2.2.2, managing the position link data on the real scene model by the user. The link adopts a hyperlink form on the editable PDF to link files, associates the image with the entity model, and triggers the jump behavior of PDF software when a user clicks a flow chart, so that the association interaction with the field position of the equipment and the information of the surrounding environment is realized. The user can add, modify, delete and the like to the position link data. The position link data generated or changed in operation is stored in a back-end database of the panoramic roaming device positioning navigation system.
And 2.3, the panoramic image positioning and navigation system finds out the specific corresponding position of the positioning data in the internal module and returns the position.
And 2.3.1, searching the position of the target equipment for navigation and positioning.
The user selects two ways to find the target device position for navigation and positioning.
And 2.3.1.1, inputting the equipment code of the equipment to be searched in the search bar, judging whether the code is in a code library by the system, if so, displaying a list corresponding to information such as the Chinese name of the equipment, the name of the operating system where the equipment is located, the position of a factory building, the operating condition, the picture where the equipment is located, the coordinates of the equipment and the like, otherwise, prompting that the matching content is not found, and returning to the search bar.
And 2.3.1.2, inputting all or part of the marked content in the search box, performing marked content level search in a storage database at the back end by the system, returning a list corresponding to the most similar information such as the picture where the equipment is located, the equipment coordinate and the like according to the similarity search result, and otherwise, prompting that the matched content is not found and returning to a search column.
And 2.3.2, the panoramic image positioning and navigation system carries out navigation positioning according to the type contained in the navigation positioning request data submitted by the user.
Navigation and positioning requests are of two types, namely 'positioning' and 'navigation', and are presented on a user interaction page in a visual button mode. If the user selects a certain item in the result list, the user clicks a 'positioning' button, and the operation type in the triggered navigation positioning request is 'positioning'. If the user selects a certain item in the result list, the navigation button is clicked, and the operation type in the triggered navigation positioning request is navigation.
And 2.3.2.1, for the positioning type request, searching the position information of the corresponding equipment from the model link data of the dynamic image labeling system and the panoramic roaming equipment positioning and navigation system for the nuclear power plant by the panoramic roaming equipment positioning and navigation system for the nuclear power plant. And the picture display component provided by the dynamic image labeling system automatically converts the picture display component into an accurate position on the picture according to the picture and the equipment coordinates, loads the labeled detailed data from the back-end database and displays the labeled detailed data to the user. Meanwhile, the nuclear power plant panoramic roaming equipment positioning navigation system finds the nuclear power plant panoramic roaming equipment positioning navigation system flow chart and hyperlink information corresponding to the equipment through model link data stored in a back-end database, and displays and opens a model file where the equipment is located.
And 2.3.2.2, for the request of the type of navigation, acquiring the current position of the user by the panoramic roaming equipment positioning and navigation system for the nuclear power plant through the local positioning capability of the positioning device of the mobile terminal equipment, and dynamically calculating and planning an arriving route by adopting a graph connectivity algorithm in combination with the position of the target equipment manually selected by the user.
And 3, displaying the panoramic image annotation information and the positioning information through a movable image annotation dynamic positioning navigation device of the nuclear power plant.
The implementation provides a nuclear power plant with a mobile image labeling dynamic positioning navigation device, executes an instruction code inside the device according to a gesture touch action of a user on the device, and completes data acquisition and visual presentation of display details. And according to the route calculated in the step 2.3.2.2, displaying the route in a form of a list and an arrow by using a visual interactive page of the mobile image annotation dynamic positioning navigation equipment of the nuclear power plant.
As shown in fig. 3, the dynamic image annotation system for nuclear power plants provided by the present invention includes a dynamic coordinate module, an annotation editing module, an annotation reading module, an annotation saving module, a local annotation library, and a back-end database, and specifically includes the following steps:
and a dynamic coordinate module. Receiving image data uploaded and input by a user, dynamically analyzing the characteristic data of the picture and calculating to generate a coordinate system of the picture, and interacting with a local labeling library to realize the local storage of the coordinate data.
And a label editing module. The method is used for acquiring the coordinates of the position from the event when the user triggers the double-click behavior on the image, and reading data from the local labeling library to judge whether the coordinates have corresponding data. And dynamically displaying different pages to the user according to different labeling types. If the annotation type is the detailed annotation data of the equipment, popping up an annotation data editing page for a user to input or edit the annotation data. If the annotation type is the equipment position pointing data, a pointing data editing page is popped up for the user to select the pointed equipment picture file data or change the currently pointed equipment picture file data. After the user finishes editing and selecting and saving, the detailed device labeling data or the device position pointing data and the coordinates of the corresponding position are stored in the local labeling library together.
And a label reading module. Default display behavior for annotations and response by the user to trigger a single click behavior on the image. And for the default display behavior, reading the labeled data from the back-end database, and dynamically displaying the labeled data on the image in a layer form according to the coordinate information corresponding to the label of the labeled data. Displaying brief title information by default in the content; and for the single-click behavior of the user, acquiring the coordinates of the position from the behavior event, and further reading and displaying the marked data from the back-end database.
And a label storage module. For data communication with a back-end database, performing data synchronization activities, and performing specific save activities. The data synchronization behavior is that the annotation data of the currently operated image is read out from the back-end database once and is synchronized in the local annotation database; and when the local labeling library changes, the changed content is synchronized to the back-end database from the local labeling library in an asynchronous mode. And when the specific saving behavior is executed, saving the data change confirmed to be input by the user in the local marking library.
A local annotation store. The method is used for storing local temporary data, and is convenient for accelerating local data reading.
A back-end database. The method is used for persistent data storage and provides a unified data storage service.
As shown in fig. 5, for the panoramic positioning and navigation system for nuclear power plants provided by the present invention, the system includes a model management module, a live-action link module, a navigation positioning module, a visual display module, an external integration module, and a backend database, which are specifically as follows:
and a model management module. The method is used for managing the panoramic models of plants and equipment in the nuclear power plant established by a user by adopting a modeling tool, and realizing the modeling management of the plants, the equipment arrangement information and the environmental information. And providing a maintenance function of the multi-type model data. The model data is stored in a back-end database.
And a live-action link module. For enabling positional linking over the panoramic model. The link adopts a hyperlink form on the editable PDF to link files, associates the image with the entity model, and triggers the jump behavior of PDF software when a user clicks the hyperlink on the flow chart, thereby realizing the association interaction with the field position of the equipment and the surrounding environment information. The model data is stored in a back-end database.
And a navigation positioning module. The module is used for receiving a navigation positioning request generated by the behavior of a user on a visual display mode, and implementing corresponding functions according to the specific functions of positioning or navigation according to the type of the request. The module has a route calculation planning function and performs data interaction with the model management module and the dynamic image annotation system.
And a visual display module. The modules collectively present the content of each module that is visible to the user and provide an interactive access experience for the user through the layout and organization of the content. And supporting the presentation model file and the picture file. And the system performs data interaction with a back-end database, a navigation positioning module and an external integration module.
An external integration module. The module realizes integration with a real-time data system for nuclear power plant equipment production and data of radiation monitoring equipment by adopting an application integration mode, and realizes the function of synchronously seeing real-time operation parameters and monitoring data of the radiation monitoring equipment on an equipment image page. And receiving data of an external system, performing logic processing, and then displaying through a visual display module.
A back-end database. Serves to store all data of the system and provides data services to other modules.
In addition, the dynamic image labeling system for the nuclear power plant in fig. 3 is called to provide a picture display for the positioning and navigation system of the panoramic roaming device for the nuclear power plant.
As shown in fig. 6, the image annotation dynamic positioning navigation device for a nuclear power plant provided by the present invention includes an interaction unit, an instruction execution unit, a remote service unit, and a storage read-write unit, and specifically includes the following:
and an interaction unit. Depending on the portable and movable terminal, a user interacts with the labeling system and the navigation system through manual operations on a terminal touch screen, including clicking, double clicking, dragging, selecting and the like. The user may view the display and prompts of the screen. The operation event of the user can be converted into an input instruction of the program through a development framework of the terminal. After the interaction unit transmits the instruction to the instruction execution unit, the behavior characteristics of the display page on the terminal are dynamically changed according to the output of the instruction execution unit, and the behavior characteristics can be regarded as different display contents on the terminal screen.
An instruction execution unit. The instruction execution unit is a local code segment on the terminal, the SDK formulated by the terminal is used for development, and the high-performance processor equipped in the terminal analyzes the called distribution and input parameters according to the calling input transmitted by the interaction unit and executes the parameters according to the logic of the code segment. If the remote service unit is called, the input data is sent to the remote service unit, a corresponding service method is called, and after the remote service unit executes the code logic, the execution result is returned to the instruction execution unit; if the storage read-write action is involved, the data is sent to the storage read-write unit according to different execution logics so as to complete the read-write action on the local memory or the external memory.
And a remote service unit. The unit is deployed on a remote server and is provided for use by the navigation system through the REST API. The unit mainly completes remote service operations such as service database storage, user login authentication, user authority identification and the like. The unit realizes the self-management of the transaction state, and returns the service execution result to the instruction execution unit by executing the service logic of the remote end.
And storing the read-write unit. The unit completes the read-write of the high-speed memory according to the input of the instruction execution unit, and the read-write object comprises an internal memory and an external memory. The exporting of data of the internal memory to the external memory can be supported periodically by an application service on the terminal.
The present invention has been described in detail with reference to the drawings and examples, but the present invention is not limited to the examples, and various changes can be made within the knowledge of those skilled in the art without departing from the spirit of the present invention. The prior art can be adopted in the content which is not described in detail in the invention.

Claims (19)

1. A dynamic marking and positioning method for panoramic images for nuclear power plants is characterized by comprising the following steps: the method comprises the following steps:
step 1, executing a dynamic image annotation step for a nuclear power plant, and establishing an incidence relation between a panoramic image and annotation, wherein the step 1 comprises the following steps:
step 1.1, establishing a dynamic coordinate system of an image through a dynamic image labeling system;
step 1.2, when a user triggers a label editing behavior on an image, providing an inputtable label editing function and locally storing label data and coordinate data;
step 1.3, when a user browses the image, dynamically reading annotation data and coordinate data on the image from a localized storage by a dynamic image annotation system;
step 1.4, synchronizing the local storage data to a back-end database when the storage action is triggered, and establishing an association relation between the panoramic image and the label;
step 2, executing a panoramic image positioning and navigation step for the nuclear power plant, acquiring positioning request data sent by a user and searching positioning data; the step 2 comprises the following steps:
step 2.1, establishing a live-action shooting model and linking an equipment graph in the dynamic image labeling system with the live-action model;
2.2, associating relation data of the panoramic image and the annotation and received positioning request data of the user are obtained;
step 2.3, the panoramic image positioning navigation system finds out the specific corresponding position of the positioning data;
step 3, presenting the panoramic image annotation information and the positioning information through the image annotation dynamic positioning navigation equipment for the nuclear power plant, wherein the step 3 comprises the following steps:
dynamically positioning the navigation equipment by image marking of a nuclear power plant, executing an instruction code inside the equipment according to a gesture touch action of a user on the equipment, and finishing data acquisition and visual presentation of display details; and (4) according to the route calculated in the step (2.3), presenting the route in a manner of a list and an arrow through a visual interactive page of the nuclear power plant panoramic image labeling dynamic positioning navigation equipment, and completing the nuclear power plant panoramic image dynamic labeling and positioning.
2. The dynamic marking and positioning method of the panoramic image for the nuclear power plant according to claim 1, characterized in that: the step 1.1 specifically comprises the following steps:
step 1.1.1, a user opens a picture uploading page of the dynamic image annotation system, uploads a picture, and transmits picture data to the dynamic image annotation system through a network transmission channel;
step 1.1.2, the dynamic image annotation system carries out dynamic analysis according to the uploaded picture data to obtain the resolution and the size of the uploaded picture data; and establishing a two-dimensional coordinate system of the plane where the picture is located, storing the coordinates into a coordinate database of a dynamic image labeling system, and establishing a dynamic coordinate system of the picture.
3. The dynamic marking and positioning method of the panoramic image for the nuclear power plant according to claim 2, characterized in that: the step 1.2 specifically comprises the following steps:
step 1.2.1, when picture loading behaviors are executed, a dynamic image annotation system loads and displays pictures through a picture display component;
step 1.2.2, the dynamic image annotation system establishes an event monitoring mechanism on the picture through the picture display component;
step 1.2.3, after a user triggers a double-click action on a picture, the dynamic image annotation system obtains the position coordinates of the occurrence of an event according to the event attached to the action, the picture display assembly records the coordinates of the occurrence of the event, and a marked data editing page is called for the user to input or edit marked data.
4. The dynamic marking and positioning method of the panoramic image for the nuclear power plant according to claim 3, characterized in that: the step 1.3 specifically comprises the following steps:
step 1.3.1, the dynamic image annotation system prompts a user to select an annotation type;
step 1.3.2, after the user selects the marking type as the detailed marking data of the equipment, the dynamic image marking system judges whether the coordinate point has marking data or not;
step 1.3.3, after the user selects the marking type as the equipment position pointing data, the system judges whether the coordinate point has the equipment position pointing data or not;
step 1.3.4, the user operates according to the result of the labeling data in the step 1.3.2 or the step 1.3.3, and the content is edited and then is stored;
step 1.3.5: after the user executes the data editing behavior, the dynamic image annotation system initiates an asynchronous storage request, the back-end service receives the data modified by the user and executes storage operation, the data is stored in an annotation database of the dynamic image annotation system, a user page is refreshed through a callback method, and the picture and the corresponding annotation data are reloaded.
5. The nuclear power plant panoramic image dynamic labeling and positioning method according to claim 4, characterized in that: the step 1.4 specifically comprises the following steps: after a user triggers a click action behavior on a picture, the dynamic image annotation system acquires a position coordinate of an event according to the event attached to the behavior, reads specific annotation content data or annotation pointing data from an annotation database according to the width and height of the picture, displays related information through a dynamic side bar, synchronizes locally stored data into a back-end database of the dynamic image annotation system, and establishes an association relationship between a panoramic image and an annotation.
6. The nuclear power plant panoramic image dynamic annotation positioning method according to claim 5, characterized in that: the step 2.2 specifically comprises the following steps:
step 2.2.1, the user manages the annotation data on the live-action picture through the dynamic image annotation system, and the generated live-action annotation data is stored in a back-end database of the dynamic image annotation system;
and 2.2.2, managing the position link data on the real scene model by the user, adding, modifying and deleting the position link data by the user, and storing the position link data generated or changed by operation in a back-end database of the positioning navigation system of the panoramic roaming equipment.
7. The nuclear power plant panoramic image dynamic annotation positioning method according to claim 6, characterized in that: the step 2.3 specifically comprises the following steps:
step 2.3.1, the position of the target equipment for navigation and positioning is searched;
and 2.3.2, the panoramic image positioning and navigation system carries out navigation positioning according to the type contained in the navigation positioning request data submitted by the user.
8. The dynamic annotation and positioning method for the panoramic image used for the nuclear power plant according to claim 7, characterized in that: in the step 2.3.1, the user selects the following two ways to find the position of the target device for navigation and positioning: and searching the position of the target device for navigation positioning by inputting the device code of the device to be searched in the search bar or searching the position of the target device for navigation positioning by inputting the marked content in the search box.
9. The dynamic marking and positioning method of the panoramic image for the nuclear power plant according to claim 8, characterized in that: the navigation positioning request types in the step 2.3.2 comprise two request types of a positioning request and a navigation request; for the positioning type request, the nuclear power plant panoramic roaming equipment positioning navigation system searches the position information of corresponding equipment from the model link data of the dynamic image annotation system and the nuclear power plant panoramic roaming equipment positioning navigation system; for the navigation type request, the nuclear power plant panoramic roaming equipment positioning navigation system acquires the current position of the user through the local positioning capability of the positioning device of the mobile terminal equipment, and dynamically calculates and plans the arriving route by adopting a graph connectivity algorithm in combination with the position of the target equipment manually selected by the user.
10. A dynamic image annotation system for nuclear power plants for implementing the method for dynamically annotating and positioning panoramic images for nuclear power plants of any one of claims 1 to 9, characterized in that: the system comprises:
the dynamic coordinate module receives image data uploaded and input by a user, dynamically analyzes the characteristic data of the picture and calculates the characteristic data to generate a coordinate system of the picture, and interacts with a local labeling library to realize the local storage of the coordinate data;
the annotation editing module is used for acquiring the coordinates of the position from the event when the user triggers the double-click behavior on the image, and reading data from the local annotation library to judge whether the coordinates have corresponding data; the label editing module dynamically displays different pages to users according to different label types; if the annotation type is the detailed annotation data of the equipment, popping up an annotation data editing page for a user to input or edit the annotation data; if the annotation type is equipment position pointing data, popping up a pointing data editing page for a user to select pointed equipment picture file data or change the currently pointed equipment picture file data; after the user finishes editing and selecting and saving, storing the detailed equipment marking data or the equipment position pointing data and the coordinates of the corresponding position in a local marking library;
the annotation reading module is used for responding to the default display behavior of the annotation and the triggering of the clicking behavior of the user on the image; for default display behaviors, the label reading module reads label data from a back-end database, and dynamically displays the label data on an image in a layer form according to coordinate information corresponding to the label of the label data; displaying brief title information by default in the content; for the click behavior of the user, acquiring the coordinates of the position from the behavior event, and further reading and displaying the marked data from the back-end database;
the label storage module is used for communicating with the data of the back-end database, executing data synchronization behaviors and executing specific storage behaviors;
the local marking library is used for storing local temporary data;
a back-end database for persistent data storage.
11. The dynamic image annotation system for nuclear power plants as claimed in claim 10, wherein: the data synchronization behavior in the annotation storage module is to read the annotation data of the currently operated image from the back-end database once and synchronize the annotation data in the local annotation library.
12. A panoramic positioning and navigation system for nuclear power plants for realizing the method for dynamically labeling and positioning the panoramic images for nuclear power plants of any one of claims 1 to 9, which is characterized in that: the system comprises:
the model management module is used for managing a panoramic model of a plant and equipment in the nuclear power plant, which is established by a user by adopting a modeling tool; modeling management of plant, equipment arrangement information and environmental information is realized, and a maintenance function of multi-type model data is provided;
the live-action linking module is used for realizing position linking on the panoramic model; the link adopts a hyperlink form on editable PDF to link files, associates images with the entity model, and triggers the jump behavior of PDF software when a user clicks a hyperlink on a flow chart, so that the association interaction with the field position of equipment and the surrounding environment information is realized;
the navigation positioning module is used for receiving a navigation positioning request generated by the behavior of a user on the visual display mode and implementing corresponding functions by positioning or specific navigation functions according to the type of the request;
the visual display module is used for displaying the content of each module visible for the user in a centralized manner and providing interactive access experience for the user through layout and content organization; supporting the display of model files and picture files; the system performs data interaction with a back-end database, a navigation positioning module and an external integration module;
the external integration module is used for realizing integration with a real-time data system for production of nuclear power plant equipment and data of radiation monitoring equipment and realizing the function of synchronously viewing real-time operation parameters and monitoring data of the radiation monitoring equipment on an equipment image page;
and the back-end database is used for storing all data of the system.
13. The panoramic positioning and navigation system for nuclear power plants of claim 12, characterized in that: and the navigation positioning module performs data interaction with the model management module and the dynamic image annotation system.
14. The panoramic positioning and navigation system for nuclear power plants of claim 13, characterized in that: the visual display module supports displaying of model files and picture files.
15. The panoramic positioning and navigation system for nuclear power plants of claim 14, characterized in that: and the external integration module receives data of an external system, performs logic processing on the data and displays the data through the visual display module.
16. An image annotation dynamic positioning navigation device for nuclear power plants for realizing the panoramic image dynamic annotation positioning method for nuclear power plants of any one of claims 1 to 9, characterized in that: the apparatus includes:
the interaction unit is used for interacting with the image marking system and the positioning navigation system by operating on a terminal touch screen by a user and converting an operation event of the user into an input instruction by depending on the portable mobile terminal; the instruction execution unit is used for analyzing the called distribution and input parameters by a high-performance processor equipped in the terminal according to the calling input transmitted by the interaction unit and executing according to the logic of the code segment; if the instruction execution unit is involved in the call to the remote service unit, the input data is sent to the remote service unit, and the execution result is returned to the instruction execution unit after the code logic is executed; if the storage read-write action is involved, the data is sent to a storage read-write unit so as to complete the read-write action on the local memory or the external memory;
the remote service unit is deployed on a remote server and used for finishing the operations of storing a service database, logging in and authenticating a user and identifying the remote service of the user authority; the unit realizes the self-management of the transaction state, and returns the service execution result to the instruction execution unit by executing the service logic of the remote end;
and the storage read-write unit completes the read-write of the high-speed memory according to the input of the instruction execution unit.
17. The nuclear power plant image annotation dynamic positioning and navigation device according to claim 16, characterized in that: and after the interaction unit transmits the instruction to the instruction execution unit, the behavior characteristics of the display page on the terminal are dynamically changed according to the output of the instruction execution unit.
18. The nuclear power plant image annotation dynamic positioning navigation equipment as claimed in claim 17, wherein: the remote service unit of the instruction execution unit returns the service execution result to the instruction execution unit by executing the service logic of the remote end.
19. The nuclear power plant image annotation dynamic positioning and navigation device according to claim 18, characterized in that: the read-write object of the high-speed memory in the storage read-write unit comprises an internal memory and an external memory.
CN202010594411.3A 2020-06-28 2020-06-28 Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant Active CN111858799B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010594411.3A CN111858799B (en) 2020-06-28 2020-06-28 Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010594411.3A CN111858799B (en) 2020-06-28 2020-06-28 Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant

Publications (2)

Publication Number Publication Date
CN111858799A CN111858799A (en) 2020-10-30
CN111858799B true CN111858799B (en) 2022-10-21

Family

ID=72989357

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010594411.3A Active CN111858799B (en) 2020-06-28 2020-06-28 Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant

Country Status (1)

Country Link
CN (1) CN111858799B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112257678A (en) * 2020-11-19 2021-01-22 国网上海市电力公司 Power grid equipment accurate positioning method based on real object ID and real scene graph
CN115311409A (en) * 2022-06-26 2022-11-08 杭州美创科技有限公司 WEBGL-based electromechanical system visualization method and device, computer equipment and storage medium
CN115186315B (en) * 2022-07-25 2023-05-23 成都安讯智服科技有限公司 Method and system for accurately positioning equipment in factory diagram for configuration software

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177391A (en) * 2013-01-31 2013-06-26 李生林 Equipment monitoring system based on three-dimensional real scenes and system integration method based on three-dimensional real scenes
US9792368B1 (en) * 2010-03-04 2017-10-17 A9.Com, Inc. Dynamic map synchronization
CN108829435A (en) * 2018-06-19 2018-11-16 数据堂(北京)科技股份有限公司 A kind of image labeling method and general image annotation tool
WO2019226729A1 (en) * 2018-05-23 2019-11-28 Thomson Stephen C Spatial linking visual navigation system and method of using the same

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7424218B2 (en) * 2005-07-28 2008-09-09 Microsoft Corporation Real-time preview for panoramic images
WO2009153789A1 (en) * 2008-06-18 2009-12-23 Surgix Ltd. A method and system for stitching multiple images into a panoramic image
US20150309316A1 (en) * 2011-04-06 2015-10-29 Microsoft Technology Licensing, Llc Ar glasses with predictive control of external device based on event input
US9361283B2 (en) * 2011-11-30 2016-06-07 Google Inc. Method and system for projecting text onto surfaces in geographic imagery
JP6184237B2 (en) * 2013-08-07 2017-08-23 株式会社東芝 Three-dimensional data processing apparatus, processing method thereof, and processing program thereof
CN107766356A (en) * 2016-08-17 2018-03-06 上海毅昊信息科技股份有限公司 A kind of electric network fault pattern analysis display systems and method based on Model Matching
US10733777B2 (en) * 2017-08-10 2020-08-04 Google Llc Annotation generation for an image network
CN110047035B (en) * 2019-04-15 2023-04-28 深圳市数字城市工程研究中心 Panoramic video hot spot interaction system and interaction equipment
CN111024087B (en) * 2019-12-26 2023-06-20 国网上海市电力公司 Substation inspection navigation system and navigation method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9792368B1 (en) * 2010-03-04 2017-10-17 A9.Com, Inc. Dynamic map synchronization
CN103177391A (en) * 2013-01-31 2013-06-26 李生林 Equipment monitoring system based on three-dimensional real scenes and system integration method based on three-dimensional real scenes
WO2019226729A1 (en) * 2018-05-23 2019-11-28 Thomson Stephen C Spatial linking visual navigation system and method of using the same
CN108829435A (en) * 2018-06-19 2018-11-16 数据堂(北京)科技股份有限公司 A kind of image labeling method and general image annotation tool

Also Published As

Publication number Publication date
CN111858799A (en) 2020-10-30

Similar Documents

Publication Publication Date Title
CN111858799B (en) Dynamic marking and positioning method, system and equipment for panoramic image for nuclear power plant
Machado et al. Conceptual framework for integrating BIM and augmented reality in construction management
CN111526118B (en) Remote operation guiding system and method based on mixed reality
Chi et al. Research trends and opportunities of augmented reality applications in architecture, engineering, and construction
KR102201658B1 (en) Interactive digital displays
Zhang et al. RFID-assisted assembly guidance system in an augmented reality environment
CN104268939B (en) Transformer substation virtual-reality management system based on three-dimensional panoramic view and implementation method of transformer substation virtual-reality management system based on three-dimensional panoramic view
CA2128984C (en) Interactive method and system for producing address-correlated information using user-specified address zones
CN110865708B (en) Interaction method, medium, device and computing equipment of virtual content carrier
JP2018077882A (en) Method and system for operation environment having multiple client devices and displays
KR101623041B1 (en) System and method for managing markers coexisting mixed space, and the recording media storing the program performing the said method
KR101382703B1 (en) Interaction method and system for unifying augmented reality technology and big data
EP3281403A1 (en) Methods and apparatus for augmented reality applications
KR20200121357A (en) Object creation using physical manipulation
CN112929384A (en) AR intelligent point inspection system based on space anchor point
CN111222190B (en) Ancient building management system
CN111240669B (en) Interface generation method and device, electronic equipment and computer storage medium
Corneli et al. Augmented reality and deep learning towards the management of secondary building assets
JP2020098568A (en) Information management device, information management system, information management method, and information management program
CN111563200A (en) Information display method, device, equipment and medium
CN105302893A (en) Three-dimensional geographic information system for pollution sources
CN115661412A (en) Aero-engine auxiliary assembly system and method based on mixed reality
Chantziaras et al. An augmented reality-based remote collaboration platform for worker assistance
JP2009086952A (en) Information processing system and information processing program
CN112567476A (en) Device for representing and utilizing the overall layout of a nuclear power plant

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant