CN107977716A - The method and system that a kind of hidden danger point is shown - Google Patents
The method and system that a kind of hidden danger point is shown Download PDFInfo
- Publication number
- CN107977716A CN107977716A CN201711167618.7A CN201711167618A CN107977716A CN 107977716 A CN107977716 A CN 107977716A CN 201711167618 A CN201711167618 A CN 201711167618A CN 107977716 A CN107977716 A CN 107977716A
- Authority
- CN
- China
- Prior art keywords
- glasses
- hidden danger
- tunnel
- information
- danger point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
Abstract
The invention discloses the method and system that a kind of hidden danger point is shown, in the work of patrol officer or maintenance personal, first position information can characterize patrol officer's virtual location residing in tunnel model, according to first position information, obtain the second place information of patrol officer's hidden danger point within the vision, according to second place information, the real scene image of hidden danger point and tunnel is overlapped display, patrol officer can Real Time Observation to existing hidden danger point within sweep of the eye, substitute the work of the description information of inspection information and memory tunnel cable hidden danger point position before inspection or maintenance, more accurate and efficient working method is provided for maintenance personal and patrol officer, improve work efficiency.
Description
Technical field
The present invention relates to AR technical fields, the method and system shown more particularly to a kind of hidden danger point.
Background technology
With the fast development of power system power supply network, the power transmission cable distribution in the supply network of underground is more and more closeer
Collection.In order to ensure power transmission cable safe operation, power transmission cable failure is avoided to cause the accident, the administrative department of power transmission cable, can send
Send patrol officer and safety inspection periodically is carried out to the power transmission cable in cable duct well tunnel.
Patrol officer records the description information of the position of hidden danger point during inspection, and patrol officer is by the position of the hidden danger point
That puts informs maintenance personal, and maintenance personal finds the hidden danger point and carry out maintenance according to the description information of the position of the hidden danger point.On
The description information for stating the position according to hidden danger point searches the mode of hidden danger point, expends the time, accuracy is low.
The content of the invention
Present invention solves the technical problem that it is to provide a kind of method that hidden danger point is shown, so as to real using AR glasses
When show the hidden danger point of tunnel inner cable, substitute inspection information and memory tunnel cable hidden danger point position before inspection or maintenance
The work for the description information put, provides more accurate and efficient working method for maintenance personal and patrol officer, improves
Work efficiency.
For this reason, the technical solution that the present invention solves technical problem is：
A kind of method that hidden danger point is shown, this method include：
Augmented reality AR glasses obtain the first position information of staff, and the first position information is used to characterize described
Virtual location of the staff in tunnel model；
The first position information is back to server by AR glasses；
Whether server is from the tunnel model, centered on the first position information, search and deposited in preset range
In hidden danger point；
When, there are during hidden danger point, the server obtains the second place information of the hidden danger point, described in preset range
Second place information is used to characterize virtual location of the hidden danger point in the tunnel model；
The second place information is back to the AR glasses by server；
AR glasses are according to the second place information, the hidden danger described in Overlapping display in the real scene image in the tunnel
The virtual tag of point.
Optionally, the first position information of the AR glasses acquisition staff includes：
AR glasses obtain the third place information of the staff, and the third place information is used to characterize the work
Actual position of the personnel in tunnel；
AR glasses use HoloLens technologies, and the third place information is converted into the first position information.
Optionally, the first position information of the AR glasses acquisition staff includes：
The Sign Board of cable in AR glasses identification tunnel, obtains the 4th positional information of the cable on the Sign Board；
AR glasses obtain the first position information according to the 4th positional information.
Optionally, the AR glasses obtain the first position information according to the 4th positional information and include：
AR glasses analyze the real scene image in the tunnel, obtain the staff and the phase of the cable
To positional information, the real scene image in the tunnel includes the cable；
AR glasses obtain the first position information according to the relative position information and the 4th positional information.
Optionally, the AR glasses are superimposed according to the second place information in the real scene image in the tunnel
Showing the virtual tag of the hidden danger point includes：
AR glasses determine display location of the hidden danger point on the AR glasses according to the second place information；
AR glasses generate the virtual tag of the hidden danger point；
AR glasses obtain the real scene image in the tunnel, the Overlapping display institute in the real scene image in the tunnel
State the virtual tag of hidden danger point.
In addition, present invention also offers the system that a kind of hidden danger point is shown, which includes：AR glasses, server；
Server is connected with AR glasses；
AR glasses, for obtaining the first position information of staff, the first position information is used to characterize the work
Make virtual location of the personnel in tunnel model, and the first position information is back to server；According to received
Two positional informations, the virtual tag of hidden danger point described in Overlapping display in the real scene image in the tunnel；
Server, for receiving the first position information of AR glasses transmission, in tunnel model, is believed with the first position
Centered on breath, search in preset range and whether there is hidden danger point；When, there are during hidden danger point, obtaining the hidden danger point in preset range
Second place information, the second place information be used for characterize virtual location of the hidden danger point in the tunnel model；
And the second place information is back to the AR glasses.
Optionally, the AR glasses, the first position information for obtaining staff include：
AR glasses obtain the third place information of the staff, and the third place information is used to characterize the work
Actual position of the personnel in tunnel；
AR glasses use HoloLens technologies, and the third place information is converted into the first position information.
Optionally, the AR glasses, the first position information for obtaining staff include：
The Sign Board of cable in AR glasses identification tunnel, obtains the 4th positional information of the cable on the Sign Board；
AR glasses obtain the first position information according to the 4th positional information.
Optionally, the AR glasses, include for obtaining the first position information according to the 4th positional information：
AR glasses analyze the real scene image in the tunnel, obtain the staff and the phase of the cable
To positional information, the real scene image in the tunnel includes the cable；
AR glasses obtain the first position information according to the relative position information and the 4th positional information.
Optionally, the AR glasses, for according to the second place information, in the real scene image in the tunnel
The virtual tag of hidden danger point includes described in Overlapping display：
AR glasses determine display location of the hidden danger point on the AR glasses according to the second place information；
AR glasses generate the virtual tag of the hidden danger point；
AR glasses obtain the real scene image in the tunnel, the Overlapping display institute in the real scene image in the tunnel
State the virtual tag of hidden danger point.
According to the above-mentioned technical solution, the method have the advantages that：
Method and system provided by the present invention, augmented reality AR glasses obtain the first position information of staff, should
First position information is used to characterize virtual location of the staff in tunnel model；First position information is back to by AR glasses
Server；Server is from tunnel model, centered on the first position information received, searches and whether there is in preset range
Hidden danger point；When, there are during hidden danger point, server obtains the second place information of hidden danger point, the second place information in preset range
For characterizing virtual location of the above-mentioned hidden danger point in tunnel model；Second place information is back to AR glasses by server；AR
Glasses are according to the second place information received, the virtual mark of the above-mentioned hidden danger point of Overlapping display in the real scene image in tunnel
Note.
In the work of patrol officer or maintenance personal, first position information can characterize patrol officer in tunnel model
In residing virtual location, according to first position information, obtain the second confidence of patrol officer's hidden danger point within the vision
Breath, according to second place information, is overlapped display, patrol officer can be real-time by the real scene image of hidden danger point and tunnel
It was observed that existing hidden danger point within sweep of the eye, substitutes inspection information and memory tunnel cable hidden danger before inspection or maintenance
The work of the description information of point position, provides more accurate and efficient working method for maintenance personal and patrol officer, carries
High work efficiency.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the flow chart for the method that hidden danger point provided in an embodiment of the present invention is shown；
Fig. 2 is the display renderings for the method that hidden danger point provided in an embodiment of the present invention is shown；
Fig. 3 is the signaling process figure for the method that hidden danger point provided in an embodiment of the present invention is shown；
Fig. 4 is the structure diagram for the system that hidden danger point provided in an embodiment of the present invention is shown.
Embodiment
In order to be given at the implementation of real-time display tunnel cable hidden danger point in inspection or maintenance process, the present invention is real
Apply example and provide the method and system that a kind of hidden danger point is shown, for the ease of understanding the technical solution of description of the embodiment of the present invention,
Below first to the present embodiments relate to basic concepts be introduced.
Augmented reality (Augmented Reality, AR) is a kind of by real world information and virtual world information " nothing
The integrated new technology of seam ", the target of the technology are that virtual world and real world are superimposed on the screen and carried out mutually
It is dynamic.Specifically refer to, the entity information that script is hardly perceivable in real world certain time, spatial dimension, passes through computer
Etc. science and technology, be added to real world again after analog simulation, real environment and virtual object is added in real time
Same picture or space exist at the same time, and the information that the mankind under normal circumstances not directly perceive is perceived, so as to reach
The sensory experience of exceeding reality.
Virtual information can not only be added in real environment by AR technologies in real time, but also accomplish virtual information
It is consistent with true environment display, AR technologies contain multimedia, three-dimensional modeling, real-time video show and control, multisensor
New technology and the new tool such as fusion, real-time tracking and registration, scene fusion.
AR can be divided into according to the difference of hardware carrier equipment：Helmet Mounted Display, computer, mobile equipment, glasses etc.,
The AR equipment of every kind of hardware carrier has its own exclusive interactive feature, and based on the application background of the present invention, staff exists
Inspection or maintenance in cable duct well tunnel, liberate both hands while, can real-time reception to tunnel cable hidden danger point information,
Consider human-computer interaction flexibility and the operability of AR equipment, selecting AR glasses to be used as has the work(such as data receiver, superposition, display
The AR equipment of energy.
AR glasses, are a kind of one kind " high-tech glasses " for exactly liking common spectacles, it is possible to achieve various functions.One
AR glasses can be regarded as a miniature mobile phone, the state for judging that user is currently in by tracking eyeball sight track, and
And corresponding function can be turned on or off；One AR glasses can also regard a computer as, can be directed to storage information
With reference to the actual environment of shooting, correspondence between the two is calculated, and be superimposed with inciting somebody to action the two " seamless ", etc..
Under normal circumstances, AR glasses include display screen, video camera, position indicator etc., wherein, the current institute of camera acquisition user
The true environment video at place, position indicator position the position that user is presently in real time, and display screen shows true environment video and void
Intend the superposition of information, and realize the function of human-computer interaction.
In power transmission cable Gou Jing tunnels, staff wears AR glasses and carries out inspection or maintenance, so special AR systems
System is the development environment based on Hololens+Unity3D, wherein, Unity3D is integrated with abundant in terms of Hololens interactions
API, and user interface is friendly, simple, and great convenience is provided using realization to AR.
Introduction with reference to more than for some backgrounds and basic conception, below simply retouches the application scenarios of the present invention
State.
As the power transmission cable distribution in the supply network of underground is more and more intensive, in order to avoid power transmission cable failure causes thing
Therefore patrol officer needs periodically to carry out safety inspection to the power transmission cable in cable duct well tunnel, is obtained according to patrol officer's inspection
The hidden danger point arrived, maintenance personal need to carry out maintenance hidden danger point.Environment is complicated in cable duct well tunnel, inspection or maintenance people
Member must know the hidden danger point information of power transmission cable in the tunnel of this task before inspection or maintenance, therefore, staff
The data of patrol record hidden danger point and remember before needing to consult or record the hidden danger point information of numerous power transmission cables, so as to
Targetedly inspection or maintenance are carried out in this task.But above-mentioned preparation not only increases the work of staff
Amount, it is also possible to omitted or mistake due to remembering the power transmission cable hidden danger point information that either records, cause to expend the time and
The problem of work accuracy is low, causes this inspection or maintenance work invalid.
In order to mitigate the workload of staff, work efficiency is improved, it is ensured that the validity of inspection and maintenance work, this hair
A kind of bright method and system for providing hidden danger point and showing, using AR technologies, realize and tunnel cable hidden danger point are shown.
AR glasses obtain actual position information, which is used to characterize true position of the staff in tunnel
Put.Using Hololens technologies, first position information is obtained according to actual position information, first position information representation work people
Virtual location of the member in tunnel model.First position information is sent to server, server and obtains first position by AR glasses
After information, centered on obtaining the first position information, the second place information of hidden danger point in preset range, the second place information
For characterizing virtual location of the hidden danger point in tunnel model, second place information is back to AR glasses by server.AR glasses
Second place information and real scene image superposition are shown.Staff can be from the AR glasses, it was observed that hidden danger point exists
Position in real scene.
Description more than for application scenarios of the present invention, is preferable to carry out the present invention with reference to Figure of description
Example illustrates, it will be appreciated that preferred embodiment described herein is merely to illustrate and explain the present invention, and is not used to limit
The present invention.And in the case where there is no conflict, the feature in the embodiment and embodiment in the present invention can be mutually combined.
Fig. 1 is the flow chart for the method that a kind of hidden danger point provided in an embodiment of the present invention is shown, as shown in Figure 1, this method
Including：
Step 101, augmented reality AR glasses obtain the first position information of staff, and the first position information is used for
Characterize virtual location of the staff in tunnel model.
Tunnel can be traffic tunnel (such as subway tunnel, railway tunnel, seabed tunnel as a kind of special architectural environment
Road etc.) or municipal tunnel (such as cable tunnel, outlet tunnel, heating tunnel), in embodiments of the present invention, with defeated
Illustrated exemplified by the Gou Jing tunnels of electrical cables.
In power transmission cable Gou Jing tunnels, there is many identical or different power transmission cable, in order to ensure transmission of electricity electricity
Cable can normal operation, patrol officer need periodically to tunnel inner cable carry out attribute inspection, find the hidden danger point of cable, and remember
Record the positional information of hidden danger point.But cable tunnel environment is complicated, and tunnel inner cable type and quantity are various, patrol officer or maintenance
Personnel in inspection next time or maintenance work, it is necessary to before consulting patrol record hidden danger point data, so as in this work
Targetedly inspection or maintenance are carried out in work.
By wearing AR glasses progress inspection, either why maintenance can improve inspection or maintenance personal to staff
The accuracy of work, reduces workload, be because being integrated with video camera on AR glasses, can be around captured in real-time patrol officer
Actual environment；In addition, two display screens are also integrated with AR glasses, on the one hand, by virtual information and actual environment Overlapping display,
To the more preferable working environment of staff and visual experience, another aspect, there is provided staff puts down with interacting for AR glasses
Platform, staff can be learned on the cable on oneself periphery with the presence or absence of hidden danger point, the position of hidden danger point in real time by the display screen
Put, and then instruct the progress of following inspection or maintenance work.
In specific implementation, staff wears AR glasses and enters in cable tunnel, passes through the video camera of AR glasses, work
Personnel can watch the actual environment in tunnel in real time.For inspection and maintenance cable hidden danger point staff for, it is necessary to
Real-time on-site focuses on tunnel cable hidden danger point in actual environment, because the cable hidden danger point in tunnel is that staff works
Destination object, patrol officer is being had found outside new hidden danger point, also to be paid close attention to and be detected and mark hidden compared with before this inspection
Suffer from the present situation of point；Maintenance personal then needs to find this time maintenance before once, the hidden danger that patrol officer marks in inspection
Point, pointedly carries out the maintenance of hidden danger point.
Tunnel model is before tunneling operation is carried out using AR glasses, is established by AR technologies, utilizes the tunnel of collection
Image, a dummy model for copying true tunnel environment of foundation.In the position that is shown in the tunnel model, relative position
Objects such as cable etc., correspond with true tunnel, can be with environment, position and the object in accurate characterization reality tunnel.
The corresponding staff into tunnel, can be and pre- according to the actual environment of the video camera captured in real-time of AR glasses
Image in the tunnel model first established is detected and identifies, obtains relative position information of the AR glasses in tunnel model,
As first position information.The first position information, can be used for representing that wearing the staff that the AR glasses work exists
Virtual location in tunnel model,.
In specific implementation, AR glasses obtain the first position information of staff, can use such a way：First
Kind, the actual position information for the staff for wearing the AR glasses is obtained by AR glasses, it is mutual with reference to HoloLens holograms
Dynamic technology, first position information is obtained according to the actual position information；Second, cable is included in the image that AR glasses collect
Sign Board, the Sign Board of cable in tunnel is identified by AR glasses, its corresponding cable position information is identified using Sign Board,
And then first position information is obtained according to the relative position of cable and AR glasses, and cable position information.
In an example, first position information is obtained according to the actual position information of staff, including：
Step 101A, AR glasses obtain the third place information of staff, and the third place information is used to characterize work
Make actual position of the personnel in tunnel；
Step 101B, AR glasses use HoloLens technologies, and the third place information is converted into the first position
Information.
HoloLens technologies, be it is a kind of can be the people real 3D worlds and the virtual 3D worlds stored in program at the moment
It is combined together, by holographic Display Technique, is shown on the display screen of AR glasses, in this way, people can utilizes manually
Operation, various functions are realized in the virtual 3D worlds.Wherein, the function that HoloLens technologies are realized, including by reality
Positional information in scene, is the including level information in its corresponding virtual scene model by specific Program transformation.
In specific implementation, AR glasses obtain current camera by the image of camera acquisition into processing and analysis excessively
Location, and then actual position information of the staff in tunnel is obtained, it is denoted as the third place information；AR glasses are obtaining
To after the third place information, the third place information is converted to the virtual bit confidence in the tunnel model using HoloLens technologies
Breath, is denoted as first position information.
The method that the AR glasses that above-mentioned steps 101A and step 101B is provided obtain the first position information of staff, is
Under normal circumstances, when staff carries out operation using AR glasses, AR glasses realize that staff positions common method, and
A kind of mode of the high acquisition staff virtual location in tunnel model of accuracy rate.
In addition, the cable in tunnel, might have corresponding cable identification board, and AR glasses equally can be according to electricity
Cable Sign Board positions virtual location --- first position information of the staff in tunnel model.
In an example, identify that cable identification board obtains first position information, including：
The Sign Board of cable in step 101A ', AR glasses identification tunnel, obtains the 4th position letter of cable on Sign Board
Breath；
Step 101B ', AR glasses obtain first position information according to the 4th positional information.
The Sign Board of tunnel cable is the label for the unique mark tunnel cable positional information, by Sign Board into
Row processing and analysis, can obtain the including level information that the Sign Board corresponds to cable.Specifically, the bar code on Sign Board can
To be one-dimensional bar code or two-dimensional bar, one-dimensional bar code and two-dimensional bar can also be included at the same time, herein
It is not especially limited.
The Sign Board of AR Glasses detection tunnel cables, obtaining the positional information of tunnel cable on Sign Board includes：AR glasses
On camera scanning-tunnelling cable Sign Board on bar code, obtain the positional information of the tunnel cable.Implementing
When, the camera on AR glasses gathers the real ring in tunnel by way of intermittent scanning (such as carrying out single pass every 5s)
Border image, carries out the image procossings such as image preprocessing, image segmentation, contours extract, polygonal approximation by the image collected and grasps
Make, get the tunnel cable Sign Board in scan image.
The tunnel cable Sign Board got by image procossing is carried out further information extraction by AR glasses, is identified
Bar code on board；Handled by image recognition etc., obtain the positional information that the cable identification board corresponds to cable, the positional information
Can be specific coordinate information or with the unique corresponding identification code of positional information.Every tunnel cable is in theory all
Comprising a Sign Board, there is at least one bar code on each Sign Board, identification bar code can determine the virtual of tunnel cable
Positional information, i.e. the 4th positional information.
Specifically, AR glasses obtain first position information according to the 4th positional information and include：
First, AR glasses analyze the real scene image in the tunnel, obtain the staff and the electricity
The relative position information of cable.The video camera of AR glasses can gather real scene image in real time, be collected according to camera true
The depth of field of real scene image, can obtain the relative position relation between AR glasses and cable, since the position of AR glasses is with regard to table
The position of staff is levied, so that, the as relative position information of staff and cable of acquisition.
Then, AR glasses are learning the relative position information of staff and cable, and cable is in tunnel model
After 4th positional information, AR glasses can calculate first position information of the staff in tunnel model.
By above-mentioned steps 101A, step 101B and/or step 101A ', step 101B ', it can realize and utilize AR
Mirror obtains staff first position information, and data basis has been accomplished fluently for technologies such as follow-up hidden danger point lookup, displays.Passing through
After the AR glasses of step 101 obtain the first position information of staff, following steps 102 are performed.
Step 102, the first position information is back to server by AR glasses.
During specific implementation, first position information of the staff got in tunnel model is sent to clothes by AR glasses
It is engaged in device, under a kind of mode, first position information directly can be transferred directly to server by AR glasses by internet；It is another
Under kind mode, AR glasses can use short haul connection mode, and first position information is sent to information gathering industrial personal computer, then by
Information gathering industrial personal computer sends first position information to server by internet.Wherein, short haul connection mode includes indigo plant
Tooth communicates, radio communication etc..
By above-mentioned steps, AR glasses send the first position information of staff to server, are subsequent server
Got ready by the first position information inquiry and display hidden danger point.
Step 103, whether server is from tunnel model, centered on the information of first position, search and deposited in preset range
In hidden danger point.
On the server, technical staff or manager can pre-set the search range of a hidden danger point, the default model
The zone of reasonableness of one lookup hidden danger point of characterization is enclosed, can be a border circular areas centered on the information of first position, also may be used
To be a square region centered on the information of first position.Under normal circumstances, the preset range and the visual field model of AR glasses
Enclose identical.During specific implementation, which can carry out the change of adaptability according to the change of AR glasses field ranges.
If above-mentioned staff is a patrol officer, server is from the tunnel model, using first position in
The heart, searches the previous hidden danger point that patrol officer marks in inspection work within a preset range, centered on first position,
Search in the preset range, if there are marked hidden danger point.If it is present obtain the position of the marked hidden danger point
Information, as second place information, it is clear that the second place information can characterize virtual bit of the hidden danger point in tunnel model
Put.
When centered on the information of first position, within a preset range there is no during hidden danger point, then next cycle is carried out
Search, i.e. with movement of the staff in tunnel, AR glasses can get new first position information, continue with new
Centered on the information of first position, hidden danger point is searched within a preset range, and so on, until this inspection or maintenance mans finish
Into.If any within a preset range there are hidden danger point, then following steps 104 are performed.
Step 104, when, there are during hidden danger point, the server obtains the second confidence of the hidden danger point in preset range
Breath, the second place information are used to characterize virtual location of the hidden danger point in the tunnel model.
In tunnel model, server finds hidden danger point in the preset range centered on the information of first position, hidden
The quantity for suffering from point is probably one, it is also possible to multiple.When hidden danger point is multiple, this multiple hidden danger point may be from same root
Cable, it is also possible to from different cables.
When hidden danger point is one, server obtains hidden danger point corresponding unique virtual position in tunnel model
Put --- second place information.
When hidden danger point is multiple, server can obtain multiple hidden danger points corresponding multiple void in tunnel model at the same time
Intend position, obtain multiple second place information；It is corresponding in tunnel model that server can also obtain multiple hidden danger points successively
Multiple virtual locations, are similarly obtained multiple second place information.Wherein, when obtaining second place information successively, can take
Acquisition modes in units of cable, have obtained the hidden danger point on a cable, then obtain the hidden danger point on next cable；
The mode that unit length (such as 0.5m) can be taken to obtain successively, by multiple hidden danger points in the preset range from left to right with
Unit length sectional obtains hidden danger point successively.
Step 105, the second place information is back to the AR glasses by the server.
The second place information got is sent to AR glasses by server, and in the case of a kind of, server passes through internet
Second place information is transmitted directly to AR glasses；In another case, server is sent out second place information by internet
Send the information gathering industrial personal computer to tunnel, then by information gathering industrial personal computer by short-distance transmission mode by second confidence
Breath is sent to AR glasses.
By above-mentioned steps, server sends second place information to AR glasses, is follow-up AR glasses by the second place
Information superposition carries out display on real scene image and provides precondition.
Step 106, the AR glasses are superimposed according to the second place information in the real scene image in the tunnel
Show the virtual tag of the hidden danger point.
AR glasses utilize the augmented reality of itself, and according to second place information, hidden danger point is superimposed upon real scene
Shown in image.Wherein, real scene image is the video camera captured in real-time carried by AR glasses.
It is understood that as staff moves, real scene constantly changes, and first position information also becomes
Change.First position information change, causes the second place information of obtained expression hidden danger point also to change therewith.According to second
Confidence ceases, and in real time shows hidden danger point and real scene image superposition.Thus, it is possible to characterize the tunnel in current real scene
Cable hidden danger point situation, realizes that the real-time tracking of tunnel cable hidden danger point is shown, right before substituting staff's inspection or repairing
In the access and memory work of cable hidden danger point information, the workload of staff is significantly reduced, it is hidden to improve cable tunnel
Suffer from the work efficiency of point inspection and maintenance.
Specifically, AR glasses are according to the second place information, in the real scene image in tunnel described in Overlapping display
The virtual tag of hidden danger point includes：
Step 106A, AR glasses determine display location of the hidden danger point on AR glasses according to the second place information；
Step 106B, AR glasses generate the virtual tag of above-mentioned hidden danger point；
Step 106C, AR glasses obtain the real scene image in tunnel, the Overlapping display in the real scene image in tunnel
The virtual tag of hidden danger point.
In specific implementation, AR glasses calculate the second place information to video camera view plane according to second place information
Affine transformation, obtain display location of the hidden danger point on AR glasses；Then, according to above-mentioned affine transformation matrix, in display position
Put the virtual tag for drawing hidden danger point；Finally, directly by S-HMD technologies, by obtained hidden danger point virtual tag and true field
Scape image merges, and is shown in after merging on the display screen of AR glasses.
Virtual tunnel model and the buried cable tunnel of reality is in the identical world by AR glasses, will count
The virtual tag of the hidden danger point of calculation machine generation is superimposed upon on real buried cable, and the movement of patrol officer is followed the trail of by AR glasses
And sight, in the eye which is projected to patrol officer by light, realize the display of hidden danger point.Specific hidden danger point
Display effect is as shown in Figure 2.
As shown in Fig. 2, in the display screen on the AR glasses left side, the display box left-hand component of top, it is shown that " a choosing
The plug-in unit button of the down-drawable of item ", can select to want the hidden danger point situation of all working section before viewing；Top is shown
Show the right half part of frame, be the sum of hidden danger point in current real scene；In addition most of region, it is shown that tunnel
Interior current real scene image and hidden danger point distribution.
Under a scene, in the display screen on the right of AR glasses, in response to staff for hidden danger on the display screen of the left side
Point chooses operation, is shown in display box on the top and chooses hidden danger point title and the hidden danger situation of hidden danger point；In central region,
It is shown that real scene image current in tunnel and the distribution of hidden danger point, and the corresponding specific letter for choosing hidden danger point
Breath, such as：Hidden danger point title, the possible cause of hidden danger, mark time etc., if being displayed without all information, it can click on down
The drop-down plug-in unit of side, into the display of lower one page hidden danger point specifying information.
Due to being limited be subject to identification image, the display of cable hidden danger point keeps technology using space anchor and scene, wherein,
Space anchor is a kind of method that can be retained in object on specific location and rotation status；It is HoloLens that scene, which keeps technology,
One key technology of holography experience, when staff leaves former scene, holographic object can be maintained at certain bits in former scene
Put, when user returns to former scene, be capable of the holographic content of accurate reproduction original scene.With above-mentioned technology, field personnel
The information of hidden danger point can be watched in real time by any angle.
Staff can carry out maintenance the hidden danger point being shown on AR glasses, in an example, if hidden danger point quilt
Repair, then AR glasses carry out data interaction in real time with server, and AR glasses send the position for the hidden danger point repaired to server
Information, server cancel the mark of the hidden danger point to having repaired in the tunnel model.
Above is the explanation of the Overall Steps to embodiment of the method provided by the invention, in order to make the technology of the present invention
Scheme is more clear, below using Fig. 3 as foundation, integrally introduces the message transmitting procedure of the embodiment of the present invention.
Fig. 3 is the signaling process figure of hidden danger point indication method provided in an embodiment of the present invention, as shown in figure 3, this method
Whole implementation process is：
S301, AR glasses obtain the first position information of staff；
S302, AR glasses send the first position information that S301 is got to server；
S303, server is from tunnel model, centered on the information of first position, searches the hidden danger point in preset range；
S304, server obtain the second place information for the hidden danger point that S303 is found；
The second place information that S304 is got is back to AR glasses by S305, server；
S306, AR glasses are according to second place information, the void of Overlapping display hidden danger point in the real scene image in tunnel
Intend mark.
Above-mentioned S301-S306 is corresponding with hidden danger point indication method provided in an embodiment of the present invention, only to facilitate reason
Solution, has carried out the description of overall signal transmitting procedure, and specific implementation refers to the description of above method embodiment, here no longer
Repeat.
In the work of patrol officer or maintenance personal, first position information can characterize patrol officer in tunnel model
In residing virtual location, according to first position information, obtain the second confidence of patrol officer's hidden danger point within the vision
Breath, according to second place information, is overlapped display, patrol officer can be real-time by the real scene image of hidden danger point and tunnel
It was observed that existing hidden danger point within sweep of the eye, substitutes inspection information and memory tunnel cable hidden danger before inspection or maintenance
The work of the description information of point position, provides more accurate and efficient working method for maintenance personal and patrol officer, carries
High work efficiency.
The above is the introduction of the method shown to a kind of hidden danger point provided in an embodiment of the present invention, with above method embodiment
Want to correspond to, the embodiment of the present invention additionally provides the system that a kind of hidden danger point is shown.Below in conjunction with the accompanying drawings to the embodiment of the present invention into
Row description.
Fig. 4 is the structure diagram for the system that a kind of hidden danger point provided in an embodiment of the present invention is shown, as shown in figure 4, should
System includes：AR glasses 401, server 402；Server 402 is connected with AR glasses 401.
Wherein, AR glasses 401, for obtaining the first position information of staff, first position information is used to characterize work
Make virtual location of the personnel in tunnel model, and the first position information is back to server；According to received
Two positional informations, the virtual tag of hidden danger point described in Overlapping display in the real scene image in the tunnel；
Server 402, for receiving the first position information of AR glasses transmission, in tunnel model, with described first
Centered on confidence breath, search in preset range and whether there is hidden danger point；When, there are during hidden danger point, acquisition is described hidden in preset range
Suffer from the second place information of point, the second place information is used to characterize virtual bit of the hidden danger point in the tunnel model
Put；And the second place information is back to the AR glasses.
Alternatively, above-mentioned AR glasses 401, the first position information for obtaining staff include：
AR glasses obtain the third place information of the staff, and the third place information is used to characterize the work
Actual position of the personnel in tunnel；AR glasses use HoloLens technologies, and the third place information is converted into described
One positional information.
Alternatively, AR glasses 401, the first position information for obtaining staff include：
The Sign Board of cable in AR glasses identification tunnel, obtains the 4th positional information of the cable on the Sign Board；
AR glasses obtain the first position information according to the 4th positional information.
Specifically, AR glasses, include for obtaining the first position information according to the 4th positional information：
AR glasses analyze the real scene image in the tunnel, obtain the staff and the phase of the cable
To positional information, the real scene image in the tunnel includes the cable；AR glasses are according to the relative position information and institute
State the 4th positional information and obtain the first position information.
Alternatively, AR glasses 401, for according to the second place information, in the real scene image in the tunnel
The virtual tag of hidden danger point includes described in Overlapping display：
AR glasses determine display location of the hidden danger point on the AR glasses according to the second place information；AR
Glasses generate the virtual tag of the hidden danger point；AR glasses obtain the real scene image in the tunnel, in the true of the tunnel
The virtual tag of hidden danger point described in Overlapping display in real scene image.
In the work of patrol officer or maintenance personal, first position information can characterize patrol officer in tunnel model
In residing virtual location, according to first position information, obtain the second confidence of patrol officer's hidden danger point within the vision
Breath, according to second place information, is overlapped display, patrol officer can be real-time by the real scene image of hidden danger point and tunnel
It was observed that existing hidden danger point within sweep of the eye, substitutes inspection information and memory tunnel cable hidden danger before inspection or maintenance
The work of the description information of point position, provides more accurate and efficient working method for maintenance personal and patrol officer, carries
High work efficiency.
The embodiment of the present invention is the corresponding system embodiment of above method embodiment, and specific implementation refers to the above method
The description of embodiment, which is not described herein again.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, without departing from the principle of the present invention, some improvements and modifications can also be made, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (10)
1. a kind of method that hidden danger point is shown, it is characterised in that the described method includes：
Augmented reality AR glasses obtain the first position information of staff, and the first position information is used to characterize the work
Virtual location of the personnel in tunnel model；
The first position information is back to server by AR glasses；
Whether the server is from the tunnel model, centered on the first position information, search and deposited in preset range
In hidden danger point；
When there are during hidden danger point, the server obtains the second place information of the hidden danger point in preset range, described second
Positional information is used to characterize virtual location of the hidden danger point in the tunnel model；
The second place information is back to the AR glasses by the server；
The AR glasses are according to the second place information, the hidden danger described in Overlapping display in the real scene image in the tunnel
The virtual tag of point.
2. according to the method described in claim 1, it is characterized in that, the AR glasses obtain the first position information of staff
Including：
The AR glasses obtain the third place information of the staff, and the third place information is used to characterize the work
Actual position of the personnel in tunnel；
The AR glasses use HoloLens technologies, and the third place information is converted into the first position information.
3. according to the method described in claim 1, it is characterized in that, the AR glasses obtain the first position information of staff
Including：
The Sign Board of cable in the AR glasses identification tunnel, obtains the 4th positional information of the cable on the Sign Board；
The AR glasses obtain the first position information according to the 4th positional information.
4. according to the method described in claim 3, it is characterized in that, the AR glasses obtain institute according to the 4th positional information
Stating first position information includes：
The AR glasses analyze the real scene image in the tunnel, obtain the staff and the phase of the cable
To positional information, the real scene image in the tunnel includes the cable；
The AR glasses obtain the first position information according to the relative position information and the 4th positional information.
5. according to the method described in claim 1, it is characterized in that, the AR glasses according to the second place information, in institute
Stating the virtual tag of hidden danger point described in Overlapping display in the real scene image in tunnel includes：
The AR glasses determine display location of the hidden danger point on the AR glasses according to the second place information；
The AR glasses generate the virtual tag of the hidden danger point；
The AR glasses obtain the real scene image in the tunnel, the Overlapping display institute in the real scene image in the tunnel
State the virtual tag of hidden danger point.
A kind of 6. system that hidden danger point is shown, it is characterised in that the system comprises：AR glasses, server；
The server is connected with the AR glasses；
The AR glasses, for obtaining the first position information of staff, the first position information is used to characterize the work
Make virtual location of the personnel in tunnel model, and the first position information is back to server；According to received
Two positional informations, the virtual tag of hidden danger point described in Overlapping display in the real scene image in the tunnel；
The server, for receiving the first position information of AR glasses transmission, in tunnel model, is believed with the first position
Centered on breath, search in preset range and whether there is hidden danger point；When, there are during hidden danger point, obtaining the hidden danger point in preset range
Second place information, the second place information be used for characterize virtual location of the hidden danger point in the tunnel model；
And the second place information is back to the AR glasses.
7. system according to claim 6, it is characterised in that the AR glasses, for obtaining first of staff
Confidence breath includes：
The AR glasses obtain the third place information of the staff, and the third place information is used to characterize the work
Actual position of the personnel in tunnel；
The AR glasses use HoloLens technologies, and the third place information is converted into the first position information.
8. system according to claim 6, it is characterised in that the AR glasses, for obtaining first of staff
Confidence breath includes：
The Sign Board of cable in the AR glasses identification tunnel, obtains the 4th positional information of the cable on the Sign Board；
The AR glasses obtain the first position information according to the 4th positional information.
9. system according to claim 8, it is characterised in that the AR glasses, for according to the 4th positional information
Obtaining the first position information includes：
The AR glasses analyze the real scene image in the tunnel, obtain the staff and the phase of the cable
To positional information, the real scene image in the tunnel includes the cable；
The AR glasses obtain the first position information according to the relative position information and the 4th positional information.
10. state according to claim 6, it is characterised in that the AR glasses, for according to the second confidence
Breath, the virtual tag of hidden danger point includes described in Overlapping display in the real scene image in the tunnel：
The AR glasses determine display location of the hidden danger point on the AR glasses according to the second place information；
The AR glasses generate the virtual tag of the hidden danger point；
The AR glasses obtain the real scene image in the tunnel, the Overlapping display institute in the real scene image in the tunnel
State the virtual tag of hidden danger point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711167618.7A CN107977716A (en) | 2017-11-21 | 2017-11-21 | The method and system that a kind of hidden danger point is shown |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711167618.7A CN107977716A (en) | 2017-11-21 | 2017-11-21 | The method and system that a kind of hidden danger point is shown |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107977716A true CN107977716A (en) | 2018-05-01 |
Family
ID=62010844
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711167618.7A Pending CN107977716A (en) | 2017-11-21 | 2017-11-21 | The method and system that a kind of hidden danger point is shown |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107977716A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109887090A (en) * | 2019-01-31 | 2019-06-14 | 北京市政路桥管理养护集团有限公司 | Bridge maintenance visiting method and device based on AR |
| CN110503216A (en) * | 2019-08-28 | 2019-11-26 | 国网重庆市电力公司电力科学研究院 | A kind of cable visual inspection method and device |
| CN110928412A (en) * | 2019-11-19 | 2020-03-27 | 江苏正为应急装备科技有限公司 | Method and system for generating virtual fire hazard, augmented reality equipment and medium |
| CN111242107A (en) * | 2020-04-26 | 2020-06-05 | 北京外号信息技术有限公司 | Method and electronic device for setting virtual object in space |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN106898049A (en) * | 2017-01-18 | 2017-06-27 | 北京商询科技有限公司 | A kind of spatial match method and system for mixed reality equipment |
| CN107084737A (en) * | 2017-05-13 | 2017-08-22 | 浙江正泰中自控制工程有限公司 | Drainage pipeline networks inspection system and method based on AR outdoor scenes and Voice Navigation |
| CN107085857A (en) * | 2017-05-25 | 2017-08-22 | 广东电网有限责任公司教育培训评价中心 | Power cable localization method, device and system |
-
2017
- 2017-11-21 CN CN201711167618.7A patent/CN107977716A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN106898049A (en) * | 2017-01-18 | 2017-06-27 | 北京商询科技有限公司 | A kind of spatial match method and system for mixed reality equipment |
| CN107084737A (en) * | 2017-05-13 | 2017-08-22 | 浙江正泰中自控制工程有限公司 | Drainage pipeline networks inspection system and method based on AR outdoor scenes and Voice Navigation |
| CN107085857A (en) * | 2017-05-25 | 2017-08-22 | 广东电网有限责任公司教育培训评价中心 | Power cable localization method, device and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109887090A (en) * | 2019-01-31 | 2019-06-14 | 北京市政路桥管理养护集团有限公司 | Bridge maintenance visiting method and device based on AR |
| CN110503216A (en) * | 2019-08-28 | 2019-11-26 | 国网重庆市电力公司电力科学研究院 | A kind of cable visual inspection method and device |
| CN110928412A (en) * | 2019-11-19 | 2020-03-27 | 江苏正为应急装备科技有限公司 | Method and system for generating virtual fire hazard, augmented reality equipment and medium |
| CN110928412B (en) * | 2019-11-19 | 2024-03-22 | 江苏正为应急装备科技有限公司 | Method, system, augmented reality device and medium for generating virtual fire hazard |
| CN111242107A (en) * | 2020-04-26 | 2020-06-05 | 北京外号信息技术有限公司 | Method and electronic device for setting virtual object in space |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107782314B (en) | Code scanning-based augmented reality technology indoor positioning navigation method | |
| CN104331929B (en) | Scene of a crime restoring method based on video map and augmented reality | |
| US11887312B2 (en) | Fiducial marker patterns, their automatic detection in images, and applications thereof | |
| CN107977716A (en) | The method and system that a kind of hidden danger point is shown | |
| CN108023298A (en) | A kind of tunnel cable attribute display method and system | |
| CN103460256B (en) | In Augmented Reality system, virtual image is anchored to real world surface | |
| CN204465738U (en) | A kind of disaster relief rescue visible system | |
| Veas et al. | Extended overview techniques for outdoor augmented reality | |
| CN104660995A (en) | Disaster relief visual system | |
| CN109859538A (en) | A kind of key equipment training system and method based on mixed reality | |
| CN109165329A (en) | A kind of the underground pipe network intelligence control technology and system of fusion augmented reality and Internet of Things | |
| CN106710001A (en) | Substation inspection robot based centralized monitoring and simulation system and method thereof | |
| CN109358754B (en) | Mixed reality head-mounted display system | |
| CN111222190B (en) | Ancient building management system | |
| CN106707810A (en) | Auxiliary system and method for ship remote fault diagnosis and maintenance based on mixed reality glasses | |
| CN103458225B (en) | For including the method and system of the supervision of the video data stream of amendment | |
| Wu et al. | Efficient VR and AR navigation through multiperspective occlusion management | |
| CN103257707B (en) | Utilize the three-dimensional range method of Visual Trace Technology and conventional mice opertaing device | |
| CN107426508A (en) | A kind of method that long-range security inspection is realized using AR | |
| CN102306088A (en) | Solid projection false or true registration device and method | |
| CN107071297A (en) | A kind of virtual reality system that logical computer room displaying is believed for electric power | |
| CN101581874A (en) | Tele-immersion teamwork device based on multi-camera acquisition | |
| CN108259827A (en) | A kind of method, apparatus for realizing security protection, AR equipment and system | |
| Gee et al. | Augmented crime scenes: virtual annotation of physical environments for forensic investigation | |
| CN107872655A (en) | A kind of method and system for determining hidden danger point |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180501 |