CN108665556A - A kind of road administration instruction display methods and storage medium based on mixed reality - Google Patents
A kind of road administration instruction display methods and storage medium based on mixed reality Download PDFInfo
- Publication number
- CN108665556A CN108665556A CN201810484962.7A CN201810484962A CN108665556A CN 108665556 A CN108665556 A CN 108665556A CN 201810484962 A CN201810484962 A CN 201810484962A CN 108665556 A CN108665556 A CN 108665556A
- Authority
- CN
- China
- Prior art keywords
- information
- mixed
- road
- virtual
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000003860 storage Methods 0.000 title claims abstract description 19
- 238000002955 isolation Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 11
- 239000011800 void material Substances 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 7
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 8
- 238000013528 artificial neural network Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000013135 deep learning Methods 0.000 description 4
- 210000001525 retina Anatomy 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 206010052428 Wound Diseases 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000000465 moulding Methods 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- E—FIXED CONSTRUCTIONS
- E01—CONSTRUCTION OF ROADS, RAILWAYS, OR BRIDGES
- E01F—ADDITIONAL WORK, SUCH AS EQUIPPING ROADS OR THE CONSTRUCTION OF PLATFORMS, HELICOPTER LANDING STAGES, SIGNS, SNOW FENCES, OR THE LIKE
- E01F9/00—Arrangement of road signs or traffic signals; Arrangements for enforcing caution
- E01F9/60—Upright bodies, e.g. marker posts or bollards; Supports for road signs
- E01F9/604—Upright bodies, e.g. marker posts or bollards; Supports for road signs specially adapted for particular signalling purposes, e.g. for indicating curves, road works or pedestrian crossings
- E01F9/615—Upright bodies, e.g. marker posts or bollards; Supports for road signs specially adapted for particular signalling purposes, e.g. for indicating curves, road works or pedestrian crossings illuminated
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Remote Sensing (AREA)
- Geometry (AREA)
- Radar, Positioning & Navigation (AREA)
- Human Computer Interaction (AREA)
- Architecture (AREA)
- Civil Engineering (AREA)
- Structural Engineering (AREA)
- Processing Or Creating Images (AREA)
- Traffic Control Systems (AREA)
Abstract
A kind of road administration instruction display methods and storage medium based on mixed reality, include the following steps, establish the three-dimensional model information of realistic space scanning, receives virtual road mixed information, the virtual road mixed information is loaded, by the virtual road mixed information and realistic space information mixed display.The technique effect that virtualization shows the auxiliary display of road information can be reached.
Description
Technical field
The present invention relates to mixed reality fields, more particularly to the road instruction mark display field of application mixed reality.
Background technology
Mixed reality (MR) (both having included that augmented reality and enhancing are virtual) refers to merging reality and virtual world and generating
New visible environment.Physics and digital object coexist in new visible environment, and real-time interactive.The common spy of system
Point has：
It combines virtual and real；It is virtual in the three dimensions projection of reality；Real time execution.
The realization of mixed reality (MR) needs in the environment that can be interacted with each things of real world at one.If one
Cut things all and be the field that virtual that is exactly VR.If the virtual information shown can only simple superposition in real things
On, that is, AR.The key point of MR is exactly the timely acquisition interacted with real world with information.
In existing road surface driving environment, be required for realistically pull-up isolation strip, establish guideboard, brush track paint etc., it is non-
Normal waste of resource, if it is possible to the virtual display to road traffic facility is reached by existing area of computer aided display technology,
A large number of physics cost can be saved, even and if the road instruction mark that virtually shows damage will not be generated on vehicle " hitting "
It is bad, improve the safety of driving environment.
Invention content
For this reason, it may be necessary to provide a kind of new auxiliary display method that can virtualize display road information.
To achieve the above object, a kind of road administration instruction display methods based on mixed reality is inventor provided, including such as
Lower step establishes the three-dimensional model information of realistic space scanning, receives virtual road mixed information, and it is mixed to load the virtual road
Information is closed, by the virtual road mixed information and realistic space information mixed display.
Specifically, the virtual road mixed information includes virtual mixed model information and coordinate information；It is described virtual mixed
Molding type information includes two-dimentional mixed information or three-dimensional hybrid information.
Further, the virtual mixed model information is for playing road traffic indicative function, including road sign, traffic mark
Will board, lane line, straight trip/turning mark symbol, guardrail, isolation strip, pyrometric cone or safety island.
Preferably, further include step, receive the first virtual road mixed information, receive the second virtual road mixed information,
The switching idsplay order of virtual road mixed information is received, display equipment is after receiving switching idsplay order, by script display
First virtual road mixed information replaces with the second virtual road mixed information and is shown.
A kind of road administration instruction display storage medium based on mixed reality, is stored with computer program, the computer journey
Sequence is executed when being run to be included the following steps, the three-dimensional model information of realistic space scanning is established, and receives virtual road mixing
Information loads the virtual road mixed information, by the virtual road mixed information and realistic space information mixed display.
Further, the virtual road mixed information includes virtual mixed model information and coordinate information；It is described virtual
Mixed model information includes two-dimentional mixed information or three-dimensional hybrid information.
Specifically, the virtual mixed model information is for playing road traffic indicative function, including road sign, traffic sign
Board, lane line, straight trip/turning mark symbol, guardrail, isolation strip, pyrometric cone or safety island.
Preferably, the computer program also executes step when being run, and receives the first virtual road mixed information, connects
The second virtual road mixed information is received, the switching idsplay order of virtual road mixed information is received, display equipment is receiving switching
After idsplay order, the first virtual road mixed information of script display is replaced with into the second virtual road mixed information and is shown
Show.
It is different from the prior art, above-mentioned technical proposal is also eliminated existing by showing that equipment sees new mark
The problem of with the passing of time entity instruction is easy to fade year in year out.Moreover, all relevant direction boards of existing road administration can basis
It needs to replace and show, it not only can be with the traffic lights of display transformation, additionally it is possible to show prescribe a time limit closed track, the guideboard that no through traffic
Etc..
Description of the drawings
Fig. 1 is that the road administration described in the specific embodiment of the invention indicates display methods flow chart；
Fig. 2 is the mixed reality road display system module map described in the specific embodiment of the invention；
Fig. 3 is the mixed reality road display method flow chart described in the specific embodiment of the invention；
Fig. 4 is the isolation model display methods flow chart described in the specific embodiment of the invention；
Fig. 5 is the road display optimization method flow diagram described in the specific embodiment of the invention.
Specific implementation mode
For the technology contents of technical solution, construction feature, the objects and the effects are described in detail, below in conjunction with specific reality
It applies example and attached drawing is coordinated to be explained in detail.
Referring to Fig. 1, the road administration instruction display methods schematic diagram for the mixed reality that will be introduced for the present invention, this method can
To be used under the arbitrary scene of road traffic, this can be used in either urban road, road, highway etc. outside city
Method carries out the mixed display of road administration instruction information and real road conditions.We have seen that, the method for the present invention includes following step from figure
Suddenly, S100 establishes the scanned three-dimensional model information of realistic space, that is, is required to presently described realistic space ring in advance
Border digitization, this is the conventional steps for generally mixing with reality and being required for completing, and is conducive to subsequent virtual information and real information
Accurate mixing.Establishing realistic space model information enables to the display of successor virtual road mixed information can be more smart
Really.But the example that mixed display can be carried out in open space rare in the prior art, this needs larger memory, but
It is also to be not without method to overcome, it, can be by a certain range of area near intersection under the application scenarios of intersection
Domain is modeled as the confined space, therefore, in an embodiment of the present invention, carries out step, S102 shows that equipment connects
Realistic space model is received, next, the method for the present invention further includes step, S104 receives virtual road mixed information, and loads institute
State virtual road mixed information.The display equipment is that can allow for real world object to generate or the light of reflection penetrates, while energy
It is enough generate it is virtual, auxiliary can by optical signal that retina receives (either need a display screen as medium still
Direct retina projection imaging) electronic equipment, generally wear-type can even is that by vehicle in preferred embodiment
Windshield realize etc. that the load virtual road mixed information is, it is only necessary to which opposite human eye generates shadow and makes people
" feeling " some position be implicitly present in the model of a definite shape and show.Here it is not excluded for simply carrying out virtual mould
The AR technologies and AR equipment of the display of type, in fact up to the present, there are one the differentiations on fully defining by AR and MR, even
The difference of effect mostly " is claimed " between different company.It only needs to be finally reached to mix the virtual road in our scheme
Close the effect of information and realistic space model information mixed display.Here virtual road mixed information includes virtual mixing
Model information and coordinate information；The virtual mixed model information is the point that several can shine, these pixels are virtual
The two-dimentional mixed information in two dimensional surface or the three-dimensional hybrid information with certain space structure are shown as in space.Virtual mixing
Model can be used for playing road traffic indicative function, such as virtual mixed model can be road sign, traffic mark board, ground track
The two-dimensional pictures such as line, straight trip/turning mark symbol.Or the threedimensional models such as guardrail, isolation strip, pyrometric cone, safety island.Then
Coordinate information i.e. location information of these virtual mixed models relative to realistic space model above-mentioned, can be in all models
The location information of luminous point can also be the coordinate information of characteristic point in different models.Pass through virtual mixed model information and reality
The mixed display of spatial model, including step calculate virtual mixed model and show the relative position of equipment, aobvious in relative position
Show virtual mixed model.Through the above steps so that user can show equipment under road traffic situation by mixed reality
See the road traffic information sign virtually generated, the cost of physical road mark can be save, but improve road traffic
Safety.In addition importantly, when part way road traffic information sign needs transformation, it is only necessary to can be in computer
On dummy model is shown into edlin or replace, therefore our scheme further includes step, and it is virtual that S106 receives first
Road mixed information receives the second virtual road mixed information, and S108 receives the switching idsplay order of virtual road mixed information,
S110 shows equipment after receiving switching idsplay order, and the first virtual road mixed information of script display is replaced with the second void
Quasi- road mixed information is shown.If the virtual traffic trade of a certain crossing leftmost side is designated as turn lane, need by
When it becomes left turn lane, no longer needs to row and send someone to carry out mopping again, be directly directly adjusted to the two dimension mixed information
Show the road instruction of left turn lane.User easily by showing that equipment sees new mark, also eliminates simultaneously
The problem of with the passing of time existing entity instruction is easy to fade year in year out.Moreover, all relevant direction boards of existing road administration can
Replace display as needed, not only can be with the traffic lights of display transformation, additionally it is possible to display prescribe a time limit closed track, no through traffic
Guideboard etc..
Specifically, the invention also includes a kind of, and the road administration instruction based on mixed reality shows storage medium, is stored with calculating
Machine program, the computer program is executed when being run to be included the following steps, establishes the threedimensional model letter of realistic space scanning
Breath receives virtual road mixed information, loads the virtual road mixed information, by the virtual road mixed information and reality
Spatial information mixed display.
Further, the virtual road mixed information includes virtual mixed model information and coordinate information；It is described virtual
Mixed model information includes two-dimentional mixed information or three-dimensional hybrid information.
Specifically, the virtual mixed model information is for playing road traffic indicative function, including road sign, traffic sign
Board, lane line, straight trip/turning mark symbol, guardrail, isolation strip, pyrometric cone or safety island.
Preferably, the computer program also executes step when being run, and receives the first virtual road mixed information, connects
The second virtual road mixed information is received, the switching idsplay order of virtual road mixed information is received, display equipment is receiving switching
After idsplay order, the first virtual road mixed information of script display is replaced with into the second virtual road mixed information and is shown
Show.
In order to use the mixed reality display methods of new road instruction in the region of bigger, we have also been devised one
The new system of kind.As shown in Fig. 2, this system includes vehicle-mounted end 20, and along the relay 22 of road setting, wherein along road
Road setting can be in roadside, road surface, roadbed etc..Realistic space model of the relay for storage section section is believed
Breath, is additionally operable to the virtual mixed model information in storage section section.In general the part way is used for, realistic space model
Information is intended merely to facilitate the display equipment 200 of vehicle-mounted end to be positioned, by showing that equipment positions in realistic space model
The position of oneself, virtual mixed model are also contained in the coordinate information in realistic space model, to pass through calculating coordinate change
It obtains virtual mixed model and shows the real-time relative position of equipment, to carry out smooth display.Therefore in section Example
Realistic space model is stored after being packaged with virtual mixed model, when needing to be communicated with display equipment,
Such as, after relay receives the data requesting instructions for showing equipment, packaged data are transferred to vehicle-mounted end together, can also be incited somebody to action
Realistic space model information is transmitted respectively with virtual mixed model, needs the occasion often changed just in virtual mixed model in this way
It is practical.The need of road traffic information sign mixed display in a wide range of space can be solved by the design of relay
It wants.
In this system, further include scan module 202, the scan module is built for being scanned to realistic space
Vertical realistic space model, and stored, scan module can be acquired realistic space model and build digitization information,
Scan module can be arranged along road, or can store scanning result into relay with relay collocation setting,
Such scanning result will have certain limitation.In a preferred embodiment, as shown in our Fig. 2, scan module 202
It is arranged in vehicle-mounted end, traffic information is scanned in real time in vehicle travel process, section block is divided into realistic space
Form builds realistic space model, re-sends to the corresponding relay of different sections of highway 22 and is stored.With vehicle-mounted scan pattern
It is more mature to the technology of spatial modeling.Carrying out real-time Reginal-block scanning by mobile vehicle end can further increase
The precision of road relevant range modeling.
It may be seen that mixed reality display system further includes the display equipment of vehicle-mounted end from Fig. 2, the display is set
It is standby be can allow for that real world object generates or the light of reflection penetrates, while can generate it is virtual or auxiliary display can
By the optical signal (either needing a display screen as medium or direct retina projection imaging) of retina receiving
Electronic equipment, generally wear-type can even is that in preferred embodiment and be designed to the windshield of vehicle to realize etc..
Display equipment can be used for carrying out step and receive realistic space model, receive virtual road mixed information, and load described virtual
Road mixed information shows virtual road mixed information.By above system, mixed reality display system has reached void
The effect that quasi-ization traffic direction sign is shown solves the road guard of entity, isolation strip etc. in the prior art once hitting
On with regard to car crash, excessively dangerous problem becomes to retrieve accidentally having hit isolated column after virtually showing
Leeway, driver only needs to snap to attention, then returns steering wheel, and vehicle is opened back on correct road.Pass through virtualization
Road traffic information sign, which can also reach, easily changes Warning Mark, cost-effective, the technology for being easily changed, maintaining easily
Effect.
Further include server 24 in order to preferably reach the management for road traffic information sign, in this system, it is described
Server includes editor module 240, communication module 242, and editor module here is used to believe the virtual mixed model in certain section
It ceases into edlin, content of edit may include the shape in section need model to be shown, display time and each model
The coordinate information etc. of shape, size, the content and model that show on model, user on the server can be to particular way
The virtual mixed model information of section such as is selected, is changed, being increased, being deleted, being coloured at a variety of editting functions to content.Finally,
The virtual mixed model information editted is sent to relay by server by communication module, and vehicle is sent to by relay
, or vehicle-mounted end is sent directly to by mobile communications network.Then in a certain specific embodiment, a track at certain crossing is limited
When public transportation lane, 17 yellow solid line is shown in the display device when 19 11 when 13, at dusk at noon, at it
The remaining period is shown as white solid line.Again certain section road traffic information sign on, within a certain period of time for one-way road, other one
Such as festivals or holidays are the shopping mall for forbidding motor vehicle to enter again in a little times.It can be according to the needs of city manager more
Flexible setting, this is all needing to send police strength scheduling on duty in the past, is provided using that can solve manpower after this system
The problem of source consumes.
In order to further increase the practicability of mixed reality display system, we can also design fusion in vehicle end has,
Unmanned navigation module 204, the unmanned navigation module is for receiving traffic information, carrying out processing judgement, Jin Erxiang
Vehicle sends out the control instruction of road driving.Above functions has been able to maturely realize very much according to the prior art, is place nothing but
The logic that reason judges is had nothing in common with each other, such as the Google X of Google and Baidu, UBER companies have ripe nobody to drive
Sail AI.The progress of this system is that our unmanned navigation module can receive virtual mixed model information, also conduct
The input of a part of traffic information, existing traffic information identify reality generally by modes such as optical identification, radar scannings
Emergency case in road conditions carries out driving navigation, and needs by the scanning result digitization of the road conditions in reality, to carry out
Processing judges.In our embodiment, vehicle-mounted end sends it to nobody and drives after receiving virtual mixed model information
Navigation module is sailed, unmanned navigation module will be according to position, size, color, word etc. existing for virtual mixed model together
Judged as traffic information, to send out the control instruction of road driving to vehicle.So, it is existed simultaneously when on the road
When having human driver and the automatic driving vehicle with display equipment, both sides " can see " same road conditions
And road traffic information sign, and then avoid due to traffic accident caused by information gap.
Corresponding with system in Fig. 2, we will also introduce a kind of mixed reality road display method, as shown in figure 3, also wrapping
Step is included, S302 vehicle-mounted ends receive the virtual mixed model information or realistic space model information of relay storage；Position vehicle
Position in realistic space model；The virtual mixed model further includes virtual mixed model in realistic space model
Coordinate information, according to coordinate information, S304 calculating coordinate changes obtain the real-time relative position of virtual mixed model and vehicle,
In the display equipment of vehicle end, the virtual mixed model is shown according to relative position.Big model can be solved by the above method
The needs of road traffic information sign mixed display in confining space so that it is aobvious that vehicle can quote mixed reality whenever and wherever possible
Show.
Can also include step, vehicle-mounted end transmission data request instruction in specific embodiment；Relay receives data
Request instruction, and realistic space model information or virtual mixed model information are returned to according to request instruction.Above-mentioned steps be in order to
Transmitting, sharing between the storage content and vehicle-mounted end of realization relay station so that vehicle is able to know that forever in the process of moving
Road ahead or the concrete condition in place section, communication mode between vehicle-mounted end and relay station can there are many kinds of, according to existing
There is the communication technology can be with unrestricted choice.But vehicle-mounted end transmission data request instruction is not necessary, as relay is outside always
Realistic space model information or virtual mixed model information are broadcasted, same effect can be also reached.
Further include step in some other embodiment, scan module is scanned realistic space, establishes realistic space mould
Type, will be in scanning result storage to relay.Real-time Reginal-block scanning is carried out by mobile vehicle end can further carry
The precision of high road relevant range modeling.And in preferred embodiment, the realistic space model of establishing can be, in default sky
Between realistic space model is built in range size, can be sent to after the completion of the realistic space model construction of different spaces corresponding
Relay is stored.
In order to which the virtual mixed model information for preferably providing different is shown, relay send mixed model or
Further include before realistic space model S300 to the virtual mixed model information of specific road section into edlin, be included in the section needs
The model of display, the display time, the shape of model, size, the content or model that show on model coordinate information；It will editor
Good virtual mixed model information is sent to relay.Content of edit may include in section need model to be shown, show
Show the coordinate information etc. of the content and model that are shown in the shape, size, model of time and each model, Yong Hu
The virtual mixed model information of specific road section can be selected on server, change, increase, delete, colour etc. and is a variety of
To the editting function of content.It by artificially designing, can preferably save labour turnover, and improve the emergent sound to road administration facility
Answer level.
Further include step in further embodiment, the unmanned navigation module of vehicle-mounted end receives traffic information, according to
Traffic information and virtual mixed model information carry out processing judgement, unmanned navigation module is needed all virtual hybrid guided modes
Physical entity existing for type information " being considered as ", the control instruction of road driving is sent out based on this logic to vehicle.By will be virtual
Mixed model information also carries out processing response as traffic information, can further improve the method for the present invention in unmanned neck
The adaptability in domain.
In the example that some more make progress meaning, we will be appreciated that how to solve by new virtual mixed model
Certainly the problem of congestion in road.
Let us assume that a scene, certain direction vehicle for entering traffic light intersection has waited in a queue, however the road
The opposite track on road is absolutely empty, and this scene is very common in modern metropolitan cities, and crossing can be represented by number of track-lines
The upper limit that the section is through-flow, and in specific time period, the vehicle number into the section is higher than the vehicle number left, results in naturally
Congestion, therefore in our scheme, as shown in figure 4, including step, S400 congestions at the crossing for detecting current road segment
When, step is carried out, changes the display location of isolation model in virtual mixed model information, widens having a lot of social connections into crossing direction.
Whether the method for detecting whether congestion can be used for reference using the prior art, such as by vehicle Flow Detection, gathered around by threshold decision
It is stifled；Or vehicle location is received, it is determined as congestion etc. when vehicle location is trapped in average time in certain section more than certain threshold value,
Comparison of this technology in each map software is more；In preferred embodiment, each metropolitan city can be directly invoked
The data of monitoring network can directly judge the jam situation of present road by image recognition in each section monitoring.Here every
It is two dimension or three dimensional virtual models for separating opposite track, such as guardrail, hard shoulder, greenbelt, double amber lines from model.
Changing display location can generally be selected as widening the position in a track, and certainly although opposite direction track is to narrow, but red waiting
This direction of green light has had more a track and has been lined up, and can effectively reduce the queues of stationary traffic length of traffic congestion, permits when that can enter crossing
Many troops enter crossing simultaneously, can also increase the through-flow upper limit in the section, to which gathering around for current road segment be effectively relieved
Stifled problem.
Administration of highways is carried out by changing the display location of virtual isolation model in new method, but if is changed
The generation that may result in very much driving accident suddenly, in order to avoid the means that this problem can carry out be exactly can be with friendship
Ventilating signal lamp links, when the straight trip in other tracks, left turning vehicle all cannot be introduced into this section by traffic lights limitation
The variation for carrying out isolation model display location, the problem of bringing so in fact, are turned right when cannot be limited in variation display location
Vehicle enters the crossing, therefore can also carry out step, carries out virtual warning mark and shows, prompts the opposite track for needing to change
Middle vehicle is avoided, and step can also be detected, and whether detect in the track that may be changed has vehicle, and detection here may
The track of variation includes the track of one fixed width, further includes the limitation in certain length.100 meters of long sections can be divided into
10 sections, the track that may be changed is bicycle road width, then whether has vehicle in the long default section of 10 meters of bicycle road of detection every time,
If not provided, just carry out step, change the isolation model display location of this 10 meters long way sections so that enter crossing to vehicle
Road number becomes more.Or inverse operation changes the display location of isolation model when road not congestion so that enters the vehicle at crossing
Road number tails off.The way section for detecting next 10 meters again steps be repeated alternatively until that the isolation model in all default sections can
Access the change of display location.
Therefore, in comprehensive stronger embodiment, our scheme includes step as shown in Figure 5, and S500 is to difference
The jam situation of road, virtual mixed model show that content is recorded, and specifically include time that congestion starts and congestion terminates
Time, virtual mixed model shows the duration of different content, presses the congestion information on week, date, chronological classification respectively
Statistical result, according to the congestion information statistical result, when determining the adjustment of optimal isolation model display location of different sections of highway
Section.In common embodiment, the statistical result can be analyzed, such as to time that congestion in different sections of highway starts
And the end time determines the optimal correction period using mean value, to change the display location of isolation model in the congestion period,
To widen road surface etc..In specific some other embodiment, also carries out step S502 and build deep learning neural network, institute
Whether the input layer for stating deep learning neural network includes the date, week, the moment, is festivals or holidays, road congestion conditions, output layer
The display content of display location information, virtual mixed model including virtual mixed model can be carried out according to the statistical result
Training, can finally obtain the deep learning after the training according to time and the virtual mixed display content of condition of road surface adjust automatically
Neural network.S504 uses the deep learning neural network after training, each predetermined time collect it is current when
Between date, road congestion conditions, predetermined time that neural network just can be optimized needs virtual mixed model to be shown
Information.Certainly in the scope that can be not limited only to isolation model and show handled using neural network, all virtual mixing
Display, the variation of model, can be completed by neural network.Solves the virtual mixing of intelligent optimization through the above scheme
The problem of model is shown.
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that process, method, article or terminal device including a series of elements include not only those
Element, but also include other elements that are not explicitly listed, or further include for this process, method, article or end
The intrinsic element of end equipment.In the absence of more restrictions, being limited by sentence " including ... " or " including ... "
Element, it is not excluded that there is also other elements in process, method, article or the terminal device including the element.This
Outside, herein, " being more than ", " being less than ", " being more than " etc. are interpreted as not including this number；" more than ", " following ", " within " etc. understandings
It includes this number to be.
It should be understood by those skilled in the art that, the various embodiments described above can be provided as method, apparatus or computer program production
Product.Complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in these embodiments
Form.All or part of step in the method that the various embodiments described above are related to can be instructed by program relevant hardware come
It completes, the program can be stored in the storage medium that computer equipment can be read, for executing the various embodiments described above side
All or part of step described in method.The computer equipment, including but not limited to：Personal computer, server, general-purpose computations
It is machine, special purpose computer, the network equipment, embedded device, programmable device, intelligent mobile terminal, smart home device, wearable
Smart machine, vehicle intelligent equipment etc.；The storage medium, including but not limited to：RAM, ROM, magnetic disc, tape, CD, sudden strain of a muscle
It deposits, USB flash disk, mobile hard disk, storage card, memory stick, webserver storage, network cloud storage etc..
The various embodiments described above are with reference to method, equipment (system) and the computer program product according to embodiment
Flowchart and/or the block diagram describes.It should be understood that can be realized by computer program instructions every in flowchart and/or the block diagram
The combination of flow and/or box in one flow and/or box and flowchart and/or the block diagram.These computers can be provided
Program instruction is to the processor of computer equipment to generate a machine so that the finger executed by the processor of computer equipment
It enables and generates to specify in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
The device of function.
These computer program instructions, which may also be stored in, can guide computer equipment computer operate in a specific manner to set
In standby readable memory so that the instruction generation being stored in the computer equipment readable memory includes the manufacture of command device
Product, command device realization refer in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
Fixed function.
These computer program instructions can be also loaded on computer equipment so that be executed on a computing device a series of
To generate computer implemented processing, the instruction to execute on a computing device is provided for realizing in flow operating procedure
The step of function of being specified in one flow of figure or multiple flows and/or one box of block diagram or multiple boxes.
Although the various embodiments described above are described, once a person skilled in the art knows basic wounds
The property made concept, then additional changes and modifications can be made to these embodiments, so example the above is only the implementation of the present invention,
It is not intended to limit the scope of patent protection of the present invention, it is every to utilize equivalent structure made by description of the invention and accompanying drawing content
Or equivalent process transformation, it is applied directly or indirectly in other relevant technical fields, the patent for being similarly included in the present invention
Within protection domain.
Claims (8)
1. a kind of road administration based on mixed reality indicates display methods, which is characterized in that include the following steps, establish realistic space
The three-dimensional model information of scanning receives virtual road mixed information, the virtual road mixed information is loaded, by the virtual road
Road mixed information and realistic space information mixed display.
2. the road administration according to claim 1 based on mixed reality indicates display methods, which is characterized in that the virtual road
Road mixed information includes virtual mixed model information and coordinate information；The virtual mixed model information includes two-dimentional mixed information
Or three-dimensional hybrid information.
3. the road administration according to claim 2 based on mixed reality indicates display methods, which is characterized in that described virtual mixed
Model information is closed for playing road traffic indicative function, including road sign, traffic mark board, lane line, straight trip/turning mark symbol
Number, guardrail, isolation strip, pyrometric cone or safety island.
4. the road administration according to claim 1 based on mixed reality indicates display methods, which is characterized in that further include step
Suddenly, the first virtual road mixed information is received, the second virtual road mixed information is received, receives cutting for virtual road mixed information
Idsplay order is changed, display equipment replaces the first virtual road mixed information of script display after receiving switching idsplay order
It is shown for the second virtual road mixed information.
5. a kind of road administration instruction based on mixed reality shows storage medium, which is characterized in that it is stored with computer program, it is described
Computer program is executed when being run to be included the following steps, the three-dimensional model information of realistic space scanning is established, and is received virtual
Road mixed information loads the virtual road mixed information, and the virtual road mixed information is mixed with realistic space information
Close display.
6. the road administration instruction according to claim 5 based on mixed reality shows storage medium, which is characterized in that the void
Quasi- road mixed information includes virtual mixed model information and coordinate information；The virtual mixed model information includes that two dimension mixes
Information or three-dimensional hybrid information.
7. the road administration instruction according to claim 6 based on mixed reality shows storage medium, which is characterized in that the void
Quasi- mixed model information is for playing road traffic indicative function, including road sign, traffic mark board, lane line, straight trip/turning mark
Will symbol, guardrail, isolation strip, pyrometric cone or safety island.
8. the road administration instruction according to claim 5 based on mixed reality shows storage medium, which is characterized in that the meter
Calculation machine program also executes step when being run, and receives the first virtual road mixed information, receives the second virtual road mixing letter
Breath, receives the switching idsplay order of virtual road mixed information, and display equipment shows script after receiving switching idsplay order
The first virtual road mixed information replace with the second virtual road mixed information and shown.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810484962.7A CN108665556B (en) | 2018-05-20 | 2018-05-20 | Road indication display method based on mixed reality and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810484962.7A CN108665556B (en) | 2018-05-20 | 2018-05-20 | Road indication display method based on mixed reality and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108665556A true CN108665556A (en) | 2018-10-16 |
| CN108665556B CN108665556B (en) | 2024-03-01 |
Family
ID=63776229
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810484962.7A Active CN108665556B (en) | 2018-05-20 | 2018-05-20 | Road indication display method based on mixed reality and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108665556B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109881605A (en) * | 2019-02-19 | 2019-06-14 | 福州市极化律网络科技有限公司 | Mixed reality guardrail for road adjusts vehicle |
| CN109881604A (en) * | 2019-02-19 | 2019-06-14 | 福州市极化律网络科技有限公司 | Mixed reality guardrail for road shows adjustment system |
| CN111580516A (en) * | 2020-05-09 | 2020-08-25 | 上海木木聚枞机器人科技有限公司 | Scheduling control method, intelligent mobile device and storage medium |
| CN112037636A (en) * | 2020-09-07 | 2020-12-04 | 合肥清雅装饰工程有限公司 | Intersection road structure |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080195315A1 (en) * | 2004-09-28 | 2008-08-14 | National University Corporation Kumamoto University | Movable-Body Navigation Information Display Method and Movable-Body Navigation Information Display Unit |
| CN101673463A (en) * | 2009-09-17 | 2010-03-17 | 北京世纪高通科技有限公司 | Traffic information predicting method based on time series and device thereof |
| CN103473939A (en) * | 2013-10-09 | 2013-12-25 | 招商局重庆交通科研设计院有限公司 | Road signal control method and system |
| CN103489314A (en) * | 2013-09-25 | 2014-01-01 | 广东欧珀移动通信有限公司 | Method and device for displaying real-time road conditions |
| CN106251406A (en) * | 2016-08-04 | 2016-12-21 | 合肥景昇信息科技有限公司 | City based on virtual reality technology roadway location system |
| US20160368417A1 (en) * | 2015-06-17 | 2016-12-22 | Geo Semiconductor Inc. | Vehicle vision system |
| CN106652437A (en) * | 2017-03-05 | 2017-05-10 | 赵莉莉 | Comprehensive real-time command intelligent traffic management and control system |
| CN106710360A (en) * | 2016-02-03 | 2017-05-24 | 北京易驾佳信息科技有限公司 | Intelligent driving training system and method based on augment virtual reality man-machine interaction |
| CN107228681A (en) * | 2017-06-26 | 2017-10-03 | 上海驾馥电子科技有限公司 | A kind of navigation system for strengthening navigation feature by camera |
-
2018
- 2018-05-20 CN CN201810484962.7A patent/CN108665556B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080195315A1 (en) * | 2004-09-28 | 2008-08-14 | National University Corporation Kumamoto University | Movable-Body Navigation Information Display Method and Movable-Body Navigation Information Display Unit |
| CN101673463A (en) * | 2009-09-17 | 2010-03-17 | 北京世纪高通科技有限公司 | Traffic information predicting method based on time series and device thereof |
| CN103489314A (en) * | 2013-09-25 | 2014-01-01 | 广东欧珀移动通信有限公司 | Method and device for displaying real-time road conditions |
| CN103473939A (en) * | 2013-10-09 | 2013-12-25 | 招商局重庆交通科研设计院有限公司 | Road signal control method and system |
| US20160368417A1 (en) * | 2015-06-17 | 2016-12-22 | Geo Semiconductor Inc. | Vehicle vision system |
| CN106710360A (en) * | 2016-02-03 | 2017-05-24 | 北京易驾佳信息科技有限公司 | Intelligent driving training system and method based on augment virtual reality man-machine interaction |
| CN106251406A (en) * | 2016-08-04 | 2016-12-21 | 合肥景昇信息科技有限公司 | City based on virtual reality technology roadway location system |
| CN106652437A (en) * | 2017-03-05 | 2017-05-10 | 赵莉莉 | Comprehensive real-time command intelligent traffic management and control system |
| CN107228681A (en) * | 2017-06-26 | 2017-10-03 | 上海驾馥电子科技有限公司 | A kind of navigation system for strengthening navigation feature by camera |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109881605A (en) * | 2019-02-19 | 2019-06-14 | 福州市极化律网络科技有限公司 | Mixed reality guardrail for road adjusts vehicle |
| CN109881604A (en) * | 2019-02-19 | 2019-06-14 | 福州市极化律网络科技有限公司 | Mixed reality guardrail for road shows adjustment system |
| CN109881605B (en) * | 2019-02-19 | 2022-08-09 | 福州市极化律网络科技有限公司 | Mixed reality road isolated column adjustment vehicle |
| CN109881604B (en) * | 2019-02-19 | 2022-08-09 | 福州市极化律网络科技有限公司 | Mixed reality road isolated column display adjustment system |
| CN111580516A (en) * | 2020-05-09 | 2020-08-25 | 上海木木聚枞机器人科技有限公司 | Scheduling control method, intelligent mobile device and storage medium |
| CN112037636A (en) * | 2020-09-07 | 2020-12-04 | 合肥清雅装饰工程有限公司 | Intersection road structure |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108665556B (en) | 2024-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108520635A (en) | A kind of mixed reality road display system | |
| US11640174B2 (en) | Smart vehicle | |
| US10816993B1 (en) | Smart vehicle | |
| US10928830B1 (en) | Smart vehicle | |
| CN108665556A (en) | A kind of road administration instruction display methods and storage medium based on mixed reality | |
| WO2022141910A1 (en) | Vehicle-road laser radar point cloud dynamic segmentation and fusion method based on driving safety risk field | |
| CN107730903A (en) | Parking offense and the car vision detection system that casts anchor based on depth convolutional neural networks | |
| CN111874006A (en) | Route planning processing method and device | |
| CN108711298A (en) | A kind of mixed reality road display method | |
| CN110688311A (en) | Test case management method and device for automatic driving typical scene | |
| CN110118564A (en) | A kind of data management system, management method, terminal and the storage medium of high-precision map | |
| CN109115237A (en) | A kind of position recommended method and server of riding | |
| CN111899515B (en) | Vehicle detection system based on wisdom road edge calculates gateway | |
| CN114821507A (en) | Multi-sensor fusion vehicle-road cooperative sensing method for automatic driving | |
| CN108648480A (en) | A kind of road isolation model display methods and storage medium based on mixed reality | |
| CN110675476A (en) | Method and device for visually conveying definition of automatic driving scene | |
| CN117011413B (en) | Road image reconstruction method, device, computer equipment and storage medium | |
| Huu et al. | Proposing lane and obstacle detection algorithm using YOLO to control self-driving cars on advanced networks | |
| CN116597690B (en) | Highway test scene generation method, equipment and medium for intelligent network-connected automobile | |
| CN111583584B (en) | Intelligent walking stick safety warning system, warning method and intelligent walking stick | |
| US11465620B1 (en) | Lane generation | |
| CN108765580A (en) | A kind of mixed reality road display optimization method and storage medium | |
| Shan et al. | Vehicle collision risk estimation based on RGB-D camera for urban road | |
| CN109683613A (en) | It is a kind of for determining the method and apparatus of the ancillary control information of vehicle | |
| Chamola et al. | Overtaking mechanisms based on augmented intelligence for autonomous driving: Datasets, methods, and challenges |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |