CN108711298A - A kind of mixed reality road display method - Google Patents
A kind of mixed reality road display method Download PDFInfo
- Publication number
- CN108711298A CN108711298A CN201810484958.0A CN201810484958A CN108711298A CN 108711298 A CN108711298 A CN 108711298A CN 201810484958 A CN201810484958 A CN 201810484958A CN 108711298 A CN108711298 A CN 108711298A
- Authority
- CN
- China
- Prior art keywords
- model
- information
- virtual
- vehicle
- road
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Theoretical Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Traffic Control Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
A kind of mixed reality road display method, includes the following steps, vehicle-mounted end receives the virtual mixed model information or realistic space model information of relay storage;Position of the positioning vehicle in realistic space model;The virtual mixed model further includes coordinate information of the virtual mixed model in realistic space model, according to coordinate information, calculating coordinate change obtains the real-time relative position of virtual mixed model and vehicle, and in the display equipment of vehicle end, the virtual mixed model is shown according to relative position.It can solve the problems, such as that relief road driving vehicle obtains reality scene and virtual scene update at any time.
Description
Technical field
The present invention relates to mixed reality fields, more particularly to the road instruction mark display field of application mixed reality.
Background technology
Mixed reality (MR) (both having included that augmented reality and enhancing are virtual) refers to merging reality and virtual world and generating
New visible environment.Physics and digital object coexist in new visible environment, and real-time interactive.The common spy of system
Point has:
It combines virtual and real;It is virtual in the three dimensions projection of reality;Real time execution.
The realization of mixed reality (MR) needs in the environment that can be interacted with each things of real world at one.If one
Cut things all and be the field that virtual that is exactly VR.If the virtual information shown can only simple superposition in real things
On, that is, AR.The key point of MR is exactly the timely acquisition interacted with real world with information.
In existing road surface driving environment, be required for realistically pull-up isolation strip, establish guideboard, brush track paint etc., it is non-
Normal waste of resource, if it is possible to the virtual display to road traffic facility is reached by existing area of computer aided display technology,
A large number of physics cost can be saved, even and if the road instruction mark that virtually shows damage will not be generated on vehicle " hitting "
It is bad, improve the safety of driving environment.
Invention content
For this reason, it may be necessary to provide one kind can relief road driving vehicle obtain reality scene at any time and virtual scene is newer
Mixed reality application process.
To achieve the above object, a kind of mixed reality road display method is inventor provided, is included the following steps, it is vehicle-mounted
End receives the virtual mixed model information or realistic space model information of relay storage;Positioning vehicle is in realistic space model
In position;The virtual mixed model further includes coordinate information of the virtual mixed model in realistic space model, according to seat
Information is marked, calculating coordinate change obtains the real-time relative position of virtual mixed model and vehicle, in the display equipment of vehicle end,
The virtual mixed model is shown according to relative position.
Specifically, further include step, vehicle-mounted end transmission data request instruction;Relay receives data requesting instructions, and
Realistic space model information or virtual mixed model information are returned according to request instruction.
Further, further include step, scan module is scanned realistic space, establishes realistic space model, will sweep
It retouches in result storage to relay.
Preferably, described to establish realistic space model specifically, building realistic space mould in pre-set space range size
Type, the realistic space model of different spaces are sent to corresponding relay and are stored.
Optionally, to the virtual mixed model information of specific road section into edlin, being included in the section needs mould to be shown
Type, the display time, the shape of model, size, the content or model that show on model coordinate information;It is virtual by what is editted
Mixed model information is sent to relay.
Further, further include step, traffic information is received, at traffic information and virtual mixed model information
Reason judgement, the control instruction that road driving is sent out to vehicle.
It is different from the prior art, above-mentioned technical proposal transmits realistic space model to vehicle in real time by designing relay
And virtual mixed model so that vehicle can obtain the auxiliary information of traveling in real time during road driving, additionally it is possible to pass through
Server-side carries out edit-modify to virtual mixed model information.Said program solves assisting vehicle travel in mixed reality field
The problem of.
Description of the drawings
Fig. 1 is that the road administration described in the specific embodiment of the invention indicates display methods flow chart;
Fig. 2 is the mixed reality road display system module map described in the specific embodiment of the invention;
Fig. 3 is the mixed reality road display method flow chart described in the specific embodiment of the invention;
Fig. 4 is the isolation model display methods flow chart described in the specific embodiment of the invention;
Fig. 5 is the road display optimization method flow diagram described in the specific embodiment of the invention.
Specific implementation mode
For the technology contents of technical solution, construction feature, the objects and the effects are described in detail, below in conjunction with specific reality
It applies example and attached drawing is coordinated to be explained in detail.
Referring to Fig. 1, for the instruction display methods schematic diagram of mixed reality that the present invention will introduce, this method can be
It is used under the arbitrary scene of road traffic, either urban road, road, highway etc. outside city, this method can be used
Carry out the mixed display of road administration instruction information and real road conditions.We have seen that, the method for the present invention includes the following steps from figure,
S100 establishes the scanned three-dimensional model information of realistic space, that is, is required to presently described realistic space environment number in advance
According to change, this is the conventional steps for generally mixing with reality and being required for completing, and is conducive to subsequent virtual information and real information is accurate
Mixing.Establishing realistic space model information enables to the display of successor virtual road mixed information can be more accurate.But
It is the example that mixed display can be carried out in open space rare in the prior art, this needs larger memory, but
It is not without method to overcome, under the application scenarios of intersection, a certain range of region near intersection can be made
It is modeled for the confined space, therefore, in an embodiment of the present invention, carries out step, it is existing that S102 shows that equipment receives
Real space model, next, the method for the present invention further includes step, S104 receives virtual road mixed information, and loads the void
Quasi- road mixed information.The display equipment is that the light that can allow for real world object to generate or reflect penetrates, while can produce
It is raw virtual, auxiliary (either to need a display screen as the still direct of medium by the optical signal that retina receives
Retina projection imaging) electronic equipment, generally wear-type can even is that the gear by vehicle in preferred embodiment
Wind glass realizes etc. that the load virtual road mixed information is, it is only necessary to which opposite human eye generates shadow and people " are felt
" some position is implicitly present in the model of a definite shape and shows.Here it is not excluded for simply carrying out dummy model
The AR technologies and AR equipment of display, in fact up to the present, there are one the differentiations on fully defining by AR and MR, or even are mostly
The difference of effect " is claimed " between different company.It only needs to be finally reached to mix the virtual road in our scheme to believe
The effect of breath and realistic space model information mixed display.Here virtual road mixed information includes virtual mixed model
Information and coordinate information;The virtual mixed model information is the point that several can shine, these pixels are in Virtual Space
In show as the two-dimentional mixed information in two dimensional surface or the three-dimensional hybrid information with certain space structure.Virtual mixed model
Can be used for playing road traffic indicative function, such as virtual mixed model can be road sign, traffic mark board, ground lane line,
The two-dimensional pictures such as straight trip/turning mark symbol.Or the threedimensional models such as guardrail, isolation strip, pyrometric cone, safety island.Then sit
Information i.e. location information of these virtual mixed models relative to realistic space model above-mentioned is marked, can be light in all models
The location information of point, can also be the coordinate information of characteristic point in different models.It is empty by virtual mixed model information and reality
Between model mixed display, including step calculates virtual mixed model and shows the relative position of equipment, shown in relative position
Virtual mixed model.Through the above steps so that user can show that equipment is seen under road traffic situation by mixed reality
To the road traffic information sign virtually generated, the cost of physical road mark can be save, but improves the peace of road traffic
Quan Xing.In addition importantly, when part way road traffic information sign needs transformation, it is only necessary to can be on computers
Into edlin or display is replaced to dummy model, therefore our scheme further includes step, S106 receives the first virtual road
Road mixed information receives the second virtual road mixed information, and S108 receives the switching idsplay order of virtual road mixed information,
S110 shows equipment after receiving switching idsplay order, and the first virtual road mixed information of script display is replaced with the second void
Quasi- road mixed information is shown.If the virtual traffic trade of a certain crossing leftmost side is designated as turn lane, need by
When it becomes left turn lane, no longer needs to row and send someone to carry out mopping again, be directly directly adjusted to the two dimension mixed information
Show the road instruction of left turn lane.User easily by showing that equipment sees new mark, also eliminates simultaneously
The problem of with the passing of time existing entity instruction is easy to fade year in year out.Moreover, all relevant direction boards of existing road administration can
Replace display as needed, not only can be with the traffic lights of display transformation, additionally it is possible to display prescribe a time limit closed track, no through traffic
Guideboard etc..
In order to use the mixed reality display methods of new road instruction in the region of bigger, we have also been devised one
The new system of kind.As shown in Fig. 2, this system includes vehicle-mounted end 20, and along the relay 22 of road setting, wherein along road
Road setting can be in roadside, road surface, roadbed etc..Realistic space model of the relay for storage section section is believed
Breath, is additionally operable to the virtual mixed model information in storage section section.In general the part way is used for, realistic space model
Information is intended merely to facilitate the display equipment 200 of vehicle-mounted end to be positioned, by showing that equipment positions in realistic space model
The position of oneself, virtual mixed model are also contained in the coordinate information in realistic space model, to pass through calculating coordinate change
It obtains virtual mixed model and shows the real-time relative position of equipment, to carry out smooth display.Therefore in section Example
Realistic space model is stored after being packaged with virtual mixed model, when needing to be communicated with display equipment,
Such as, after relay receives the data requesting instructions for showing equipment, packaged data are transferred to vehicle-mounted end together, can also be incited somebody to action
Realistic space model information is transmitted respectively with virtual mixed model, needs the occasion often changed just in virtual mixed model in this way
It is practical.The need of road traffic information sign mixed display in a wide range of space can be solved by the design of relay
It wants.
In this system, further include scan module 202, the scan module is built for being scanned to realistic space
Vertical realistic space model, and stored, scan module can be acquired realistic space model and build digitization information,
Scan module can be arranged along road, or can store scanning result into relay with relay collocation setting,
Such scanning result will have certain limitation.In a preferred embodiment, as shown in our Fig. 2, scan module 202
It is arranged in vehicle-mounted end, traffic information is scanned in real time in vehicle travel process, section block is divided into realistic space
Form builds realistic space model, re-sends to the corresponding relay of different sections of highway 22 and is stored.With vehicle-mounted scan pattern
It is more mature to the technology of spatial modeling.Carrying out real-time Reginal-block scanning by mobile vehicle end can further increase
The precision of road relevant range modeling.
It may be seen that mixed reality display system further includes the display equipment of vehicle-mounted end from Fig. 2, the display is set
It is standby be can allow for that real world object generates or the light of reflection penetrates, while can generate it is virtual or auxiliary display can
By the optical signal (either needing a display screen as medium or direct retina projection imaging) of retina receiving
Electronic equipment, generally wear-type can even is that in preferred embodiment and be designed to the windshield of vehicle to realize etc..
Display equipment can be used for carrying out step and receive realistic space model, receive virtual road mixed information, and load described virtual
Road mixed information shows virtual road mixed information.By above system, mixed reality display system has reached void
The effect that quasi-ization traffic direction sign is shown solves the road guard of entity, isolation strip etc. in the prior art once hitting
On with regard to car crash, excessively dangerous problem becomes to retrieve accidentally having hit isolated column after virtually showing
Leeway, driver only needs to snap to attention, then returns steering wheel, and vehicle is opened back on correct road.Pass through virtualization
Road traffic information sign, which can also reach, easily changes Warning Mark, cost-effective, the technology for being easily changed, maintaining easily
Effect.
Further include server 24 in order to preferably reach the management for road traffic information sign, in this system, it is described
Server includes editor module 240, communication module 242, and editor module here is used to believe the virtual mixed model in certain section
It ceases into edlin, content of edit may include the shape in section need model to be shown, display time and each model
The coordinate information etc. of shape, size, the content and model that show on model, user on the server can be to particular way
The virtual mixed model information of section such as is selected, is changed, being increased, being deleted, being coloured at a variety of editting functions to content.Finally,
The virtual mixed model information editted is sent to relay by server by communication module, and vehicle is sent to by relay
, or vehicle-mounted end is sent directly to by mobile communications network.Then in a certain specific embodiment, a track at certain crossing is limited
When public transportation lane, 17 yellow solid line is shown in the display device when 19 11 when 13, at dusk at noon, at it
The remaining period is shown as white solid line.Again certain section road traffic information sign on, within a certain period of time for one-way road, other one
Such as festivals or holidays are the shopping mall for forbidding motor vehicle to enter again in a little times.It can be according to the needs of city manager more
Flexible setting, this is all needing to send police strength scheduling on duty in the past, is provided using that can solve manpower after this system
The problem of source consumes.
In order to further increase the practicability of mixed reality display system, we can also design fusion in vehicle end has,
Unmanned navigation module 204, the unmanned navigation module is for receiving traffic information, carrying out processing judgement, Jin Erxiang
Vehicle sends out the control instruction of road driving.Above functions has been able to maturely realize very much according to the prior art, is place nothing but
The logic that reason judges is had nothing in common with each other, such as the Google X of Google and Baidu, UBER companies have ripe nobody to drive
Sail AI.The progress of this system is that our unmanned navigation module can receive virtual mixed model information, also conduct
The input of a part of traffic information, existing traffic information identify reality generally by modes such as optical identification, radar scannings
Emergency case in road conditions carries out driving navigation, and needs by the scanning result digitization of the road conditions in reality, to carry out
Processing judges.In our embodiment, vehicle-mounted end sends it to nobody and drives after receiving virtual mixed model information
Navigation module is sailed, unmanned navigation module will be according to position, size, color, word etc. existing for virtual mixed model together
Judged as traffic information, to send out the control instruction of road driving to vehicle.So, it is existed simultaneously when on the road
When having human driver and the automatic driving vehicle with display equipment, both sides " can see " same road conditions
And road traffic information sign, and then avoid due to traffic accident caused by information gap.
Corresponding with system in Fig. 2, we will also introduce a kind of mixed reality road display method, as shown in figure 3, also wrapping
Step is included, S302 vehicle-mounted ends receive the virtual mixed model information or realistic space model information of relay storage;Position vehicle
Position in realistic space model;The virtual mixed model further includes virtual mixed model in realistic space model
Coordinate information, according to coordinate information, S304 calculating coordinate changes obtain the real-time relative position of virtual mixed model and vehicle,
In the display equipment of vehicle end, the virtual mixed model is shown according to relative position.Big model can be solved by the above method
The needs of road traffic information sign mixed display in confining space so that it is aobvious that vehicle can quote mixed reality whenever and wherever possible
Show.
Can also include step, vehicle-mounted end transmission data request instruction in specific embodiment;Relay receives data
Request instruction, and realistic space model information or virtual mixed model information are returned to according to request instruction.Above-mentioned steps be in order to
Transmitting, sharing between the storage content and vehicle-mounted end of realization relay station so that vehicle is able to know that forever in the process of moving
Road ahead or the concrete condition in place section, communication mode between vehicle-mounted end and relay station can there are many kinds of, according to existing
There is the communication technology can be with unrestricted choice.But vehicle-mounted end transmission data request instruction is not necessary, as relay is outside always
Realistic space model information or virtual mixed model information are broadcasted, same effect can be also reached.
Further include step in some other embodiment, scan module is scanned realistic space, establishes realistic space mould
Type, will be in scanning result storage to relay.Real-time Reginal-block scanning is carried out by mobile vehicle end can further carry
The precision of high road relevant range modeling.And in preferred embodiment, the realistic space model of establishing can be, in default sky
Between realistic space model is built in range size, can be sent to after the completion of the realistic space model construction of different spaces corresponding
Relay is stored.
In order to which the virtual mixed model information for preferably providing different is shown, relay send mixed model or
Further include before realistic space model S300 to the virtual mixed model information of specific road section into edlin, be included in the section needs
The model of display, the display time, the shape of model, size, the content or model that show on model coordinate information;It will editor
Good virtual mixed model information is sent to relay.Content of edit may include in section need model to be shown, show
Show the coordinate information etc. of the content and model that are shown in the shape, size, model of time and each model, Yong Hu
The virtual mixed model information of specific road section can be selected on server, change, increase, delete, colour etc. and is a variety of
To the editting function of content.It by artificially designing, can preferably save labour turnover, and improve the emergent sound to road administration facility
Answer level.
Further include step in further embodiment, the unmanned navigation module of vehicle-mounted end receives traffic information, according to
Traffic information and virtual mixed model information carry out processing judgement, unmanned navigation module is needed all virtual hybrid guided modes
Physical entity existing for type information " being considered as ", the control instruction of road driving is sent out based on this logic to vehicle.By will be virtual
Mixed model information also carries out processing response as traffic information, can further improve the method for the present invention in unmanned neck
The adaptability in domain.
In the example that some more make progress meaning, we will be appreciated that how to solve by new virtual mixed model
Certainly the problem of congestion in road.
Let us assume that a scene, certain direction vehicle for entering traffic light intersection has waited in a queue, however the road
The opposite track on road is absolutely empty, and this scene is very common in modern metropolitan cities, and crossing can be represented by number of track-lines
The upper limit that the section is through-flow, and in specific time period, the vehicle number into the section is higher than the vehicle number left, results in naturally
Congestion, therefore in our scheme, as shown in figure 4, including step, S400 congestions at the crossing for detecting current road segment
When, step is carried out, changes the display location of isolation model in virtual mixed model information, widens having a lot of social connections into crossing direction.
Whether the method for detecting whether congestion can be used for reference using the prior art, such as by vehicle Flow Detection, gathered around by threshold decision
It is stifled;Or vehicle location is received, it is determined as congestion etc. when vehicle location is trapped in average time in certain section more than certain threshold value,
Comparison of this technology in each map software is more;In preferred embodiment, each metropolitan city can be directly invoked
The data of monitoring network can directly judge the jam situation of present road by image recognition in each section monitoring.Here every
It is two dimension or three dimensional virtual models for separating opposite track, such as guardrail, hard shoulder, greenbelt, double amber lines from model.
Changing display location can generally be selected as widening the position in a track, and certainly although opposite direction track is to narrow, but red waiting
This direction of green light has had more a track and has been lined up, and can effectively reduce the queues of stationary traffic length of traffic congestion, permits when that can enter crossing
Many troops enter crossing simultaneously, can also increase the through-flow upper limit in the section, to which gathering around for current road segment be effectively relieved
Stifled problem.
Administration of highways is carried out by changing the display location of virtual isolation model in new method, but if is changed
The generation that may result in very much driving accident suddenly, in order to avoid the means that this problem can carry out be exactly can be with friendship
Ventilating signal lamp links, when the straight trip in other tracks, left turning vehicle all cannot be introduced into this section by traffic lights limitation
The variation for carrying out isolation model display location, the problem of bringing so in fact, are turned right when cannot be limited in variation display location
Vehicle enters the crossing, therefore can also carry out step, carries out virtual warning mark and shows, prompts the opposite track for needing to change
Middle vehicle is avoided, and step can also be detected, and whether detect in the track that may be changed has vehicle, and detection here may
The track of variation includes the track of one fixed width, further includes the limitation in certain length.100 meters of long sections can be divided into
10 sections, the track that may be changed is bicycle road width, then whether has vehicle in the long default section of 10 meters of bicycle road of detection every time,
If not provided, just carry out step, change the isolation model display location of this 10 meters long way sections so that enter crossing to vehicle
Road number becomes more.Or inverse operation changes the display location of isolation model when road not congestion so that enters the vehicle at crossing
Road number tails off.The way section for detecting next 10 meters again steps be repeated alternatively until that the isolation model in all default sections can
Access the change of display location.
Therefore, in comprehensive stronger embodiment, our scheme includes step as shown in Figure 5, and S500 is to difference
The jam situation of road, virtual mixed model show that content is recorded, and specifically include time that congestion starts and congestion terminates
Time, virtual mixed model shows the duration of different content, presses the congestion information on week, date, chronological classification respectively
Statistical result, according to the congestion information statistical result, when determining the adjustment of optimal isolation model display location of different sections of highway
Section.In common embodiment, the statistical result can be analyzed, such as to time that congestion in different sections of highway starts
And the end time determines the optimal correction period using mean value, to change the display location of isolation model in the congestion period,
To widen road surface etc..In specific some other embodiment, also carries out step S502 and build deep learning neural network, institute
Whether the input layer for stating deep learning neural network includes the date, week, the moment, is festivals or holidays, road congestion conditions, output layer
The display content of display location information, virtual mixed model including virtual mixed model can be carried out according to the statistical result
Training, can finally obtain the deep learning after the training according to time and the virtual mixed display content of condition of road surface adjust automatically
Neural network.S504 uses the deep learning neural network after training, each predetermined time collect it is current when
Between date, road congestion conditions, predetermined time that neural network just can be optimized needs virtual mixed model to be shown
Information.Certainly in the scope that can be not limited only to isolation model and show handled using neural network, all virtual mixing
Display, the variation of model, can be completed by neural network.Solves the virtual mixing of intelligent optimization through the above scheme
The problem of model is shown.
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that process, method, article or terminal device including a series of elements include not only those
Element, but also include other elements that are not explicitly listed, or further include for this process, method, article or end
The intrinsic element of end equipment.In the absence of more restrictions, being limited by sentence " including ... " or " including ... "
Element, it is not excluded that there is also other elements in process, method, article or the terminal device including the element.This
Outside, herein, " being more than ", " being less than ", " being more than " etc. are interpreted as not including this number;" more than ", " following ", " within " etc. understandings
It includes this number to be.
It should be understood by those skilled in the art that, the various embodiments described above can be provided as method, apparatus or computer program production
Product.Complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in these embodiments
Form.All or part of step in the method that the various embodiments described above are related to can be instructed by program relevant hardware come
It completes, the program can be stored in the storage medium that computer equipment can be read, for executing the various embodiments described above side
All or part of step described in method.The computer equipment, including but not limited to:Personal computer, server, general-purpose computations
It is machine, special purpose computer, the network equipment, embedded device, programmable device, intelligent mobile terminal, smart home device, wearable
Smart machine, vehicle intelligent equipment etc.;The storage medium, including but not limited to:RAM, ROM, magnetic disc, tape, CD, sudden strain of a muscle
It deposits, USB flash disk, mobile hard disk, storage card, memory stick, webserver storage, network cloud storage etc..
The various embodiments described above are with reference to method, equipment (system) and the computer program product according to embodiment
Flowchart and/or the block diagram describes.It should be understood that can be realized by computer program instructions every in flowchart and/or the block diagram
The combination of flow and/or box in one flow and/or box and flowchart and/or the block diagram.These computers can be provided
Program instruction is to the processor of computer equipment to generate a machine so that the finger executed by the processor of computer equipment
It enables and generates to specify in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
The device of function.
These computer program instructions, which may also be stored in, can guide computer equipment computer operate in a specific manner to set
In standby readable memory so that the instruction generation being stored in the computer equipment readable memory includes the manufacture of command device
Product, command device realization refer in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
Fixed function.
These computer program instructions can be also loaded on computer equipment so that be executed on a computing device a series of
To generate computer implemented processing, the instruction to execute on a computing device is provided for realizing in flow operating procedure
The step of function of being specified in one flow of figure or multiple flows and/or one box of block diagram or multiple boxes.
Although the various embodiments described above are described, once a person skilled in the art knows basic wounds
The property made concept, then additional changes and modifications can be made to these embodiments, so example the above is only the implementation of the present invention,
It is not intended to limit the scope of patent protection of the present invention, it is every to utilize equivalent structure made by description of the invention and accompanying drawing content
Or equivalent process transformation, it is applied directly or indirectly in other relevant technical fields, the patent for being similarly included in the present invention
Within protection domain.
Claims (6)
1. a kind of mixed reality road display method, which is characterized in that include the following steps, vehicle-mounted end receives relay storage
Virtual mixed model information or realistic space model information;Position of the positioning vehicle in realistic space model;It is described virtual
Mixed model further includes coordinate information of the virtual mixed model in realistic space model, and according to coordinate information, coordinates computed becomes
The real-time relative position for getting out virtual mixed model and vehicle in return is shown in the display equipment of vehicle end according to relative position
The virtual mixed model.
2. mixed reality road display method according to claim 1, which is characterized in that further include step, vehicle-mounted end hair
Send data requesting instructions;Relay receive data requesting instructions, and according to request instruction return realistic space model information or
Virtual mixed model information.
3. mixed reality road display method according to claim 1, which is characterized in that further include step, scan module
Realistic space is scanned, realistic space model is established, it will be in scanning result storage to relay.
4. mixed reality road display method according to claim 3, which is characterized in that described to establish realistic space model
Specifically, building realistic space model in pre-set space range size, the realistic space model of different spaces is sent to correspondence
Relay stored.
5. according to right in requiring the mixed reality road display method described in 1, which is characterized in that the virtual mixed of specific road section
Model information is closed into edlin, includes on section need model to be shown, display time, the shape of model, size, model
The content of display or the coordinate information of model;The virtual mixed model information editted is sent to relay.
6. mixed reality road display method according to claim 1, which is characterized in that further include step, receive road conditions
Information carries out processing judgement according to traffic information and virtual mixed model information, sends out the control instruction of road driving to vehicle.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810484958.0A CN108711298B (en) | 2018-05-20 | 2018-05-20 | Mixed reality road display method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810484958.0A CN108711298B (en) | 2018-05-20 | 2018-05-20 | Mixed reality road display method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108711298A true CN108711298A (en) | 2018-10-26 |
CN108711298B CN108711298B (en) | 2022-06-17 |
Family
ID=63868245
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810484958.0A Active CN108711298B (en) | 2018-05-20 | 2018-05-20 | Mixed reality road display method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108711298B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110070788A (en) * | 2019-03-18 | 2019-07-30 | 叶哲伟 | A kind of human body 3D meridian point method for visualizing based on mixed reality |
CN112989900A (en) * | 2019-12-13 | 2021-06-18 | 深动科技(北京)有限公司 | Method for accurately detecting traffic signs or marking lines |
WO2021197189A1 (en) * | 2020-03-31 | 2021-10-07 | 深圳光峰科技股份有限公司 | Augmented reality-based information display method, system and apparatus, and projection device |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103489314A (en) * | 2013-09-25 | 2014-01-01 | 广东欧珀移动通信有限公司 | Method and device for displaying real-time road conditions |
US20160019786A1 (en) * | 2014-07-17 | 2016-01-21 | Thinkware Corporation | System and method for providing augmented reality notification |
CN105513391A (en) * | 2016-01-19 | 2016-04-20 | 吉林大学 | Vehicle-mounted virtual road state display system based on vehicle infrastructure cooperative technology |
CN106652437A (en) * | 2017-03-05 | 2017-05-10 | 赵莉莉 | Comprehensive real-time command intelligent traffic management and control system |
CN107316489A (en) * | 2017-08-17 | 2017-11-03 | 戴姆勒股份公司 | Vehicle interactive information shows system and method |
US20180061242A1 (en) * | 2016-08-24 | 2018-03-01 | Uber Technologies, Inc. | Hybrid trip planning for autonomous vehicles |
-
2018
- 2018-05-20 CN CN201810484958.0A patent/CN108711298B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103489314A (en) * | 2013-09-25 | 2014-01-01 | 广东欧珀移动通信有限公司 | Method and device for displaying real-time road conditions |
US20160019786A1 (en) * | 2014-07-17 | 2016-01-21 | Thinkware Corporation | System and method for providing augmented reality notification |
CN105280006A (en) * | 2014-07-17 | 2016-01-27 | 星克跃尔株式会社 | System and method for providing augmented reality notification |
CN105513391A (en) * | 2016-01-19 | 2016-04-20 | 吉林大学 | Vehicle-mounted virtual road state display system based on vehicle infrastructure cooperative technology |
US20180061242A1 (en) * | 2016-08-24 | 2018-03-01 | Uber Technologies, Inc. | Hybrid trip planning for autonomous vehicles |
CN106652437A (en) * | 2017-03-05 | 2017-05-10 | 赵莉莉 | Comprehensive real-time command intelligent traffic management and control system |
CN107316489A (en) * | 2017-08-17 | 2017-11-03 | 戴姆勒股份公司 | Vehicle interactive information shows system and method |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110070788A (en) * | 2019-03-18 | 2019-07-30 | 叶哲伟 | A kind of human body 3D meridian point method for visualizing based on mixed reality |
CN112989900A (en) * | 2019-12-13 | 2021-06-18 | 深动科技(北京)有限公司 | Method for accurately detecting traffic signs or marking lines |
WO2021197189A1 (en) * | 2020-03-31 | 2021-10-07 | 深圳光峰科技股份有限公司 | Augmented reality-based information display method, system and apparatus, and projection device |
Also Published As
Publication number | Publication date |
---|---|
CN108711298B (en) | 2022-06-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108520635A (en) | A kind of mixed reality road display system | |
US11640174B2 (en) | Smart vehicle | |
US10816993B1 (en) | Smart vehicle | |
US10928830B1 (en) | Smart vehicle | |
EP4152204A1 (en) | Lane line detection method, and related apparatus | |
CN108665556A (en) | A kind of road administration instruction display methods and storage medium based on mixed reality | |
CN111874006B (en) | Route planning processing method and device | |
WO2022141910A1 (en) | Vehicle-road laser radar point cloud dynamic segmentation and fusion method based on driving safety risk field | |
CN107730903A (en) | Parking offense and the car vision detection system that casts anchor based on depth convolutional neural networks | |
CN108711298A (en) | A kind of mixed reality road display method | |
CN109115237A (en) | A kind of position recommended method and server of riding | |
CN114821507A (en) | Multi-sensor fusion vehicle-road cooperative sensing method for automatic driving | |
CN114492022A (en) | Road condition sensing data processing method, device, equipment, program and storage medium | |
CN108648480A (en) | A kind of road isolation model display methods and storage medium based on mixed reality | |
CN111951548A (en) | Vehicle driving risk determination method, device, system and medium | |
CN117011413B (en) | Road image reconstruction method, device, computer equipment and storage medium | |
CN110675476A (en) | Method and device for visually conveying definition of automatic driving scene | |
CN111583584B (en) | Intelligent walking stick safety warning system, warning method and intelligent walking stick | |
CN116597690B (en) | Highway test scene generation method, equipment and medium for intelligent network-connected automobile | |
US11465620B1 (en) | Lane generation | |
CN116295336A (en) | Construction method, device, equipment and storage medium of map hierarchical structure | |
CN108765580A (en) | A kind of mixed reality road display optimization method and storage medium | |
Shan et al. | Vehicle collision risk estimation based on RGB-D camera for urban road | |
CN109683613A (en) | It is a kind of for determining the method and apparatus of the ancillary control information of vehicle | |
Yao et al. | Lane marking detection algorithm based on high‐precision map and multisensor fusion |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20220525 Address after: Room 301, floor 3, building 19, No. 18, anningzhuang East Road, Qinghe, Haidian District, Beijing 100080 Applicant after: Beijing Xinyang Haohai Technology Co.,Ltd. Address before: 350200 shop 6-4, hangbin garden, Wuhang street, Changle City, Fuzhou City, Fujian Province Applicant before: FUZHOU JIHUALYU NETWORK TECHNOLOGY CO.,LTD. |
|
GR01 | Patent grant | ||
GR01 | Patent grant |