CN108648480B - Road isolation model display method based on mixed reality and storage medium - Google Patents

Road isolation model display method based on mixed reality and storage medium Download PDF

Info

Publication number
CN108648480B
CN108648480B CN201810484961.2A CN201810484961A CN108648480B CN 108648480 B CN108648480 B CN 108648480B CN 201810484961 A CN201810484961 A CN 201810484961A CN 108648480 B CN108648480 B CN 108648480B
Authority
CN
China
Prior art keywords
road
virtual
display
model
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810484961.2A
Other languages
Chinese (zh)
Other versions
CN108648480A (en
Inventor
陈明强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhongjiasheng Construction Co ltd
Original Assignee
Zhongjiasheng Construction Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhongjiasheng Construction Co ltd filed Critical Zhongjiasheng Construction Co ltd
Priority to CN201810484961.2A priority Critical patent/CN108648480B/en
Publication of CN108648480A publication Critical patent/CN108648480A/en
Application granted granted Critical
Publication of CN108648480B publication Critical patent/CN108648480B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096708Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control
    • G08G1/096725Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control where the received information generates an automatic action on the vehicle control
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0968Systems involving transmission of navigation instructions to the vehicle
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Atmospheric Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A road isolation model display method based on mixed reality and a storage medium are provided, wherein the method comprises the following steps of changing the display position of an isolation model in virtual mixed model information when congestion at an intersection of a current road section is detected, and widening the road width in the direction of entering the intersection. The isolation model display position can be adjusted based on real-time road conditions or congestion conditions of the road, so that the problem of traffic congestion is solved.

Description

Road isolation model display method based on mixed reality and storage medium
Technical Field
The invention relates to the field of mixed reality, in particular to the field of road indicator sign display applying mixed reality.
Background
Mixed Reality (MR), which includes both augmented reality and augmented virtual, refers to a new visualization environment created by the merging of real and virtual worlds. Physical and digital objects coexist in the new visualization environment and interact in real time. The system is generally characterized in that:
it combines virtual and reality; projecting a virtual in a real three-dimensional space; and (4) running in real time.
The implementation of Mixed Reality (MR) requires an environment in which real-world objects can interact with each other. It is the domain of VR if everything is virtual. If the displayed virtual information can only be simply superposed on the real things, the AR is the virtual reality (AR). The key point of MR is the interaction with the real world and the timely acquisition of information.
In the existing road driving environment, the isolation belt needs to be pulled up, the guideboard needs to be established, the lane paint needs to be brushed and the like, resources are wasted, if the virtual display of the road traffic facilities can be achieved through the existing computer-aided display technology, a large amount of physical cost can be saved, and the road indication mark which is displayed virtually can not be damaged even if being 'hit' by a vehicle, so that the safety of the driving environment is improved.
When traffic jam occurs, long dragons are often arranged at the intersection, and the smoothness of road traffic is seriously influenced.
Disclosure of Invention
Therefore, a method for adjusting the display position of the isolation model based on the real-time road conditions or the congestion condition of the road so as to solve the problem of traffic congestion needs to be provided.
In order to achieve the above object, the inventor provides a road isolation model display method based on mixed reality, which includes the following steps that when congestion at an intersection of a current road section is detected, the display position of an isolation model in virtual mixed model information is changed, and the road width in the direction of entering the intersection is widened.
Specifically, the method further comprises the step of displaying a virtual warning sign, wherein the virtual warning sign is displayed on one side of the movement tendency of the road isolation model to be changed.
Further, a detection step is carried out, whether vehicles exist in the road section to be changed is detected, and if the detection result is negative, the step is carried out, and the display position of the isolation model of the road section is changed.
Specifically, the road section to be changed is divided into a plurality of road sections with equal length, when virtual mixed model display is needed, whether vehicles exist in different road sections or not is judged in sequence, and when the virtual mixed model display is not needed, the display position of an isolation model corresponding to the road section is changed.
A road isolation model display storage medium based on mixed reality stores a computer program which, when executed, executes a step including changing a display position of an isolation model in virtual mixed model information to widen a road width in an intersection entering direction when congestion at an intersection of a current road section is detected.
Specifically, the computer program further executes a step of performing virtual warning sign display when being executed, the virtual warning sign being displayed on a side of a movement tendency of the road isolation model to be changed.
Further, the computer program, when executed, further performs a step of detecting whether or not there is a vehicle in the road section to be changed, and if not, performs the step of changing the display position of the isolation model in the road section.
Specifically, the computer program further executes a step of dividing the road section to be changed into a plurality of road sections with equal length when the computer program is executed, sequentially judging whether vehicles exist in different road sections when virtual hybrid model display is required, and changing the display position of the isolation model corresponding to the road section when the computer program is judged not to exist.
Different from the prior art, the technical scheme realizes the display of the virtual isolation model by using the mixed reality technology, and actively widens the road width of the road entering the intersection direction when the traffic jam of the road needs to be dredged, thereby improving the traffic evacuation speed and solving the problem of road jam.
Drawings
Fig. 1 is a flowchart of a road administration instruction display method according to an embodiment of the present invention;
FIG. 2 is a block diagram of a mixed reality roadway display system according to an embodiment of the present invention;
FIG. 3 is a flowchart of a mixed reality road display method according to an embodiment of the invention;
FIG. 4 is a flowchart of an isolation model display method according to an embodiment of the present invention;
fig. 5 is a flowchart of a road display optimization method according to an embodiment of the present invention.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Please refer to fig. 1, which is a schematic diagram illustrating a mixed reality indication display method according to the present invention, the method can be used in any situation of road traffic, and whether it is an urban road, an off-highway, an expressway, etc., the method can be used to display the road administration indication information and the actual road conditions in a mixed manner. It can be seen from the figure that the method of the present invention includes the following steps, that is, S100 establishes three-dimensional model information scanned in real space, that is, it is necessary to be able to pre-datalize the current real space environment, which is a conventional step that is required to be completed in general mixed reality, and is beneficial to accurately mixing subsequent virtual information and real information. The real space model information is established, so that the display of the subsequent virtual road mixed information can be more accurate. However, in the prior art, there are few examples in which a hybrid display can be performed in an open space, which requires a large memory, but it is not yet overcome, and in an application scenario of an intersection, an area within a certain range near the intersection may be modeled as a limited space, so in an embodiment of the present invention, a step is performed in which the display device receives a real space model in S102, and then, the method of the present invention further includes a step in which the display device receives virtual road hybrid information in S104, and loads the virtual road hybrid information. The display device is an electronic device capable of allowing light generated or reflected by a real object to pass through, and generating a virtual and auxiliary light signal (whether a display screen is used as a medium or direct retina projection imaging) capable of being received by a retina, and is generally head-mounted, and in a preferred embodiment, the display device can be even realized by a windshield of a vehicle, and the like. This does not exclude AR technology and AR devices that simply perform the display of virtual models, but to date AR and MR have not a well-defined distinction, even the difference in "claimed" effect between different companies. In the scheme, the effect of mixing and displaying the virtual road mixed information and the real space model information is only required to be finally achieved. The virtual road mixing information here includes virtual mixing model information and coordinate information; the virtual mixed model information is a plurality of luminous points, and the pixel points represent two-dimensional mixed information in a two-dimensional plane or three-dimensional mixed information with a certain space structure in a virtual space. The virtual hybrid model can be used for road traffic indication, for example, the virtual hybrid model can be a two-dimensional picture such as a road sign, a traffic sign, a lane line on the ground, a straight/turning sign symbol, and the like. And also can be three-dimensional models such as guardrails, isolation belts, triangular cones, safety islands and the like. The coordinate information, i.e., the position information of these virtual hybrid models with respect to the aforementioned real space model, may be the position information of the light points in all models, or may be the coordinate information of the feature points in different models. Through the hybrid display of the virtual hybrid model information and the real space model, the method comprises the steps of calculating the relative position of the virtual hybrid model and the display equipment, and displaying the virtual hybrid model at the relative position. Through the steps, the user can see the virtually generated road traffic indication mark through the mixed reality display equipment under the road traffic situation, the cost of the entity road mark can be saved, and the safety of the road traffic is improved. In addition, more importantly, when the road traffic indicator of the partial road section needs to be changed, only the virtual model needs to be edited or replaced and displayed on the computer, so that the scheme further comprises the steps of S106 receiving the first virtual road mixing information, S108 receiving the second virtual road mixing information, S108 receiving a display switching instruction of the virtual road mixing information, and S110 replacing the originally displayed first virtual road mixing information with the second virtual road mixing information for displaying after receiving the display switching instruction. If the virtual traffic lane at the leftmost side of a certain intersection indicates a turning lane, when the virtual traffic lane needs to be changed into a left-turn lane, people do not need to be dispatched to paint again, and the two-dimensional mixed information is directly adjusted to be the road indication for displaying the left-turn lane. The user can easily see the new identification through the display device, and meanwhile, the problem that the existing entity indication is easy to fade over the years is solved. Moreover, all the signs related to the existing road administration can be replaced and displayed according to the requirements, not only can the changed traffic lights be displayed, but also the traffic lanes closed in time limit, the road boards forbidden to pass and the like can be displayed.
In order to be able to use the new mixed reality display method of road indication in larger areas, we have also designed a new system. As shown in fig. 2, this system includes a vehicle-mounted terminal 20, and a relay station 22 disposed along a road, which may be a roadside, a road surface, a roadbed, or the like. The relay station is used for storing the real space model information of part of the road sections and is also used for storing the virtual mixed model information of part of the road sections. The partial road sections are used for generally conveniently positioning the display equipment 200 at the vehicle-mounted end, the position of the display equipment is positioned in the real space model, the virtual hybrid model also comprises coordinate information in the real space model, and therefore the real-time relative position of the virtual hybrid model and the display equipment is obtained through calculating coordinate transformation, and smooth display can be achieved. Therefore, in some embodiments, the real-space model and the virtual hybrid model may be packaged and stored, and when communication with the display device is required, for example, after the relay station receives a data request instruction from the display device, the packaged data is transmitted to the vehicle-mounted terminal together, or the real-space model information and the virtual hybrid model are transmitted separately, so that the method is practical in a situation where the virtual hybrid model needs to be changed frequently. The design of the relay station can solve the requirement of mixed display of the road traffic indication signs in a large-scale space.
In this system, still include scanning module 202, scanning module is used for scanning the real space, establishes the real space model, and saves, and scanning module can gather and construct the data ization information to the real space model, and scanning module can set up along the road, or can save the scanning result in the relay station along with the collocation setting of relay station, and such scanning result will have certain limitation. In a preferred embodiment, as shown in fig. 2, the scanning module 202 is disposed at a vehicle-mounted end, and scans road condition information in real time during a vehicle driving process, constructs a real space model in a form of dividing a real space into road segment blocks, and sends the real space model to the relay stations 22 corresponding to different road segments for storage. The technology of modeling the space in the vehicle-mounted scanning mode is mature. The accuracy of modeling of the road related area can be further improved by performing real-time block scanning through the moving vehicle end.
As can be seen from fig. 2, the mixed reality display system further includes a display device at the vehicle-mounted end, which is an electronic device capable of allowing light generated or reflected by a real object to pass through, and generating a virtual, or auxiliary, display optical signal (whether requiring a display screen as a medium or direct retinal projection imaging) that can be received by the retina, and is generally head-mounted, and in a preferred embodiment, may even be implemented as a windshield of a vehicle. The display device may be configured to perform the steps of receiving the real space model, receiving the virtual road blending information, loading the virtual road blending information, and displaying the virtual road blending information. Through the system, the mixed reality display system achieves the effect of displaying the virtual traffic indication sign, solves the problems that in the prior art, the physical road guardrail, the isolation belt and the like are damaged by vehicles and people are killed once being collided, and are too dangerous, can be recovered even if the isolation fence is accidentally collided after the virtual display is changed, and a driver only needs to go back to the god and then turns back to the steering wheel to drive the vehicle to the correct road. The virtual road traffic sign has the advantages that the sign can be changed conveniently, cost is saved, replacement is easy, and maintenance is convenient.
In order to better achieve the management of the road traffic indicator, the system further includes a server 24, which includes an editing module 240 and a communication module 242, where the editing module is used to edit the virtual mixed model information of a certain road segment, the edited content may include models to be displayed on the road segment, display time, shapes and sizes of the models, content displayed on the models, coordinate information of the models, and the like, and a user can select, modify, add, delete, color, and other various editing functions on the content on the server for the virtual mixed model information of a specific road segment. And finally, the server sends the edited virtual mixed model information to a relay station through a communication module, and the information is sent to the vehicle by the relay station or directly sent to a vehicle-mounted end through a mobile communication network. In a specific embodiment, a lane at a crossing is a bus lane at a time limit, and yellow solid lines are displayed on the display device from 11 to 13 at noon and from 17 to 19 at evening, and white solid lines are displayed in the rest of time periods. On the road traffic sign of a certain road section, the road traffic sign is a one-way road in a certain time, and is a pedestrian street where motor vehicles are forbidden to enter in other times such as holidays, and the like. The system can be flexibly set according to the needs of city managers, police force on-duty scheduling needs to be sent out in the past, and the problem of human resource consumption can be solved after the system is applied.
In order to further improve the practicability of the mixed reality display system, a vehicle end can be designed and integrated with a unmanned navigation module 204, and the unmanned navigation module is used for receiving road condition information, processing and judging and sending a control instruction for road running to a vehicle. The above functions can be achieved well according to the prior art, and there are no differences in logic of processing judgment, such as Google X of Google corporation, and unmanned AI of companies such as hundredths, UBER, and the like. The system has the advantages that the unmanned navigation module can receive the virtual mixed model information and also can be used as input of a part of road condition information, the existing road condition information generally identifies emergency situations in actual road conditions through optical identification, radar scanning and the like to carry out driving navigation, and scanning results of the actual road conditions need to be digitalized so as to be processed and judged. In the embodiment of the invention, after receiving the virtual mixed model information, the vehicle-mounted end sends the virtual mixed model information to the unmanned navigation module, and the unmanned navigation module judges the position, the size, the color, the characters and the like of the virtual mixed model as road condition information, so that a control instruction of road driving is sent to the vehicle. Thus, when a human driver with a display device and an unmanned vehicle exist on the road at the same time, the human driver and the unmanned vehicle can 'see' the same road condition and road traffic indication signs, and further traffic accidents caused by poor information are avoided.
Corresponding to the system in fig. 2, we will also introduce a mixed reality road display method, as shown in fig. 3, which further includes the steps of S302, receiving virtual mixed model information or real space model information stored in the relay station by the vehicle-mounted end; locating a position of the vehicle in the real space model; the virtual hybrid model further includes coordinate information of the virtual hybrid model in the real space model, and according to the coordinate information, the real-time relative position of the virtual hybrid model and the vehicle is obtained through calculating coordinate transformation in S304, and the virtual hybrid model is displayed in the display device at the vehicle end according to the relative position. By the method, the requirement of mixed display of the road traffic indicator in a large-scale space can be met, and the vehicle can refer to mixed reality display anytime and anywhere.
In a specific embodiment, the method further comprises the steps that the vehicle-mounted end sends a data request instruction; and the relay station receives the data request instruction and returns the real space model information or the virtual mixed model information according to the request instruction. The above steps are to realize the transmission and sharing between the storage content of the relay station and the vehicle-mounted terminal, so that the vehicle can always know the specific situation of the road ahead or the road section where the vehicle is located in the driving process, the communication modes between the vehicle-mounted terminal and the relay station can be various, and the communication modes can be freely selected according to the existing communication technology. However, it is not necessary for the vehicle-mounted terminal to send a data request instruction, and the same effect can be achieved if the relay station always broadcasts the real space model information or the virtual hybrid model information to the outside.
In other embodiments, the method further includes the step of the scanning module scanning the real space, establishing a real space model, and storing the scanning result in the relay station. The accuracy of modeling of the road related area can be further improved by performing real-time block scanning through the moving vehicle end. In a preferred embodiment, the real space model may be built within a preset space range, and the real space models in different spaces are sent to the corresponding relay stations for storage after being built.
In order to better provide different virtual mixed model information for displaying, before the relay station transmits the mixed model or the real space model, the method further comprises the step S300 of editing the virtual mixed model information of a specific road section, wherein the virtual mixed model information comprises the model to be displayed on the road section, the display time, the shape and the size of the model, the content displayed on the model or the coordinate information of the model; and sending the edited virtual mixed model information to a relay station. The editing content may include models to be displayed at the road segment, display time, shapes and sizes of the models, contents displayed on the models, coordinate information of the models, and the like, and the user can select, modify, add, delete, color, and the like, the virtual mixture model information of a specific road segment on the server. Through artificial design, the labor cost can be saved better, and the emergency response level to the road administration facilities is improved.
In a further embodiment, the method further comprises the steps that the unmanned navigation module at the vehicle-mounted end receives the road condition information, processing and judging are carried out according to the road condition information and the virtual mixed model information, the unmanned navigation module needs to regard all the virtual mixed model information as existing physical entities, and a control instruction of road driving is sent to the vehicle based on the logic. The adaptability of the method in the field of unmanned driving can be further improved by processing and responding the virtual mixed model information as road condition information.
In some more progressive examples we will see how to solve the problem of road congestion by a new virtual hybrid model.
Let us imagine a scenario, a direction vehicle entering a traffic light intersection has already arranged a long dragon, but the opposite lane of the road is empty, which is very common in modern cities, the number of passing lanes at the intersection represents the upper limit of the through-flow of the road section, and in a specific time period, the number of vehicles entering the road section is higher than the number of vehicles leaving, which naturally causes congestion, so in our scheme, as shown in fig. 4, the method includes steps, S400, when detecting congestion at the intersection of the current road section, performs steps, changes the display position of the isolation model in the virtual mixed model information, and widens the road width entering the intersection direction. The method for detecting whether congestion occurs can use the prior art for reference, for example, the method judges whether congestion occurs through traffic flow detection and a threshold value; or receiving vehicle positioning, and judging congestion when the average time of the vehicle positioning trapped in a certain road section exceeds a certain threshold value, wherein the technology is used in map software of various regions; in a more preferable embodiment, the data of the city monitoring networks of the large cities can be directly called, and the congestion condition of the current road can be directly judged through image recognition in the monitoring of each road section. The isolation model is a two-dimensional or three-dimensional virtual model for separating opposite lanes, such as a guardrail, an isolation pier, a green belt, a double yellow line and the like. The display position can be changed to be a position for widening one lane, although the opposite lane is narrowed, one more lane is arranged in the same direction of the traffic lights, the length of the traffic jam can be effectively reduced, when the traffic jam can enter the intersection, more lanes are allowed to enter the intersection at the same time, the upper limit of the through flow of the road section can be increased, and therefore the problem of the congestion of the current road section can be effectively relieved.
The new method is to change the display position of the virtual isolation model for road administration, but if the change is too sudden, driving accidents may occur, and a means for avoiding the problem is to link with traffic lights, when the straight-going vehicles and the left-turning vehicles on other lanes are limited by the traffic lights and can not enter the road section, the display position of the isolation model is changed, in fact this may cause a problem in that the right-turn vehicle cannot be restricted from entering the intersection when the display position is changed, therefore, the steps of displaying a virtual warning sign to prompt the driver to avoid the vehicle in the lane to be changed, detecting whether the vehicle is in the lane which may change or not, the lanes where possible changes are detected include lanes of a certain width and also include limits within a certain length. That is, a road section with a length of 100 meters can be divided into 10 sections, and a lane which may change is a single lane width, and if it is detected that there is a vehicle in a preset road section with a length of 10 meters of a single lane, the step is performed to change the display position of the isolation model of the road section with a length of 10 meters, so that the number of lanes entering the intersection is increased. Or when the road is not congested, the display position of the isolation model is changed by reverse operation, so that the number of lanes entering the intersection is reduced. And detecting the next road section of 10 meters, and repeating the steps until the isolation models in all the preset road sections can obtain the change of the display position.
Therefore, in a more comprehensive embodiment, our scheme includes the steps as shown in fig. 5, S500 records congestion conditions of different roads and virtual hybrid model display contents, specifically including a time when congestion starts and a time when congestion ends, duration of displaying different contents by the virtual hybrid model, congestion information statistics results classified according to week, date and time, respectively, and an adjustment period of an optimal isolation model display position of different road segments is determined according to the congestion information statistics results. In a general embodiment, the statistical result may be analyzed, for example, an average value of the time when the congestion starts and the time when the congestion ends in different road segments is used to determine an optimal adjustment time period, so that the display position of the isolation model is changed in the congestion time period, thereby widening the road surface, and the like. In some specific other embodiments, step S502 is further performed to construct a deep learning neural network, where an input layer of the deep learning neural network includes a date, a week, a time, whether the input layer is a holiday or not, and a road congestion condition, and an output layer includes display position information of the virtual hybrid model, and display content of the virtual hybrid model may be trained according to the statistical result, so that a trained deep learning neural network that automatically adjusts the virtual hybrid display content according to the time and the road condition can be finally obtained. S504, the trained deep learning neural network is used, the current time and date and the road congestion condition are collected at each preset time, and the neural network can obtain the virtual mixed model information which needs to be displayed at the optimized preset time. Of course, the application of the neural network for processing is not limited to the scope of isolated model display, and all the display and change of the virtual hybrid model can be completed through the neural network. The problem of intelligent optimization virtual hybrid model display is solved through the scheme.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrases "comprising … …" or "comprising … …" does not exclude the presence of additional elements in a process, method, article, or terminal that comprises the element. Further, herein, "greater than," "less than," "more than," and the like are understood to exclude the present numbers; the terms "above", "below", "within" and the like are to be understood as including the present number.
As will be appreciated by one of skill in the art, the various embodiments described above may be provided as a method, apparatus, or computer program product. These embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. All or part of the steps in the methods according to the embodiments may be implemented by a program instructing associated hardware, where the program may be stored in a storage medium readable by a computer device and used to execute all or part of the steps in the methods according to the embodiments. The computer device includes but is not limited to: personal computers, servers, general-purpose computers, special-purpose computers, network devices, embedded devices, programmable devices, intelligent mobile terminals, intelligent home devices, wearable intelligent devices, vehicle-mounted intelligent devices, and the like; the storage medium includes but is not limited to: RAM, ROM, magnetic disk, magnetic tape, optical disk, flash memory, U disk, removable hard disk, memory card, memory stick, network server storage, network cloud storage, etc.
The various embodiments described above are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a computer apparatus to produce a machine, such that the instructions, which execute via the processor of the computer apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer apparatus to cause a series of operational steps to be performed on the computer apparatus to produce a computer implemented process such that the instructions which execute on the computer apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Although the embodiments have been described, once the basic inventive concept is obtained, other variations and modifications of these embodiments can be made by those skilled in the art, so that the above embodiments are only examples of the present invention, and not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes using the contents of the present specification and drawings, or any other related technical fields, which are directly or indirectly applied thereto, are included in the scope of the present invention.

Claims (6)

1. A road isolation model display method based on mixed reality is characterized by comprising the following steps of changing the display position of an isolation model in virtual mixed model information when congestion at an intersection of a current road section is detected, widening the road width in the direction of entering the intersection,
the method comprises the steps of dividing a road section to be changed into a plurality of road sections with equal length, judging whether vehicles exist in different road sections or not in sequence when virtual mixed model display is needed, changing the display position of an isolation model corresponding to the road section when the virtual mixed model display is not needed, constructing a deep learning neural network, wherein the input layer of the deep learning neural network comprises the date, the week and the time, whether the road section is a holiday or not and the road congestion condition, the output layer comprises the display position information of the virtual mixed model, the deep learning neural network after training for automatically adjusting the virtual mixed display content according to the time and the road condition is obtained, and the deep learning neural network after training is loaded in the step to obtain the virtual mixed model information needed to be displayed at the preset time.
2. The method according to claim 1, further comprising a step of displaying a virtual warning sign on a side of the movement tendency of the road isolation model to be changed.
3. The mixed reality-based road isolation model display method according to claim 1, further comprising a step of including a server including an editing module that edits the virtual mixed model information of a certain road section, wherein the edited contents include models to be displayed on the road section, display time, and shapes, sizes of the respective models, contents displayed on the models, and coordinate information of the models, and a user can select, modify, add, delete, or color-edit the virtual mixed model information of the specific road section.
4. A road isolation model display storage medium based on mixed reality is characterized in that a computer program is stored, and the computer program is executed when being executed and comprises the following steps of changing the display position of an isolation model in virtual mixed model information when congestion at an intersection of a current road section is detected, widening the road width in the direction of the intersection, dividing the road section to be changed into a plurality of road sections with equal length, sequentially judging whether vehicles exist in different road sections when the virtual mixed model display is needed, changing the display position of the isolation model corresponding to the road section when the virtual mixed model display is not judged, constructing a deep learning neural network, wherein the input layer of the deep learning neural network comprises the date, the week and the time, whether the road section is a holiday and the road condition, and the output layer comprises the display position information of the virtual mixed model, and obtaining the trained deep learning neural network which automatically adjusts the virtual mixed display content according to the time and the road condition And (4) through the network, loading the trained deep learning neural network to obtain the virtual mixed model information required to be displayed at the preset moment.
5. The mixed reality-based road isolation model display storage medium of claim 4, wherein the computer program when executed further performs the step of performing a virtual warning sign display, the virtual warning sign display being displayed on a side of the tendency of the road isolation model to move to be altered.
6. The mixed reality-based road isolation model display storage medium of claim 4, wherein the computer program, when executed, further performs the step of editing the virtual mixed model information of a road segment by an editing module included in the server, wherein the edited content includes models to be displayed on the road segment, display time, and shapes, sizes of the respective models, contents displayed on the models, and coordinate information of the models, and the user can select, modify, add, delete, or color-edit the virtual mixed model information of a specific road segment.
CN201810484961.2A 2018-05-20 2018-05-20 Road isolation model display method based on mixed reality and storage medium Active CN108648480B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810484961.2A CN108648480B (en) 2018-05-20 2018-05-20 Road isolation model display method based on mixed reality and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810484961.2A CN108648480B (en) 2018-05-20 2018-05-20 Road isolation model display method based on mixed reality and storage medium

Publications (2)

Publication Number Publication Date
CN108648480A CN108648480A (en) 2018-10-12
CN108648480B true CN108648480B (en) 2022-09-02

Family

ID=63756913

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810484961.2A Active CN108648480B (en) 2018-05-20 2018-05-20 Road isolation model display method based on mixed reality and storage medium

Country Status (1)

Country Link
CN (1) CN108648480B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109881604B (en) * 2019-02-19 2022-08-09 福州市极化律网络科技有限公司 Mixed reality road isolated column display adjustment system
CN109881605B (en) * 2019-02-19 2022-08-09 福州市极化律网络科技有限公司 Mixed reality road isolated column adjustment vehicle

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140272812A1 (en) * 2013-03-15 2014-09-18 Honda Motor Co., Ltd. Driver training system using heads-up display augmented reality graphics elements
CN104933882A (en) * 2015-05-20 2015-09-23 浙江吉利汽车研究院有限公司 Traffic intersection driving assistance method and system
CN105280006A (en) * 2014-07-17 2016-01-27 星克跃尔株式会社 System and method for providing augmented reality notification
CN106652437A (en) * 2017-03-05 2017-05-10 赵莉莉 Comprehensive real-time command intelligent traffic management and control system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102819954B (en) * 2012-08-28 2014-11-12 南京大学 Traffic region dynamic map monitoring and predicating system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140272812A1 (en) * 2013-03-15 2014-09-18 Honda Motor Co., Ltd. Driver training system using heads-up display augmented reality graphics elements
CN105280006A (en) * 2014-07-17 2016-01-27 星克跃尔株式会社 System and method for providing augmented reality notification
CN104933882A (en) * 2015-05-20 2015-09-23 浙江吉利汽车研究院有限公司 Traffic intersection driving assistance method and system
CN106652437A (en) * 2017-03-05 2017-05-10 赵莉莉 Comprehensive real-time command intelligent traffic management and control system

Also Published As

Publication number Publication date
CN108648480A (en) 2018-10-12

Similar Documents

Publication Publication Date Title
CN108520635B (en) Mixed reality road display system
CN108665556B (en) Road indication display method based on mixed reality and storage medium
US7487074B2 (en) Road traffic simulation apparatus
US11248925B2 (en) Augmented road line detection and display system
CN106960097B (en) Simulation method and system for constructing three-dimensional urban road network and microcosmic traffic flow
EP1569186A1 (en) A road traffic simulation apparatus
DE112014006919T5 (en) A vehicle projection control system and method for controlling image projection
CN108711298B (en) Mixed reality road display method
DE102012214988A1 (en) Advanced reality front and rear seat vehicle gaming system for entertaining and informing passengers
CN112382079B (en) Road side perception analog simulation method and system for vehicle-road cooperation
CN113065685B (en) High-precision map traffic rule model based on automatic driving application scene and implementation method thereof
CN205665896U (en) Intersection signal lamp state recognition device
CN108648480B (en) Road isolation model display method based on mixed reality and storage medium
CN111951548B (en) Vehicle driving risk determination method, device, system and medium
CN104915628A (en) Pedestrian movement prediction method and device by carrying out scene modeling based on vehicle-mounted camera
CN116597690B (en) Highway test scene generation method, equipment and medium for intelligent network-connected automobile
DE112021003339T5 (en) PARKING POINT MANAGEMENT DEVICE, PARKING POINT MANAGEMENT METHOD AND VEHICLE DEVICE
CN115840404B (en) Cloud control automatic driving system based on automatic driving special road network and digital twin map
CN116952278A (en) Simulation test method and system for removing perceived map jitter
CN108765580B (en) Mixed reality road display optimization method and storage medium
DE102021119871B4 (en) Method and processor circuit for operating an automated driving function with an object classifier in a motor vehicle, and motor vehicle
CN109881604B (en) Mixed reality road isolated column display adjustment system
CN109881605B (en) Mixed reality road isolated column adjustment vehicle
CN114820819B (en) Expressway automatic driving method and system
US20220375340A1 (en) Machine-learning based control of traffic operation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220815

Address after: 100043 906-58, floor 9, building 17, yard 30, Shixing street, Shijingshan District, Beijing (cluster registration)

Applicant after: Zhongjiasheng Construction Co.,Ltd.

Address before: Shop 6-4, Hangbin Garden, Wuhang Street, Changle City, Fuzhou City, Fujian Province, 350022

Applicant before: FUZHOU JIHUALYU NETWORK TECHNOLOGY CO.,LTD.

GR01 Patent grant
GR01 Patent grant