CN112013867A - AR navigation pre-display cruise system based on live-action feedback - Google Patents
AR navigation pre-display cruise system based on live-action feedback Download PDFInfo
- Publication number
- CN112013867A CN112013867A CN202010942287.5A CN202010942287A CN112013867A CN 112013867 A CN112013867 A CN 112013867A CN 202010942287 A CN202010942287 A CN 202010942287A CN 112013867 A CN112013867 A CN 112013867A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- live
- mounted end
- action
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/365—Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3635—Guidance using 3D or perspective road maps
- G01C21/3638—Guidance using 3D or perspective road maps including 3D objects and buildings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
Landscapes
- Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Navigation (AREA)
Abstract
The invention discloses an AR navigation pre-display cruise system based on live-action feedback, which comprises an AR server, a vehicle-mounted end and a road live-action map acquisition end, wherein the vehicle-mounted end is connected with the vehicle-mounted end through a communication network; the AR server comprises an AR live-action database, a 5G signal sending and receiving module and an AR live-action map correction module; the vehicle-mounted end comprises a local AR live-action database, a 5G signal sending and receiving module, a vehicle-mounted end processor, a vehicle-mounted end positioning module and a vehicle networking RFID sensing device; the AR live-action image display module comprises a front windshield with a display function, the front windshield has a semitransparent display function, and the searched navigation AR live-action image can be displayed on the windshield. The method and the device have the advantages that cross verification is achieved through the AR live-action map and the plane positioning map, so that more accurate positioning lane information is obtained, positioning accuracy is improved, and the vehicle-mounted end can shoot images and upload the images, so that the map can be updated conveniently.
Description
Technical Field
The invention relates to the technical field of navigation cruise systems, in particular to an AR navigation pre-display cruise system based on live-action feedback.
Background
With the development of electronic technology, people start a faster and more convenient lifestyle. Nowadays, with the development of economy in China, self-driving becomes an increasingly indispensable part in people's life. However, when people drive to a certain destination, the route cannot be known by people due to the large and complicated city or region, which brings inconvenience to life; however, with the development of navigation technology, navigation is performed by using a navigation system so as to inquire a route to a destination, which brings convenience to life of people.
In the prior art, navigation systems include a Baidu map, a Gade map, a 360-degree map, etc., but these navigation maps are presented to users in the form of planar maps, or so-called 3D virtual navigation, but for a plurality of parallel roads, such as increasingly complex bridge roads nowadays, the vehicles may be positioned on other roads due to the difference of positioning accuracy, so that the navigation is failed, and the users may operate by mistake when using the navigation systems, thereby causing accidents.
Therefore, with the increasing complexity of traffic conditions, the conventional navigation technology cannot adapt to the current roads, and for this reason, it is desirable to provide a navigation technology which is more intelligent all the time. At present, the conventional navigation technologies are basically map navigation and map display paths, but the map is not a real scene map at all, so that people with poor map recognition capability need to recognize the map and the real scene by contrast, but for vehicles running on a road, the navigation technology is not convenient enough, so that a driver needs to be distracted, and the driver is possibly dangerous.
On the other hand, with the development of AR (i.e. augmented reality) technology, the application of AR is becoming more and more extensive, wherein AR navigation is one of the main application directions. AR technology makes navigation more intuitive, aiming at using AR navigation to help guide a user to a destination.
However, the conventional navigation is still familiar with, while the 2D navigation provides convenience for people, many unsatisfactory places exist, such as a complex viaduct, a rugged scenic spot road, and numerous shopping malls, and it is not the case that many people miss an intersection and walk wrong shops because of not understanding a navigation prompt, but the AR navigation can reduce the embarrassment to the minimum by virtue of the immersive navigation experience, accurate positioning and humanized intelligent voice broadcast.
For the current navigation, in order to complete perfect navigation, on one hand, high-precision and low-delay navigation and positioning are required, and in addition, live-action navigation is also desired to be provided, so that a live-action image can be directly seen and the live-action navigation is realized.
On the other hand, the fifth Generation mobile communication technology (english: 5th Generation mobile networks or 5th Generation wireless systems, 5th-Generation, 5G for short) is the latest Generation cellular mobile communication technology, wherein the performance goal of 5G is high data rate, delay reduction, energy saving, cost reduction, system capacity improvement and large-scale device connection, the speed is up to 20Gbit/s, and wide channel bandwidth and large capacity MIMO can be realized. Therefore, in order to perform communication quickly for more convenient and quick navigation, a more convenient and quick communication technology is required, which ensures sufficiently low communication delay, and a faster and wider bandwidth is required, so that people stare at the 5G communication technology for this purpose.
On the other hand, in areas such as complex viaducts, rugged scenic spot roads or tunnels and the like, real-scene navigation cannot be realized due to loss of GPS signals, and with the rise of the car networking technology, the technology is applied to car navigation so as to increase the synchronous efficiency and the driving efficiency. Specifically, the internet of vehicles (IOV) refers to a dynamic mobile communication system in which vehicles and public networks communicate with each other by interaction between vehicles, between vehicles and roads, between vehicles and people, between vehicles and sensing devices, and the like. The method has the advantages that the advanced sensing technology, the network technology, the computing technology, the control technology and the intelligent technology are utilized to comprehensively sense roads and traffic, the interaction of large-range and large-capacity data among a plurality of systems is realized, the traffic of each automobile is controlled in the whole process, the traffic of each road is controlled in the whole time and space, and the network and the application which mainly aim at traffic efficiency and traffic safety are provided. The system can realize information sharing through interconnection and intercommunication of vehicles, vehicles and people and vehicles and roads, collect information of vehicles, roads and environments, process, calculate, share and safely release the information collected by multiple sources on an information network platform, effectively guide and supervise the vehicles according to different functional requirements, and provide professional multimedia and mobile internet application services.
From the network perspective, the IOV system is an end-pipe cloud three-layer system. The Internet of vehicles (IOV) can realize an integrated network of intelligent traffic management, intelligent dynamic information service and vehicle control, is a typical application of the technology of the Internet of things in the field of traffic systems, is a necessary way for the mobile Internet and the Internet of things to develop into business essence and depth, and is a convergence technology for the development of information communication, environmental protection, energy conservation, safety and the like in the future.
Meanwhile, in the prior art, the navigation technology basically senses the position of a positioning system and displays the position on a map, thereby realizing navigation on the map; if the photographed live-action can be fed back to the map and displayed, thereby realizing the correction of map navigation, the positioning precision can be inevitably and greatly improved. However, in the prior art, the above-mentioned technology is not available, and therefore it is desirable to provide a navigation technology to solve the above-mentioned problems.
Disclosure of Invention
The present invention is directed to an AR navigation pre-display cruise system based on real-scene feedback, so as to solve the problems mentioned in the background art.
In order to achieve the purpose, the invention provides the following technical scheme: the AR navigation pre-display cruise system based on the live-action feedback comprises an AR server, a vehicle-mounted end and a road live-action map acquisition end;
the AR server comprises an AR live-action database, a 5G signal sending and receiving module and an AR live-action map correction module;
the vehicle-mounted end comprises a local AR live-action database, a 5G signal sending and receiving module, a camera module, an AR live-action image display module, a vehicle-mounted end processor, a vehicle-mounted end positioning module and a vehicle networking RFID sensing device;
the road surface live-action map acquisition end comprises a road surface live-action map acquisition module, a carrier, a local AR live-action database and a carrier RFID sensing device, wherein the carrier is provided with the road surface live-action map acquisition module;
when the vehicle-mounted end is initialized, the 5G signal sending and receiving module of the vehicle-mounted end and the 5G signal sending and receiving module of the AR server end are in communication connection, a communication channel is established, the vehicle-mounted end is in communication with the AR server to confirm that the AR real scene database of the vehicle-mounted end is the latest AR real scene database, and otherwise, the vehicle-mounted end downloads the latest AR real scene database again to update the AR real scene database; the vehicle-mounted end processor is used for matching the image data provided by the camera module between the vehicle-mounted end and the AR real scene database, and combining the matched AR real scene image and the real vehicle data to be provided to the AR real scene image display module for display;
the RFID sensing equipment of the internet of vehicles is used for communication between vehicles or the vehicles are communicated with the road surface real scene map acquisition end;
the road surface real-scene map acquisition end can be in communication connection with the AR server and is used for acquiring a road surface real-scene map and sending the road surface real-scene map to the AR server, and meanwhile, the road surface real-scene map acquisition end can also be in communication connection with a vehicle-mounted end of a vehicle, so that the road surface real-scene map acquisition end and the vehicle can be communicated; in addition, the road surface real-scene map acquisition end and the adjacent road surface real-scene map acquisition end can also be used for communication, or can be used as a relay communication module of a vehicle-mounted end so as to realize the communication between a vehicle and the AR server, specifically, the road surface real-scene map acquisition module is used for acquiring road surface real-scene images and sending the road surface real-scene images to the AR server, and the road surface real-scene map acquisition module is processed by the AR server to form an AR real-scene database; the carrier RFID sensing equipment is used for forming a vehicle network with the adjacent carrier RFID sensing equipment and the vehicle networking RFID sensing equipment at the vehicle-mounted end on the vehicle;
when the vehicle-mounted end processor does not match a proper image in a local AR live-action database of the vehicle-mounted end, starting AI intelligent fuzzy matching for matching to obtain a current actual route and a current actual position, utilizing a camera module to pick up an image to obtain an AR live-action image, and uploading the image to an AR server through a 5G signal sending and receiving module;
when the vehicle-mounted end cannot carry out 5G communication in 5G shielding signal sections such as a tunnel which cannot be covered by a 5G signal of the signal, a shielding garage, a bridge bottom and the like, the vehicle-mounted end carries out relay communication with the carrier RFID sensing equipment through the vehicle networking RFID sensing equipment so as to be convenient for communication with an AR server;
when the vehicle-mounted end cannot carry out 5G communication due to 5G shielding signal sections such as a tunnel which cannot be covered by 5G signals of the signals, a shielding garage, a bridge bottom and the like, the vehicle-mounted end carries out relay communication through the vehicle-mounted network RFID sensing equipment, the vehicle-mounted network RFID sensing equipment of adjacent vehicles and the carrier RFID sensing equipment hybrid network so as to be convenient for communication with an AR server;
the AR real image display module comprises a front windshield with a display function, the front windshield has a semitransparent display function and can display the inquired navigation AR real image on the windshield, and when the contrast between the image seen by the driver through the front windshield and the navigation real image is basically overlapped, the driving route of the driver is correct; and when the contrast difference between the image seen by the driver through the windshield of the vehicle and the navigation live-action image is obvious, the vehicle runs on a wrong road, and the vehicle-mounted end sends out an alarm and newly plans a new navigation route.
Preferably, the street lamp and the mobile vehicle are provided with the carrier RFID sensing equipment and the camera module, and when a road is built and reconstructed, images shot by the camera module can be transmitted to the AR server through a vehicle networking formed by the carrier RFID sensing equipment so as to correct the AR real scene database of the AR server.
Preferably, the vehicle-mounted end is provided with a vehicle-mounted end positioning module, the vehicle-mounted end positioning module acquires the current position of the vehicle, and the vehicle AI intelligent algorithm, the camera module and the AR real scene database are used for matching so as to acquire the actual driving road and route of the vehicle, so as to correct the lane of the road where the vehicle is actually located or the lane of the overpass on which layer. Which can be positioned quickly.
Preferably, the carrier of the road surface real scene map collecting end may be a carrier formed by a mobile vehicle, a street lamp and the like.
In another aspect, the present application further provides an automatic navigation method of an AR navigation pre-display cruise system based on live-action feedback, where the automatic navigation method includes the following steps:
s1, opening a vehicle-mounted end of the AR navigation pre-display cruise system, initializing the vehicle-mounted end, connecting a 5G signal sending and receiving module of the vehicle-mounted end with a 5G signal sending and receiving module of the AR server, finishing the query work of the AR real scene database, ensuring that the AR real scene database of the vehicle-mounted end is the latest database, and downloading the latest AR real scene database from the AR server to update the vehicle-mounted end if the AR real scene database is not the latest database;
s2, prompting a user to input a destination after the vehicle-mounted terminal is initialized, displaying the planned path information and the AR panoramic image after the user inputs the destination, and simultaneously starting the camera to work;
s3, the camera shoots a scene of a vehicle head, AI intelligent matching is carried out on the scene of the vehicle head and data of a local AR live-action database of the vehicle-mounted end, meanwhile, a vehicle-mounted end positioning module of the vehicle-mounted end gives map geographic position data, and an AR live-action map matched with the AI intelligent positioning module through the map position data so as to obtain an AR live-action cruising image of the vehicle, and the vehicle is positioned in a specific lane;
s4, when the map geographical position data given by the vehicle-mounted end positioning module cannot be obtained, acquiring speed data of the vehicle speed sensing module and direction information measured by the acceleration sensor, and further acquiring an AR real-scene cruise chart of the vehicle by using the direction information and the speed data and combining with an AR real-scene chart intelligently matched with AI;
s5, if images of the scene shot by the camera and the data of the local AR live-action database of the vehicle-mounted end cannot be matched, the current live-action is determined to have changed, fuzzy matching needs to be started at the moment, and meanwhile, the AR live-action database of the vehicle-mounted end and the AR live-action image of the server are corrected; specifically, during fuzzy matching, fuzzy matching is performed according to the shot main image point and an image in an AR live-action database near the current map positioning, so as to obtain a lane and a position where the vehicle is actually located, meanwhile, an image acquired by a camera at the vehicle-mounted end and position information acquired by a vehicle-mounted end positioning module at the vehicle-mounted end are transmitted to an AR live-action map correction module of an AR live-action server, the AR live-action map correction module corrects an AR live-action map at a corresponding position, and updates the AR live-action database of the AR live-action server.
Preferably, when the vehicle travels to a tunnel which cannot be covered by a 5G signal, a shielding garage is large, a 5G shielding signal section such as a bridge bottom and the like and cannot carry out 5G communication, the vehicle-mounted end carries out relay communication through the vehicle networking RFID sensing equipment and the vehicle networking RFID sensing equipment of an adjacent vehicle and the carrier RFID sensing equipment hybrid networking so as to communicate with the AR server.
Compared with the prior art, the invention has the beneficial effects that:
1. the AR navigation pre-display cruise system based on the live-action feedback carries out cross query through the AR live-action image and the shot scene, so that the lane of a specific road route can be quickly positioned, the accuracy of automobile driving is further improved, and the reliability is high.
2. According to the AR navigation pre-display cruise system based on the live-action feedback, when the vehicle-mounted end cannot carry out 5G communication in 5G shielding signal sections such as a tunnel which cannot be covered by a 5G signal of a signal, a shielding garage, a bridge bottom and the like, the vehicle-mounted end carries out relay communication through the vehicle-mounted networking RFID sensing equipment and the carrier RFID sensing equipment or carries out relay communication through the vehicle-mounted networking RFID sensing equipment, the vehicle-mounted networking RFID sensing equipment of an adjacent vehicle and the carrier RFID sensing equipment in a mixed networking mode so as to be communicated with an AR server, and therefore the communication and positioning accuracy of the AR server in a region without the 5G signal is improved;
3. according to the AR navigation pre-display cruise system based on the real-scene feedback, when the scene changes due to trimming and transformation of the current road and effective matching cannot be achieved, fuzzy matching can be conducted through the camera of the vehicle-mounted end so as to obtain the current lane, the problem that the traditional matching is poor and the reporting error is not beneficial to navigation is solved, the map library of the server can be trimmed automatically, the map is guaranteed to be up to date, automatic control is achieved, human resources are saved, and the working efficiency is improved.
Drawings
FIG. 1 is a schematic view of the present general inventive concept;
FIG. 2 is a schematic diagram of an AR server according to the present invention;
FIG. 3 is a schematic structural diagram of the vehicle-mounted end of the present invention;
fig. 4 is a schematic diagram of a road real-scene map collecting end structure according to the present invention.
In the figure: 1. an AR server; 2. a road surface live-action map acquisition end; 3. a vehicle-mounted end; 4. an AR live action database; 5. an AR live-action map correction module; 6. and the 5G signal sending and receiving module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-4, the present invention provides a technical solution: the AR navigation pre-display cruise system based on the live-action feedback comprises an AR server, a vehicle-mounted end and a road live-action map acquisition end;
the AR server comprises an AR live-action database, a 5G signal sending and receiving module and an AR live-action map correction module;
the vehicle-mounted end comprises a local AR live-action database, a 5G signal sending and receiving module, a camera module, an AR live-action image display module, a vehicle-mounted end processor, a vehicle-mounted end positioning module and a vehicle networking RFID sensing device;
the road surface live-action map acquisition end comprises a road surface live-action map acquisition module, a carrier, a local AR live-action database and a carrier RFID sensing device, wherein the carrier is provided with the road surface live-action map acquisition module;
when the vehicle-mounted end is initialized, the 5G signal sending and receiving module of the vehicle-mounted end and the 5G signal sending and receiving module of the AR server end are in communication connection, a communication channel is established, the vehicle-mounted end is in communication with the AR server to confirm that the AR real scene database of the vehicle-mounted end is the latest AR real scene database, and otherwise, the vehicle-mounted end downloads the latest AR real scene database again to update the AR real scene database; the vehicle-mounted end processor is used for matching the image data provided by the camera module between the vehicle-mounted end and the AR real scene database, and combining the matched AR real scene image and the real vehicle data to be provided to the AR real scene image display module for display;
the RFID sensing equipment of the internet of vehicles is used for communication between vehicles or the vehicles are communicated with the road surface real scene map acquisition end;
the road surface real-scene map acquisition end can be in communication connection with the AR server and is used for acquiring a road surface real-scene map and sending the road surface real-scene map to the AR server, and meanwhile, the road surface real-scene map acquisition end can also be in communication connection with a vehicle-mounted end of a vehicle, so that the road surface real-scene map acquisition end and the vehicle can be communicated; in addition, the road surface real-scene map acquisition end and the adjacent road surface real-scene map acquisition end can also be used for communication, or can be used as a relay communication module of a vehicle-mounted end so as to realize the communication between a vehicle and the AR server, specifically, the road surface real-scene map acquisition module is used for acquiring road surface real-scene images and sending the road surface real-scene images to the AR server, and the road surface real-scene map acquisition module is processed by the AR server to form an AR real-scene database; the carrier RFID sensing equipment is used for forming a vehicle network with the adjacent carrier RFID sensing equipment and the vehicle networking RFID sensing equipment at the vehicle-mounted end on the vehicle.
Preferably, when the vehicle-mounted end processor does not match a proper image in the local AR real scene database of the vehicle-mounted end, AI intelligent fuzzy matching is started to perform matching so as to obtain the current actual route and position, an AR real scene image is obtained by shooting through the camera module, and the image is uploaded to the AR server through the 5G signal sending and receiving module.
Preferably, when the vehicle-mounted end cannot perform 5G communication in a 5G shielded signal section such as a tunnel which cannot be covered by a 5G signal of the signal, a shielded garage, a bridge bottom and the like, the vehicle-mounted end performs relay communication with the carrier RFID sensing device through the internet of vehicles RFID sensing device so as to communicate with the AR server;
preferably, when the vehicle-mounted end cannot perform 5G communication due to 5G shielding signal sections such as a tunnel which cannot be covered by 5G signals of the signals, a large shielding garage, a bridge bottom and the like, the vehicle-mounted end performs relay communication through the vehicle networking RFID sensing equipment and the carrier RFID sensing equipment hybrid networking of adjacent vehicles so as to communicate with the AR server;
preferably, the carrier at the road surface live-action map collecting end can be a carrier formed by a mobile vehicle, a street lamp and the like.
Preferably, the street lamp and the mobile vehicle are provided with the carrier RFID sensing equipment and the camera module, and when a road is built and transformed, images shot by the camera module can be transmitted to the AR server through a vehicle networking formed by the carrier RFID sensing equipment so as to correct the AR real scene database of the AR server.
Preferably, the AR live-action image display module includes a front windshield with a display function, the front windshield has a semi-transparent display function, and the searched navigation AR live-action image can be displayed on the windshield, and when the contrast between the image seen by the driver through the windshield and the navigation live-action image is substantially overlapped, it indicates that the walking route of the driver is correct; and when the contrast difference between the image seen by the driver through the windshield of the vehicle and the navigation live-action image is obvious, the vehicle runs on a wrong road, and the vehicle-mounted end sends out an alarm and newly plans a new navigation route.
Preferably, the vehicle-mounted end is provided with a vehicle-mounted end positioning module, the vehicle-mounted end positioning module acquires the current position of the vehicle, and the vehicle AI intelligent algorithm, the camera module and the AR live-action database are used for matching so as to acquire the actual driving road and route of the vehicle, so that the lane of the road where the vehicle is actually located or the lane of the overpass on which layer is located is corrected. Which can be positioned quickly.
Preferably, the junction box is connected with a grounding wire, and the grounding wire is connected with the outer wall of the tank body.
Preferably, the carrier is an automobile, an intersection signal lamp or a street lamp or other carriers capable of bearing the road surface real scene map acquisition module.
In another aspect, the present application further provides an automatic navigation method of an AR navigation pre-display cruise system based on live-action feedback, where the automatic navigation method includes the following steps:
s1, opening a vehicle-mounted end of the AR navigation pre-display cruise system, initializing the vehicle-mounted end, connecting a 5G signal sending and receiving module of the vehicle-mounted end with a 5G signal sending and receiving module of the AR server, finishing the query work of the AR real scene database, ensuring that the AR real scene database of the vehicle-mounted end is the latest database, and downloading the latest AR real scene database from the AR server to update the vehicle-mounted end if the AR real scene database is not the latest database;
s2, prompting a user to input a destination after the vehicle-mounted terminal is initialized, displaying the planned path information and the AR panoramic image after the user inputs the destination, and simultaneously starting the camera to work;
s3, the camera shoots a scene of a vehicle head, AI intelligent matching is carried out on the scene of the vehicle head and data of a local AR live-action database of the vehicle-mounted end, meanwhile, a vehicle-mounted end positioning module of the vehicle-mounted end gives map geographic position data, and an AR live-action map matched with the AI intelligent positioning module through the map position data so as to obtain an AR live-action cruising image of the vehicle, and the vehicle is positioned in a specific lane;
s4, when the map geographical position data given by the vehicle-mounted end positioning module cannot be obtained, acquiring speed data of the vehicle speed sensing module and direction information measured by the acceleration sensor, and further acquiring an AR real-scene cruise chart of the vehicle by using the direction information and the speed data and combining with an AR real-scene chart intelligently matched with AI;
s5, if images of the scene shot by the camera and the data of the local AR live-action database of the vehicle-mounted end cannot be matched, the current live-action is determined to have changed, fuzzy matching needs to be started at the moment, and meanwhile, the AR live-action database of the vehicle-mounted end and the AR live-action image of the server are corrected; specifically, during fuzzy matching, fuzzy matching is performed according to the shot main image point and an image in an AR live-action database near the current map positioning, so as to obtain a lane and a position where the vehicle is actually located, meanwhile, an image acquired by a camera at the vehicle-mounted end and position information acquired by a vehicle-mounted end positioning module at the vehicle-mounted end are transmitted to an AR live-action map correction module of an AR live-action server, the AR live-action map correction module corrects an AR live-action map at a corresponding position, and updates the AR live-action database of the AR live-action server.
Preferably, when the vehicle travels to a tunnel which cannot be covered by a 5G signal, a shielding garage is large, a 5G shielding signal section such as a bridge bottom and the like and cannot carry out 5G communication, the vehicle-mounted end carries out relay communication through the vehicle networking RFID sensing equipment and the vehicle networking RFID sensing equipment of an adjacent vehicle and the carrier RFID sensing equipment hybrid networking so as to communicate with the AR server.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (4)
1. The AR navigation pre-display cruise system based on the live-action feedback comprises an AR server, a vehicle-mounted end and a road live-action map acquisition end;
the AR server comprises an AR live-action database, a 5G signal sending and receiving module and an AR live-action map correction module;
the vehicle-mounted end comprises a local AR live-action database, a 5G signal sending and receiving module, a camera module, an AR live-action image display module, a vehicle-mounted end processor, a vehicle-mounted end positioning module and a vehicle networking RFID sensing device;
the road surface live-action map acquisition end comprises a road surface live-action map acquisition module, a carrier, a local AR live-action database and a carrier RFID sensing device, wherein the carrier is provided with the road surface live-action map acquisition module;
when the vehicle-mounted end is initialized, the 5G signal sending and receiving module of the vehicle-mounted end and the 5G signal sending and receiving module of the AR server end are in communication connection, a communication channel is established, the vehicle-mounted end is in communication with the AR server to confirm that the AR real scene database of the vehicle-mounted end is the latest AR real scene database, and otherwise, the vehicle-mounted end downloads the latest AR real scene database again to update the AR real scene database; the vehicle-mounted end processor is used for matching the image data provided by the camera module between the vehicle-mounted end and the AR real scene database, and combining the matched AR real scene image and the real vehicle data to be provided to the AR real scene image display module for display;
the RFID sensing equipment of the internet of vehicles is used for communication between vehicles or the vehicles are communicated with the road surface real scene map acquisition end;
the road surface real-scene map acquisition end can be in communication connection with the AR server and is used for acquiring a road surface real-scene map and sending the road surface real-scene map to the AR server, and meanwhile, the road surface real-scene map acquisition end can also be in communication connection with a vehicle-mounted end of a vehicle, so that the road surface real-scene map acquisition end and the vehicle can be communicated; in addition, the road surface real scene map acquisition end and the adjacent road surface real scene map acquisition end can also be used for communication, or the road surface real scene map acquisition end and the adjacent road surface real scene map acquisition end can be used as a relay communication module of a vehicle-mounted end so as to realize the communication between a vehicle and the AR server; specifically, the road real scene map acquisition module is used for acquiring road real scene images, sending the road real scene images to the AR server, and forming an AR real scene database after the road real scene images are processed by the AR server; the carrier RFID sensing equipment is used for forming a vehicle network with the adjacent carrier RFID sensing equipment and the vehicle networking RFID sensing equipment at the vehicle-mounted end on the vehicle;
when the vehicle-mounted end processor does not match a proper image in a local AR live-action database of the vehicle-mounted end, starting AI intelligent fuzzy matching for matching to obtain a current actual route and a current actual position, utilizing a camera module to pick up an image to obtain an AR live-action image, and uploading the image to an AR server through a 5G signal sending and receiving module;
when the vehicle-mounted end cannot carry out 5G communication in 5G shielding signal sections such as a tunnel which cannot be covered by a 5G signal of the signal, a shielding garage, a bridge bottom and the like, the vehicle-mounted end carries out relay communication with the carrier RFID sensing equipment through the vehicle networking RFID sensing equipment so as to be convenient for communication with an AR server;
when the vehicle-mounted end cannot carry out 5G communication due to 5G shielding signal sections such as a tunnel which cannot be covered by 5G signals of the signals, a shielding garage, a bridge bottom and the like, the vehicle-mounted end carries out relay communication through the vehicle-mounted network RFID sensing equipment, the vehicle-mounted network RFID sensing equipment of adjacent vehicles and the carrier RFID sensing equipment hybrid network so as to be convenient for communication with an AR server;
the AR real image display module comprises a front windshield with a display function, the front windshield has a semitransparent display function and can display the inquired navigation AR real image on the windshield, and when the contrast between the image seen by the driver through the front windshield and the navigation real image is basically overlapped, the driving route of the driver is correct; and when the contrast difference between the image seen by the driver through the windshield of the vehicle and the navigation live-action image is obvious, the vehicle runs on a wrong road, and the vehicle-mounted end sends out an alarm and newly plans a new navigation route.
2. The real feedback-based AR navigation pre-display cruise system according to claim 1, characterized by: the street lamp and the mobile vehicle are provided with the carrier RFID sensing equipment and the camera module, and when a road is built and transformed, images shot by the camera module can be transmitted to the AR server through the Internet of vehicles formed by the carrier RFID sensing equipment so as to correct the AR real scene database of the AR server.
3. The real feedback-based AR navigation pre-display cruise system according to claim 1, characterized by: the vehicle-mounted end is provided with a vehicle-mounted end positioning module, the vehicle-mounted end positioning module acquires the current position of a vehicle, and the vehicle AI intelligent algorithm, the camera module and the AR real scene database are used for matching so as to acquire the actual driving road and route of the vehicle, thereby correcting the lane of the road where the vehicle is actually located or the lane of the layer of the viaduct. Which can be positioned quickly.
4. The real feedback-based AR navigation pre-display cruise system according to claim 1, characterized by: the carrier of the road surface live-action map acquisition end can be a carrier formed by a mobile vehicle, a street lamp and the like.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010942287.5A CN112013867B (en) | 2020-09-09 | 2020-09-09 | AR navigation pre-display cruise system based on live-action feedback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010942287.5A CN112013867B (en) | 2020-09-09 | 2020-09-09 | AR navigation pre-display cruise system based on live-action feedback |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112013867A true CN112013867A (en) | 2020-12-01 |
| CN112013867B CN112013867B (en) | 2022-03-29 |
Family
ID=73521691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010942287.5A Active CN112013867B (en) | 2020-09-09 | 2020-09-09 | AR navigation pre-display cruise system based on live-action feedback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112013867B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113240816A (en) * | 2021-03-29 | 2021-08-10 | 泰瑞数创科技(北京)有限公司 | AR and semantic model based city accurate navigation method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090125235A1 (en) * | 2007-11-09 | 2009-05-14 | Altek Corporation | Method of updating navigation map data |
| CN104199073A (en) * | 2014-08-13 | 2014-12-10 | 芜湖航飞科技股份有限公司 | Beidou Satellite vehicle navigation system |
| CN205333084U (en) * | 2015-12-08 | 2016-06-22 | 悠泊物联网科技(上海)有限公司 | Car navigation system based on AR technique |
| US20170174129A1 (en) * | 2014-03-06 | 2017-06-22 | Sensedriver Technologies, Llc | Vehicular visual information system and method |
| CN108282635A (en) * | 2018-02-11 | 2018-07-13 | 中国联合网络通信集团有限公司 | Panorama image generation method and system, car networking big data service platform |
| US20190101405A1 (en) * | 2017-10-02 | 2019-04-04 | Hua-Chuang Automobile Information Technical Center Co., Ltd. | Three-dimensional driving navigation device |
| CN110855933A (en) * | 2018-08-21 | 2020-02-28 | 上海擎感智能科技有限公司 | Vehicle-mounted live monitoring system and method based on 5G technology, monitoring equipment and vehicle |
| CN111541989A (en) * | 2020-04-28 | 2020-08-14 | 重庆金美通信有限责任公司 | Live-action navigation system and method based on 5G technology |
-
2020
- 2020-09-09 CN CN202010942287.5A patent/CN112013867B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090125235A1 (en) * | 2007-11-09 | 2009-05-14 | Altek Corporation | Method of updating navigation map data |
| US20170174129A1 (en) * | 2014-03-06 | 2017-06-22 | Sensedriver Technologies, Llc | Vehicular visual information system and method |
| CN104199073A (en) * | 2014-08-13 | 2014-12-10 | 芜湖航飞科技股份有限公司 | Beidou Satellite vehicle navigation system |
| CN205333084U (en) * | 2015-12-08 | 2016-06-22 | 悠泊物联网科技(上海)有限公司 | Car navigation system based on AR technique |
| US20190101405A1 (en) * | 2017-10-02 | 2019-04-04 | Hua-Chuang Automobile Information Technical Center Co., Ltd. | Three-dimensional driving navigation device |
| CN108282635A (en) * | 2018-02-11 | 2018-07-13 | 中国联合网络通信集团有限公司 | Panorama image generation method and system, car networking big data service platform |
| CN110855933A (en) * | 2018-08-21 | 2020-02-28 | 上海擎感智能科技有限公司 | Vehicle-mounted live monitoring system and method based on 5G technology, monitoring equipment and vehicle |
| CN111541989A (en) * | 2020-04-28 | 2020-08-14 | 重庆金美通信有限责任公司 | Live-action navigation system and method based on 5G technology |
Non-Patent Citations (1)
| Title |
|---|
| 高扬: "可量测影像实景导航关键技术研究", 《中国优秀博硕士学位论文全文数据库(博士)基础科学辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113240816A (en) * | 2021-03-29 | 2021-08-10 | 泰瑞数创科技(北京)有限公司 | AR and semantic model based city accurate navigation method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112013867B (en) | 2022-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6785859B2 (en) | Self-driving navigation methods, devices and systems, in-vehicle terminals, and servers | |
| CN110186467B (en) | Method for controlling autonomous vehicles based on group sensing point cloud map and computer-implemented system | |
| CN104359487B (en) | A kind of real scene navigation system | |
| EP2203718B1 (en) | A method of processing positioning data | |
| EP1221588B1 (en) | Method of navigation guidance | |
| CN103559805B (en) | Based on the high precision 3G video vehicle positioning system of the Big Dipper and inertial navigation | |
| CN102713520B (en) | Guider and method | |
| CN101946157A (en) | Improved navigation device and method | |
| US20130144525A1 (en) | Method and system for creating indoor and outdoor linked path | |
| CN104583722A (en) | Apparatus and method for route searching | |
| WO2008044309A1 (en) | Navigation system, mobile terminal device, and route guiding method | |
| CN101903745A (en) | Improved navigation device and method | |
| CN102607566A (en) | Road live-action navigation system and method | |
| WO2021189570A1 (en) | Indoor vehicle-searching guidance system and method based on augmented reality | |
| CN101620814B (en) | Tour guide and navigation method and tour guide and navigation terminal | |
| CN112013867B (en) | AR navigation pre-display cruise system based on live-action feedback | |
| US20190227176A1 (en) | Gnss localization using vehicle sensors | |
| CN112197786B (en) | AR navigation pre-display cruise system based on live-action feedback | |
| EP4086783A1 (en) | Electronic horizon creation method and system | |
| CN106802151A (en) | Air navigation aid based on the matching of object of reference on the way | |
| CN112067014B (en) | AR multi-path navigation system | |
| CN106643751A (en) | Cloud service-based vehicle-mounted navigation system | |
| CN105674998A (en) | Navigation device and method thereof | |
| CN112050826B (en) | Low-delay high-definition AR multi-path navigation system | |
| CN112689236B (en) | RTK transmission system and method based on V2X networking technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |