CN110440815A - A kind of air navigation aid based on augmented reality - Google Patents

A kind of air navigation aid based on augmented reality Download PDF

Info

Publication number
CN110440815A
CN110440815A CN201910756518.0A CN201910756518A CN110440815A CN 110440815 A CN110440815 A CN 110440815A CN 201910756518 A CN201910756518 A CN 201910756518A CN 110440815 A CN110440815 A CN 110440815A
Authority
CN
China
Prior art keywords
information
float
navigation
augmented reality
arrow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910756518.0A
Other languages
Chinese (zh)
Inventor
陈杨帆
陈志�
岳文静
陈坤
华奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Post and Telecommunication University
Nanjing University of Posts and Telecommunications
Original Assignee
Nanjing Post and Telecommunication University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Post and Telecommunication University filed Critical Nanjing Post and Telecommunication University
Priority to CN201910756518.0A priority Critical patent/CN110440815A/en
Publication of CN110440815A publication Critical patent/CN110440815A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/28Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
    • G01C21/30Map- or contour-matching
    • G01C21/32Structuring or formatting of map data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/3407Route searching; Route guidance specially adapted for specific applications
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/3632Guidance using simplified or iconic instructions, e.g. using arrows
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/3635Guidance using 3D or perspective road maps
    • G01C21/3638Guidance using 3D or perspective road maps including 3D objects and buildings

Abstract

The invention discloses a kind of air navigation aids based on augmented reality, the inconvenience of the common GPS navigation of people is made up by way of combining GPS and AR, purport gives people in the shortest time with clear instruction, and people is allowed to save the time on the way and increase enjoyment travelling outdoors.The present invention is loaded into AR mode, calling mobile phone camera and network show road information, actual situation combined, correctly user is led to arrive at the destination according to the instruction (such as setting destination starts to navigate) of user.The present invention collects road information first, building information, establish database, then by drawing 3D model, and map is based on by server-side and carries out route planning, finally according to the Fundamentals of Sensors of Android, relevant virtual data is rendered to be superimposed upon in the video flowing of camera acquisition, realize the navigation based on augmented reality.

Description

A kind of air navigation aid based on augmented reality
Technical field
The invention belongs to the interleaving techniques such as augmented reality, GPS navigation, sensor fields, in particular to a kind of based on enhancing The air navigation aid of reality.
Background technique
Augmented reality is the new technology to grow up on the basis of virtual reality, is also referred to as " mixed reality ". Augmented reality refers to enhancing to real world as its name suggests, it be the text provided by computer system, figure, The technology that the information such as voice recognize and perceive to increase user to real world.Augmented reality is by computer or other equipment wash with watercolours Dye generate dummy object, scene and other prompt informations be superimposed upon in real scene (such as camera obtain video flowing On), with this come realize to reality enhancing.
Augmented reality is a hot research topic in recent years.Currently, domestic and international many well-known universities and research institution All carrying out associated research.Since the display that AR technology can carry out information enhancement to real scene, environment excessively exports, It has application in various fields, industry,
As the handheld devices such as laptop computer, smart phone, personal electric assistant are grown rapidly, much it is formerly only available in platform The traditional technology and application run in formula equipment starts constantly to shift to handheld device successively, and augmented reality is in handheld device On application and development also just like a raging fire carry out.Mobile augmented reality technology is primarily referred to as augmented reality in handheld device On application.Mobile augmented reality not only has the characteristics of actual situation combination, real-time, interactive and three-dimensional registration that augmented reality possesses, Also there is certain moving freely property, it will not because of the factors such as environment, scene limitation and can only be in the narrow of a certain fixation It is used in area of space, mobile augmented reality is applied will be mainly related to geo-location service.
21 century, development in science and technology are maked rapid progress, and along with the progress of mobile terminal science and technology, have small in size, carrying Conveniently, the popularization of the smart phone for the features such as performance is intrepid is higher and higher, camera, the sensor, GPS module carried So that augmented reality application in mobile terminal is implemented as possibility.In conjunction with mobile augmented reality technology, sensor technology, mobile communication The augmented reality navigation system that technology, GIS data access and dispatching technique etc. are developed on smart phone will have application value very much.
Based on the studies above achievement, the present invention proposes a kind of air navigation aid based on augmented reality, it is intended to which uninteresting is common Virtual 3D element is added in navigation, preferably user is guided to arrive at the destination.
Summary of the invention
It is an object of the invention to combine augmented reality with navigation, the part of augmented reality solves the wash with watercolours of 3D model Dye, and it is superimposed with video flowing, and when smart phone occurs mobile, 3D model can also be moved with smart phone, be made It obtains 3D model and reality more perfectly to combine, the acquisition of navigational portions solution location information, storage, is called and path planning is believed The acquisition of breath, when the two is combined, according to road difference and the difference of smart phone direction, the type of real-time update arrow And prompt information, it is ensured that the correctness of navigation.
To achieve the above object, the technical solution adopted by the present invention are as follows:
A kind of air navigation aid based on augmented reality, comprising the following steps:
S1, starting module CM1 is established on smart phone, starting module CM1 realizes activation system function, receives user and opens Dynamic order, checks wi-fi connection, opens cellphone GPS function, jumps to input interface;Input module INP is established in input interface With interactive module CM2, the input module INP established realizes the function of input destination, and interactive module CM2 is realized and server End interaction, starts the function of navigation interface;
S2, server end realize the acquisition of road information, building information on the basis of map, obtain road information, The longitude and latitude of building information forms road topology net, creates database realizing spatial storage methods;
S3, user's navigation command is received, interactive module CM2 starting, smart phone and server end are in Wi-Fi local area network In establish connection, pass through cellphone GPS function, realize user positioning;By interactive module CM2, user is sent to server end and is worked as The destination title inputted in preceding location information and input module INP, the server end location information current according to user With the destination title return path planning information of input, route plan is obtained;
S4, rendering virtual data, realize the rendering of augmented reality navigation 3D virtual data;According to what is encountered in navigation procedure Direction information classifies to rending model, respectively directly walks, and turns left, and turns right, turns around, right forward, and left front turn this six kinds;Definition The coordinate position of 3D model carries out the drafting and texture mapping of navigation figure, is realized not according to the service state of GPS to arrow Same texture mapping;
S5, in conjunction with acceleration transducer and magnetic field sensor, obtain smart phone azimuth information to get azimuth is arrived, The value of pitch, roll parameter, azimuth, pitch, roll are respectively smart phone around z, x, the angle of y-axis rotation, In: z, x, y-axis are the coordinate systems of acceleration transducer and magnetic field sensor, and when smart phone keeps transverse screen to place, z-axis is Normal to screen panel is simultaneously directed toward outside screen panel, and x-axis is parallel to screen panel straight up, and y axis is parallel to screen To the right, the coordinate system of acceleration transducer and magnetic field sensor does not change panel-level with mobile phone screen direction change;
S6, it calls smart phone camera in interface display road scene, is mapped by the bearing data changed at any time Into 3D model coordinate systems, come control navigation arrow and reality scene interface be superimposed and the rotation of navigational arrows change Change;
S7, by using Handler, Timer and TimerTask in conjunction with method realize that Android timer carries out The refreshing for the text and graphical cues information of navigating;
S8, it arrives at the destination, navigation terminates, and returns to interactive interface.
Further, the step 4 the following steps are included:
S401, the vertex coordinates data buffering for initializing figure, create different vertex number of coordinates according to different type arrow Group, arrow are made of several triangles and several quadrangles, are drawn respectively with triangle and quad pattern;
S402, texture mapping is carried out to graphing, initializes texture, arrow is realized according to the service state of GPS and is pasted Figure distributes texture coordinate, and the texture coordinate of triangle includes three vertex, and the texture coordinate of quadrangle includes four vertex, line Manage apex coordinate sequence and graphics vertex coordinate sequence consensus.
Further, the step 5 the following steps are included:
S501, registration and acceleration transducer and magnetic field sensor are monitored, in acceleration transducer and magnetic field sensor The parameter array of acceleration transducer and magnetic field sensor variation is obtained in monitor method,
S502, by call function SensorManager.getRotationMatrix (float [] R, float [] I, Float [] gravity, float [] geomagnetic) obtain spin matrix R, in which: gravity and geomagnetic points Not Wei the parameter array that obtains of acceleration transducer and magnetic field sensor, this time only need to obtain spin matrix R, matrix will be tilted I is set as null, and spin matrix R is the matrix of a 3*3:
Wherein: the value of R [0], R [1], R [2], R [3], R [4], R [5], R [6], R [7], R [8] by after function call by Parameter array gravity and geomagnetic are calculated;
S503, by spin matrix calculate R, obtain azimuth:
Value [0]=(float) Math.atan2 (R [1], R [4])
Value [1]=(float) Math.asin (- R [7])
Value [2]=(float) Math.atan2 (- R [6], R [8])
Wherein: the corresponding azimuth value of value [0], the corresponding roll value of value [1] corresponding pitch, value [2], atan2 (a, b) method returns to the argument of plural number a+b*i, and i is imaginary unit, and asin (c) method returns to the arcsine of c, a, b, and c is Numerical parameter.
Further, the step 6 comprises the following steps:
S601, pass through method glTranslatef (float x, float y, float z), 3D coordinate system is born along y-axis 0.5 unit is moved in direction, moves 2 units along z-axis negative direction;
S602, arrow is controlled by method glRotatef (float angle, float x, float y, float z) Rotation, wherein parameter angle represents rotation angle, x ', y ', z ' represents OpenGL ES reference axis, when smart phone keeps horizontal When screen is placed, z ' axis is perpendicular to screen panel and is directed toward outside screen panel, and x ' axis is parallel to screen panel horizontally to the right, Y ' axis is parallel to screen panel straight up, and the left rotation and right rotation of arrow is controlled using parameter azimuth, and parameter roll comes Control arrow teeters.
Further, the step 7 the following steps are included:
S701, the real-time latitude and longitude information and shortest path array obtained after parsing at regular intervals obtaining GPS The latitude and longitude information of element object is matched, when user enters region near a certain coordinate points, by the road direction of this point And turn to angle information and pass to MySurfaceView class, MySurfaceView determines that arrow is initial according to new parameter information Direction, the navigation arrow for drawing new type, delete original navigational arrows, new navigational arrows are superimposed upon camera and are obtained It in the video flowing taken, navigates, user is instructed to advance.
In S702, each refresh process, itself and next road circuit node are calculated according to the latitude and longitude information that current GPS is obtained Range information, in the form of text prompt user distance in front of distance and turn direction.
Compared with prior art, the invention has the following advantages:
The present invention proposes a kind of navigation based on augmented reality, it is intended to combine augmented reality with reality scene, realize Navigation feature, it is different from common navigation, it joined augmented reality and make navigation more lively, information collection is also more accurate, makes It is higher to obtain navigation accuracy, specifically: (1) present invention is combined augmented reality with navigation, so that navigation instruction is more clear, 3D model is combined with actually navigation by sensor, the position of user, more new data is monitored in real time, it is accurate to improve navigation Degree.(2) by server end, detailed information collection is carried out to each node of road, forms road route topological network, and build Vertical database stores it, lays the foundation for navigation route planning, reduces navigation fault.
Detailed description of the invention
Fig. 1 is flow chart of the method for the present invention;
Fig. 2 is the coordinate system schematic diagram in step S5 of the present invention;
Fig. 3 is the coordinate system schematic diagram in step S602 of the present invention.
Specific embodiment
Below with reference to embodiment, the present invention will be further explained.
A kind of air navigation aid based on augmented reality, comprising the following steps:
S1, starting module CM1 is established on smart phone, starting module CM1 realizes activation system function, receives user and opens Dynamic order, checks wi-fi connection, opens cellphone GPS function, jumps to input interface;Input module INP is established in input interface With interactive module CM2, the input module INP established realizes the function of input destination, and interactive module CM2 is realized and server End interaction, starts the function of navigation interface;
S2, server end realize the acquisition of road information, building information on the basis of map, obtain road information, The longitude and latitude of building information forms road topology net, creates database realizing spatial storage methods;
S3, user's navigation command is received, interactive module CM2 starting, smart phone and server end are in Wi-Fi local area network In establish connection, pass through cellphone GPS function, realize user positioning;By interactive module CM2, user is sent to server end and is worked as The destination title inputted in preceding location information and input module INP, the server end location information current according to user With the destination title return path planning information of input, route plan is obtained;
S4, rendering virtual data, realize the rendering of augmented reality navigation 3D virtual data;According to what is encountered in navigation procedure Direction information classifies to rending model, respectively directly walks, and turns left, and turns right, turns around, right forward, and left front turn this six kinds;Definition The coordinate position of 3D model carries out the drafting and texture mapping of navigation figure, is realized not according to the service state of GPS to arrow Same texture mapping;
In particular, the step 4 the following steps are included:
S401, the vertex coordinates data buffering for initializing figure, create different vertex number of coordinates according to different type arrow Group, arrow are made of several triangles and several quadrangles, are drawn respectively with triangle and quad pattern;
S402, texture mapping is carried out to graphing, initializes texture, arrow is realized according to the service state of GPS and is pasted Figure distributes texture coordinate, and the texture coordinate of triangle includes three vertex, and the texture coordinate of quadrangle includes four vertex, line Manage apex coordinate sequence and graphics vertex coordinate sequence consensus;
S5, in conjunction with acceleration transducer and magnetic field sensor, obtain smart phone azimuth information to get azimuth is arrived, The value of pitch, roll parameter, azimuth, pitch, roll are respectively smart phone around z, x, the angle of y-axis rotation, In: z, x, y-axis are the coordinate systems of acceleration transducer and magnetic field sensor, as shown in Fig. 2, when smart phone keeps transverse screen to put When setting, z-axis is perpendicular to screen panel and is directed toward outside screen panel, and x-axis is parallel to screen panel straight up, and y-axis is It is parallel to screen panel horizontally to the right, the coordinate system of acceleration transducer and magnetic field sensor is not as mobile phone screen direction becomes Change and changes;
In particular, the step 5 the following steps are included:
S501, registration and acceleration transducer and magnetic field sensor are monitored, in acceleration transducer and magnetic field sensor The parameter array of acceleration transducer and magnetic field sensor variation is obtained in monitor method,
S502, by call function SensorManager.getRotationMatrix (float [] R, float [] I, Float [] gravity, float [] geomagnetic) obtain spin matrix R, in which: gravity and geomagnetic points Not Wei the parameter array that obtains of acceleration transducer and magnetic field sensor, this time only need to obtain spin matrix R, matrix will be tilted I is set as null, and spin matrix R is the matrix of a 3*3:
Wherein: the value of R [0], R [1], R [2], R [3], R [4], R [5], R [6], R [7], R [8] by after function call by Parameter array gravity and geomagnetic are calculated;
S503, by spin matrix calculate R, obtain azimuth:
Value [0]=(float) Math.atan2 (R [1], R [4])
Value [1]=(float) Math.asin (- R [7])
Value [2]=(float) Math.atan2 (- R [6], R [8])
Wherein: the corresponding azimuth value of value [0], the corresponding roll value of value [1] corresponding pitch, value [2], atan2 (a, b) method returns to the argument of plural number a+b*i, and i is imaginary unit, and asin (c) method returns to the arcsine of c, a, b, and c is Numerical parameter;
S6, it calls smart phone camera in interface display road scene, is mapped by the bearing data changed at any time Into 3D model coordinate systems, come control navigation arrow and reality scene interface be superimposed and the rotation of navigational arrows change Change;
In particular, the step 6 comprises the following steps:
S601, pass through method glTranslatef (float x, float y, float z), 3D coordinate system is born along y-axis 0.5 unit is moved in direction, moves 2 units along z-axis negative direction;
S602, arrow is controlled by method glRotatef (float angle, float x, float y, float z) Rotation, wherein parameter angle represent rotation angle, x ', y ', z ' represents OpenGL ES reference axis, as shown in figure 3, when intelligence When mobile phone keeps transverse screen to place, z ' axis is perpendicular to screen panel and is directed toward outside screen panel, and x ' axis is parallel to screen cover Horizontally to the right, y ' axis is parallel to screen panel straight up to plate, and the left rotation and right rotation of arrow is controlled using parameter azimuth, Parameter roll controls teetering for arrow;
S7, by using Handler, Timer and TimerTask in conjunction with method realize that Android timer carries out The refreshing for the text and graphical cues information of navigating;
In particular, the step 7 the following steps are included:
S701, the real-time latitude and longitude information and shortest path array obtained after parsing at regular intervals obtaining GPS The latitude and longitude information of element object is matched, when user enters region near a certain coordinate points, by the road direction of this point And turn to angle information and pass to MySurfaceView class, MySurfaceView determines that arrow is initial according to new parameter information Direction, the navigation arrow for drawing new type, delete original navigational arrows, new navigational arrows are superimposed upon camera and are obtained It in the video flowing taken, navigates, user is instructed to advance.
In S702, each refresh process, itself and next road circuit node are calculated according to the latitude and longitude information that current GPS is obtained Range information, in the form of text prompt user distance in front of distance and turn direction;
S8, it arrives at the destination, navigation terminates, and returns to interactive interface.
Embodiment
As shown in Figure 1, establishing starting module CM1 on smart phone, which realizes activation system function, and CM1 is received To user's start command, wi-fi connection is checked, open cellphone GPS function, then jump to input interface.Input interface again Two big modules, input module INP and interactive module CM2 are established, the input module INP established realizes input destination Function, interactive module CM2 realization are interacted with server end, start the function of navigation interface.
It first has to realize road information, building letter on the basis of map by system server terminal before navigation The acquisition of breath obtains their longitude and latitude, creates database realizing spatial storage methods.Looking into for information is carried out convenient for the later period It looks for.
Then user inputs destination title at module I NP, starts interactive module CM2, smart phone and server end Connection is established in Wi-Fi local area network, by cellphone GPS function, realizes user's positioning.By interactive module CM2, to server End sends the destination title inputted in user current location information and input module INP, and server end is according to the two Information return path planning information obtains route plan.
Next the rendering of augmented reality navigation 3D virtual data is carried out.According to the difference being likely encountered in navigation procedure Direction information classifies to rendering figure, respectively directly walks, and turns left, and turns right, turns around, right forward, and left front turn this six kinds.According to The difference of vertex quantity separately designs the establishment that method realizes 3D navigation model apex coordinate array, then according to the difference of GPS Service state has carried out different texture mapping to 3D model.
In conjunction with acceleration transducer and magnetic field sensor, mobile phone azimuth information is obtained to get azimuth, pitch is arrived, The value of roll parameter, registration and monitoring acceleration transducer and magnetic field sensor, obtain sensing in the monitor method of sensor The parameter array of device variation, by calling letter SensorManager.getRotationMatrix (float [] R, float [] I, float [] gravity, float [] geomagnetic), obtain spin matrix R, by calculating spin matrix, acquisition side Azimuth angle information.Calling mobile phone camera is mapped in interface display road scene by the bearing data for changing these at any time Into 3D model coordinate systems, come control navigation arrow with reality scene interface be superimposed and the rotation of navigational arrows become Change.
Finally real-time update is carried out to arrow and road prompt information, by using Handler, Timer and TimerTask in conjunction with method realize that Android timer completes this function.The reality that GPS is obtained at regular intervals When latitude and longitude information matched with the latitude and longitude information of shortest path array element object obtained after parsing, user enter certain Near one coordinate points when region, the road direction of this point and steering angle information are passed into MySurfaceView class, The navigation arrow that MySurfaceView determines the initial direction of arrow according to new parameter information, draws new type, is deleted former New navigational arrows are superimposed upon in the video flowing of camera acquisition, navigate, user is instructed to advance by first navigational arrows. In each refresh process, the range information of itself and next road circuit node is calculated according to the latitude and longitude information that current GPS is obtained, How many distance in front of user distance are prompted in the form of text, how to be turned.
After leading user to arrive at the destination, interaction can be exited, may also return to interactive interface, destination is inputted again and carries out Navigation.
The above is only a preferred embodiment of the present invention, it should be pointed out that: for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (5)

1. a kind of air navigation aid based on augmented reality, which comprises the following steps:
S1, starting module CM1 is established on smart phone, starting module CM1 realizes activation system function, receives user and starts life It enables, checks wi-fi connection, open cellphone GPS function, jump to input interface;Input module INP and friendship are established in input interface Mutual module CM 2, the input module INP established realize the function of input destination, and interactive module CM2 is realized to be handed over server end Mutually, start the function of navigation interface;
S2, server end realize the acquisition of road information, building information on the basis of map, obtain road information, building The longitude and latitude of object information forms road topology net, creates database realizing spatial storage methods;
S3, user's navigation command is received, interactive module CM2 starting, smart phone and server end are built in Wi-Fi local area network Vertical connection realizes user's positioning by cellphone GPS function;By interactive module CM2, current to server end transmission user The destination title inputted in location information and input module INP, server end is according to the current location information of user and defeated The destination title return path planning information entered obtains route plan;
S4, rendering virtual data, realize the rendering of augmented reality navigation 3D virtual data;According to the steering encountered in navigation procedure Information classifies to rending model, respectively directly walks, and turns left, and turns right, turns around, right forward, and left front turn this six kinds;Define 3D mould The coordinate position of type carries out the drafting and texture mapping of navigation figure, is realized according to the service state of GPS to arrow different Texture mapping;
S5, in conjunction with acceleration transducer and magnetic field sensor, obtain smart phone azimuth information to get azimuth is arrived, The value of pitch, roll parameter, azimuth, pitch, roll are respectively smart phone around z, x, the angle of y-axis rotation, In: z, x, y-axis are the coordinate systems of acceleration transducer and magnetic field sensor, and when smart phone keeps transverse screen to place, z-axis is Normal to screen panel is simultaneously directed toward outside screen panel, and x-axis is parallel to screen panel straight up, and y-axis is parallel to screen To the right, the coordinate system of acceleration transducer and magnetic field sensor does not change panel-level with mobile phone screen direction change;
S6, it calls smart phone camera in interface display road scene, 3D is mapped to by the bearing data changed at any time In model coordinate systems, come control navigation arrow and reality scene interface be superimposed and navigational arrows it is rotationally-varying;
S7, by using Handler, Timer and TimerTask in conjunction with method realize that Android timer navigates The refreshing of text and graphical cues information;
S8, it arrives at the destination, navigation terminates, and returns to interactive interface.
2. the air navigation aid according to claim 1 based on augmented reality, it is characterised in that: the step 4 includes following Step:
S401, the vertex coordinates data buffering for initializing figure, create different vertex number of coordinates groups, arrow according to different type arrow Head is made of several triangles and several quadrangles, is drawn respectively with triangle and quad pattern;
S402, texture mapping is carried out to graphing, initializes texture, textures are realized to arrow according to the service state of GPS, point With texture coordinate, the texture coordinate of triangle includes three vertex, and the texture coordinate of quadrangle includes four vertex, texture vertex Coordinate sequence and graphics vertex coordinate sequence consensus.
3. the air navigation aid according to claim 1 based on augmented reality, it is characterised in that: the step 5 includes following Step:
S501, registration and monitoring acceleration transducer and magnetic field sensor, in the monitoring of acceleration transducer and magnetic field sensor The parameter array of acceleration transducer and magnetic field sensor variation is obtained in method,
S502, pass through calling function SensorManager.getRotationMatrix (float [] R, float [] I, float [] gravity, float [] geomagnetic) obtain spin matrix R, in which: and gravity and geomagnetic is respectively to add The parameter array that velocity sensor and magnetic field sensor obtain, this time only needs to obtain spin matrix R, and inclination matrix I is set as Null, spin matrix R are the matrixes of a 3*3:
Wherein: the value of R [0], R [1], R [2], R [3], R [4], R [5], R [6], R [7], R [8] by after function call by parameter Array gravity and geomagnetic are calculated;
S503, by spin matrix calculate R, obtain azimuth:
Value [0]=(float) Math.atan2 (R [1], R [4])
Value [1]=(float) Math.asin (- R [7])
Value [2]=(float) Math.atan2 (- R [6], R [8])
Wherein: the corresponding azimuth value of value [0], the corresponding roll value of value [1] corresponding pitch, value [2], atan2 (a, B) method returns to the argument of plural number a+b*i, and i is imaginary unit, and asin (c) method returns to the arcsine of c, and a, b, c is numerical value Parameter.
4. the air navigation aid according to claim 1 based on augmented reality, it is characterised in that: the step 6 includes following Step:
S601, pass through method glTranslatef (float x, float y, float z), by 3D coordinate system along negative direction of the y-axis Mobile 0.5 unit, moves 2 units along z-axis negative direction;
S602, the rotation that arrow is controlled by method glRotatef (float angle, float x, float y, float z) Turn, wherein parameter angle represents rotation angle, x ', y ', z ' represents OpenGL ES reference axis, when smart phone keeps transverse screen to put When setting, z ' axis is perpendicular to screen panel and is directed toward outside screen panel, and x ' axis is parallel to screen panel horizontally to the right, y ' axis It is parallel to screen panel straight up, controls the left rotation and right rotation of arrow using parameter azimuth, parameter roll controls arrow Head teeters.
5. the air navigation aid according to claim 1 based on augmented reality, it is characterised in that: the step 7 includes following Step:
S701, at regular intervals by GPS obtain real-time latitude and longitude information and shortest path array element obtained after parsing The latitude and longitude information of object is matched, user enter a certain coordinate points near region when, by this point road towards and It turns to angle information and passes to MySurfaceView class, MySurfaceView determines the initial court of arrow according to new parameter information To, draw new type navigation arrow, delete original navigational arrows, by new navigational arrows be superimposed upon camera obtain Video flowing in, navigate, user instructed to advance.
In S702, each refresh process, according to the latitude and longitude information that current GPS is obtained calculate its with next road circuit node away from From information, the distance and turn direction in front of user distance are prompted in the form of text.
CN201910756518.0A 2019-08-16 2019-08-16 A kind of air navigation aid based on augmented reality Pending CN110440815A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910756518.0A CN110440815A (en) 2019-08-16 2019-08-16 A kind of air navigation aid based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910756518.0A CN110440815A (en) 2019-08-16 2019-08-16 A kind of air navigation aid based on augmented reality

Publications (1)

Publication Number Publication Date
CN110440815A true CN110440815A (en) 2019-11-12

Family

ID=68435944

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910756518.0A Pending CN110440815A (en) 2019-08-16 2019-08-16 A kind of air navigation aid based on augmented reality

Country Status (1)

Country Link
CN (1) CN110440815A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111024113A (en) * 2019-12-05 2020-04-17 深圳震有科技股份有限公司 GMap-based navigation path direction arrow drawing method, system and equipment
CN111107487A (en) * 2019-12-16 2020-05-05 Oppo广东移动通信有限公司 Position display control method and related device
CN111597993A (en) * 2020-05-15 2020-08-28 北京百度网讯科技有限公司 Data processing method and device
CN113074736A (en) * 2021-03-24 2021-07-06 中国工商银行股份有限公司 Indoor navigation positioning method, equipment, electronic equipment, storage medium and product

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015052313A1 (en) * 2013-10-11 2015-04-16 Tomtom International B.V. Apparatus and methods of displaying navigation instructions
CN104748739A (en) * 2013-12-29 2015-07-01 刘进 Intelligent machine augmented reality implementation method
CN107015654A (en) * 2017-04-10 2017-08-04 深圳大学 Air navigation aid and device based on augmented reality
CN107782314A (en) * 2017-10-24 2018-03-09 张志奇 A kind of augmented reality indoor positioning air navigation aid based on barcode scanning
CN109059901A (en) * 2018-09-06 2018-12-21 深圳大学 A kind of AR air navigation aid, storage medium and mobile terminal based on social application

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015052313A1 (en) * 2013-10-11 2015-04-16 Tomtom International B.V. Apparatus and methods of displaying navigation instructions
CN104748739A (en) * 2013-12-29 2015-07-01 刘进 Intelligent machine augmented reality implementation method
CN107015654A (en) * 2017-04-10 2017-08-04 深圳大学 Air navigation aid and device based on augmented reality
CN107782314A (en) * 2017-10-24 2018-03-09 张志奇 A kind of augmented reality indoor positioning air navigation aid based on barcode scanning
CN109059901A (en) * 2018-09-06 2018-12-21 深圳大学 A kind of AR air navigation aid, storage medium and mobile terminal based on social application

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111024113A (en) * 2019-12-05 2020-04-17 深圳震有科技股份有限公司 GMap-based navigation path direction arrow drawing method, system and equipment
CN111107487A (en) * 2019-12-16 2020-05-05 Oppo广东移动通信有限公司 Position display control method and related device
CN111107487B (en) * 2019-12-16 2021-07-13 Oppo广东移动通信有限公司 Position display control method and related device
CN111597993A (en) * 2020-05-15 2020-08-28 北京百度网讯科技有限公司 Data processing method and device
CN111597993B (en) * 2020-05-15 2023-09-05 北京百度网讯科技有限公司 Data processing method and device
CN113074736A (en) * 2021-03-24 2021-07-06 中国工商银行股份有限公司 Indoor navigation positioning method, equipment, electronic equipment, storage medium and product

Similar Documents

Publication Publication Date Title
CN110440815A (en) A kind of air navigation aid based on augmented reality
CN106949893B (en) A kind of the Indoor Robot air navigation aid and system of three-dimensional avoidance
CN104748746B (en) Intelligent machine attitude determination and virtual reality loaming method
CN101583842B (en) Navigation system, portable terminal device, and peripheral-image display method
US9223408B2 (en) System and method for transitioning between interface modes in virtual and augmented reality applications
CN103591951B (en) A kind of indoor navigation system and method
JP4068661B1 (en) Navigation system, portable terminal device, and route guidance method
CN110222137A (en) One kind is based on oblique photograph and augmented reality Intelligent campus system
CN110537210A (en) Augmented reality display system, program and method
CN105373224A (en) Hybrid implementation game system based on pervasive computing, and method thereof
US20110054778A1 (en) Method and Apparatus for Displaying Three-Dimensional Terrain and Route Guidance
Pierce et al. Navigation with place representations and visible landmarks
US20140152764A1 (en) Information processing system, information processing apparatus, storage medium having stored therein information processing program, and information transmission/reception method
CN108917758A (en) A kind of navigation methods and systems based on AR
CN108170297A (en) Real-time six degree of freedom VR/AR/MR equipment localization methods
CN101619981A (en) Self-service tour guide and navigation terminal and method for optimally selecting tour guide and navigation information
CN110536727A (en) Virtual map display system, program and method
CN114642874A (en) Display system and server
CN105334525B (en) A kind of geography information display methods based on augmented reality
CN103487059A (en) Positioning and navigation system, device and method
TW201200846A (en) Global positioning device and system
CN106649619A (en) Outdoor activity, game and tourist map generation method, device and equipment
US6606558B2 (en) Rendering device and method
CN104133648A (en) Position-based image display method and device
CN113532442A (en) Indoor AR pedestrian navigation method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191112