CN113452842B - Flight AR display method, system, computer equipment and storage medium - Google Patents
Flight AR display method, system, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113452842B CN113452842B CN202111000868.8A CN202111000868A CN113452842B CN 113452842 B CN113452842 B CN 113452842B CN 202111000868 A CN202111000868 A CN 202111000868A CN 113452842 B CN113452842 B CN 113452842B
- Authority
- CN
- China
- Prior art keywords
- flight
- terminal equipment
- included angle
- projection
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Environmental & Geological Engineering (AREA)
- User Interface Of Digital Computer (AREA)
- Navigation (AREA)
Abstract
The invention discloses a flight AR display method, a flight AR display system, a computer device and a storage medium, wherein the flight AR display method is applied to a terminal device with a camera, a gyroscope and a positioning function and comprises the following steps: acquiring the position information of the terminal equipment through a positioning function, and sending the position information to a background server; acquiring flight information within a preset distance radius with the position information as the center from a background server; acquiring the orientation of the terminal equipment and an included angle between the terminal equipment and a ground plane through a gyroscope; calculating the projection range of the orientation of the terminal equipment according to the included angle between the preset perspective projection model and the ground plane; and screening out the target flights in the projection range from the flight information, and projecting the identification information of the target flights onto a preview interface of the camera in a projection point coordinate mode. The technical scheme of the invention displays the flight information in an augmented reality mode, and solves the problem that the existing flight information is not intuitive enough in expression.
Description
Technical Field
The invention relates to the field of information processing, in particular to a flight AR display method, a flight AR display system, a flight AR display computer device and a storage medium.
Background
The existing various maps APP, ticket booking APPs and the like are more or less accompanied with flight inquiry functions, and convenience is brought to travel of people. However, the flight identification information is often displayed on a 2D plane map, and is not intuitive enough, and cannot intuitively express the position of the flight relative to the user.
Disclosure of Invention
The embodiment of the invention provides a flight AR display method, a flight AR display system, a computer device and a storage medium, which display flight information in an augmented reality mode and solve the problem that the existing flight information is not intuitive enough in expression.
A flight AR display method is applied to terminal equipment with a camera, a gyroscope and a positioning function and comprises the following steps:
acquiring the position information of the terminal equipment through the positioning function, and sending the position information to a background server;
acquiring flight information within a preset distance radius with the position information as the center from the background server;
acquiring the orientation of the terminal equipment and an included angle between the terminal equipment and a ground plane through the gyroscope;
calculating the projection range of the orientation of the terminal equipment according to the included angle between the terminal equipment and the ground plane by using a preset perspective projection model;
and screening out the target flights in the projection range from the flight information, and projecting the identification information of the target flights onto a preview interface of the camera in a projection point coordinate mode.
A flight AR display system comprises terminal equipment and a background server, wherein the terminal equipment is connected with the background server through a network;
the terminal equipment is provided with a camera, a gyroscope and a positioning function, wherein the gyroscope is used for acquiring the orientation of the terminal equipment and the included angle between the terminal equipment and the ground plane; the positioning function is used for acquiring the position information of the terminal equipment;
the background server stores flight information and is used for sending the flight information within a preset distance radius taking the position information as a center to the terminal equipment;
the terminal device is configured to:
acquiring the position information of the terminal equipment and sending the position information to a background server;
acquiring the orientation of the terminal equipment and an included angle between the terminal equipment and a ground plane through the gyroscope in real time;
calculating the projection range of the orientation of the terminal equipment according to the included angle between the terminal equipment and the ground plane by using a preset perspective projection model;
and screening out the target flights in the projection range from the flight information, and projecting the identification information of the target flights onto a preview interface of the camera in a projection point coordinate mode.
A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the flight AR display method when executing the computer program.
A computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of the above-described flight AR display method.
The flight AR display method, the flight AR display system, the computer device and the storage medium are characterized in that a positioning function on the terminal device is used for obtaining accurate position information of the terminal device, the gyroscope is used for monitoring the orientation of the terminal device and the included angle between the terminal device and the ground plane in real time, and the preview interface of the camera is used for displaying flight AR (augmented reality) information.
The realization principle of the scheme is as follows: firstly, the terminal equipment acquires all flight information within a preset distance radius (for example, 100 kilometers) of the position from a background server by using the position information acquired by the positioning function; secondly, the terminal equipment acquires the space state of the terminal equipment by using a gyroscope, namely the orientation and the included angle between the terminal equipment and the ground plane; calculating the projection range of the orientation of the terminal equipment by utilizing the principle of perspective projection and the included angle between the perspective projection and the ground plane; then, calculating the flight which can be projected into the terminal equipment camera preview interface, and calculating the specific position of the flight projected to the preview interface according to the perspective projection principle.
The beneficial effect of this scheme does: when a user opens the preview interface of the camera, the identification information representing the flight can be seen to be distributed at different positions of the interface, and the identification information is updated and moved along with the operation of the flight; meanwhile, when the terminal equipment rotates, moves or forms an included angle with the ground plane, the identification information of the flight changes, so that the user can inquire the flight nearby more intuitively and the information of the flight, such as the position, the height, the speed, the distance and the like relative to the user, the method is convenient and quick, and manual retrieval is not needed.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
Fig. 1 is a schematic view of an application scenario of a flight AR display method according to an embodiment of the present invention;
FIG. 2 is a main flowchart of a flight AR display method according to an embodiment of the present invention;
FIG. 3 is a complete flow chart of a flight AR display method according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating an effect of the camera preview interface in an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The flight AR display method provided by the invention is applied to terminal equipment with a camera, a gyroscope and a positioning function, and can be applied to an application scene as shown in figure 1. The terminal device can be a smart phone, a tablet computer and the like, and is not limited to operating systems such as iOS, Android or Hongmon; the positioning function is used for positioning the geographic position of the terminal equipment; the background server is computer equipment for storing flight information; the terminal equipment is connected with the background server through a network.
The flight AR display method, as shown in FIG. 2, includes the following steps:
s1: and acquiring the position information of the terminal equipment through the positioning function, and sending the position information to the background server.
S2: and acquiring flight information within a preset distance radius taking the position information as the center from the background server.
S3: and acquiring the orientation of the terminal equipment and the included angle between the terminal equipment and the ground plane through a gyroscope.
S4: and calculating the projection range of the orientation of the terminal equipment according to the included angle between the preset perspective projection model and the ground plane.
S5: and screening out the target flights in the projection range from the flight information, and projecting the identification information of the target flights onto a preview interface of the camera in a projection point coordinate mode.
The position information comprises the longitude and latitude of the terminal equipment; the flight information comprises the longitude and latitude of the airplane, the height of the airplane, the heading of the airplane, the included angle between the flight line and the geographic north pole, the change rate of the latitude of the airplane, the change rate of the longitude of the airplane and the like.
Specifically, taking a terminal device as a mobile phone as an example for explanation, a data processing flowchart is shown in fig. 3.
The mobile phone calls a positioning function to acquire the longitude and latitude information of the geographic position of the user, and the information is recorded as userLocation = (userLat, userLong); wherein userLat represents the current latitude of the mobile phone, and userLong represents the current longitude of the mobile phone. Then, userLat and userLong are sent to the backend server.
The background server returns all flight information within a certain radius (for example, 100 Km) by taking the position information (userLat, userLong) as a center to the terminal device, wherein the flight information includes flight longitude and latitude (flight long), the flight lat represents the current latitude of the flight, and the flight long represents the current longitude of the flight.
The mobile phone obtains the gesture of the mobile phone in real time through a gyroscope, namely the orientation and the included angle between the orientation and the ground plane are recorded as userDirect, wherein the current orientation of the mobile phone and the angle (0-360) of the geographic north pole are 0, and 0 represents that the mobile phone is directly opposite to the geographic north pole; the orientation of the mobile phone and the angle between the mobile phone and the ground plane are acquired from the gyroscope at intervals of a certain period, and the continuous monitoring is realized every 30 seconds, for example.
The preset perspective projection model is used for calculating whether the plane is in the projection range of the mobile phone orientation or not according to the perspective projection principle in graphics and calculating the specific position of the flight projection to the mobile phone screen.
First, a straight line formed by two coordinate points (userlot, userLong) and (flightland, flightLong) is calculated, and an angle between the straight line and the due north direction is denoted as userToFlightDirect.
Secondly, assuming that the maximum included angle range between the viewpoint of the perspective projection and the projection plane is eyeSpan =60 (unit degree), the minimum angle minDirect = userDirect-eyeSpan/2.0 and the maximum angle maxDirect = userDirect + eyeSpan/2.0 in the projection range can be calculated, that is, if the preset perspective projection model includes that the maximum included angle range between the viewpoint of the perspective projection and the projection plane is N degrees, the projection range is N degrees and is bisected by taking the included angle with the ground plane as the center.
Therefore, only when the userToFlightDirect is greater than or equal to minDirect and less than or equal to maxDirect, the airplane is in the visual field range of the direction in which the mobile phone is facing, namely, in the projection range.
And thirdly, screening the airplanes within the projection range to obtain target flights to be displayed on a preview interface of the mobile phone camera.
Finally, when displaying, displaying the identification information (such as an icon) of the target flight on a mobile phone camera preview interface in a projection point coordinate mode, and specifically comprising the following steps:
calculating the abscissa px of the coordinates of the projection points: and px is obtained by simple mathematical operation through userDirect and userToFlightDirect.
Calculating the abscissa py of the projection point coordinates: the three-dimensional space coordinate transformation algorithm is obtained through geometric transformation and a preset three-dimensional space coordinate transformation algorithm.
And creating an airplane information map on the camera preview interface, and displaying the identification information of the target flight at the (px, py) position of the screen.
Specifically, if the abscissa is DC and the ordinate is HG, the specific calculation mode of DC and HG is:
DE is the screen width of the terminal equipment, eyespan is the maximum included angle of the projection plane, userToFlightdirect is the included angle in the due north direction, HM is the screen height of the terminal equipment, and NF is the height of the airplaneDegree, BF being the distance of the aircraft from the terminal device, AB being
。
In one embodiment, the flight AR display system comprises terminal equipment and a background server, wherein the terminal equipment is connected with the background server through a network;
the terminal equipment is provided with a camera, a gyroscope and a positioning function, wherein the gyroscope is used for acquiring the orientation of the terminal equipment and the included angle between the terminal equipment and the ground plane; the positioning function is used for acquiring the position information of the terminal equipment;
the background server stores flight information and is used for sending the flight information within a preset distance radius taking the position information as the center to the terminal equipment;
the terminal device is used for:
acquiring the position information of the terminal equipment and sending the position information to a background server;
acquiring the orientation of the terminal equipment and the included angle between the terminal equipment and the ground plane through a gyroscope in real time;
calculating the projection range of the orientation of the terminal equipment according to the included angle between the preset perspective projection model and the ground plane;
and screening out the target flights in the projection range from the flight information, and projecting the identification information of the target flights onto a preview interface of the camera in a projection point coordinate mode.
In this embodiment, the flight AR display method is adopted for data processing of the terminal device and the background server, and details are not described here.
In one embodiment, a computer device is provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor executes the computer program to implement the steps of the flight AR display method in the above embodiments, such as steps S1 to S5 shown in fig. 2.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program, when executed by a processor, implements the flight AR display method in the above method embodiments.
The schematic diagram of the implementation effect of the technical scheme is shown in fig. 4, wherein 1 represents a photographing key; 2 represents a common building previewed by the camera; 3 identification information representing the target flight; therefore, a user can inquire nearby flights based on the current geographic position of the user only by opening the camera preview interface, information such as the position, height, speed and distance of the nearby flights relative to the user can be visually checked, and the user experience is better.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (5)
1. A flight AR display method is applied to terminal equipment with a camera, a gyroscope and a positioning function, and comprises the following steps:
acquiring the position information of the terminal equipment through the positioning function, and sending the position information to a background server;
acquiring flight information within a preset distance radius with the position information as the center from the background server;
acquiring the orientation of the terminal equipment and an included angle between the terminal equipment and a ground plane through the gyroscope;
calculating the projection range of the orientation of the terminal equipment according to the included angle between the terminal equipment and the ground plane by using a preset perspective projection model;
screening out target flights in the projection range from the flight information, and projecting identification information of the target flights onto a preview interface of the camera in a projection point coordinate mode;
the preset perspective projection model includes: if the maximum included angle range of the viewpoint of perspective projection and the projection surface is N degrees, the projection range is N degrees; setting the included angle between the projection range and the ground plane as userDirect, setting the minimum angle in the projection range as minDirect and the maximum angle as maxDiect, wherein minDiect is equal to userDirect minus N/2 and maxDiect is equal to userDirect plus N/2; wherein N is a natural number;
the position information comprises the longitude and latitude of the terminal equipment, and the flight information comprises the longitude and latitude of an airplane; the screening of the target flight in the projection range from the flight information includes:
determining a connecting line formed by the terminal equipment and the airplane and an included angle between the connecting line and the due north direction according to the longitude and latitude of the terminal equipment and the longitude and latitude of the airplane;
if the included angle between the connecting line and the due north direction is in the projection range, determining the flight corresponding to the longitude and latitude of the airplane as a target flight;
the projecting the identification information of the target flight onto the preview interface of the camera in a projection point coordinate mode comprises:
calculating to obtain the abscissa of the projection point coordinate according to the included angle between the projection point coordinate and the ground plane and the included angle between the connecting line and the due north direction;
calculating to obtain a vertical coordinate of the projection point coordinate through geometric conversion and a preset three-dimensional space coordinate conversion algorithm;
and if the abscissa is DC, the DC is calculated according to the following formula:
wherein DE is the screen width of the terminal device, eyespan is the maximum included angle of the projection plane, and userToFlightdirect is the included angle in the due north direction;
and if the ordinate is HG, the HG is calculated according to the following formula:
HM is the screen height of the terminal equipment, NF is the height of the airplane, BF is the distance from the airplane to the terminal equipment, and AB is
。
2. The flight AR display method of claim 1, wherein the obtaining of the orientation of the terminal device and the angle between the terminal device and the ground plane via the gyroscope comprises:
and acquiring the orientation of the terminal equipment and the included angle between the terminal equipment and the ground plane through the gyroscope by taking a preset time interval as a period.
3. A flight AR display system for performing the flight AR display method according to claim 1, the flight AR display system comprising a terminal device and a background server, the terminal device and the background server being connected via a network;
the terminal equipment is provided with a camera, a gyroscope and a positioning function, wherein the gyroscope is used for acquiring the orientation of the terminal equipment and the included angle between the terminal equipment and the ground plane; the positioning function is used for acquiring the position information of the terminal equipment;
the background server stores flight information and is used for sending the flight information within a preset distance radius taking the position information as a center to the terminal equipment;
the terminal device is configured to:
acquiring the position information of the terminal equipment and sending the position information to a background server;
acquiring the orientation of the terminal equipment and an included angle between the terminal equipment and a ground plane through the gyroscope in real time;
calculating the projection range of the orientation of the terminal equipment according to the included angle between the terminal equipment and the ground plane by using a preset perspective projection model;
and screening out the target flights in the projection range from the flight information, and projecting the identification information of the target flights onto a preview interface of the camera in a projection point coordinate mode.
4. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the flight AR display method according to any one of claims 1 to 2 when executing the computer program.
5. A computer-readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the steps of the flight AR display method according to any one of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111000868.8A CN113452842B (en) | 2021-08-30 | 2021-08-30 | Flight AR display method, system, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111000868.8A CN113452842B (en) | 2021-08-30 | 2021-08-30 | Flight AR display method, system, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113452842A CN113452842A (en) | 2021-09-28 |
| CN113452842B true CN113452842B (en) | 2021-12-10 |
Family
ID=77818889
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111000868.8A Active CN113452842B (en) | 2021-08-30 | 2021-08-30 | Flight AR display method, system, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113452842B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114821007B (en) * | 2022-06-28 | 2022-09-16 | 中航信移动科技有限公司 | Flight display method and device based on AR, storage medium and electronic equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101330418A (en) * | 2008-07-21 | 2008-12-24 | 中国民航大学 | Apparatus for real time tracking aerodrome flight information and processing method thereof |
| WO2018150492A1 (en) * | 2017-02-15 | 2018-08-23 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッド | Image display method, image display system, flying object, program, and recording medium |
| CN107770496B (en) * | 2017-11-03 | 2019-08-20 | 中国民用航空总局第二研究所 | Aircraft intelligent surveillance method, apparatus and system on panoramic video |
| CN108961842A (en) * | 2018-08-17 | 2018-12-07 | 飞友科技有限公司 | A kind of flight-follow and ground monitoring system based on ADS-B |
-
2021
- 2021-08-30 CN CN202111000868.8A patent/CN113452842B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113452842A (en) | 2021-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11650708B2 (en) | System and method of indicating the distance or the surface of an image of a geographical object | |
| CN107450088B (en) | Location-based service LBS augmented reality positioning method and device | |
| EP3359918B1 (en) | Systems and methods for orienting a user in a map display | |
| CN107993282B (en) | Dynamic measurable live-action map making method | |
| CN108154558B (en) | Augmented reality method, device and system | |
| US11367257B2 (en) | Information processing apparatus, information processing method, and storage medium | |
| US20130201214A1 (en) | Methods, Apparatuses, and Computer-Readable Storage Media for Providing Interactive Navigational Assistance Using Movable Guidance Markers | |
| US11282225B2 (en) | Calibration for vision in navigation systems | |
| US20210352262A1 (en) | Rendering augmented reality with occlusion | |
| JP6087712B2 (en) | DISTRIBUTION DATA DISPLAY DEVICE, METHOD, AND PROGRAM | |
| CN109489654B (en) | Navigation route presenting method, device, equipment and storage medium | |
| CN113452842B (en) | Flight AR display method, system, computer equipment and storage medium | |
| CN112422653A (en) | Scene information pushing method, system, storage medium and equipment based on location service | |
| JP5513806B2 (en) | Linked display device, linked display method, and program | |
| CN110969704A (en) | Marker generation tracking method and device based on AR guide | |
| EP2574029A1 (en) | Object distribution range setting device and object distribution range setting method | |
| EP4057127A2 (en) | Display method, display apparatus, device, storage medium, and computer program product | |
| US10108882B1 (en) | Method to post and access information onto a map through pictures | |
| CN114655240A (en) | Information display method and device, electronic equipment and storage medium | |
| CN114708407A (en) | Virtual three-dimensional space information display method, device and program product | |
| US20200244943A1 (en) | Graphical user interface for indicating off-screen points of interest | |
| US11580649B1 (en) | Graphical element rooftop reconstruction in digital map | |
| US11823329B2 (en) | Efficient graphical element top surface rendering in digital map | |
| US11726740B2 (en) | Immersive audio tours | |
| US20220341737A1 (en) | Method and device for navigating |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |