CN111443723B - Third visual angle view generation and display program of unmanned aerial vehicle - Google Patents

Third visual angle view generation and display program of unmanned aerial vehicle Download PDF

Info

Publication number
CN111443723B
CN111443723B CN202010265314.XA CN202010265314A CN111443723B CN 111443723 B CN111443723 B CN 111443723B CN 202010265314 A CN202010265314 A CN 202010265314A CN 111443723 B CN111443723 B CN 111443723B
Authority
CN
China
Prior art keywords
unmanned aerial
aerial vehicle
flight
map
environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010265314.XA
Other languages
Chinese (zh)
Other versions
CN111443723A (en
Inventor
施展
吴慧垚
金古烃
李裕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Aeronautical Radio Electronics Research Institute
Original Assignee
China Aeronautical Radio Electronics Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Aeronautical Radio Electronics Research Institute filed Critical China Aeronautical Radio Electronics Research Institute
Priority to CN202010265314.XA priority Critical patent/CN111443723B/en
Publication of CN111443723A publication Critical patent/CN111443723A/en
Application granted granted Critical
Publication of CN111443723B publication Critical patent/CN111443723B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • G05D1/0808Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft

Abstract

The invention discloses a program for generating and displaying a third visual angle view of an unmanned aerial vehicle, which comprises the following steps: step 1), according to the position information of the unmanned aerial vehicle, a corresponding three-dimensional environment map is called out from a three-dimensional environment map library, and a virtual flight environment three-dimensional map of a third view angle is drawn; and 2) generating an unmanned aerial vehicle model by utilizing flight parameters of the unmanned aerial vehicle and position information of the unmanned aerial vehicle in combination with a simulation technology, and superposing the unmanned aerial vehicle model on a virtual flight environment three-dimensional map in real time to generate a virtual reality scene of a third visual angle of the unmanned aerial vehicle and displaying the virtual reality scene on a display. The unmanned aerial vehicle environment sensing system can greatly improve the unmanned aerial vehicle environment sensing capability, expand the unmanned aerial vehicle flight range, ensure the flight safety, and can be widely applied to the fields of unmanned aerial vehicle control, unmanned aerial vehicle flight training and the like.

Description

Third visual angle view generation and display program of unmanned aerial vehicle
Technical Field
The invention belongs to an unmanned aerial vehicle visual generation technology, and relates to a program for presenting the flight attitude and the surrounding environment of an unmanned aerial vehicle in the form of a 'emperor visual angle' (third visual angle) in front of the eyes of an unmanned aerial vehicle operator. The technology can be widely applied to the fields of unmanned aerial vehicle entertainment of a consumer machine, unmanned aerial vehicle operator training, low-visibility scene task execution and the like.
Background
In the unmanned aerial vehicle control process, the vision is an important way of communication between an operator and the unmanned aerial vehicle, and is also a necessary condition for guaranteeing the flight safety of the unmanned aerial vehicle and the completion of tasks.
From the perspective of guaranteeing flight safety, the primary task of the unmanned aerial vehicle vision is to provide a clear flight attitude of the unmanned aerial vehicle during flight so as to ensure stronger perceptibility to the environment and situation around the unmanned aerial vehicle during flight of the unmanned aerial vehicle and avoid collision;
from the perspective of guaranteeing task completion, along with the current unmanned aerial vehicle measurement and control distance's increase by a wide margin, the condition that a large amount of unmanned aerial vehicles are in the visual scope can appear, and the main role of unmanned aerial vehicle vision is to provide the completion of front view image guarantee task this moment.
From current market, unmanned aerial vehicle operation vision is mainly first vision, mainly relies on the operation hand to visually operate, perhaps passes back the form of unmanned aerial vehicle operator through unmanned aerial vehicle's front view camera image to realize, and the range of application of unmanned aerial vehicle has been very big restriction in the control of visual scope, can not satisfy the curiosity that the consumer extended more unknown environment through unmanned aerial vehicle, also is difficult to guarantee flight safety. Unmanned aerial vehicle of first visual angle controls the visual angle singlely, the environmental perception is poor, and the improper operation causes "falling machine" or "losing machine" accident very easily, brings loss of property for the consumer, also constitutes the threat to ground safety. Therefore, it is particularly important to design a view generation and display method capable of improving situation awareness of the unmanned aerial vehicle and guaranteeing safe flight outside the visual range of the unmanned aerial vehicle, and the method has great market demands.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a third visual angle view generation and display program of an unmanned aerial vehicle, and by combining real-time position information and flight control parameters of the unmanned aerial vehicle through a flight simulation technology, the real-time flight attitude of the unmanned aerial vehicle in a three-dimensional space is simulated; a flight environment in a third view angle of the unmanned aerial vehicle is sketched through a virtual map construction technology; through the 3D virtual view display technology and the head-mounted display, the real-time flight state of the unmanned aerial vehicle is shown, and the operation experience with more immersion feeling is provided. The unmanned aerial vehicle environment sensing capability can be greatly improved, the flight range of the unmanned aerial vehicle is expanded, the flight safety is guaranteed, the unmanned aerial vehicle environment sensing device can be widely applied to the fields of unmanned aerial vehicle control, unmanned aerial vehicle flight training and the like, and can also be used for executing flight tasks with low visualization degree and severe environment such as an explosion site and the like, and the flight safety is guaranteed. The method can be widely applied to the fields of unmanned aerial vehicle visual range out-of-control, unmanned aerial vehicle visual enhancement, immersed unmanned aerial vehicle operation experience, operation feedback of a third visual angle and the like.
The invention aims at realizing the following technical scheme:
a third perspective view generation and display program for an unmanned aerial vehicle, comprising the steps of:
step 1), according to the position information of the unmanned aerial vehicle, a corresponding three-dimensional environment map is called out from a three-dimensional environment map library, and a virtual flight environment three-dimensional map of a third view angle is drawn;
and 2) generating an unmanned aerial vehicle model by utilizing flight parameters of the unmanned aerial vehicle and position information of the unmanned aerial vehicle in combination with a simulation technology, and superposing the unmanned aerial vehicle model on a virtual flight environment three-dimensional map in real time to generate a virtual reality scene of a third visual angle of the unmanned aerial vehicle and displaying the virtual reality scene on a display.
The invention can be widely applied to the operation of various unmanned aerial vehicles, can effectively expand the use scene and the use efficiency of the unmanned aerial vehicle, and has the following four main beneficial effects:
1) Unmanned aerial vehicle visual range out-of-control
At present, the flight scope of civil unmanned aerial vehicle aircraft concentrates in the space of visual scope radius 500 meters high 120 meters, because the image view angle of the first visual angle of on-vehicle camera is too narrow, leads to unmanned aerial vehicle operator unable comprehensive grasp unmanned aerial vehicle's surrounding flight environment, so hardly guarantees the flight safety of unmanned aerial vehicle outside the visual scope.
Through real-time virtual map construction technology, can be through the flight area map of preloaded (be far away from the visual scope) and unmanned aerial vehicle real-time positional information, construct the virtual flight environment three-dimensional map of unmanned aerial vehicle of third visual angle in flight environment, unmanned aerial vehicle's flight state and unmanned aerial vehicle's during flight surrounding environment all can demonstrate in unmanned aerial vehicle operator's eyes directly perceivedly, guarantee unmanned aerial vehicle safety when flying outside the visual scope.
The flight distance of the unmanned aerial vehicle is liberated beyond the visual range, and the application range of the unmanned aerial vehicle can be greatly expanded. For example, when major natural disasters such as earthquake and explosion occur, rescue workers cannot go deep into an accident scene, and the unmanned aerial vehicle can safely fly outside the visual range by utilizing the virtual reality scene of the third visual angle, and can return the image of the accident scene at the first time by combining with the onboard forward-looking camera, so that first hand data is provided for rescue.
2) Unmanned aerial vehicle vision enhancement
At present, video images for unmanned aerial vehicle operators to view are basically photographed by an onboard camera and then transmitted back to the ground in real time through a wireless link, and the image quality is limited by the photographing quality and the service environment of the camera. When the circumstances that the visibility of service environment such as big fog, smoke and dust is lower appear, unmanned aerial vehicle operator will not be able to control unmanned aerial vehicle according to real-time image, has restricted unmanned aerial vehicle's use.
In the project, the flight images of the third visual angle of the unmanned aerial vehicle are virtual views, the surrounding environment is obtained by real-time construction of map data, the flight attitude is obtained by flight simulation, the virtual views are not limited by the flight environment, and the flight safety can be ensured under the condition of lower visibility through a view enhancement technology.
3) "immersive" unmanned aerial vehicle operation experience
When the traditional unmanned aerial vehicle operates, video images are required to be displayed on a mobile phone or a flat panel display in real time, and the video images are easy to be interfered by environmental factors such as strong light in the using process. Meanwhile, the planar video image experience is single, and the unmanned aerial vehicle operator is difficult to have the operation experience of being personally on the scene.
By using the visual display method designed in the invention, the video image can be displayed in front of the eyes of the unmanned aerial vehicle operator in a 3D mode, thus providing immersed operation experience and enabling the unmanned aerial vehicle operator to have better environment perception capability. Meanwhile, the head-mounted display mode has a more stereoscopic display effect, is not interfered by the environment, and can provide more real operation experience for operators.
4) Operational feedback of "third viewing angle
Because the aerial photographing unmanned aerial vehicle carries expensive photographic equipment, the aerial photographing unmanned aerial vehicle is large in general volume and high in cost, and accidents are easy to occur due to improper operation when flying in complex environments such as cities. According to data statistics, the rate of 'crash' and 'crash' of the aerial photo-level unmanned aerial vehicle during operation reaches 3.4%, and most of the reasons are that an operator cannot correctly judge the relationship between the flight attitude of the unmanned aerial vehicle and the surrounding environment.
In the unmanned aerial vehicle operator training process, a third visual angle is introduced, so that an operator can better sense the surrounding environment of the unmanned aerial vehicle, and avoid obstacles. By combining the third visual angle image of the unmanned aerial vehicle generated by the flight simulation, an operator can better sense the influence of the actions of the operating lever and the throttle lever on the flight attitude of the unmanned aerial vehicle, so that more direct operation feedback can be realized, and the training efficiency of the operator can be improved.
Drawings
Fig. 1 is a schematic flow chart of a third view perspective view generation and display procedure of an unmanned aerial vehicle.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples.
The third view generating and displaying program of the unmanned aerial vehicle in this embodiment is run on the display, and first, a three-dimensional environmental map library of the flight area needs to be loaded in the display in advance, where the three-dimensional environmental map library may be provided by third party software (such as hundred degrees, germany, etc.). After the unmanned aerial vehicle takes off, the position information of the unmanned aerial vehicle is provided through sensors such as GPS or Beidou and the like of the unmanned aerial vehicle, a corresponding three-dimensional environment map is taken out, and a virtual flight environment three-dimensional map of a third visual angle of the unmanned aerial vehicle is constructed in real time. And then combining the flight parameters of the unmanned aerial vehicle and the position information of the unmanned aerial vehicle, and simulating the real-time flight attitude of the unmanned aerial vehicle. And finally, forming a third visual angle virtual reality scene of the unmanned aerial vehicle by utilizing a scene superposition technology, and displaying the third visual angle virtual reality scene on a display. Referring to fig. 1, the method specifically comprises the following steps:
1) And calling out the corresponding three-dimensional environment map from the three-dimensional environment map library according to the position information of the unmanned aerial vehicle, and drawing a virtual flight environment three-dimensional map of a third view angle.
The three-dimensional environment map library is used for constructing a terrain model according to characteristic point elevation and terrain characteristic parameters (such as average elevation, elevation standard deviation and the like) aiming at application scenes of small consumer unmanned aerial vehicles in low altitudes, urban streets, parks and the like; and drawing and measuring the topography and the topography of buildings, greenbelts and water areas of the city and the surrounding environment by adopting a light detection and measurement (LIDAR) tool, carrying out detail modeling on the drawing data by using scene modeling software such as 3DMax, 3D Studio and the like, and finally forming a complete three-dimensional environment map through color and texture processing.
The three-dimensional map of the virtual flight environment at the third view angle can be drawn in real time by only importing the three-dimensional environment map library in the flight boundary of the unmanned aerial vehicle in advance in the display and through the positioning signals of the unmanned aerial vehicle. Meanwhile, in the drawing process, through filtering excessive three-dimensional map details, for example, filtering out information such as rendering, color, and the like of obstacles in an original three-dimensional environment map, the information is processed into information only for keeping outline lines of the obstacles, environment perception required by unmanned aerial vehicle flight is only provided, obstacle avoidance requirements in the unmanned aerial vehicle flight process are guaranteed, and the calculation amount of map construction and view generation can be greatly reduced.
The virtual flying environment three-dimensional map replaces abstract map symbols with visual three-dimensional topography and ground objects. The map exceeds the traditional state of geographic information symbolization, spatial information leveling, solidification and stationing of map content, and enters the stages of exploring a geographic space cognition mode of simulating a person through a multi-sensory channel and performing various spatial geographic analyses under the conditions of dynamic, space-time transformation and multi-dimensional interactable map. In accordance therewith, mapping is transformed from traditional selection, creation, organization coordination and drawing of map symbols to three-dimensional terrain, construction of ground features, generation of multiple sensations, and creation of analytical application models.
2) And generating an unmanned aerial vehicle model by combining the flight parameters of the unmanned aerial vehicle and the position information of the unmanned aerial vehicle with a simulation technology, and generating a virtual reality scene of a third visual angle of the unmanned aerial vehicle by superposing the model of the unmanned aerial vehicle on a virtual flight environment three-dimensional map in real time.
The unmanned aerial vehicle third visual angle virtual reality scene generation technology is that according to the real pose information of an unmanned aerial vehicle, a model of the unmanned aerial vehicle is overlapped in real time in a virtual reality map generated by a real map by utilizing a virtual reality technology, and the eye point position of the third visual angle can be freely adjusted, so that an operator can see the relationship between the unmanned aerial vehicle and the surrounding environment from various visual angles in real time, and especially when the sight of the operator is blocked or the unmanned aerial vehicle flies away from a visual range, the unmanned aerial vehicle flight condition can still be provided for the operator in a clear, accurate and real-time mode, and the operation of the operator is assisted. The virtual drone flight image may be displayed on a head-mounted display or a common display device along with a forward-looking video image captured by the drone.
3) Head-mounted virtual 3D display technology
In part of cinema, the 3D hall uses linear polarization 3D technology, for example, in IMAX cinema, more than 2 projectors are used to realize 3D projection, so that progressive full-high-definition 3D pictures can be projected, and a single household projector can only realize full-high-definition 3D display by accelerating the flicker speed. In order to better reduce the volume, power consumption and weight of the head-mounted display, the effect of 3D display of the image is achieved through two OLED screens in the head-mounted display.
Based on the technology, the generation and display of the third vision of the unmanned aerial vehicle can be realized by relying on a mature 3D display hardware platform in the current market.

Claims (2)

1. A third perspective view generation and display program for an unmanned aerial vehicle, comprising the steps of:
step 1), according to the position information of the unmanned aerial vehicle, a corresponding three-dimensional environment map is called out from a three-dimensional environment map library, and a virtual flight environment three-dimensional map of a third view angle is drawn; the three-dimensional environment map library is aimed at an application scene of the small-sized consumer unmanned aerial vehicle, and a terrain model is built according to characteristic point elevation and terrain characteristic parameters; drawing and measuring topography and topography of buildings, greenbelts and water areas in urban and urban surrounding environments by adopting a light detection and measurement tool, carrying out detail modeling on the drawing data by using scene modeling software, and finally forming a complete three-dimensional environment map through color and texture processing; when a virtual flying environment three-dimensional map is drawn, filtering details of obstacles in the three-dimensional environment map, and only keeping outline lines of the obstacles;
and 2) generating an unmanned aerial vehicle model by utilizing flight parameters of the unmanned aerial vehicle and position information of the unmanned aerial vehicle in combination with a simulation technology, and superposing the flight gesture provided by the unmanned aerial vehicle model on a virtual flight environment three-dimensional map in real time according to the eye point position of the third visual angle to generate a virtual reality scene of the unmanned aerial vehicle at the third visual angle and displaying the virtual reality scene on a display.
2. A third perspective view generation and display procedure for a drone according to claim 1, wherein the display is a head-mounted display.
CN202010265314.XA 2020-04-07 2020-04-07 Third visual angle view generation and display program of unmanned aerial vehicle Active CN111443723B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010265314.XA CN111443723B (en) 2020-04-07 2020-04-07 Third visual angle view generation and display program of unmanned aerial vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010265314.XA CN111443723B (en) 2020-04-07 2020-04-07 Third visual angle view generation and display program of unmanned aerial vehicle

Publications (2)

Publication Number Publication Date
CN111443723A CN111443723A (en) 2020-07-24
CN111443723B true CN111443723B (en) 2023-09-15

Family

ID=71651609

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010265314.XA Active CN111443723B (en) 2020-04-07 2020-04-07 Third visual angle view generation and display program of unmanned aerial vehicle

Country Status (1)

Country Link
CN (1) CN111443723B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112270751A (en) * 2020-10-29 2021-01-26 久瓴(上海)智能科技有限公司 Agriculture and forestry operation scene display method and device, terminal and storage medium
CN113485392B (en) * 2021-06-17 2022-04-08 广东工业大学 Virtual reality interaction method based on digital twins
CN114397960A (en) * 2021-12-28 2022-04-26 深圳潜行创新科技有限公司 Flight control direction visualization method based on intelligent mobile equipment
CN114815903A (en) * 2022-06-29 2022-07-29 沃飞长空科技(成都)有限公司 Flight route visual display method and device, aircraft and storage medium
CN115544673B (en) * 2022-11-28 2023-03-31 四川腾盾科技有限公司 Method for assisting in taking off and landing of large unmanned aerial vehicle
CN117389338B (en) * 2023-12-12 2024-03-08 天津云圣智能科技有限责任公司 Multi-view interaction method and device of unmanned aerial vehicle and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102339021A (en) * 2011-07-21 2012-02-01 成都西麦克虚拟现实电子技术有限公司 UAV(unmanned aerial vehicle) visual simulation system and simulation method
CN104765280A (en) * 2015-03-13 2015-07-08 吉林医药学院 Unmanned aerial vehicle three-dimensional display control comprehensive-training system
CN105391988A (en) * 2015-12-11 2016-03-09 谭圆圆 Multi-view unmanned aerial vehicle and multi-view display method thereof
CN106228615A (en) * 2016-08-31 2016-12-14 陈昊 Unmanned vehicle experiencing system based on augmented reality and experiential method thereof
CN106483973A (en) * 2015-09-02 2017-03-08 中国航空工业第六八研究所 A kind of visualization unmanned aerial vehicle station
WO2017173799A1 (en) * 2016-04-08 2017-10-12 吕佩剑 Head-mounted display apparatus enabling multiple flight-points-of-view
WO2018045538A1 (en) * 2016-09-08 2018-03-15 顾磊 Unmanned aerial vehicle, obstacle avoidance method for same, and obstacle avoidance system thereof
CN108492366A (en) * 2018-03-01 2018-09-04 中国航空无线电电子研究所 Adaptively more scenes synthesize virtual views method to unmanned plane
CN109167643A (en) * 2018-07-06 2019-01-08 北京航空航天大学 A kind of UAV Communication signal simulation generation method based on GIS geographical environment
CN109270941A (en) * 2017-07-18 2019-01-25 李保文 A kind of aerial unmanned plane ultra-viewing distance remote control method
KR20190063883A (en) * 2017-11-30 2019-06-10 로보웍스(주) System for providing augmented reality interactive game contents using a drones
KR20200002213A (en) * 2018-06-29 2020-01-08 현대엠엔소프트 주식회사 Apparatus and method for constructing a 3d space map for route search for unmanned aerial vehicle

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102339021A (en) * 2011-07-21 2012-02-01 成都西麦克虚拟现实电子技术有限公司 UAV(unmanned aerial vehicle) visual simulation system and simulation method
CN104765280A (en) * 2015-03-13 2015-07-08 吉林医药学院 Unmanned aerial vehicle three-dimensional display control comprehensive-training system
CN106483973A (en) * 2015-09-02 2017-03-08 中国航空工业第六八研究所 A kind of visualization unmanned aerial vehicle station
CN105391988A (en) * 2015-12-11 2016-03-09 谭圆圆 Multi-view unmanned aerial vehicle and multi-view display method thereof
WO2017173799A1 (en) * 2016-04-08 2017-10-12 吕佩剑 Head-mounted display apparatus enabling multiple flight-points-of-view
CN106228615A (en) * 2016-08-31 2016-12-14 陈昊 Unmanned vehicle experiencing system based on augmented reality and experiential method thereof
WO2018045538A1 (en) * 2016-09-08 2018-03-15 顾磊 Unmanned aerial vehicle, obstacle avoidance method for same, and obstacle avoidance system thereof
CN109270941A (en) * 2017-07-18 2019-01-25 李保文 A kind of aerial unmanned plane ultra-viewing distance remote control method
KR20190063883A (en) * 2017-11-30 2019-06-10 로보웍스(주) System for providing augmented reality interactive game contents using a drones
CN108492366A (en) * 2018-03-01 2018-09-04 中国航空无线电电子研究所 Adaptively more scenes synthesize virtual views method to unmanned plane
KR20200002213A (en) * 2018-06-29 2020-01-08 현대엠엔소프트 주식회사 Apparatus and method for constructing a 3d space map for route search for unmanned aerial vehicle
CN109167643A (en) * 2018-07-06 2019-01-08 北京航空航天大学 A kind of UAV Communication signal simulation generation method based on GIS geographical environment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于Simulink的无人机模拟系统设计;孙成;唐碧蔚;吴慧垚;张强;;航空电子技术(第01期);全文 *
无人机三维视景仿真系统的设计与实现;谢迪;;硅谷(第01期);全文 *

Also Published As

Publication number Publication date
CN111443723A (en) 2020-07-24

Similar Documents

Publication Publication Date Title
CN111443723B (en) Third visual angle view generation and display program of unmanned aerial vehicle
US11106203B2 (en) Systems and methods for augmented stereoscopic display
US10818088B2 (en) Virtual barrier objects
US10678238B2 (en) Modified-reality device and method for operating a modified-reality device
US11398078B2 (en) Gradual transitioning between two-dimensional and three-dimensional augmented reality images
Krückel et al. Intuitive visual teleoperation for UGVs using free-look augmented reality displays
US9667947B2 (en) Stereoscopic 3-D presentation for air traffic control digital radar displays
AU2002366994A1 (en) Method and system to display both visible and invisible hazards and hazard information
CN109741431B (en) Two-dimensional and three-dimensional integrated electronic map frame
CN109990797A (en) A kind of control method of the augmented reality navigation display for HUD
Marayong et al. Urban air mobility system testbed using cave virtual reality environment
CN108629842B (en) Unmanned equipment motion information providing and motion control method and equipment
WO2021038834A1 (en) Operation simulation system and method for unmanned aircraft
CN115562474A (en) Virtual environment and real scene fusion display system
CN111968221A (en) Dual-mode three-dimensional modeling method and device based on temperature field and live-action video stream
RU2736008C1 (en) Method for generating augmented reality environment
US20220269266A1 (en) Apparatus, method and software for assisting human operator in flying drone using remote controller
WO2023184487A1 (en) Unmanned aerial vehicle obstacle avoidance method and apparatus, unmanned aerial vehicle, remote control device and storage medium
US11967035B1 (en) Visualizing area covered by drone camera
Walko et al. Integration and use of an AR display in a maritime helicopter simulator
Sugisaki et al. Design and Implementation of Multi-layered Seeing-and-moving-through System
Vergara et al. Complementing Human Perception in Remote Site Exploration using Augmented Reality-A Proof of Concept
JP2021033377A (en) Information terminal device, program, presentation system and server
EP4295205A1 (en) Apparatus, method and software for assisting human operator in flying drone using remote controller
Liu et al. 3D interactive virtual reality system based on Wiimote stereo structure

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant