PL4273656T3 - Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar - Google Patents

Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar

Info

Publication number
PL4273656T3
PL4273656T3 PL23198555.7T PL23198555T PL4273656T3 PL 4273656 T3 PL4273656 T3 PL 4273656T3 PL 23198555 T PL23198555 T PL 23198555T PL 4273656 T3 PL4273656 T3 PL 4273656T3
Authority
PL
Poland
Prior art keywords
drone
flying
glasses
assisting
operator
Prior art date
Application number
PL23198555.7T
Other languages
English (en)
Inventor
Hannu Lesonen
Lassi Immonen
Original Assignee
Anarky Labs Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anarky Labs Oy filed Critical Anarky Labs Oy
Publication of PL4273656T3 publication Critical patent/PL4273656T3/pl

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/22—Command input arrangements
    • G05D1/221—Remote-control arrangements
    • G05D1/222—Remote-control arrangements operated by humans
    • G05D1/224—Output arrangements on the remote controller, e.g. displays, haptics or speakers
    • G05D1/2244—Optic
    • G05D1/2245—Optic providing the operator with a purely computer-generated representation of the environment of the vehicle, e.g. virtual reality
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0038—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64C—AEROPLANES; HELICOPTERS
    • B64C39/00—Aircraft not otherwise provided for
    • B64C39/02—Aircraft not otherwise provided for characterised by special use
    • B64C39/024—Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0022—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement characterised by the communication link
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0044—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/22—Command input arrangements
    • G05D1/221—Remote-control arrangements
    • G05D1/222—Remote-control arrangements operated by humans
    • G05D1/224—Output arrangements on the remote controller, e.g. displays, haptics or speakers
    • G05D1/2244—Optic
    • G05D1/2247—Optic providing the operator with simple or augmented images from one or more cameras
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/22—Command input arrangements
    • G05D1/221—Remote-control arrangements
    • G05D1/226—Communication links with the remote-control arrangements
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20—Control system inputs
    • G05D1/22—Command input arrangements
    • G05D1/229—Command input data, e.g. waypoints
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00—UAVs specially adapted for particular uses or applications
    • B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2201/00—UAVs characterised by their flight controls
    • B64U2201/20—Remote controls
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2109/00—Types of controlled vehicles
    • G05D2109/20—Aircraft, e.g. drones

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Traffic Control Systems (AREA)
  • User Interface Of Digital Computer (AREA)
PL23198555.7T 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar PL4273656T3 (pl)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP23198555.7A EP4273656B1 (en) 2021-02-19 2021-02-19 Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses
EP21158161.6A EP4047434B1 (en) 2021-02-19 2021-02-19 Apparatus, method and software for assisting an operator in flying a drone using a remote controller and ar glasses

Publications (1)

Publication Number Publication Date
PL4273656T3 true PL4273656T3 (pl) 2025-05-12

Family

ID=74672174

Family Applications (2)

Application Number Title Priority Date Filing Date
PL23198555.7T PL4273656T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar
PL21158161.6T PL4047434T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar

Family Applications After (1)

Application Number Title Priority Date Filing Date
PL21158161.6T PL4047434T3 (pl) 2021-02-19 2021-02-19 Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów rozszerzonej rzeczywistości ar

Country Status (8)

Country Link
US (2) US11409280B1 (pl)
EP (2) EP4273656B1 (pl)
JP (1) JP7698725B2 (pl)
KR (1) KR20230158498A (pl)
CN (1) CN117222955A (pl)
ES (2) ES2970543T3 (pl)
PL (2) PL4273656T3 (pl)
WO (1) WO2022175379A1 (pl)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11414189B2 (en) * 2020-04-15 2022-08-16 Edmond A. DeFrank Social distancing methods and devices
PL4273656T3 (pl) * 2021-02-19 2025-05-12 Anarky Labs Oy Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar
US11702191B1 (en) * 2022-10-30 2023-07-18 Archer Aviation, Inc. Systems and methods for controlling an electric vertical take-off and landing aircraft
TWI831495B (zh) * 2022-12-01 2024-02-01 財團法人工業技術研究院 定位系統及定位方法
GB2629638B (en) * 2023-05-05 2025-07-16 J Saunders Mike Methods and apparatus for augmented reality
WO2024261732A1 (en) * 2023-06-23 2024-12-26 National Research Council Of Canada Augmenting uav flight data with regulatory alert
CN120317019B (zh) * 2025-06-11 2025-09-19 之江实验室 仿真无人机的调度方法、装置、电子设备及存储介质

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10488860B1 (en) * 2006-02-21 2019-11-26 Automodality, Inc. Geocoding data for an automated vehicle
US9134534B2 (en) * 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
US9097890B2 (en) * 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc Grating in a light transmissive illumination system for see-through near-eye display glasses
US20150309316A1 (en) * 2011-04-06 2015-10-29 Microsoft Technology Licensing, Llc Ar glasses with predictive control of external device based on event input
FR2957266B1 (fr) * 2010-03-11 2012-04-20 Parrot Procede et appareil de telecommande d'un drone, notamment d'un drone a voilure tournante.
TWI649675B (zh) * 2013-03-28 2019-02-01 新力股份有限公司 Display device
WO2014181380A1 (ja) * 2013-05-09 2014-11-13 株式会社ソニー・コンピュータエンタテインメント 情報処理装置およびアプリケーション実行方法
US8903568B1 (en) * 2013-07-31 2014-12-02 SZ DJI Technology Co., Ltd Remote control method and terminal
JP2015119373A (ja) * 2013-12-19 2015-06-25 ソニー株式会社 画像処理装置および方法、並びにプログラム
US9595138B2 (en) * 2014-05-29 2017-03-14 Commissariat A L'energie Atomique Et Aux Energies Alternatives Augmented reality display device
CN107291104A (zh) * 2014-07-30 2017-10-24 深圳市大疆创新科技有限公司 目标追踪系统及方法
BR112017018874A2 (pt) * 2015-03-01 2018-04-17 Aris Md Inc método de facilitamento de um procedimento em relação a um domínio morfológico, sistema, e, meio legível por máquina não transitório
FR3035523B1 (fr) * 2015-04-23 2017-04-21 Parrot Systeme de pilotage de drone en immersion
JP6572618B2 (ja) * 2015-05-08 2019-09-11 富士通株式会社 情報処理装置、情報処理プログラム、情報処理方法、端末装置、設定方法、設定プログラム
FR3046226B1 (fr) * 2015-12-29 2020-02-14 Thales Affichage de donnees meteorologiques dans un aeronef
FR3046225B1 (fr) * 2015-12-29 2019-06-28 Thales Affichage de donnees meteorologiques dans un aeronef
US10317989B2 (en) * 2016-03-13 2019-06-11 Logitech Europe S.A. Transition between virtual and augmented reality
WO2017185316A1 (zh) * 2016-04-29 2017-11-02 深圳市大疆创新科技有限公司 一种无人机第一视角飞行的控制方法及系统、智能眼镜
US10474144B2 (en) * 2016-08-01 2019-11-12 The United States Of America, As Represented By The Secretary Of The Navy Remote information collection, situational awareness, and adaptive response system for improving advance threat awareness and hazardous risk avoidance
WO2018086130A1 (zh) * 2016-11-14 2018-05-17 深圳市大疆创新科技有限公司 飞行轨迹的生成方法、控制装置及无人飞行器
CN106500716A (zh) * 2016-12-13 2017-03-15 英业达科技有限公司 车辆导航投影系统及其方法
CN106643781A (zh) * 2016-12-14 2017-05-10 英业达科技有限公司 车辆导航显示系统及其方法
JP2018112809A (ja) * 2017-01-10 2018-07-19 セイコーエプソン株式会社 頭部装着型表示装置およびその制御方法、並びにコンピュータープログラム
US10532814B2 (en) * 2017-09-11 2020-01-14 Disney Enterprises, Inc. Augmented reality travel route planning
US20190088025A1 (en) * 2017-09-15 2019-03-21 DroneBase, Inc. System and method for authoring and viewing augmented reality content with a drone
JP7389032B2 (ja) * 2017-12-14 2023-11-29 マジック リープ， インコーポレイテッド 仮想アバタのコンテキストベースのレンダリング
US10678238B2 (en) * 2017-12-20 2020-06-09 Intel IP Corporation Modified-reality device and method for operating a modified-reality device
US11153503B1 (en) * 2018-04-26 2021-10-19 AI Incorporated Method and apparatus for overexposing images captured by drones
JP2019206262A (ja) * 2018-05-29 2019-12-05 日本精機株式会社 表示装置
JP2019211249A (ja) * 2018-05-31 2019-12-12 パナソニック株式会社 飛行物体検知システムおよび飛行物体検知方法
WO2020035932A1 (ja) * 2018-08-16 2020-02-20 楽天株式会社 無人航空機制御システム、無人航空機制御方法、及びプログラム
CN112105559B (zh) * 2018-11-30 2024-09-13 乐天集团股份有限公司 显示控制系统、显示控制装置及显示控制方法
CN110244760A (zh) * 2019-06-06 2019-09-17 深圳市道通智能航空技术有限公司 一种避障方法、装置和电子设备
KR20210078164A (ko) * 2019-12-18 2021-06-28 엘지전자 주식회사 드론을 제어하기 위한 사용자 단말, 시스템 및 제어 방법
US11043038B1 (en) * 2020-03-16 2021-06-22 Hong Kong Applied Science and Technology Research Institute Company Limited Apparatus and method of three-dimensional interaction for augmented reality remote assistance
US11804052B2 (en) * 2020-03-26 2023-10-31 Seiko Epson Corporation Method for setting target flight path of aircraft, target flight path setting system, and program for setting target flight path
PL4273656T3 (pl) * 2021-02-19 2025-05-12 Anarky Labs Oy Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar

Also Published As

Publication number Publication date
JP2024516480A (ja) 2024-04-16
ES3014104T3 (en) 2025-04-16
EP4047434B1 (en) 2023-11-08
JP7698725B2 (ja) 2025-06-25
US20220269267A1 (en) 2022-08-25
ES2970543T3 (es) 2024-05-29
WO2022175379A1 (en) 2022-08-25
US11669088B2 (en) 2023-06-06
KR20230158498A (ko) 2023-11-20
EP4047434C0 (en) 2023-11-08
US20220269266A1 (en) 2022-08-25
US11409280B1 (en) 2022-08-09
EP4273656A2 (en) 2023-11-08
PL4047434T3 (pl) 2024-04-15
EP4273656B1 (en) 2025-01-29
CN117222955A (zh) 2023-12-12
EP4273656A3 (en) 2023-12-20
EP4273656C0 (en) 2025-01-29
EP4047434A1 (en) 2022-08-24

Similar Documents

Publication Publication Date Title
PL4273656T3 (pl) Urządzenie, sposób i oprogramowanie do wspomagania operatora w pilotowaniu drona z użyciem pilota zdalnego sterowania i okularów ar
EP4113375A4 (en) METHOD AND APPARATUS FOR TEACHING AN IMAGE PROCESSING MODEL
KR102334011B9 (ko) 무선 통신 시스템에서 머신 러닝 기반 제한된 피드백 방법 및 장치
EP3861734A4 (en) SYSTEM AND PROCEDURE FOR QUALITY CONTROL IN AN IMMERSIVE 360 ° VIDEO DURING THE BREAK
EP4270266A4 (en) METHOD AND APPARATUS FOR UPDATE A MACHINE LEARNING MODEL
EP4121951A4 (en) METHOD AND APPARATUS FOR GENERATING A FLOOR PLAN
EP4116894A4 (en) METHOD OF PROCESSING MODEL PARAMETERS AND DEVICE
EP4034988A4 (en) METHOD AND APPARATUS FOR A STAGED WORKFLOW
GB201901210D0 (en) Method and apparatus for manufacturing a consumable unit for an inhalation device, and a consumable unit for an inhalation device
GB202002870D0 (en) A method and system for controlling a storage apparatus
EP3759059B8 (fr) Procede de traitement d'un recipient a paroi en verre et installation afferente
EP4305873A4 (en) METHOD AND APPARATUS FOR RATE CONTROL
EP4206921A4 (en) PROCESS CONTROL METHOD AND APPARATUS
EP4264508A4 (en) METHOD AND DEVICE FOR CONTROLLING TRAINING DATA
EP4018620A4 (en) METHOD AND APPARATUS FOR PERFORMING PROTECTION CONTROL IN A CENTRAL NETWORK
GB201809000D0 (en) An apparatus and a method for controlling steering
EP4387708A4 (en) Method and device for assisting a heart
EP3907662A4 (en) METHOD AND APPARATUS FOR PROCESSING AN ARTIFICIAL NEURON NETWORK MODEL
GB201808999D0 (en) An apparatus and a method for controlling steering
EP4116068A4 (en) DEVICE FOR 3D PRINTING AND CONTROL METHOD THEREOF
EP3918879A4 (en) APPARATUS AND METHOD FOR A HEATED BLANKET
EP3914421A4 (en) ROBOTIC SYSTEM MONITORING METHOD AND APPARATUS
EP4417101A4 (en) METHOD AND DEVICE FOR CONTROLLING A CLEANING DEVICE AND CLEANING DEVICE
GB202417236D0 (en) Method and apparatus for online training radiation image recognition model, and radiation image recognition method and apparatus
PL4444615T3 (pl) Urządzenie i sposób pobierania wody do lecącego samolotu