NL2023628B9 - Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, autonoom rijdend voer- of (lucht)vaartuig voorzien van een dergelijk systeem. - Google Patents

Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, autonoom rijdend voer- of (lucht)vaartuig voorzien van een dergelijk systeem.

Info

Publication number
NL2023628B9
NL2023628B9 NL2023628A NL2023628A NL2023628B9 NL 2023628 B9 NL2023628 B9 NL 2023628B9 NL 2023628 A NL2023628 A NL 2023628A NL 2023628 A NL2023628 A NL 2023628A NL 2023628 B9 NL2023628 B9 NL 2023628B9
Authority
NL
Netherlands
Prior art keywords
vehicle
air
camera images
driving vehicle
steering
Prior art date
Application number
NL2023628A
Other languages
English (en)
Other versions
NL2023628B1 (nl
Inventor
Wilhelmus Maria Van Bentum Johannes
Johannes Smit Stephan
Original Assignee
Wilhelmus Maria Van Bentum Johannes
Johannes Smit Stephan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wilhelmus Maria Van Bentum Johannes, Johannes Smit Stephan filed Critical Wilhelmus Maria Van Bentum Johannes
Priority to NL2023628A priority Critical patent/NL2023628B9/nl
Priority to US16/987,612 priority patent/US12001207B2/en
Priority to EP20190016.4A priority patent/EP3786756B1/en
Application granted granted Critical
Publication of NL2023628B1 publication Critical patent/NL2023628B1/nl
Publication of NL2023628B9 publication Critical patent/NL2023628B9/nl
Priority to US18/432,397 priority patent/US20240176345A1/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0088Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/06Automatic manoeuvring for parking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/001Planning or execution of driving tasks
    • B60W60/0015Planning or execution of driving tasks specially adapted for safety
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/3407Route searching; Route guidance specially adapted for specific applications
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3602Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0251Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/0274Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/24Arrangements for determining position or orientation
    • G05D1/243Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals
    • G05D1/2435Extracting 3D information
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/24Arrangements for determining position or orientation
    • G05D1/246Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/24Arrangements for determining position or orientation
    • G05D1/247Arrangements for determining position or orientation using signals provided by artificial sources external to the vehicle, e.g. navigation beacons
    • G05D1/249Arrangements for determining position or orientation using signals provided by artificial sources external to the vehicle, e.g. navigation beacons from positioning sensors located off-board the vehicle, e.g. from cameras
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/40Control within particular dimensions
    • G05D1/46Control of position or course in three dimensions
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/80Arrangements for reacting to or preventing system or operator failure
    • G05D1/81Handing over between on-board automatic and on-board manual control
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/003Flight plan management
    • G08G5/0034Assembly of a flight plan
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0047Navigation or guidance aids for a single aircraft
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00Input parameters relating to overall vehicle dynamics

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Game Theory and Decision Science (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Traffic Control Systems (AREA)
  • Navigation (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)

Abstract

Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, met een zekerheidsbepalingsmodule die is ingericht voor het ontvangen van livecamerabeelden van de camera, het ontvangen van geannoteerde voor beeldherkenning voorbewerkte vorm van geregistreerde opgeslagen camerabeelden van een interne zekerheidsbepalingsmodulegegevensopslag, het ontvangen van de ten minste éne navigatieinstructie van de navigatiemodule; het vergelijken van de live-camerabeelden met de opgeslagen camerabeelden en het bepalen van een mate van overeenkomst; en het bepalen van een zekerheidswaarde die aangeeft in hoeverre de bepaalde mate van overeenkomst volstaat om de ten minst éne navigatieinstructie uit te voeren; waarbij de stuurmodule is ingericht voor: het van de navigatiemodule ontvangen van de ten minste éne navigatieinstructie; het van de camera ontvangen van de live-camerabeelden; het van de zekerheidsbepalingsmodule ontvangen van een zekerheidswaarde; het vergelijken van de zekerheidswaarde met een voorafbepaalde waarde; indien de zekerheidswaarde groter is dan de voorafbepaalde waarde: het omzetten van de ten minste éne navigatieinstructie en de camerabeelden in stuur- en versnellingswaarden voor het bestuurbaar autonoom rijdend voer- of (lucht)vaartuig.
NL2023628A 2019-08-09 2019-08-09 Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, autonoom rijdend voer- of (lucht)vaartuig voorzien van een dergelijk systeem. NL2023628B9 (nl)

Priority Applications (4)

Application Number Priority Date Filing Date Title
NL2023628A NL2023628B9 (nl) 2019-08-09 2019-08-09 Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, autonoom rijdend voer- of (lucht)vaartuig voorzien van een dergelijk systeem.
US16/987,612 US12001207B2 (en) 2019-08-09 2020-08-07 System for controlling an autonomous driving vehicle or air vessel, which can be controlled on the basis of steering and acceleration values, and an autonomous driving vehicle or air vessel provided with such a system
EP20190016.4A EP3786756B1 (en) 2019-08-09 2020-08-07 System for controlling a vehicle or (air)craft which is controllable on the basis of control values and acceleration values and moves autonomously, autonomously moving vehicle or (air)craft provided with such a system
US18/432,397 US20240176345A1 (en) 2019-08-09 2024-02-05 System for controlling an autonomous driving vehicle or air vessel, which can be controlled on the basis of steering and acceleration values, and an autonomous driving vehicle or air vessel provided with such a system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
NL2023628A NL2023628B9 (nl) 2019-08-09 2019-08-09 Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, autonoom rijdend voer- of (lucht)vaartuig voorzien van een dergelijk systeem.

Publications (2)

Publication Number Publication Date
NL2023628B1 NL2023628B1 (nl) 2021-02-23
NL2023628B9 true NL2023628B9 (nl) 2021-08-20

Family

ID=68073134

Family Applications (1)

Application Number Title Priority Date Filing Date
NL2023628A NL2023628B9 (nl) 2019-08-09 2019-08-09 Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, autonoom rijdend voer- of (lucht)vaartuig voorzien van een dergelijk systeem.

Country Status (3)

Country Link
US (2) US12001207B2 (nl)
EP (1) EP3786756B1 (nl)
NL (1) NL2023628B9 (nl)

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9720410B2 (en) * 2014-03-03 2017-08-01 Waymo Llc Remote assistance for autonomous vehicles in predetermined situations
US9151626B1 (en) * 2014-04-11 2015-10-06 Nissan North America, Inc. Vehicle position estimation system
US10088736B2 (en) * 2015-09-24 2018-10-02 Amazon Technologies, Inc. Unmanned aerial vehicle descent
JP6380422B2 (ja) * 2016-02-05 2018-08-29 トヨタ自動車株式会社 自動運転システム
WO2017165383A1 (en) * 2016-03-21 2017-09-28 Wal-Mart Stores, Inc. Systems and methods for autonomous drone navigation
EP3497405B1 (en) * 2016-08-09 2022-06-15 Nauto, Inc. System and method for precision localization and mapping
US10452068B2 (en) * 2016-10-17 2019-10-22 Uber Technologies, Inc. Neural network system for autonomous vehicle control
US10922903B2 (en) * 2017-07-11 2021-02-16 Waymo Llc Methods and systems for providing remote assistance to a stopped vehicle
US11222299B1 (en) * 2017-08-31 2022-01-11 Amazon Technologies, Inc. Indoor deliveries by autonomous vehicles
US11003183B2 (en) * 2017-09-13 2021-05-11 Baidu Usa Llc Driving scene based path planning for autonomous driving vehicles
NL2019756B1 (nl) 2017-10-18 2019-04-25 Johannes Smit Stephan Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voertuig, autonoom rijdend voertuig voorzien van een dergelijk systeem en werkwijze voor het trainen van een dergelijk systeem.
US11620906B2 (en) * 2017-12-27 2023-04-04 Direct Current Capital LLC Method for accessing supplemental sensor data from other vehicles
KR20200100810A (ko) * 2018-02-01 2020-08-26 토르드라이브 아이엔씨 자율 주행을 위한 자차 위치 예측 방법 및 자율 주행 장치
CN110602642A (zh) * 2018-06-13 2019-12-20 北京嘀嘀无限科技发展有限公司 一种基于云服务的导航播报方法及系统
US11966838B2 (en) * 2018-06-19 2024-04-23 Nvidia Corporation Behavior-guided path planning in autonomous machine applications
US11294387B2 (en) * 2019-06-17 2022-04-05 Toyota Research Institute, Inc. Systems and methods for training a vehicle to autonomously drive a route
JP7268740B2 (ja) * 2019-07-26 2023-05-08 株式会社Soken 車両制御装置、及び車両制御方法

Also Published As

Publication number Publication date
US20210041872A1 (en) 2021-02-11
EP3786756A1 (en) 2021-03-03
EP3786756B1 (en) 2022-08-31
US12001207B2 (en) 2024-06-04
US20240176345A1 (en) 2024-05-30
NL2023628B1 (nl) 2021-02-23

Similar Documents

Publication Publication Date Title
Jung et al. Perception, guidance, and navigation for indoor autonomous drone racing using deep learning
US10591292B2 (en) Method and device for movable object distance detection, and aerial vehicle
GB2584810A (en) Vehicle control system and control method
WO2019180506A3 (en) Systems and methods for navigating a vehicle
MX2017002722A (es) Funcionamiento de vehiculo autonomo en base al control predictivo basado en modelo interactivo.
Park et al. Development of an unmanned surface vehicle system for the 2014 Maritime RobotX Challenge
US9656593B2 (en) Flight vehicle autopilot
Tanakitkorn A review of unmanned surface vehicle development
EP3736191A1 (en) Electronic device and method for vehicle driving assistance
JP5272560B2 (ja) 飛しょう体の誘導方法及び誘導装置
NL2023628B9 (nl) Systeem voor het aansturen van een op basis van stuur- en versnellingswaarden bestuurbaar autonoom rijdend voer- of (lucht)vaartuig, autonoom rijdend voer- of (lucht)vaartuig voorzien van een dergelijk systeem.
JP6302860B2 (ja) 船舶
US20190384325A1 (en) Method for maintaining stability of mobile robot and mobile robot thereof
KR20160049352A (ko) 무인 수상정의 긴급 임무수행 시스템
Ura et al. Observation behavior of an AUV for ship wreck investigation
US10227141B2 (en) Safety function module for a vehicle, in particular for a flying object
US11221194B2 (en) IMUless flight control system
SE536875C2 (sv) Anordning och förfarande för hothantering för ett markbaserat fordon
US10969786B1 (en) Determining and using relative motion of sensor modules
US20160283802A1 (en) Apparatus and method of diagnosing recognition failure
KR20140076433A (ko) 학습 정보를 이용한 차선 유도 추종선 조정 방법 및 그 시스템
Nakamura et al. Development of Dual-eyes Docking System for AUV with Lighting 3D Marker
US20190266440A1 (en) Self-Adapting Guidance Method for Unmanned Underwater Vehicle Docking
US20220063616A1 (en) System for controlling vehicle speed
GB2548166A8 (en) Determining whether an object has entered a certain space

Legal Events

Date Code Title Description
TK Erratum

Effective date: 20210825