EP3766044C0 - Modellierung einer dreidimensionalen umgebung auf der grundlage eines multikamera-convolver-systems - Google Patents

Modellierung einer dreidimensionalen umgebung auf der grundlage eines multikamera-convolver-systems

Info

Publication number
EP3766044C0
EP3766044C0 EP19709164.8A EP19709164A EP3766044C0 EP 3766044 C0 EP3766044 C0 EP 3766044C0 EP 19709164 A EP19709164 A EP 19709164A EP 3766044 C0 EP3766044 C0 EP 3766044C0
Authority
EP
European Patent Office
Prior art keywords
multicamera
dimensional environment
modeling based
environment modeling
convolution system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
EP19709164.8A
Other languages
English (en)
French (fr)
Other versions
EP3766044A1 (de
EP3766044B1 (de
Inventor
Shabarivas Abhiram
Gilles J C A Backhus
Eugene M Feinberg
Berend Ozceri
Martin Stefan Patz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Recogni Inc
Original Assignee
Recogni Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Recogni Inc filed Critical Recogni Inc
Publication of EP3766044A1 publication Critical patent/EP3766044A1/de
Application granted granted Critical
Publication of EP3766044C0 publication Critical patent/EP3766044C0/de
Publication of EP3766044B1 publication Critical patent/EP3766044B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/05—Geographic models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/579—Depth or shape recovery from multiple images from motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G06T7/596—Depth or shape recovery from multiple images from stereo images from three or more stereo images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Geometry (AREA)
  • Evolutionary Computation (AREA)
  • Computer Graphics (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Remote Sensing (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
EP19709164.8A 2018-03-13 2019-02-13 Modellierung einer dreidimensionalen umgebung auf der grundlage eines multikamera-convolver-systems Active EP3766044B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862642578P 2018-03-13 2018-03-13
US201862690509P 2018-06-27 2018-06-27
PCT/US2019/017789 WO2019177736A1 (en) 2018-03-13 2019-02-13 Three-dimensional environment modeling based on a multicamera convolver system

Publications (3)

Publication Number Publication Date
EP3766044A1 EP3766044A1 (de) 2021-01-20
EP3766044C0 true EP3766044C0 (de) 2023-06-14
EP3766044B1 EP3766044B1 (de) 2023-06-14

Family

ID=65685957

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19709164.8A Active EP3766044B1 (de) 2018-03-13 2019-02-13 Modellierung einer dreidimensionalen umgebung auf der grundlage eines multikamera-convolver-systems

Country Status (4)

Country Link
US (1) US10740964B2 (de)
EP (1) EP3766044B1 (de)
CN (1) CN112166459A (de)
WO (1) WO2019177736A1 (de)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2553148A (en) * 2016-08-26 2018-02-28 Nctech Ltd Modelling system and method
CN107945198B (zh) * 2016-10-13 2021-02-23 北京百度网讯科技有限公司 用于标注点云数据的方法和装置
US10586379B2 (en) * 2017-03-08 2020-03-10 Ebay Inc. Integration of 3D models
US10691968B2 (en) 2018-02-08 2020-06-23 Genetec Inc. Systems and methods for locating a retroreflective object in a digital image
US11727656B2 (en) 2018-06-12 2023-08-15 Ebay Inc. Reconstruction of 3D model with immersive experience
US10834413B2 (en) * 2018-08-24 2020-11-10 Disney Enterprises, Inc. Fast and accurate block matching for computer generated content
US11257242B2 (en) * 2018-12-31 2022-02-22 Wipro Limited Method and device for determining operation of an autonomous device
US10510155B1 (en) * 2019-06-11 2019-12-17 Mujin, Inc. Method and processing system for updating a first image generated by a first camera based on a second image generated by a second camera
US11138751B2 (en) * 2019-07-06 2021-10-05 Toyota Research Institute, Inc. Systems and methods for semi-supervised training using reprojected distance loss
US11158070B2 (en) 2019-10-23 2021-10-26 1974266 AB Ltd (TAGDit) Data processing systems and methods using six-dimensional data transformations
CA3155551C (en) * 2019-10-26 2023-09-26 Louis-Antoine Blais-Morin Automated license plate recognition system and related method
US12456277B2 (en) * 2019-10-29 2025-10-28 Nvidia Corporation Determining object orientation from an image with machine learning
CN111243021A (zh) * 2020-01-06 2020-06-05 武汉理工大学 基于多组合相机的车载视觉定位方法、系统及存储介质
CN111678521B (zh) * 2020-06-18 2021-12-28 上海大学 一种移动机器人定位精度的评估方法和系统
US12051147B1 (en) * 2021-05-18 2024-07-30 Apple Inc. Techniques for point cloud representation
CN114419435B (zh) * 2021-12-31 2026-03-03 联想(北京)有限公司 一种检测方法、装置、设备以及存储介质
CN116166976B (zh) * 2023-03-01 2026-03-03 京能东风(十堰)能源发展有限公司 一种用于热力站负荷预测输入变量分类的改进型聚类算法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102129708A (zh) * 2010-12-10 2011-07-20 北京邮电大学 增强现实环境中快速多层次虚实遮挡处理方法
US11282287B2 (en) * 2012-02-24 2022-03-22 Matterport, Inc. Employing three-dimensional (3D) data predicted from two-dimensional (2D) images using neural networks for 3D modeling applications and other applications
CA2834877A1 (en) * 2012-11-28 2014-05-28 Henry Leung System and method for event monitoring and detection
CN104881881B (zh) * 2014-02-27 2018-04-10 株式会社理光 运动对象表示方法及其装置
US9612123B1 (en) 2015-11-04 2017-04-04 Zoox, Inc. Adaptive mapping to navigate autonomous vehicles responsive to physical environment changes
US9958864B2 (en) 2015-11-04 2018-05-01 Zoox, Inc. Coordination of dispatching and maintaining fleet of autonomous vehicles
US10181195B2 (en) 2015-12-28 2019-01-15 Facebook, Inc. Systems and methods for determining optical flow
US10551838B2 (en) 2017-08-08 2020-02-04 Nio Usa, Inc. Method and system for multiple sensor correlation diagnostic and sensor fusion/DNN monitor for autonomous driving application
WO2019075276A1 (en) * 2017-10-11 2019-04-18 Aquifi, Inc. SYSTEMS AND METHODS FOR IDENTIFYING OBJECT
US10580148B2 (en) * 2017-12-21 2020-03-03 Microsoft Technology Licensing, Llc Graphical coordinate system transform for video frames

Also Published As

Publication number Publication date
WO2019177736A1 (en) 2019-09-19
EP3766044A1 (de) 2021-01-20
US10740964B2 (en) 2020-08-11
CN112166459A (zh) 2021-01-01
US20190287297A1 (en) 2019-09-19
EP3766044B1 (de) 2023-06-14

Similar Documents

Publication Publication Date Title
EP3766044C0 (de) Modellierung einer dreidimensionalen umgebung auf der grundlage eines multikamera-convolver-systems
EP3673233A4 (de) Fahrzeugumgebungsmodellierung mit einer kamera
EP3812309A4 (de) Dreidimensionales lagersystem
EP3692146A4 (de) Auf crispr-effektor-system basierende diagnose
EP3777900A4 (de) Räumliches umgebungsverwaltungssystem
EP3737997A4 (de) Systeme und verfahren zur darstellung von daten aus einer 3d-umgebung
EP3652474A4 (de) Optisches unterwassermesssystem
EP3895515A4 (de) Autonomes fahrsystem
EP3915082A4 (de) Ölfeldsystem
EP3881153A4 (de) Positions- und ausrichtungsverfolgungssystem
EP3577619A4 (de) System zur geofence-bewertung
EP3299975A4 (de) Vorrichtung zur erzeugung eines innenraumumgebungsmodells
EP3484406A4 (de) Vorrichtung zum spülen von instrumenten
EP3842887A4 (de) Automatisches fahrsystem
EP3774416A4 (de) System zur überwachung der umwelt
EP3601054A4 (de) Autonomes flugzeuglokalisationssystem
EP3804042C0 (de) Sicherungssystem für steckverbinder
EP3427307A4 (de) Beleuchtungssystem mit linsenanordnung
EP4162766A4 (de) System zur physikalischen virtuellen umgebungsfusion
EP3850629A4 (de) Globales abstammungsbestimmungssystem
EP3882181A4 (de) Speichersystem
EP3853639A4 (de) Bildgebungssystem
EP3632139A4 (de) Verfahren und systeme zur benennung eines abholorts
EP3786019A4 (de) Konvoifahrsystem
EP3759428A4 (de) Metrologiesystem

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200908

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220818

RIN1 Information on inventor provided before grant (corrected)

Inventor name: PATZ, MARTIN, STEFAN

Inventor name: OZCERI, BEREND

Inventor name: FEINBERG, EUGENE, M.

Inventor name: BACKHUS, GILLES, J.C.A.

Inventor name: ABHIRAM, SHABARIVAS

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: CH

Ref legal event code: PK

Free format text: BERICHTIGUNGEN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019030990

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1579771

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230715

RAP4 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: RECOGNI INC.

RIN2 Information on inventor provided after grant (corrected)

Inventor name: PATZ, MARTIN, STEFAN

Inventor name: OZCERI, BEREND

Inventor name: FEINBERG, EUGENE, M.

Inventor name: BACKHUS, GILLES, J.C.A.

Inventor name: ABHIRAM, SHABARIVAS

U01 Request for unitary effect filed

Effective date: 20230629

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI

Effective date: 20230710

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230914

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230915

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231014

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231014

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602019030990

Country of ref document: DE

U20 Renewal fee for the european patent with unitary effect paid

Year of fee payment: 6

Effective date: 20240227

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240227

Year of fee payment: 6

26N No opposition filed

Effective date: 20240315

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190213

U90 Renewal fees not paid: noting of loss of rights

Free format text: RENEWAL FEE NOT PAID FOR YEAR 07

Effective date: 20250919

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20250213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230614

U93 Unitary patent lapsed

Free format text: RENEWAL FEE NOT PAID

Effective date: 20250228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20250213