EP2848995B1 - Bildsystem mit Mehrfachansicht mit einer einzelnen Kamera und einer transreflektiven Vorrichtung - Google Patents

Bildsystem mit Mehrfachansicht mit einer einzelnen Kamera und einer transreflektiven Vorrichtung Download PDF

Info

Publication number
EP2848995B1
EP2848995B1 EP14168898.6A EP14168898A EP2848995B1 EP 2848995 B1 EP2848995 B1 EP 2848995B1 EP 14168898 A EP14168898 A EP 14168898A EP 2848995 B1 EP2848995 B1 EP 2848995B1
Authority
EP
European Patent Office
Prior art keywords
image
camera
perspective
transreflective
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14168898.6A
Other languages
English (en)
French (fr)
Other versions
EP2848995A1 (de
Inventor
Yew Kwang Low
Kok Wee Yeo
Chee Keng Yeo
Ronald M. Taylor
Ward K. Everly
William G. Shogren
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aptiv Technologies Ltd
Original Assignee
Aptiv Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aptiv Technologies Ltd filed Critical Aptiv Technologies Ltd
Publication of EP2848995A1 publication Critical patent/EP2848995A1/de
Application granted granted Critical
Publication of EP2848995B1 publication Critical patent/EP2848995B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00—Stereoscopic photography
    • G03B35/02—Stereoscopic photography by sequential recording
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/02—Bodies
    • G03B17/17—Bodies with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/211—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using temporal multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems

Definitions

  • This disclosure generally relates to multi-view or autostereoscopic image system that uses a single camera to capture multiple views, and more particularly relates to a system that uses a transreflective device to multiplex distinct images to the single camera.
  • the system also includes a mirror arrangement configured to cooperate with the transreflective device to provide the camera the first image when the transreflective device is in the transparent-state, and the second image when the transreflective device in in the reflective-state.
  • the system may be configured such that the camera receives the first image during a first time period, and receives a second image during a second time period distinct from the first time period.
  • the transreflective device may comprise an electrically switchable transreflective mirror (ESTM).
  • the transreflective device may comprise a microshutter array.
  • the system may be configured such that the first image and the second image cooperate to form an autostereoscopic image of the area.
  • the system may be configured such that the first image and the second image cooperate to form a panoramic image of the area.
  • the system may comprise a plurality of transreflective devices configured to provide the camera a third image of the area from a third perspective distinct from the first perspective and the second perspective.
  • Fig. 1 illustrates a non-limiting example of a multi-view image system, hereafter the system 10.
  • the system 10 is configured to capture (i.e. take or store) an autostereoscopic image 14 of an object 12 located in an area 16.
  • the system 10 captures a first image 18 of the object 12 from a first perspective 20, and captures a second image 22 of the object 12 from a second perspective 24 that is distinct from the first perspective 20, as will be recognized by those skilled in the art.
  • the function of the transreflective device 30 may be provided by an electrically switchable transreflective mirror (ESTM) available from Kent Optronics, Inc. located in Hopewell Junction, New York, USA.
  • the function of the transreflective device 30 may be provided by a microshutter array that is described in a paper entitled MAGNETICALLY ACTUATED MICROSHUTTER ARRAYS by Mott et al., published in the Proceedings of Society for Optics and Photonics (SPIE) Vol. 4561 (2001 ), or United States Patent Number 8,218,220 to Dodds et al, issued July 10, 2012 .
  • Such microshutter array may include a metalized surface such as aluminum deposited using known deposition processes commonly used for integrated circuit manufacturing.
  • Fig. 1 illustrates a configuration of the system 10 useful to form the autostereoscopic image 14 of a portion of the area 16 where the first image 18 and the second image 22 cooperate to form an autostereoscopic image 14.
  • the directions of the first perspective 20 and the second perspective 24 may diverge so the first image 18 and the second image 22 do not substantially overlap such that the first image 18 and the second image 22 cooperate to form a panoramic image of the area 16. It is recognized that such a configuration may preclude the camera 26 from viewing any portion of the area 16 in an autostereoscopic fashion.
  • the system 10 may include a mirror arrangement 32 configured to cooperate with the transreflective device 30 to provide the camera 26 the first image 18 when the transreflective device 30 is in the transparent-state, and the second image 22 when the transreflective device 30 is in the reflective-state.
  • the mirror arrangement 32 constitutes a mirror 34. It is contemplated that the mirror 34 is fixed, but could be replaced with a movable mirror (not shown) so that the distance from the camera 26 to where the center lines indicated by the first perspective 20 and the second perspective 24 intersect could be varied. It is also contemplated that the angle of the mirror 34 could be fixed so that the system 10 always takes panoramic image of the area 16.
  • the mirror arrangement 32 may include additional mirrors configured to equalize the optical path length from the camera 26 to the object 12 for the first image 18 and the second image 22, for example. It is noted that without the mirror arrangement 32, the system 10 may still be useful to capture images where the second perspective 24 is oriented at right angles to the first perspective 20.
  • transreflective device 30 and the mirror arrangement 32 could be integrated within the camera between the camera's imager and lens.
  • the size of the devices would be proportionately smaller with the placement within the camera and could be advantageous from a cost integration perspective.
  • Fig. 2 illustrates another non-limiting example of the system 10 that includes a plurality of transreflective devices, including the transreflective device 30, a second transreflective device 30A operated by a second control signal 28A, and a third transreflective device 30B operated by a third control signal 28B.
  • the system 10 may further include mirrors 34A and 34B in addition to the mirror 34.
  • Such a configuration provides the camera 26 a third image 36 of the area 16 from a third perspective 38 distinct from the first perspective 20 and the second perspective 24, and/or a fourth image 40 of the area 16 from a fourth perspective 42 distinct from the first perspective 20, the second perspective 24, and the third perspective 38.
  • the transreflective devices are operated so only one of the images (the first image 18, the second image 22, the third image 36, and the fourth image 40) is received by the camera 26 at any given time).
  • the mirror arrangement 32 may be configured so that various combinations of the images can be paired to form autostereoscopic images.
  • the third image 36 and the fourth image 40 may be used to more accurately estimate a distance from the camera 26 to the object 12 as the spacing of the third perspective 38 and the fourth perspective 42 is the greatest for this non-limiting example.
  • the mirror arrangement 32 may be such that the various perspectives (the first perspective 20, the second perspective 24, the third perspective 38, and the fourth perspective 42 may be oriented to provide a panaoramic view of the area 16, including a view behind the camera 26, i.e. - a direction opposites of the direction to the object 12.
  • the advantage of using transreflective devices instead of beam splitters and shutters is particularly apparent for this example as an image would be greatly reduced if the image encountered two beam splitters before reaching the camera 26.
  • a multi-view image system (the system 10) is provided.
  • Such a system may be particularly useful on a vehicle for detecting objects in an area proximate to the vehicle, especially since the cost of such features on a vehicle are highly scrutinized.
  • the autostereoscopic capability of the system 10 can be used to estimate the distance to an object in front of or behind a vehicle in order to warn the operator of the vehicle, or automatically apply the brakes of the vehicle, for example.
  • the system may also be useful for synthesizing a 'birds-eye' view of the area surrounding the vehicle.
  • the system 10 may also be used inside the vehicle to detect in three dimensions gestures made by the operator or occupants of the vehicle for controlling devices of the vehicle.
  • Non-vehicle applications include gesture recognition by personal computing devices such as smart phones, tablets, personal computers, security systems, and the like.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Cameras In General (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Claims (6)

  1. Bildsystem (10) mit mehreren Ansichten, das umfasst:
    eine einzige Kamera (26), die ausgestaltet ist, um ein Bild aufzunehmen; und
    eine transreflexive Vorrichtung (30), die in einem transparenten Zustand betrieben werden kann, bei dem Licht durch die transreflexive Vorrichtung (30) hindurch geht, um für die Kamera (26) ein erstes Bild (18) eines Gebiets (16) aus einer ersten Perspektive (20) bereitzustellen, und die in einem reflektierenden Zustand betrieben werden kann, bei dem Licht von der transreflexiven Vorrichtung (30) reflektiert wird, um für die Kamera (26) ein zweites Bild (22) des Gebiets (16) aus einer zweiten Perspektive (24) bereitzustellen, die sich von der ersten Perspektive (20) unterscheidet, wobei die transreflexive Vorrichtung (30) einen elektrisch schaltbaren transreflexiven Spiegel (34) (ESTM) oder eine Mikroverschlussmatrix umfasst.
  2. System (10) nach Anspruch 1, wobei das System (10) ferner eine Spiegelanordnung (32) umfasst, die ausgestaltet ist, um mit der transreflexiven Vorrichtung (30) zusammen zu arbeiten, um für die Kamera (26) das erste Bild (18) bereitzustellen, wenn sich die transreflexive Vorrichtung (30) in dem transparenten Zustand befindet, und das zweite Bild (22) bereitzustellen, wenn sich die transreflexive Vorrichtung (30) in dem reflektierenden Zustand befindet.
  3. System (10) nach einem der vorstehenden Ansprüche, wobei das System (10) derart ausgestaltet ist, dass die Kamera (26) das erste Bild (18) während einer ersten Zeitspanne empfängt und ein zweites Bild (22) während einer zweiten Zeitspanne empfängt, die sich von der ersten Zeitspanne unterscheidet.
  4. System (10) nach einem der vorstehenden Ansprüche, wobei das System (10) derart ausgestaltet ist, dass das erste Bild (18) und das zweite Bild (22) zusammenarbeiten, um ein autostereoskopisches Bild (14) des Gebiets (16) auszubilden.
  5. System (10) nach einem der vorstehenden Ansprüche, wobei das System (10) derart ausgestaltet ist, dass das erste Bild (18) und das zweite Bild (22) zusammenarbeiten, um ein Panoramabild des Gebiets (16) auszubilden.
  6. System (10) nach einem der vorstehenden Ansprüche, wobei das System (10) eine Vielzahl transreflexiver Vorrichtungen umfasst, die ausgestaltet sind, um für die Kamera (26) ein drittes Bild (36) des Gebiets (16) aus einer dritten Perspektive (38) bereitzustellen, die sich von der ersten Perspektive (20) und der zweiten Perspektive (24) unterscheidet.
EP14168898.6A 2013-06-04 2014-05-19 Bildsystem mit Mehrfachansicht mit einer einzelnen Kamera und einer transreflektiven Vorrichtung Active EP2848995B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/909,425 US20140355974A1 (en) 2013-06-04 2013-06-04 Multi-view image system with a single camera and a transreflective device

Publications (2)

Publication Number Publication Date
EP2848995A1 EP2848995A1 (de) 2015-03-18
EP2848995B1 true EP2848995B1 (de) 2020-01-08

Family

ID=51022219

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14168898.6A Active EP2848995B1 (de) 2013-06-04 2014-05-19 Bildsystem mit Mehrfachansicht mit einer einzelnen Kamera und einer transreflektiven Vorrichtung

Country Status (3)

Country Link
US (1) US20140355974A1 (de)
EP (1) EP2848995B1 (de)
CN (1) CN104219514A (de)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102089624B1 (ko) * 2013-09-02 2020-03-16 삼성전자주식회사 이미지를 합성하기 위한 방법 및 그 전자 장치
US10592712B2 (en) 2017-12-01 2020-03-17 Datalogic Ip Tech S.R.L. Compact camera module with multilevel zoom and focus distance utilizing a switchable mirror
JP7181790B2 (ja) * 2018-12-28 2022-12-01 株式会社キーエンス レーザ加工装置
CN111722769B (zh) * 2020-07-16 2024-03-05 腾讯科技（深圳）有限公司 交互方法、装置、显示设备和存储介质

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3691656B2 (ja) * 1998-03-31 2005-09-07 株式会社リコー 撮像装置
CN1231071C (zh) * 1998-05-27 2005-12-07 斯夫亚托斯拉夫·伊万诺维奇·阿森尼奇 立体系统
GB2385428A (en) 2002-01-17 2003-08-20 Zoran Perisic Apparatus for creating or viewing three dimensional photography
DE10318258A1 (de) * 2003-04-16 2004-11-04 X3D Technologies Gmbh Anordnung zur zwei- oder dreidimensionalen Darstellung
US6924948B2 (en) * 2003-08-21 2005-08-02 Arc Design, Inc. Multifocal lens system for digital cameras
TWI398718B (zh) * 2007-07-02 2013-06-11 Htc Corp 可攜式電子裝置及可攜式電子裝置之照相模組
JP5152718B2 (ja) * 2007-12-26 2013-02-27 Ｎｌｔテクノロジー株式会社 画像表示装置および端末装置
KR101285474B1 (ko) * 2009-06-16 2013-07-12 인텔 코오퍼레이션 핸드헬드 디바이스의 카메라 응용
US8218220B1 (en) * 2009-12-21 2012-07-10 Raytheon Company Variable aperture optical device having a microshutter
US8362992B2 (en) * 2010-07-21 2013-01-29 Delphi Technologies, Inc. Dual view display system using a transparent display
JP5821150B2 (ja) * 2010-12-29 2015-11-24 オリンパスメモリーワークス株式会社 ３次元画像撮像方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
US20140355974A1 (en) 2014-12-04
CN104219514A (zh) 2014-12-17
EP2848995A1 (de) 2015-03-18

Similar Documents

Publication Publication Date Title
US9749614B2 (en) Image capturing system obtaining scene depth information and focusing method thereof
US9386300B2 (en) Portable device and method for controlling the same
CN103415807B (zh) 立体图像拍摄装置
CN107122770B (zh) 多目相机系统、智能驾驶系统、汽车、方法和存储介质
US10694094B2 (en) Thin multi-aperture imaging system with auto-focus and methods for using same
US20150145950A1 (en) Multi field-of-view multi sensor electro-optical fusion-zoom camera
JP5273356B2 (ja) 複眼画像入力装置及びそれを用いた距離測定装置
EP3718299B1 (de) Einzeloptik für bildgebung mit niedrig- und hochlichtpegel
US20150054958A1 (en) Vehicle safety control apparatus and method using cameras
CN115244451B (zh) 空中影像显示装置
CN108076264A (zh) 摄像装置
WO2020117285A9 (en) A multicamera system for autonamous driving vehicles
US9264612B2 (en) Imaging apparatus and photographing support method
EP2848995A1 (de) Bildsystem mit Mehrfachansicht mit einer einzelnen Kamera und einer transreflektiven Vorrichtung
CN104660980A (zh) 车载图像处理装置和半导体装置
US20110090313A1 (en) Multi-eye camera and method for distinguishing three-dimensional object
JP2020028027A (ja) 車両用周辺表示装置
JP2019032409A (ja) ステレオ画像処理装置
CN103873752A (zh) 一种反射式全景摄像机
JP6035789B2 (ja) 画像合成装置及びプログラム
US20210248770A1 (en) Device
GB2423156A (en) Wide angle camera system with planar and non planar mirrors
KR101673000B1 (ko) 3안 스테레오 이미지를 이용한 피사체 윤곽선 개선 시스템
KR102197196B1 (ko) 차량용 블랙박스의 초점 제어 장치 및 그 방법
JP3088852B2 (ja) ３次元画像入力装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140519

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

R17P Request for examination filed (corrected)

Effective date: 20150918

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: APTIV TECHNOLOGIES LIMITED

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602014059587

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G03B0035000000

Ipc: G03B0017170000

RIC1 Information provided on ipc code assigned before grant

Ipc: G03B 35/02 20060101ALI20190412BHEP

Ipc: H04N 13/211 20180101ALI20190412BHEP

Ipc: G03B 17/17 20060101AFI20190412BHEP

Ipc: H04N 13/282 20180101ALI20190412BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190726

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014059587

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1223431

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200215

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200108

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200531

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200408

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200508

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200408

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200409

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014059587

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1223431

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200108

26N No opposition filed

Effective date: 20201009

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200531

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200531

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200108

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230424

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602014059587

Country of ref document: DE

Owner name: APTIV TECHNOLOGIES AG, CH

Free format text: FORMER OWNER: APTIV TECHNOLOGIES LIMITED, ST. MICHAEL, BB

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250422

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250513

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20260313

Year of fee payment: 13