EP3085073A4 - Object detection apparatus, moving body device control system and program thereof - Google Patents

Object detection apparatus, moving body device control system and program thereof Download PDF

Info

Publication number
EP3085073A4
EP3085073A4 EP14870904.1A EP14870904A EP3085073A4 EP 3085073 A4 EP3085073 A4 EP 3085073A4 EP 14870904 A EP14870904 A EP 14870904A EP 3085073 A4 EP3085073 A4 EP 3085073A4
Authority
EP
European Patent Office
Prior art keywords
program
control system
moving body
detection apparatus
device control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP14870904.1A
Other languages
German (de)
French (fr)
Other versions
EP3085073B1 (en
EP3085073A1 (en
Inventor
Ryosuke Kasahara
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ricoh Co Ltd
Original Assignee
Ricoh Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ricoh Co Ltd filed Critical Ricoh Co Ltd
Publication of EP3085073A1 publication Critical patent/EP3085073A1/en
Publication of EP3085073A4 publication Critical patent/EP3085073A4/en
Application granted granted Critical
Publication of EP3085073B1 publication Critical patent/EP3085073B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60SSERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00Cleaning of vehicles
    • B60S1/02Cleaning windscreens, windows or optical devices
    • B60S1/04Wipers or the like, e.g. scrapers
    • B60S1/06Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • B60S1/0822Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like characterized by the arrangement or type of detection means
    • B60S1/0833Optical rain sensor
    • B60S1/0844Optical rain sensor including a camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • B60Q1/04Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
    • B60Q1/14Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights having dimming means
    • B60Q1/1415Dimming circuits
    • B60Q1/1423Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B60R16/0231Circuits relating to the driving or the functioning of the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/09Taking automatic action to avoid collision, e.g. braking and steering
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141Control of illumination
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • B60Q1/04Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
    • B60Q1/14Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights having dimming means
    • B60Q1/1415Dimming circuits
    • B60Q1/1423Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
    • B60Q1/143Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/30Indexing codes relating to the vehicle environment
    • B60Q2300/31Atmospheric conditions
    • B60Q2300/312Adverse weather
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/40Indexing codes relating to other road users or special conditions
    • B60Q2300/41Indexing codes relating to other road users or special conditions preceding vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/40Indexing codes relating to other road users or special conditions
    • B60Q2300/42Indexing codes relating to other road users or special conditions oncoming vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/108Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/166Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/167Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Transportation (AREA)
  • Mathematical Physics (AREA)
  • Signal Processing (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)
EP14870904.1A 2013-12-19 2014-12-11 Object detection apparatus, moving body device control system and program therefor Active EP3085073B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2013262885 2013-12-19
JP2014209786A JP6380843B2 (en) 2013-12-19 2014-10-14 Object detection apparatus, mobile device control system including the same, and object detection program
PCT/JP2014/083490 WO2015093552A1 (en) 2013-12-19 2014-12-11 Object detection apparatus, moving body device control system and program thereof

Publications (3)

Publication Number Publication Date
EP3085073A1 EP3085073A1 (en) 2016-10-26
EP3085073A4 true EP3085073A4 (en) 2017-04-05
EP3085073B1 EP3085073B1 (en) 2018-05-09

Family

ID=53402896

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14870904.1A Active EP3085073B1 (en) 2013-12-19 2014-12-11 Object detection apparatus, moving body device control system and program therefor

Country Status (5)

Country Link
US (1) US9944293B2 (en)
EP (1) EP3085073B1 (en)
JP (1) JP6380843B2 (en)
CN (1) CN105830428A (en)
WO (1) WO2015093552A1 (en)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017505946A (en) * 2014-01-17 2017-02-23 ケーピーアイティ テクノロジーズ リミテッド Vehicle detection system and method
EP3252707A4 (en) * 2015-01-28 2018-09-19 Kyocera Corporation Image processing apparatus, image processing system, vehicle, imaging apparatus, and image processing method
CN108028022B (en) * 2015-09-30 2021-06-15 索尼公司 Image processing apparatus, image processing method, and vehicle control system
JP6589760B2 (en) * 2016-07-07 2019-10-16 株式会社デンソー Vehicle control device
CN106427902A (en) * 2016-10-26 2017-02-22 江苏金米智能科技有限责任公司 Automatic vehicle windscreen wiper control system based on image detection
CN106446873B (en) * 2016-11-03 2021-01-26 北京旷视科技有限公司 Face detection method and device
US10009554B1 (en) * 2017-02-24 2018-06-26 Lighthouse Ai, Inc. Method and system for using light emission by a depth-sensing camera to capture video images under low-light conditions
CN108605081B (en) * 2017-07-18 2020-09-01 杭州他若信息科技有限公司 Intelligent target tracking
US11460550B2 (en) 2017-09-19 2022-10-04 Veoneer Us, Llc Direct detection LiDAR system and method with synthetic doppler processing
JP2019055756A (en) * 2017-09-22 2019-04-11 トヨタ自動車株式会社 Recognition support apparatus for vehicle
US11194022B2 (en) 2017-09-29 2021-12-07 Veoneer Us, Inc. Detection system with reflection member and offset detection array
JPWO2019069733A1 (en) * 2017-10-06 2020-11-26 ソニーセミコンダクタソリューションズ株式会社 Solid-state image sensor, manufacturing method, and electronic equipment
US11585901B2 (en) 2017-11-15 2023-02-21 Veoneer Us, Llc Scanning lidar system and method with spatial filtering for reduction of ambient light
US11145046B2 (en) * 2018-07-24 2021-10-12 The Regents Of The University Of Michigan Detection of near-field occlusions in images
EP3844714B1 (en) * 2018-10-26 2024-09-25 Samsung Electronics Co., Ltd. Method and apparatus for image segmentation using an event sensor
WO2020145097A1 (en) * 2019-01-10 2020-07-16 株式会社小糸製作所 LiDAR SENSOR UNIT AND VEHICLE SECURITY SYSTEM
CN109886900B (en) * 2019-03-15 2023-04-28 西北大学 Synthetic rain map rain removing method based on dictionary training and sparse representation
US11474218B2 (en) 2019-07-15 2022-10-18 Veoneer Us, Llc Scanning LiDAR system and method with unitary optical element
US11579257B2 (en) 2019-07-15 2023-02-14 Veoneer Us, Llc Scanning LiDAR system and method with unitary optical element
US11313969B2 (en) 2019-10-28 2022-04-26 Veoneer Us, Inc. LiDAR homodyne transceiver using pulse-position modulation
CN110941024B (en) * 2019-12-11 2022-05-17 江西莱利电气有限公司 Device and method for detecting foreign matters in fan based on interference imaging
EP4113478A4 (en) * 2020-02-27 2023-08-16 Koito Manufacturing Co., Ltd. Sensor system, control device, non-transitory computer-readable medium, and computer program
CN112804447B (en) * 2020-12-30 2023-01-17 北京石头创新科技有限公司 Method, device, medium and electronic equipment for detecting near-field object
US12044800B2 (en) 2021-01-14 2024-07-23 Magna Electronics, Llc Scanning LiDAR system and method with compensation for transmit laser pulse effects
US11326758B1 (en) 2021-03-12 2022-05-10 Veoneer Us, Inc. Spotlight illumination system using optical element
US11732858B2 (en) 2021-06-18 2023-08-22 Veoneer Us, Llc Headlight illumination system using optical element
KR20230086979A (en) * 2021-12-09 2023-06-16 현대자동차주식회사 Vehicle, controlling method of vehicle
CN114419076B (en) * 2022-03-28 2022-08-05 杭州微影软件有限公司 Data processing method and device
CN114898577B (en) * 2022-07-13 2022-09-20 环球数科集团有限公司 Road intelligent management system and method for peak road management
US12092278B2 (en) 2022-10-07 2024-09-17 Magna Electronics, Llc Generating a spotlight
CN115934405B (en) * 2023-01-29 2023-07-21 蔚来汽车科技(安徽)有限公司 Detecting multi-system display synchronicity on a display device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013065870A1 (en) * 2011-11-02 2013-05-10 Ricoh Company, Limited Image processing apparatus, image-capturing method, and vehicle
WO2013081162A1 (en) * 2011-11-29 2013-06-06 Ricoh Company, Limited Image processing system, vehicle including the same, image processing method, and computer program product

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4326999B2 (en) * 2003-08-12 2009-09-09 株式会社日立製作所 Image processing system
JP5572954B2 (en) 2009-01-26 2014-08-20 株式会社リコー Image pickup device and image pickup apparatus including the image pickup device
JP5316805B2 (en) 2009-03-16 2013-10-16 株式会社リコー In-vehicle camera device image adjustment device and in-vehicle camera device
JP2010272067A (en) * 2009-05-25 2010-12-02 Hitachi Automotive Systems Ltd Image processing apparatus
JP5376313B2 (en) 2009-09-03 2013-12-25 株式会社リコー Image processing apparatus and image pickup apparatus
EP2517175A4 (en) 2009-12-25 2018-01-10 Ricoh Company, Ltd. Object identifying apparatus, moving body control apparatus, and information providing apparatus
WO2011099404A1 (en) * 2010-02-15 2011-08-18 Ricoh Company, Ltd. Transparent object detection system and transparent flat plate detection system
DE112011102968A5 (en) * 2010-11-30 2013-07-04 Conti Temic Microelectronic Gmbh Detecting raindrops on a glass by means of a camera and lighting
JP5950196B2 (en) 2011-08-30 2016-07-13 株式会社リコー Imaging apparatus, and image analysis apparatus and moving apparatus using the same
JP6098575B2 (en) 2011-11-02 2017-03-22 株式会社リコー Imaging unit, image processing apparatus, and vehicle
JP5846485B2 (en) * 2011-11-30 2016-01-20 株式会社リコー Adhering matter detection apparatus and adhering matter detection method
JP2014032174A (en) 2012-07-13 2014-02-20 Ricoh Co Ltd Imaging device, attachment detection device, apparatus control system for transfer device, and transfer device
EP2879370B1 (en) * 2012-07-27 2020-09-02 Clarion Co., Ltd. In-vehicle image recognizer
RU2571368C1 (en) * 2012-07-27 2015-12-20 Ниссан Мотор Ко., Лтд. Device for detecting three-dimensional objects, method of detecting three-dimensional objects

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013065870A1 (en) * 2011-11-02 2013-05-10 Ricoh Company, Limited Image processing apparatus, image-capturing method, and vehicle
WO2013081162A1 (en) * 2011-11-29 2013-06-06 Ricoh Company, Limited Image processing system, vehicle including the same, image processing method, and computer program product

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2015093552A1 *

Also Published As

Publication number Publication date
WO2015093552A1 (en) 2015-06-25
JP6380843B2 (en) 2018-08-29
US9944293B2 (en) 2018-04-17
JP2015136095A (en) 2015-07-27
US20160280229A1 (en) 2016-09-29
EP3085073B1 (en) 2018-05-09
CN105830428A (en) 2016-08-03
EP3085073A1 (en) 2016-10-26

Similar Documents

Publication Publication Date Title
EP3085073A4 (en) Object detection apparatus, moving body device control system and program thereof
EP3340018A4 (en) Sensor controller, pointing device, and position detection system
EP3001224A4 (en) Position detection device, position detection system, and position detection method
EP3193238A4 (en) Detection device, detection method, control device, and control method
EP3038342A4 (en) Imaging device, control method, and program
EP2999407A4 (en) Sensor apparatus and associated systems and methods
HUE043509T2 (en) Gesture control method, apparatus and system
EP2953110A4 (en) Travel control device and travel control system
EP3087534A4 (en) Analysis device, system and program
EP2992451A4 (en) Application control and monitoring apparatus, systems and methods
EP3015989A4 (en) System analysis device, system analysis method and system analysis program
EP2952992A4 (en) Control system, control device, image processing device, and control method
SG11201508624QA (en) Position detection device, position detection method and moving body system
EP3087735A4 (en) Measuring device, system and program
EP3011924A4 (en) Treatment system, instrument control device, and treatment operation method
EP3098697A4 (en) Position detection device, position detection system, and position detection method
EP3087736A4 (en) Measuring apparatus, system, and program
EP3032840A4 (en) Control system, control method, electrical apparatus, control device, and program
EP2997898A4 (en) Electronic device, control program, control method, and system
EP2882180A4 (en) Control method, control apparatus and control device
EP3006301A4 (en) Derailment sign detection system, control device, derailment sign detection method, and derailment sign detection program
EP3130363A4 (en) Detection device, detection system, detection method, and program
EP3282383A4 (en) Usage control method and system for medical detection device and medical detection device
EP3053348A4 (en) Processing apparatus and control method thereof
EP2953033A4 (en) Control system, control method for control system, and control device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20160513

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20170301

RIC1 Information provided on ipc code assigned before grant

Ipc: B60Q 1/14 20060101ALI20170224BHEP

Ipc: G08G 1/16 20060101ALI20170224BHEP

Ipc: G06K 9/00 20060101AFI20170224BHEP

Ipc: H04N 5/225 20060101ALI20170224BHEP

Ipc: G06K 9/20 20060101ALI20170224BHEP

Ipc: B60W 30/09 20120101ALI20170224BHEP

Ipc: B60R 11/04 20060101ALI20170224BHEP

Ipc: H04N 5/232 20060101ALI20170224BHEP

Ipc: B60Q 1/00 20060101ALI20170224BHEP

Ipc: H04N 7/18 20060101ALI20170224BHEP

Ipc: B60S 1/08 20060101ALI20170224BHEP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602014025406

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04N0005232000

Ipc: G06K0009000000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: B60Q 1/14 20060101ALN20171030BHEP

Ipc: G08G 1/16 20060101ALN20171030BHEP

Ipc: B60S 1/08 20060101ALI20171030BHEP

Ipc: G06K 9/00 20060101AFI20171030BHEP

Ipc: G06K 9/20 20060101ALI20171030BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: G08G 1/16 20060101ALN20171106BHEP

Ipc: G06K 9/00 20060101AFI20171106BHEP

Ipc: B60S 1/08 20060101ALI20171106BHEP

Ipc: G06K 9/20 20060101ALI20171106BHEP

Ipc: B60Q 1/14 20060101ALN20171106BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: G08G 1/16 20060101ALN20171116BHEP

Ipc: G06K 9/20 20060101ALI20171116BHEP

Ipc: G06K 9/00 20060101AFI20171116BHEP

Ipc: B60S 1/08 20060101ALI20171116BHEP

Ipc: B60Q 1/14 20060101ALN20171116BHEP

INTG Intention to grant announced

Effective date: 20171129

RIN1 Information on inventor provided before grant (corrected)

Inventor name: KASAHARA, RYOSUKE

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 998219

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180515

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014025406

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180509

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180809

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180809

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180810

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 998219

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014025406

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181211

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20181231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181211

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181231

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181211

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20191220

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20191220

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20141211

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180509

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180909

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20201211

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602014025406

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G06K0009000000

Ipc: G06V0010000000

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201211

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230522

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231214

Year of fee payment: 10