JP5999032B2 - 車載表示装置およびプログラム - Google Patents

車載表示装置およびプログラム Download PDF

Info

Publication number
JP5999032B2
JP5999032B2 JP2013125597A JP2013125597A JP5999032B2 JP 5999032 B2 JP5999032 B2 JP 5999032B2 JP 2013125597 A JP2013125597 A JP 2013125597A JP 2013125597 A JP2013125597 A JP 2013125597A JP 5999032 B2 JP5999032 B2 JP 5999032B2
Authority
JP
Japan
Prior art keywords
obstacle
image
vehicle
driver
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2013125597A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015000630A5 (enExample
JP2015000630A (ja
Inventor
整 伊口
整 伊口
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Priority to JP2013125597A priority Critical patent/JP5999032B2/ja
Priority to PCT/JP2014/002741 priority patent/WO2014199574A1/ja
Priority to US14/897,583 priority patent/US9878667B2/en
Priority to DE112014002804.5T priority patent/DE112014002804T5/de
Publication of JP2015000630A publication Critical patent/JP2015000630A/ja
Publication of JP2015000630A5 publication Critical patent/JP2015000630A5/ja
Application granted granted Critical
Publication of JP5999032B2 publication Critical patent/JP5999032B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B60K35/235—Head-up displays [HUD] with means for detecting the driver's gaze direction or eye points
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/177—Augmented reality
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/178—Warnings
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/179—Distances to obstacles or vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/307—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261—Obstacle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Instrument Panels (AREA)
  • Traffic Control Systems (AREA)
JP2013125597A 2013-06-14 2013-06-14 車載表示装置およびプログラム Expired - Fee Related JP5999032B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2013125597A JP5999032B2 (ja) 2013-06-14 2013-06-14 車載表示装置およびプログラム
PCT/JP2014/002741 WO2014199574A1 (ja) 2013-06-14 2014-05-26 車載表示装置およびプログラム製品
US14/897,583 US9878667B2 (en) 2013-06-14 2014-05-26 In-vehicle display apparatus and program product
DE112014002804.5T DE112014002804T5 (de) 2013-06-14 2014-05-26 Innenanzeigevorrichtung für Fahrzeuge und Programmprodukt

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2013125597A JP5999032B2 (ja) 2013-06-14 2013-06-14 車載表示装置およびプログラム

Publications (3)

Publication Number Publication Date
JP2015000630A JP2015000630A (ja) 2015-01-05
JP2015000630A5 JP2015000630A5 (enExample) 2015-08-27
JP5999032B2 true JP5999032B2 (ja) 2016-09-28

Family

ID=52021895

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2013125597A Expired - Fee Related JP5999032B2 (ja) 2013-06-14 2013-06-14 車載表示装置およびプログラム

Country Status (4)

Country Link
US (1) US9878667B2 (enExample)
JP (1) JP5999032B2 (enExample)
DE (1) DE112014002804T5 (enExample)
WO (1) WO2014199574A1 (enExample)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWM492262U (zh) * 2014-07-18 2014-12-21 Seeways Technology Inc 自動顯示三態視角之倒車顯影系統及其倒車攝影裝置
KR102263725B1 (ko) * 2014-11-21 2021-06-11 현대모비스 주식회사 주행 정보 제공 장치 및 주행 정보 제공 방법
JP6415943B2 (ja) 2014-11-21 2018-10-31 三菱重工サーマルシステムズ株式会社 ヒートポンプ式車両用空調システム
JP6520668B2 (ja) * 2015-02-09 2019-05-29 株式会社デンソー 車両用表示制御装置及び車両用表示ユニット
WO2017022047A1 (ja) * 2015-08-03 2017-02-09 三菱電機株式会社 表示制御装置、表示装置及び表示制御方法
JP2017123029A (ja) * 2016-01-06 2017-07-13 富士通株式会社 情報通知装置、情報通知方法及び情報通知プログラム
JP6512449B2 (ja) 2016-01-20 2019-05-15 パナソニックＩｐマネジメント株式会社 表示装置
DE102016001201B4 (de) * 2016-02-03 2021-07-08 Audi Ag Kraftfahrzeug
DE102016001204B4 (de) * 2016-02-03 2021-07-08 Audi Ag Kraftfahrzeug
JP6658859B2 (ja) * 2016-02-18 2020-03-04 株式会社リコー 情報提供装置
DE102016211737A1 (de) * 2016-06-29 2018-01-04 Bayerische Motoren Werke Aktiengesellschaft Kraftfahrzeug
JP6690715B2 (ja) * 2016-08-09 2020-04-28 日産自動車株式会社 自動運転車両の制御方法及び制御装置
DE102016225346A1 (de) 2016-12-16 2018-06-21 Robert Bosch Gmbh Verfahren zum Ermitteln eines Anzeigebereichs mindestens eines Elements auf einer Anzeigevorrichtung
JP6972549B2 (ja) * 2016-12-28 2021-11-24 株式会社リコー Ｈｕｄ装置、車両装置及び表示方法
EP3648096A4 (en) * 2017-06-28 2021-06-09 Nippon Seiki Co., Ltd. IMAGE PROCESSING UNIT AND HEAD-UP DISPLAY DEVICE EQUIPPED WITH IT
US10495733B2 (en) * 2018-02-26 2019-12-03 GM Global Technology Operations LLC Extendable sensor mount
JP7232320B2 (ja) * 2019-03-28 2023-03-02 本田技研工業株式会社 鞍乗り型車両の運転支援システム
WO2020230612A1 (ja) * 2019-05-15 2020-11-19 日産自動車株式会社 表示制御方法及び表示制御装置
JP7206010B2 (ja) * 2019-09-19 2023-01-17 株式会社 ミックウェア 制御装置
CN115835994A (zh) * 2020-07-29 2023-03-21 石通瑞吉电子公司 用于通知车辆乘员潜在车辆威胁的严重性和位置的系统和方法
JP7347406B2 (ja) * 2020-11-30 2023-09-20 トヨタ自動車株式会社 画像表示装置、プログラム及び画像表示方法
KR20250103813A (ko) 2021-02-08 2025-07-07 사이트풀 컴퓨터스 리미티드 생산성을 위한 확장 현실
JP7558850B2 (ja) * 2021-03-12 2024-10-01 本田技研工業株式会社 注意喚起システム、及び注意喚起方法
JP7574113B2 (ja) * 2021-03-12 2024-10-28 本田技研工業株式会社 注意喚起システム、及び注意喚起方法
WO2023146837A2 (en) 2022-01-25 2023-08-03 Sightful Computers Ltd Extended reality for collaboration
EP4335679A1 (en) * 2022-09-06 2024-03-13 KNORR-BREMSE Systeme für Nutzfahrzeuge GmbH System and method for providing well distinguishable warning levels for obstacles in different visibility areas in the vicinity of a vehicle
WO2024069534A1 (en) 2022-09-30 2024-04-04 Sightful Computers Ltd Adaptive extended reality content presentation in multiple physical environments
JP7722341B2 (ja) * 2022-12-01 2025-08-13 トヨタ自動車株式会社 車両制御装置、車両制御方法及びプログラム
JP7800466B2 (ja) * 2023-01-20 2026-01-16 トヨタ自動車株式会社 車両用表示制御装置、車両、車両用表示制御方法およびプログラム
JP2025105159A (ja) * 2023-12-28 2025-07-10 パナソニックオートモーティブシステムズ株式会社 表示装置、表示方法、及びプログラム

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10307545A (ja) * 1997-05-07 1998-11-17 Shimadzu Corp ヘッドアップディスプレイ
JP4334686B2 (ja) * 1999-07-07 2009-09-30 本田技研工業株式会社 車両の画像表示装置
JP4698002B2 (ja) * 2000-07-11 2011-06-08 マツダ株式会社 車両の表示装置
JP2006276964A (ja) 2005-03-28 2006-10-12 Nippon Seiki Co Ltd 車両用表示装置
DE102009004432B4 (de) * 2008-01-25 2016-12-08 Denso Corporation Kraftfahrzeuganzeigevorrichtung zum Anzeigen eines ein vorderes Hindernis umkreisenden Bildflecks
JP2009190520A (ja) 2008-02-13 2009-08-27 Toyota Motor Corp 車両用表示装置
JP2009205268A (ja) * 2008-02-26 2009-09-10 Honda Motor Co Ltd 障害物表示装置
US20090225434A1 (en) * 2008-03-10 2009-09-10 Nicholas Clayton L Vehicle rear view apparatus utilizing heads up display and rear looking sensors
JP2009217682A (ja) 2008-03-12 2009-09-24 Yazaki Corp 車両用表示装置
JP5723106B2 (ja) * 2010-05-18 2015-05-27 東芝アルパイン・オートモティブテクノロジー株式会社 車両用ディスプレイ装置及び車両用ディスプレイ方法
US20110301813A1 (en) * 2010-06-07 2011-12-08 Denso International America, Inc. Customizable virtual lane mark display
JP2012063524A (ja) 2010-09-15 2012-03-29 Nippon Seiki Co Ltd 車両用ヘッドアップディスプレイ装置
US8810381B2 (en) * 2012-06-29 2014-08-19 Yazaki North America, Inc. Vehicular heads up display with integrated bi-modal high brightness collision warning system

Also Published As

Publication number Publication date
US20160121794A1 (en) 2016-05-05
US9878667B2 (en) 2018-01-30
WO2014199574A1 (ja) 2014-12-18
DE112014002804T5 (de) 2016-03-31
JP2015000630A (ja) 2015-01-05

Similar Documents

Publication Publication Date Title
JP2015000630A (ja) 車載表示装置およびプログラム
JP5962594B2 (ja) 車載表示装置およびプログラム
JP4475308B2 (ja) 表示装置
EP4339938A1 (en) Projection method and apparatus, and vehicle and ar-hud
US9620009B2 (en) Vehicle surroundings monitoring device
JP6459205B2 (ja) 車両用表示システム
US9463743B2 (en) Vehicle information display device and vehicle information display method
GB2548718B (en) Virtual overlay system and method for displaying a representation of a road sign
CN115700196A (zh) 车辆用显示控制装置及控制方法、车辆用显示装置
JP2014041398A (ja) 画像生成装置、画像表示システム及び画像生成方法
US11813988B2 (en) Image processing apparatus, image processing method, and image processing system
US9836814B2 (en) Display control apparatus and method for stepwise deforming of presentation image radially by increasing display ratio
EP4485920A2 (en) Imaging system and method
CN114489332A (zh) Ar-hud输出信息的显示方法及系统
JP6186905B2 (ja) 車載表示装置およびプログラム
US20170158132A1 (en) Vehicular display control apparatus
JP6394940B2 (ja) 車両用表示システム
KR101209796B1 (ko) 전경 투과 기능을 갖는 차량용 표시장치 및 이의 표시방법
JP2019188855A (ja) 車両用視認装置
EP3648096A1 (en) Image processing unit, and head-up display device provided with same
KR20170056100A (ko) 헤드업 디스플레이의 물체 표시 장치 및 방법
JP6727400B2 (ja) 表示制御装置及び表示制御方法
US20200231099A1 (en) Image processing apparatus
JP6781010B2 (ja) 画像表示装置及び画像処理方法
JP6624312B2 (ja) 表示装置、制御方法、プログラム、及び記憶媒体

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150708

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150722

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160517

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160623

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160802

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160815

R151 Written notification of patent or utility model registration

Ref document number: 5999032

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees