JP6627811B2 - 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム - Google Patents

集中度判定装置、集中度判定方法及び集中度判定のためのプログラム Download PDF

Info

Publication number
JP6627811B2
JP6627811B2 JP2017048203A JP2017048203A JP6627811B2 JP 6627811 B2 JP6627811 B2 JP 6627811B2 JP 2017048203 A JP2017048203 A JP 2017048203A JP 2017048203 A JP2017048203 A JP 2017048203A JP 6627811 B2 JP6627811 B2 JP 6627811B2
Authority
JP
Japan
Prior art keywords
driving
concentration
driver
period
operation mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2017048203A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018151910A (ja
JP2018151910A5 (enExample
Inventor
智浩 籔内
智浩 籔内
相澤　知禎
知禎 相澤
円香 渡部
円香 渡部
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omron Corp
Original Assignee
Omron Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omron Corp filed Critical Omron Corp
Priority to JP2017048203A priority Critical patent/JP6627811B2/ja
Priority to DE112017007267.0T priority patent/DE112017007267T8/de
Priority to PCT/JP2017/038575 priority patent/WO2018168052A1/ja
Priority to CN201780055638.7A priority patent/CN109690654B/zh
Priority to US16/333,850 priority patent/US20190265699A1/en
Publication of JP2018151910A publication Critical patent/JP2018151910A/ja
Publication of JP2018151910A5 publication Critical patent/JP2018151910A5/ja
Application granted granted Critical
Publication of JP6627811B2 publication Critical patent/JP6627811B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6893—Cars
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/082—Selecting or switching between different modes of propelling
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005—Handover processes
    • B60W60/0051—Handover processes from occupants to vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005—Handover processes
    • B60W60/0053—Handover processes from vehicle to occupant
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • B60W60/005—Handover processes
    • B60W60/0059—Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00—Input parameters relating to overall vehicle dynamics
    • B60W2520/10—Longitudinal speed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/10—Accelerator pedal position
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/12—Brake pedal position
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/18—Steering angle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/22—Psychological state; Stress level or workload
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/221—Physiology, e.g. weight, heartbeat, health or special needs
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/225—Direction of gaze
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00—Input parameters relating to infrastructure
    • B60W2552/05—Type of road, e.g. motorways, local streets, paved or unpaved roads

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Human Computer Interaction (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Social Psychology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Psychiatry (AREA)
  • General Physics & Mathematics (AREA)
  • Hospice & Palliative Care (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)
  • Psychology (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
JP2017048203A 2017-03-14 2017-03-14 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム Expired - Fee Related JP6627811B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2017048203A JP6627811B2 (ja) 2017-03-14 2017-03-14 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム
DE112017007267.0T DE112017007267T8 (de) 2017-03-14 2017-10-25 Vorrichtung zur Bestimmung des Konzentrationsgrades, Verfahren zur Bestimmung des Konzentrationsgrades und Programm zur Bestimmung des Konzentrationsgrades
PCT/JP2017/038575 WO2018168052A1 (ja) 2017-03-14 2017-10-25 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム
CN201780055638.7A CN109690654B (zh) 2017-03-14 2017-10-25 集中度判定装置、集中度判定方法及用于集中度判定的程序
US16/333,850 US20190265699A1 (en) 2017-03-14 2017-10-25 Concentration degree determination device, concentration degree determination method, and program for determining concentration degree

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017048203A JP6627811B2 (ja) 2017-03-14 2017-03-14 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム

Publications (3)

Publication Number Publication Date
JP2018151910A JP2018151910A (ja) 2018-09-27
JP2018151910A5 JP2018151910A5 (enExample) 2019-05-23
JP6627811B2 true JP6627811B2 (ja) 2020-01-08

Family

ID=63521906

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017048203A Expired - Fee Related JP6627811B2 (ja) 2017-03-14 2017-03-14 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム

Country Status (5)

Country Link
US (1) US20190265699A1 (enExample)
JP (1) JP6627811B2 (enExample)
CN (1) CN109690654B (enExample)
DE (1) DE112017007267T8 (enExample)
WO (1) WO2018168052A1 (enExample)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6946425B2 (ja) * 2017-06-02 2021-10-06 本田技研工業株式会社 車両制御システム、車両制御方法、および車両制御プログラム
JP2018203009A (ja) * 2017-06-02 2018-12-27 本田技研工業株式会社 車両制御システム、車両制御方法、およびプログラム
JP6920112B2 (ja) * 2017-06-15 2021-08-18 株式会社デンソーテン 運転支援装置および運転支援方法
JP6859907B2 (ja) * 2017-09-08 2021-04-14 トヨタ自動車株式会社 車両制御装置
DE102018209440A1 (de) * 2018-06-13 2019-12-19 Bayerische Motoren Werke Aktiengesellschaft Verfahren zur Beeinflussung von Systemen zur Aufmerksamkeitsüberwachung
JP7424305B2 (ja) * 2018-11-13 2024-01-30 ソニーグループ株式会社 情報処理装置、および情報処理方法、並びにプログラム
US10807605B2 (en) 2018-12-19 2020-10-20 Waymo Llc Systems and methods for detecting and dynamically mitigating driver fatigue
US11810373B2 (en) 2019-09-19 2023-11-07 Mitsubishi Electric Corporation Cognitive function estimation device, learning device, and cognitive function estimation method
WO2021145131A1 (ja) * 2020-01-17 2021-07-22 ソニーセミコンダクタソリューションズ株式会社 情報処理装置、情報処理システム、情報処理方法及び情報処理プログラム
JP7621091B2 (ja) * 2020-11-06 2025-01-24 フォルシアクラリオン・エレクトロニクス株式会社 情報処理装置および生体状態判定方法
JP7523373B2 (ja) * 2021-01-25 2024-07-26 株式会社豊田中央研究所 運転準備状態推定装置及びプログラム
DE102021109329A1 (de) * 2021-04-14 2022-10-20 Cariad Se Verfahren zum Überprüfen einer Fahrtüchtigkeit eines Fahrers eines Kraftfahrzeugs sowie ein Kraftfahrzeug
JP7762577B2 (ja) * 2022-01-07 2025-10-30 花王株式会社 睡眠判定システム、睡眠判定方法及び睡眠判定プログラム
JP7475388B2 (ja) * 2022-03-31 2024-04-26 本田技研工業株式会社 生体状態誘導装置、生体状態誘導方法、及びプログラム
US12649483B2 (en) * 2023-12-22 2026-06-09 Toyota Jidosha Kabushiki Kaisha Dynamically setting a limit that effects an actuator of a vehicle

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH102241A (ja) * 1996-04-19 1998-01-06 Toyota Motor Corp ハイブリッド車両の制御装置
JP4075345B2 (ja) * 2001-10-11 2008-04-16 日産自動車株式会社 自動巡航制御装置
JP2003267173A (ja) * 2002-03-14 2003-09-25 Toyota Central Res & Dev Lab Inc 車間距離警報装置
JP6213282B2 (ja) * 2014-02-12 2017-10-18 株式会社デンソー 運転支援装置
KR20170093817A (ko) * 2014-12-12 2017-08-16 소니 주식회사 자동 운전 제어 디바이스 및 자동 운전 제어 방법, 및 프로그램
WO2017002471A1 (ja) * 2015-07-02 2017-01-05 ソニー株式会社 車両制御装置と車両制御方法およびプログラム
JP6552316B2 (ja) * 2015-07-29 2019-07-31 修一 田山 車輌の自動運転システム

Also Published As

Publication number Publication date
US20190265699A1 (en) 2019-08-29
DE112017007267T5 (de) 2019-11-28
CN109690654A (zh) 2019-04-26
JP2018151910A (ja) 2018-09-27
WO2018168052A1 (ja) 2018-09-20
CN109690654B (zh) 2021-10-26
DE112017007267T8 (de) 2020-01-16

Similar Documents

Publication Publication Date Title
CN109690654B (zh) 集中度判定装置、集中度判定方法及用于集中度判定的程序
JP7080598B2 (ja) 車両制御装置および車両制御方法
US20240000354A1 (en) Driving characteristic determination device, driving characteristic determination method, and recording medium
CN105197011B (zh) 车辆用驾驶员危险指数管理系统及其方法
JP6593712B2 (ja) 車両運転支援システム
JP6631569B2 (ja) 運転状態判定装置、運転状態判定方法及び運転状態判定のためのプログラム
US20210291837A1 (en) Concentration degree determination device, concentration degree determination method, and program for determining concentration degree
MX2013009434A (es) Sistema y método de respuesta al comportamiento del conductor.
JP6756174B2 (ja) 車両制御装置
JP2018149941A (ja) 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム
WO2018168121A1 (ja) 運転状態判定装置、運転状態判定方法及び運転状態判定のためのプログラム
US20190147264A1 (en) Concentration determination apparatus, concentration determination method, and program for concentration determination
CN119654667A (zh) 驾驶员辅助装置、驾驶员辅助系统以及驾驶员辅助方法
JP6627810B2 (ja) 運転モード切替制御装置、方法およびプログラム
JP2010253033A (ja) 意識低下度判定装置および警報装置
WO2018168099A1 (ja) 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム
US20200023863A1 (en) Concentration degree determination device, concentration degree determination method, and program for determining concentration degree
CN113039589A (zh) 通知控制装置、通知装置、通知系统及通知控制方法
WO2018168048A1 (ja) 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム
JP7610039B2 (ja) 運転支援装置及びコンピュータプログラム並びにコンピュータプログラムを記録した記録媒体
JP7393738B2 (ja) ドライバ状態推定装置
JP7578021B2 (ja) 運転状態検出方法
WO2018168046A1 (ja) 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム
JP2018147247A (ja) 運転者身体コンディション回復支援装置、方法およびプログラム
WO2018168047A1 (ja) 集中度判定装置、集中度判定方法及び集中度判定のためのプログラム

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20190312

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190412

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20191105

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20191118

R150 Certificate of patent or registration of utility model

Ref document number: 6627811

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees