JP6069923B2 - ロボットシステム、ロボット、ロボット制御装置 - Google Patents

ロボットシステム、ロボット、ロボット制御装置 Download PDF

Info

Publication number
JP6069923B2
JP6069923B2 JP2012161281A JP2012161281A JP6069923B2 JP 6069923 B2 JP6069923 B2 JP 6069923B2 JP 2012161281 A JP2012161281 A JP 2012161281A JP 2012161281 A JP2012161281 A JP 2012161281A JP 6069923 B2 JP6069923 B2 JP 6069923B2
Authority
JP
Japan
Prior art keywords
data
collision detection
representative point
node
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2012161281A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014021810A (ja
JP2014021810A5 (enExample
Inventor
稲積　満広
満広 稲積
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Seiko Epson Corp
Original Assignee
Seiko Epson Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Seiko Epson Corp filed Critical Seiko Epson Corp
Priority to JP2012161281A priority Critical patent/JP6069923B2/ja
Priority to US13/921,437 priority patent/US20140025203A1/en
Priority to CN201310303138.4A priority patent/CN103568022B/zh
Publication of JP2014021810A publication Critical patent/JP2014021810A/ja
Publication of JP2014021810A5 publication Critical patent/JP2014021810A5/ja
Application granted granted Critical
Publication of JP6069923B2 publication Critical patent/JP6069923B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • B25J9/1666—Avoiding collision or forbidden zones
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39085—Use of two dimensional maps and feedback of external and joint sensors
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39095—Use neural geometric modeler, overlapping spheres

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Processing Or Creating Images (AREA)
  • Manipulator (AREA)
  • Image Processing (AREA)
JP2012161281A 2012-07-20 2012-07-20 ロボットシステム、ロボット、ロボット制御装置 Expired - Fee Related JP6069923B2 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2012161281A JP6069923B2 (ja) 2012-07-20 2012-07-20 ロボットシステム、ロボット、ロボット制御装置
US13/921,437 US20140025203A1 (en) 2012-07-20 2013-06-19 Collision detection system, collision detection data generator, and robot
CN201310303138.4A CN103568022B (zh) 2012-07-20 2013-07-18 碰撞检测系统、碰撞检测用数据生成装置以及机械手

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012161281A JP6069923B2 (ja) 2012-07-20 2012-07-20 ロボットシステム、ロボット、ロボット制御装置

Publications (3)

Publication Number Publication Date
JP2014021810A JP2014021810A (ja) 2014-02-03
JP2014021810A5 JP2014021810A5 (enExample) 2015-08-27
JP6069923B2 true JP6069923B2 (ja) 2017-02-01

Family

ID=49947229

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012161281A Expired - Fee Related JP6069923B2 (ja) 2012-07-20 2012-07-20 ロボットシステム、ロボット、ロボット制御装置

Country Status (3)

Country Link
US (1) US20140025203A1 (enExample)
JP (1) JP6069923B2 (enExample)
CN (1) CN103568022B (enExample)

Families Citing this family (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3090542B1 (en) * 2014-01-03 2020-09-30 Intel Corporation Real-time 3d reconstruction with a depth camera
CN103884302B (zh) * 2014-03-20 2016-04-13 安凯 空间机械臂与舱体的碰撞检测方法
KR101626795B1 (ko) * 2014-10-22 2016-06-02 삼인정보시스템(주) 충돌 검사 방법 및 그 방법을 수행하는 프로그램이 기록된 컴퓨터 판독 가능한 기록 매체
GB2531585B8 (en) * 2014-10-23 2017-03-15 Toshiba Res Europe Limited Methods and systems for generating a three dimensional model of a subject
EP3020514B1 (de) * 2014-11-17 2023-10-11 KRONES Aktiengesellschaft Handhabungsvorrichtung und verfahren zur handhabung von artikeln
CN107206592B (zh) 2015-01-26 2021-03-26 杜克大学 专用机器人运动规划硬件及其制造和使用方法
DE102015007395A1 (de) * 2015-06-08 2016-12-08 Kuka Roboter Gmbh Verfahren und System zum Betreiben und/oder Überwachen einer Maschine, insbesondere eines Roboters
US11262897B2 (en) * 2015-06-12 2022-03-01 Nureva Inc. Method and apparatus for managing and organizing objects in a virtual repository
CN105512377B (zh) 2015-11-30 2017-12-12 腾讯科技（深圳）有限公司 实时虚拟场景中圆柱碰撞体与凸体碰撞探测的方法和系统
EP3449214B1 (en) 2016-06-10 2021-12-15 Duke University Motion planning for autonomous vehicles and reconfigurable motion planning processors
CN106127764B (zh) * 2016-06-22 2019-01-25 东软集团股份有限公司 Svg图形碰撞检测方法及装置
DE102016120763B4 (de) 2016-10-31 2019-03-14 Pilz Gmbh & Co. Kg Verfahren zur kollisionsfreien Bewegungsplanung
JP6420296B2 (ja) * 2016-12-01 2018-11-07 ファナック株式会社 ロボットの干渉領域を自動で設定するロボット制御装置
CN106625662A (zh) * 2016-12-09 2017-05-10 南京理工大学 一种基于虚拟现实带电作业机械臂防碰撞保护方法
KR101756946B1 (ko) 2017-01-20 2017-07-11 장수진 경도선/위도선을 기반으로 교통로를 구성하고, 지도 검색을 수행하는 방법 및 장치
CN107515736B (zh) * 2017-07-01 2021-01-15 广州深域信息科技有限公司 一种在嵌入式设备上加速深度卷积网络计算速度的方法
JP6879464B2 (ja) 2017-08-02 2021-06-02 オムロン株式会社 干渉判定方法、干渉判定システム及びコンピュータプログラム
CN108032333B (zh) * 2017-10-30 2020-06-09 广州明珞汽车装备有限公司 可批量自动检查机器人仿真姿态的方法
KR102418451B1 (ko) * 2017-12-27 2022-07-07 주식회사 한화 로봇 제어 시스템
WO2019139815A1 (en) 2018-01-12 2019-07-18 Duke University Apparatus, method and article to facilitate motion planning of an autonomous vehicle in an environment having dynamic objects
TWI822729B (zh) 2018-02-06 2023-11-21 美商即時機器人股份有限公司 用於儲存一離散環境於一或多個處理器之一機器人之運動規劃及其改良操作之方法及設備
PL3769174T3 (pl) 2018-03-21 2022-10-24 Realtime Robotics, Inc. Planowanie przemieszczania robota do różnych środowisk i zadań oraz jego ulepszone działanie
CN108714894A (zh) * 2018-05-03 2018-10-30 华南理工大学 一种求解双冗余机械臂互相碰撞的动力学方法
EP3784449A1 (en) * 2018-05-30 2021-03-03 Sony Corporation Control apparatus, control method, robot apparatus and program
CN108898676B (zh) * 2018-06-19 2022-05-13 青岛理工大学 一种虚实物体之间碰撞及遮挡检测方法及系统
JP7141665B2 (ja) 2018-08-23 2022-09-26 リアルタイム ロボティクス， インコーポレーテッド ロボットの動作計画に役立つ衝突検出
US11269336B2 (en) * 2018-09-21 2022-03-08 Tata Consultancy Services Limited Method and system for free space detection in a cluttered environment
CN109558676B (zh) * 2018-11-28 2023-11-10 珠海金山数字网络科技有限公司 一种碰撞检测方法及装置、一种计算设备及存储介质
JP7394853B2 (ja) 2018-12-04 2023-12-08 デューク・ユニバーシティ 動的物体を有する環境における運動計画を促進する装置、方法及び物品
CN111325070B (zh) * 2018-12-17 2023-12-08 北京京东尚科信息技术有限公司 基于图像的碰撞检测方法和装置
CN109732599B (zh) * 2018-12-29 2020-11-03 深圳市越疆科技有限公司 一种机器人碰撞检测方法、装置、存储介质及机器人
CN109920057B (zh) * 2019-03-06 2022-12-09 珠海金山数字网络科技有限公司 一种视点变换方法及装置、计算设备及存储介质
JP7511259B2 (ja) 2019-04-17 2024-07-05 リアルタイム ロボティクス， インコーポレーテッド モーション計画グラフ生成ユーザインターフェース、システム、方法、および物品
US10696493B1 (en) 2019-05-31 2020-06-30 Mujin, Inc. Robotic system with packing mechanism
US10679379B1 (en) * 2019-05-31 2020-06-09 Mujin, Inc. Robotic system with dynamic packing mechanism
US10618172B1 (en) * 2019-05-31 2020-04-14 Mujin, Inc. Robotic system with error detection and dynamic packing mechanism
US10647528B1 (en) 2019-05-31 2020-05-12 Mujin, Inc. Robotic system for palletizing packages using real-time placement simulation
US11077554B2 (en) 2019-05-31 2021-08-03 Mujin, Inc. Controller and control method for robotic system
US10696494B1 (en) 2019-05-31 2020-06-30 Mujin, Inc. Robotic system for processing packages arriving out of sequence
US11634126B2 (en) 2019-06-03 2023-04-25 Realtime Robotics, Inc. Apparatus, methods and articles to facilitate motion planning in environments having dynamic obstacles
TWI873149B (zh) 2019-06-24 2025-02-21 美商即時機器人股份有限公司 用於多個機械手臂於共用工作空間中之移動規劃系統及方法
EP3993963B1 (en) 2019-08-23 2025-07-16 Realtime Robotics, Inc. Motion planning for robots to optimize velocity while maintaining limits on acceleration and jerk
JP7505877B2 (ja) * 2019-12-02 2024-06-25 ファナック株式会社 制御システム
CN113001537B (zh) * 2019-12-20 2022-08-02 深圳市优必选科技股份有限公司 机械臂控制方法、机械臂控制装置及终端设备
TWI887329B (zh) 2020-01-22 2025-06-21 美商即時機器人股份有限公司 於多機器人操作環境中之機器人之建置之方法及系統
CN115297999A (zh) 2020-03-18 2022-11-04 实时机器人有限公司 在机器人的运动规划中有用的机器人操作环境的数字表示
US11724387B2 (en) * 2020-04-03 2023-08-15 Fanuc Corporation Fast robot motion optimization with distance field
CN113633988B (zh) * 2020-04-27 2025-09-05 腾讯科技（深圳）有限公司 碰撞检测方法、装置、计算机设备和计算机可读存储介质
JP7666514B2 (ja) * 2020-09-14 2025-04-22 コニカミノルタ株式会社 安全監視装置、安全監視方法、及び、プログラム
US11794107B2 (en) * 2020-12-30 2023-10-24 Activision Publishing, Inc. Systems and methods for improved collision detection in video games
CN112619152B (zh) * 2021-01-05 2024-11-08 网易（杭州）网络有限公司 游戏包围盒的处理方法、装置及电子设备
CN113211495B (zh) * 2021-04-12 2024-09-06 北京航天飞行控制中心 一种机械臂碰撞检测方法、系统、存储介质和机械臂
CN113344303B (zh) * 2021-07-19 2023-05-23 安徽工程大学 一种三维地形下多移动机器人能耗优化的时间窗动态避障方法
CN113580130B (zh) * 2021-07-20 2022-08-30 佛山智能装备技术研究院 六轴机械臂避障控制方法、系统及计算机可读存储介质
CN114329998B (zh) * 2021-12-31 2025-09-26 中国电子产品可靠性与环境试验研究所（（工业和信息化部电子第五研究所）（中国赛宝实验室）） 边缘碰撞检测方法、装置、计算机设备和存储介质
CN114310892B (zh) * 2021-12-31 2024-05-03 梅卡曼德（北京）机器人科技有限公司 基于点云数据碰撞检测的物体抓取方法、装置和设备
US12307915B2 (en) 2022-03-29 2025-05-20 Flir Unmanned Aerial Systems Ulc Collision detection and avoidance for unmanned aerial vehicle systems and methods
CN114851202B (zh) * 2022-05-20 2024-05-10 梅卡曼德（北京）机器人科技有限公司 碰撞检测方法、控制方法、抓取系统及计算机存储介质
CN115048824B (zh) * 2022-08-15 2022-12-06 北京华航唯实机器人科技股份有限公司 一种碰撞检测方法、装置及计算机可读介质
CN115730370B (zh) * 2022-11-15 2025-10-03 上海天华建筑设计有限公司 一种消防栓和灭火器的摆放优化方法
CN120712535A (zh) * 2023-03-09 2025-09-26 发那科株式会社 数值控制装置
CN115952569B (zh) * 2023-03-14 2023-06-16 安世亚太科技股份有限公司 仿真方法、装置、电子设备及计算机可读存储介质
CN116502479B (zh) * 2023-06-29 2023-09-01 之江实验室 一种三维物体在仿真环境中的碰撞检测方法和装置

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4694404A (en) * 1984-01-12 1987-09-15 Key Bank N.A. High-speed image generation of complex solid objects using octree encoding
FR2625345A1 (fr) * 1987-12-24 1989-06-30 Thomson Cgr Procede de visualisation en trois dimensions d'objets codes numeriquement sous forme arborescente et dispositif de mise en oeuvre
US5056031A (en) * 1988-11-12 1991-10-08 Kabushiki Kaisha Toyota Chuo Kenyusho Apparatus for detecting the collision of moving objects
US5347459A (en) * 1993-03-17 1994-09-13 National Research Council Of Canada Real time collision detection
JP3340198B2 (ja) * 1993-08-12 2002-11-05 株式会社東芝 形状復元装置
US5572634A (en) * 1994-10-26 1996-11-05 Silicon Engines, Inc. Method and apparatus for spatial simulation acceleration
US5548694A (en) * 1995-01-31 1996-08-20 Mitsubishi Electric Information Technology Center America, Inc. Collision avoidance system for voxel-based object representation
US5812138A (en) * 1995-12-19 1998-09-22 Cirrus Logic, Inc. Method and apparatus for dynamic object indentification after Z-collision
US5793900A (en) * 1995-12-29 1998-08-11 Stanford University Generating categorical depth maps using passive defocus sensing
WO1998000811A1 (en) * 1996-06-28 1998-01-08 Resolution Technologies, Inc. Fly-through computer aided design method and apparatus
US6236405B1 (en) * 1996-07-01 2001-05-22 S3 Graphics Co., Ltd. System and method for mapping textures onto surfaces of computer-generated objects
JP3425760B2 (ja) * 1999-01-07 2003-07-14 富士通株式会社 干渉チェック装置
US7292255B2 (en) * 2000-05-31 2007-11-06 Canon Kabushiki Kaisha Image data acquisition optimisation
GB0120039D0 (en) * 2001-08-16 2001-10-10 Univ London Method for dressing and animating dressed beings
US8072470B2 (en) * 2003-05-29 2011-12-06 Sony Computer Entertainment Inc. System and method for providing a real-time three-dimensional interactive environment
WO2005086080A1 (en) * 2004-03-02 2005-09-15 Sarnoff Corporation Method and apparatus for detecting a presence
JP4522129B2 (ja) * 2004-03-31 2010-08-11 キヤノン株式会社 画像処理方法および画像処理装置
KR100926193B1 (ko) * 2004-12-21 2009-11-09 캐논 가부시끼가이샤 디지털 화상 분할 및 콤팩트한 표현 생성
US7663630B2 (en) * 2005-12-08 2010-02-16 Electronics And Telecommunications Research Institute Apparatus and method for processing collision information in graphic system
KR100791381B1 (ko) * 2006-06-01 2008-01-07 삼성전자주식회사 이동 로봇의 원격 조종을 위한 충돌방지 시스템, 장치 및방법
US7928993B2 (en) * 2006-07-28 2011-04-19 Intel Corporation Real-time multi-resolution 3D collision detection using cube-maps
JP5191167B2 (ja) * 2007-06-06 2013-04-24 オリンパスメディカルシステムズ株式会社 医用ガイドシステム
JP2009099082A (ja) * 2007-10-19 2009-05-07 Sony Corp 力学シミュレーション装置及び力学シミュレーション方法、並びにコンピュータ・プログラム
US8472689B2 (en) * 2008-03-04 2013-06-25 Carestream Health, Inc. Method for enhanced voxel resolution in MRI image
CN101393872A (zh) * 2008-11-07 2009-03-25 华中科技大学 一种视觉引导下的拾放装置
US9530246B2 (en) * 2009-01-15 2016-12-27 Mitsubishi Electric Corporation Collision determination device and collision determination program
US8405680B1 (en) * 2010-04-19 2013-03-26 YDreams S.A., A Public Limited Liability Company Various methods and apparatuses for achieving augmented reality
JP2012081577A (ja) * 2010-09-17 2012-04-26 Denso Wave Inc ロボットの移動方向決定方法及びロボットの制御装置
GB2487421A (en) * 2011-01-21 2012-07-25 Imagination Tech Ltd Tile Based Depth Buffer Compression
JP5708196B2 (ja) * 2011-04-21 2015-04-30 セイコーエプソン株式会社 衝突検出システム、ロボットシステム、衝突検出方法及びプログラム
US20130016099A1 (en) * 2011-07-13 2013-01-17 2XL Games, Inc. Digital Rendering Method for Environmental Simulation
TW201308253A (zh) * 2011-08-04 2013-02-16 Univ Nat Taiwan 運動量分析方法及採用此方法之運動量分析裝置
US9116011B2 (en) * 2011-10-21 2015-08-25 Here Global B.V. Three dimensional routing
US9196083B2 (en) * 2012-01-16 2015-11-24 Intel Corporation Time-continuous collision detection using 3D rasterization
US20140002595A1 (en) * 2012-06-29 2014-01-02 Hong Kong Applied Science And Technology Research Institute Co., Ltd. Apparatus, system and method for foreground biased depth map refinement method for dibr view synthesis
JP6046246B2 (ja) * 2012-07-02 2016-12-14 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ ３ｄビデオコーディングのための深度マップのイントラコーディング

Also Published As

Publication number Publication date
JP2014021810A (ja) 2014-02-03
CN103568022B (zh) 2017-04-12
US20140025203A1 (en) 2014-01-23
CN103568022A (zh) 2014-02-12

Similar Documents

Publication Publication Date Title
JP6069923B2 (ja) ロボットシステム、ロボット、ロボット制御装置
JP6879464B2 (ja) 干渉判定方法、干渉判定システム及びコンピュータプログラム
US9827675B2 (en) Collision avoidance method, control device, and program
JP5872077B2 (ja) 干渉チェック装置
US10671081B1 (en) Generating and utilizing non-uniform volume measures for voxels in robotics applications
US20170197308A1 (en) Teaching data generating device and teaching data-generating method for work robot
CN117795445A (zh) 用于基于路径点的导航地图的备用路线发现
KR20190022435A (ko) 로봇의 장애물 회피 제어 시스템, 방법, 로봇 및 저장매체
JP5775279B2 (ja) 経路生成装置
JP2018008347A (ja) ロボットシステムおよび動作領域表示方法
JPWO2016121120A1 (ja) ３次元造形システム、情報処理装置、３次元造形モデル配置方法および３次元造形モデル配置プログラム
JP2014178794A (ja) 搬入経路計画システム
JP5766936B2 (ja) ３次元環境復元装置、３次元環境復元方法、及びロボット
JP2013184242A (ja) 産業用機械の干渉判定装置、干渉判定方法、コンピュータプログラムおよび記録媒体
JP2014238687A (ja) 画像処理装置、ロボット制御システム、ロボット、画像処理方法及び画像処理プログラム
JP7347169B2 (ja) 情報提示装置、情報提示方法、及び情報提示プログラム
Udugama Mini bot 3d: A ros based gazebo simulation
JP6285849B2 (ja) 行動制御システム、その方法及びプログラム
JP2017131990A (ja) 干渉回避方法
WO2024105847A1 (ja) 制御装置、３次元位置計測システム、及びプログラム
CN116917924A (zh) 信息处理方法、信息处理系统和程序
KR102903474B1 (ko) 로봇 경로 생성 방법 및 상기 방법을 수행하는 컴퓨팅 장치
Yu et al. A mixed reality platform for online motion planning of mobile robots via hololens 2
JP7614359B2 (ja) シミュレーション装置
KR20250062677A (ko) 로봇 경로 생성 방법 및 상기 방법을 수행하는 컴퓨팅 장치

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20150108

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150708

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150708

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160422

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160510

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160608

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20160609

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20160613

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160906

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161005

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20161206

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20161219

R150 Certificate of patent or registration of utility model

Ref document number: 6069923

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees