US11507833B2 - Image recognition apparatus - Google Patents

Image recognition apparatus Download PDF

Info

Publication number
US11507833B2
US11507833B2 US16/833,957 US202016833957A US11507833B2 US 11507833 B2 US11507833 B2 US 11507833B2 US 202016833957 A US202016833957 A US 202016833957A US 11507833 B2 US11507833 B2 US 11507833B2
Authority
US
United States
Prior art keywords
target
ambience
feature
frame images
change
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/833,957
Other languages
English (en)
Other versions
US20200394515A1 (en
Inventor
Shin Koike
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Original Assignee
Toyota Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Corp filed Critical Toyota Motor Corp
Publication of US20200394515A1 publication Critical patent/US20200394515A1/en
Application granted granted Critical
Publication of US11507833B2 publication Critical patent/US11507833B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
    • B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/582—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of traffic signs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/62—Extraction of image or video features relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection
US16/833,957 2019-06-14 2020-03-30 Image recognition apparatus Active 2040-11-01 US11507833B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JPJP2019-110843 2019-06-14
JP2019-110843 2019-06-14
JP2019110843A JP7176478B2 (ja) 2019-06-14 2019-06-14 画像認識装置

Publications (2)

Publication Number Publication Date
US20200394515A1 US20200394515A1 (en) 2020-12-17
US11507833B2 true US11507833B2 (en) 2022-11-22

Family

ID=73546879

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/833,957 Active 2040-11-01 US11507833B2 (en) 2019-06-14 2020-03-30 Image recognition apparatus

Country Status (4)

Country Link
US (1) US11507833B2 (ja)
JP (1) JP7176478B2 (ja)
CN (1) CN112084833B (ja)
DE (1) DE102020110157A1 (ja)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017205093A1 (de) * 2017-03-27 2018-09-27 Conti Temic Microelectronic Gmbh Verfahren und System zur Vorhersage von Sensorsignalen eines Fahrzeugs
DE102019216357A1 (de) * 2019-10-24 2021-04-29 Robert Bosch Gmbh Verfahren und Vorrichtung zum Bereitstellen von annotierten Verkehrsraumdaten
CN112966582A (zh) * 2021-02-26 2021-06-15 北京卓视智通科技有限责任公司 车型三维识别方法、装置、系统、电子设备及存储介质
JP7259880B2 (ja) 2021-03-24 2023-04-18 いすゞ自動車株式会社 積載率推定装置
CN113791339A (zh) * 2021-07-19 2021-12-14 国网浙江省电力有限公司乐清市供电公司 一种基于r-ncc图像识别算法的断路器性能状态检测方法
US11972614B2 (en) * 2021-11-09 2024-04-30 Zoox, Inc. Machine-learned architecture for efficient object attribute and/or intention classification

Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070140527A1 (en) 2005-12-19 2007-06-21 Fujitsu Ten Limited On-board image-recognizing apparatus, on-board image-shooting apparatus, on-board image-shooting controller, warning apparatus, image recognizing method, image shooting method, and image-shooting controlling method
US20070222877A1 (en) * 2006-03-27 2007-09-27 Seiko Epson Corporation Image sensing apparatus, image sensing system, and image sensing method
US20090069973A1 (en) * 2007-09-10 2009-03-12 Shih-Hsiung Li Warning method and device for deviation of a moving vehicle
JP2010128744A (ja) 2008-11-27 2010-06-10 Toyota Infotechnology Center Co Ltd 対応ブロック探索装置
US20100271484A1 (en) * 2009-04-23 2010-10-28 Steven John Fishwick Object tracking using momentum and acceleration vectors in a motion estimation system
US20130182896A1 (en) * 2011-11-02 2013-07-18 Honda Elesys Co., Ltd. Gradient estimation apparatus, gradient estimation method, and gradient estimation program
US20150154317A1 (en) * 2012-03-28 2015-06-04 Katsumi Inoue Memory provided with set operation function, and method for processing set operation processing using same
US20150243043A1 (en) * 2012-11-19 2015-08-27 Haike Guan Moving object recognizer
JP2016004446A (ja) 2014-06-17 2016-01-12 トヨタ自動車株式会社 動き推定装置
US9430840B1 (en) 2015-07-23 2016-08-30 Mitsubishi Electric Research Laboratories, Inc. Method and system for segmenting an image based on motion vanishing points
JP2017162438A (ja) 2016-03-11 2017-09-14 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 危険予測方法
US20170262750A1 (en) 2016-03-11 2017-09-14 Panasonic Intellectual Property Corporation Of America Risk prediction method
US9898669B2 (en) 2015-04-17 2018-02-20 Toyota Jidosha Kabushiki Kaisha Traveling road surface detection device and traveling road surface detection method
US20180165527A1 (en) * 2016-12-12 2018-06-14 Plk Technologies Co., Ltd. Side safety assistant device and method for large vehicle
US20180365839A1 (en) * 2016-09-27 2018-12-20 SZ DJI Technology Co., Ltd. Systems and methods for initialization of target object in a tracking system
JP2019009615A (ja) 2017-06-23 2019-01-17 株式会社 日立産業制御ソリューションズ 監視カメラ装置、監視映像配信方法および監視システム
US20190035125A1 (en) * 2017-07-27 2019-01-31 Rockwell Collins, Inc. Neural Network Foreground Separation for Mixed Reality
US10339393B2 (en) 2015-01-21 2019-07-02 Denso Corporation Demarcation line recognition apparatus
US20190206065A1 (en) * 2018-01-04 2019-07-04 Wistron Corporation Method, system, and computer-readable recording medium for image object tracking
US10427689B2 (en) 2014-11-28 2019-10-01 Denso Corporation Vehicle control apparatus
US10486698B2 (en) 2015-01-21 2019-11-26 Denso Corporation Vehicle cruise control device and cruise control method
US20190362163A1 (en) * 2018-05-28 2019-11-28 Aptiv Technologies Limited Method for validation of obstacle candidate
US20190378283A1 (en) * 2018-06-09 2019-12-12 Lot Spot Inc. System and method for transforming video data into directional object count
US10731996B2 (en) 2016-12-27 2020-08-04 Toyota Jidosha Kabushiki Kaisha Position calculating apparatus
US10922561B2 (en) 2018-03-06 2021-02-16 Toyota Jidosha Kabushiki Kaisha Object recognition device and vehicle travel control system
US11072328B2 (en) 2017-09-28 2021-07-27 Denso Corporation Control-target vehicle setting apparatus, control-target vehicle setting system, and control-target vehicle setting method
US11235766B2 (en) 2017-09-28 2022-02-01 Denso Corporation Device for setting target vehicle, system for setting target vehicle, and method for setting target vehicle

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100495438C (zh) * 2007-02-09 2009-06-03 南京大学 一种基于视频监控的运动目标检测与识别方法
CN108122247B (zh) * 2017-12-25 2018-11-13 北京航空航天大学 一种基于图像显著性和特征先验模型的视频目标检测方法
CN109766841B (zh) * 2019-01-10 2022-03-29 深圳大学 车辆检测方法、装置及计算机可读存储介质

Patent Citations (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007172035A (ja) 2005-12-19 2007-07-05 Fujitsu Ten Ltd 車載画像認識装置、車載撮像装置、車載撮像制御装置、警告処理装置、画像認識方法、撮像方法および撮像制御方法
US20070140527A1 (en) 2005-12-19 2007-06-21 Fujitsu Ten Limited On-board image-recognizing apparatus, on-board image-shooting apparatus, on-board image-shooting controller, warning apparatus, image recognizing method, image shooting method, and image-shooting controlling method
US20070222877A1 (en) * 2006-03-27 2007-09-27 Seiko Epson Corporation Image sensing apparatus, image sensing system, and image sensing method
US20090069973A1 (en) * 2007-09-10 2009-03-12 Shih-Hsiung Li Warning method and device for deviation of a moving vehicle
JP2010128744A (ja) 2008-11-27 2010-06-10 Toyota Infotechnology Center Co Ltd 対応ブロック探索装置
US20100271484A1 (en) * 2009-04-23 2010-10-28 Steven John Fishwick Object tracking using momentum and acceleration vectors in a motion estimation system
US20130182896A1 (en) * 2011-11-02 2013-07-18 Honda Elesys Co., Ltd. Gradient estimation apparatus, gradient estimation method, and gradient estimation program
US20150154317A1 (en) * 2012-03-28 2015-06-04 Katsumi Inoue Memory provided with set operation function, and method for processing set operation processing using same
US20150243043A1 (en) * 2012-11-19 2015-08-27 Haike Guan Moving object recognizer
JP2016004446A (ja) 2014-06-17 2016-01-12 トヨタ自動車株式会社 動き推定装置
US10427689B2 (en) 2014-11-28 2019-10-01 Denso Corporation Vehicle control apparatus
US10486698B2 (en) 2015-01-21 2019-11-26 Denso Corporation Vehicle cruise control device and cruise control method
US10339393B2 (en) 2015-01-21 2019-07-02 Denso Corporation Demarcation line recognition apparatus
US9898669B2 (en) 2015-04-17 2018-02-20 Toyota Jidosha Kabushiki Kaisha Traveling road surface detection device and traveling road surface detection method
US9430840B1 (en) 2015-07-23 2016-08-30 Mitsubishi Electric Research Laboratories, Inc. Method and system for segmenting an image based on motion vanishing points
JP2017162438A (ja) 2016-03-11 2017-09-14 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 危険予測方法
US20170262750A1 (en) 2016-03-11 2017-09-14 Panasonic Intellectual Property Corporation Of America Risk prediction method
US20180365839A1 (en) * 2016-09-27 2018-12-20 SZ DJI Technology Co., Ltd. Systems and methods for initialization of target object in a tracking system
US20180165527A1 (en) * 2016-12-12 2018-06-14 Plk Technologies Co., Ltd. Side safety assistant device and method for large vehicle
US10731996B2 (en) 2016-12-27 2020-08-04 Toyota Jidosha Kabushiki Kaisha Position calculating apparatus
JP2019009615A (ja) 2017-06-23 2019-01-17 株式会社 日立産業制御ソリューションズ 監視カメラ装置、監視映像配信方法および監視システム
US20190035125A1 (en) * 2017-07-27 2019-01-31 Rockwell Collins, Inc. Neural Network Foreground Separation for Mixed Reality
US11072328B2 (en) 2017-09-28 2021-07-27 Denso Corporation Control-target vehicle setting apparatus, control-target vehicle setting system, and control-target vehicle setting method
US11235766B2 (en) 2017-09-28 2022-02-01 Denso Corporation Device for setting target vehicle, system for setting target vehicle, and method for setting target vehicle
US20190206065A1 (en) * 2018-01-04 2019-07-04 Wistron Corporation Method, system, and computer-readable recording medium for image object tracking
US10922561B2 (en) 2018-03-06 2021-02-16 Toyota Jidosha Kabushiki Kaisha Object recognition device and vehicle travel control system
US20190362163A1 (en) * 2018-05-28 2019-11-28 Aptiv Technologies Limited Method for validation of obstacle candidate
US20190378283A1 (en) * 2018-06-09 2019-12-12 Lot Spot Inc. System and method for transforming video data into directional object count

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Fuentes A., Yoon S., Park D.S.: Visual Scene Segmentation using Optical Flow Field from dynamic environment. In: KISM Conference, Apr. 2016, 73-76.
Mishra P.K., Saroha G.P.: A Study on Classification for Static and Moving Object in Video Surveillance System. In: International Journal of Image, Graphics and Signal Processing, 2016, 76-82.
Partial Translation of Office Action Issued to JP2019-110843.
Shuichi Enokida, Masatomo Ishikura, "Risk Estimation Using Video Information from Videos of Drive Recorder," [online], May 2016, https://www.jsdc.or.jp/Portals/0/pdf/library/jyosei/h27_21605_kyutech.pdf.
Sistu G., Leang I., Chennupati S., Milz S., Yogamani S., Rawashdeh S.: NeurAll: Towards a Unified Model for Visual Perception in Automated Driving. In: IEEE Intelligent Transportation Systems Conference, Feb. 2019, 1-8.

Also Published As

Publication number Publication date
JP7176478B2 (ja) 2022-11-22
DE102020110157A1 (de) 2020-12-17
CN112084833A (zh) 2020-12-15
CN112084833B (zh) 2024-04-30
US20200394515A1 (en) 2020-12-17
JP2020204804A (ja) 2020-12-24

Similar Documents

Publication Publication Date Title
US11507833B2 (en) Image recognition apparatus
US20210362596A1 (en) End-To-End Tracking of Objects
CN103308058B (zh) 使用加权贝叶斯滤波的融合的增强数据关联
CN111932580A (zh) 一种基于卡尔曼滤波与匈牙利算法的道路3d车辆跟踪方法及系统
WO2020131660A1 (en) Techniques for precisely locating landmarks in monocular camera images with deep learning
CN113492851B (zh) 车辆控制装置、车辆控制方法以及车辆控制用计算机程序
US11501449B2 (en) Method for the assessment of possible trajectories
US11829153B2 (en) Apparatus, method, and computer program for identifying state of object, and controller
US11335099B2 (en) Proceedable direction detection apparatus and proceedable direction detection method
US11776277B2 (en) Apparatus, method, and computer program for identifying state of object, and controller
Nose et al. A study on a lane keeping system using CNN for online learning of steering control from real time images
CN112298194A (zh) 一种车辆的换道控制方法及装置
CN110636964A (zh) 用于确定行驶指令的方法
CN114067166A (zh) 用于确定物理对象的物理特性的设备和方法
US20200097005A1 (en) Object detection device, object detection method, and vehicle controller
Choi et al. Radar-based lane estimation with deep neural network for lane-keeping system of autonomous highway driving
Qiao et al. Human driver behavior prediction based on urbanflow
CN113793371B (zh) 目标分割追踪方法、装置、电子设备和存储介质
JP2020201746A (ja) 距離推定装置、距離推定方法及び距離推定用コンピュータプログラム
Petrović et al. Kalman Filter and NARX neural network for robot vision based human tracking
Kim et al. Neuromorphic hardware accelerated lane detection system
Kress et al. Start intention detection of cyclists using an LSTM network
EP4145352A1 (en) Systems and methods for training and using machine learning models and algorithms
CN115331448B (zh) 一种基于逆向车辆的智能导航方法和装置
US20230177844A1 (en) Apparatus, method, and computer program for identifying state of lighting

Legal Events

Date Code Title Description
AS Assignment

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KOIKE, SHIN;REEL/FRAME:052267/0067

Effective date: 20200211

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE