JP7323509B2 - 鉄道資産を検査するための無人航空機システム - Google Patents
鉄道資産を検査するための無人航空機システム Download PDFInfo
- Publication number
- JP7323509B2 JP7323509B2 JP2020509068A JP2020509068A JP7323509B2 JP 7323509 B2 JP7323509 B2 JP 7323509B2 JP 2020509068 A JP2020509068 A JP 2020509068A JP 2020509068 A JP2020509068 A JP 2020509068A JP 7323509 B2 JP7323509 B2 JP 7323509B2
- Authority
- JP
- Japan
- Prior art keywords
- flight
- uav
- railroad
- data
- aircraft
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004891 communication Methods 0.000 claims description 90
- 238000000034 method Methods 0.000 claims description 63
- 230000007547 defect Effects 0.000 claims description 45
- 238000012544 monitoring process Methods 0.000 claims description 13
- 208000036758 Postinfectious cerebellitis Diseases 0.000 description 33
- 230000000116 mitigating effect Effects 0.000 description 27
- 238000004458 analytical method Methods 0.000 description 23
- 238000007689 inspection Methods 0.000 description 19
- 238000011084 recovery Methods 0.000 description 19
- 238000012502 risk assessment Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 14
- 230000002159 abnormal effect Effects 0.000 description 12
- 230000036541 health Effects 0.000 description 12
- 230000000007 visual effect Effects 0.000 description 12
- 238000013459 approach Methods 0.000 description 11
- 230000033228 biological regulation Effects 0.000 description 11
- 238000001514 detection method Methods 0.000 description 11
- 239000000446 fuel Substances 0.000 description 10
- 238000003860 storage Methods 0.000 description 10
- 230000006378 damage Effects 0.000 description 9
- 230000000694 effects Effects 0.000 description 9
- 239000003381 stabilizer Substances 0.000 description 9
- 238000012423 maintenance Methods 0.000 description 8
- 239000010755 BS 2869 Class G Substances 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000012546 transfer Methods 0.000 description 7
- 230000007704 transition Effects 0.000 description 7
- 241000255925 Diptera Species 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000010006 flight Effects 0.000 description 6
- 239000003973 paint Substances 0.000 description 6
- 238000013439 planning Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 240000007320 Pinus strobus Species 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 5
- 230000002950 deficient Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000012549 training Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 238000009826 distribution Methods 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 230000033001 locomotion Effects 0.000 description 4
- 238000005259 measurement Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 3
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 3
- 230000004913 activation Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000010365 information processing Effects 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 229910052744 lithium Inorganic materials 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000002085 persistent effect Effects 0.000 description 3
- 229920000642 polymer Polymers 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 206010002953 Aphonia Diseases 0.000 description 2
- 241000824719 Conops Species 0.000 description 2
- 241000282412 Homo Species 0.000 description 2
- 238000000342 Monte Carlo simulation Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000003628 erosive effect Effects 0.000 description 2
- 239000007788 liquid Substances 0.000 description 2
- 230000007257 malfunction Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 238000010248 power generation Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 108091008598 receptor tyrosine kinases Proteins 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 230000001932 seasonal effect Effects 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 230000026676 system process Effects 0.000 description 2
- 238000001931 thermography Methods 0.000 description 2
- 238000012384 transportation and delivery Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 101000606504 Drosophila melanogaster Tyrosine-protein kinase-like otk Proteins 0.000 description 1
- 241001669679 Eleotris Species 0.000 description 1
- 238000006424 Flood reaction Methods 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- -1 dirt Substances 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 230000024703 flight behavior Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004297 night vision Effects 0.000 description 1
- 238000013021 overheating Methods 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 238000011056 performance test Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000000575 pesticide Substances 0.000 description 1
- 230000004962 physiological condition Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000003449 preventive effect Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000003892 spreading Methods 0.000 description 1
- 239000007858 starting material Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009469 supplementation Effects 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- 238000009827 uniform distribution Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/08—Control of attitude, i.e. control of roll, pitch, or yaw
- G05D1/0808—Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/003—Flight plan management
- G08G5/0034—Assembly of a flight plan
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/0094—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/041—Obstacle detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/042—Track changes detection
- B61L23/044—Broken rails
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/042—Track changes detection
- B61L23/047—Track or rail movements
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/042—Track changes detection
- B61L23/048—Road bed changes, e.g. road bed erosion
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C39/00—Aircraft not otherwise provided for
- B64C39/02—Aircraft not otherwise provided for characterised by special use
- B64C39/024—Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
- B64U10/14—Flying platforms with four distinct rotor axes, e.g. quadcopters
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0004—Transmission of traffic-related information to or from an aircraft
- G08G5/0013—Transmission of traffic-related information to or from an aircraft with a ground station
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/003—Flight plan management
- G08G5/0039—Modification of a flight plan
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0047—Navigation or guidance aids for a single aircraft
- G08G5/0069—Navigation or guidance aids for a single aircraft specially adapted for an unmanned aircraft
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U20/00—Constructional aspects of UAVs
- B64U20/80—Arrangement of on-board electronics, e.g. avionics systems or wiring
- B64U20/83—Electronic components structurally integrated with aircraft elements, e.g. circuit boards carrying loads
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U20/00—Constructional aspects of UAVs
- B64U20/80—Arrangement of on-board electronics, e.g. avionics systems or wiring
- B64U20/87—Mounting of imaging devices, e.g. mounting of gimbals
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U70/00—Launching, take-off or landing arrangements
- B64U70/90—Launching from or landing on platforms
- B64U70/97—Means for guiding the UAV to a specific location on the platform, e.g. platform structures preventing landing off-centre
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30181—Earth observation
- G06T2207/30184—Infrastructure
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Computer Networks & Wireless Communication (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Automation & Control Theory (AREA)
- Traffic Control Systems (AREA)
- Train Traffic Observation, Control, And Security (AREA)
Description
Claims (13)
- 鉄道資産を検査するための無人航空機(UAV)のための空中システム制御ネットワークであって、
複数の通信塔と、
前記複数の塔に接続された地上制御システムであって、
複数の通信塔を介して、鉄道路線及び飛行経路を含む飛行計画を前記UAVに送信することと、
前記複数の通信塔を介して、前記UAVが前記鉄道路線をモニタしている間にデータを受信することと、
前記受信されたデータに基づいて前記飛行経路に沿って障害を検出することと、
前記障害に基づいて前記飛行計画を調整することと
を行うように構成された地上制御システムと
を含み、
前記受信されたデータは、前記UAVに装着された少なくとも1つのカメラから捕捉された複数の画像を含み、
前記地上制御システムは、
前記鉄道路線の欠陥状態について前記複数の画像をモニタすることを行うように構成され、
前記欠陥状態は、
前記飛行経路に沿って連続して撮影された第1の画像と第2の画像との違い、及び
前記第1の画像と、前記UAVの以前の飛行からの、同じ場所について捕捉された格納された画像との違いのうちの1つ以上から特定され、
前記地上制御システムは、前記欠陥状態を確認することを行うように構成され、
前記欠陥状態を確認することは、
前記UAVに装着された前記少なくとも1つのカメラから捕捉された少なくとも1つの追加の画像を受信することであって、前記少なくとも1つの追加の画像は、前記欠陥状態を含む前記鉄道路線の領域を拡大表示することによって捕捉される、少なくとも1つの追加の画像を受信すること、及び
前記欠陥状態が前記鉄道路線に存在することを確認することを含み、
前記欠陥状態が前記鉄道路線に存在することが確認されるか、あるいは前記欠陥状態が前記鉄道路線に存在しないことが確認されるまで、前記UAVが、前記欠陥状態を含む前記鉄道路線の領域を拡大表示し続ける、空中システム制御ネットワーク。 - 前記受信されたデータは、現在の航空交通データ、障害物データ、地理情報データ及び航空音声データを含む、請求項1に記載の空中システム制御ネットワーク。
- 前記複数の通信塔は、他の航空機とデータを通信するように構成された航空帯域無線機を含み、
前記飛行計画は、前記通信されたデータに基づいて調整される、請求項1に記載の空中システム制御ネットワーク。 - 前記UAVは、前記鉄道路線の画像を捕捉するように構成された少なくとも1つのカメラを含む、請求項1に記載の空中システム制御ネットワーク。
- 前記地上制御システムは、
前記飛行計画からの逸脱について前記複数の画像をモニタすることと、
前記複数の画像において前記鉄道路線を維持するために前記飛行計画を調整することと
を行うようにさらに構成される、請求項4に記載の空中システム制御ネットワーク。 - 鉄道路線をモニタするための無人航空機(UAV)システムであって、
UAVと、
空中システム制御ネットワークと
を含み、前記空中システム制御ネットワークは、
複数の通信塔と、
前記複数の塔に接続された地上制御システムであって、
前記複数の通信塔を介して、鉄道路線及び飛行経路を含む飛行計画を前記UAVに送信することと、
前記複数の通信塔を介して、前記UAVが前記鉄道路線をモニタしている間にデータを受信することと、
前記受信されたデータに基づいて前記飛行経路に沿って障害を検出することと、
前記障害に基づいて前記飛行計画を調整することと
を行うように構成された地上制御システムと
を含み、
前記受信されたデータは、前記UAVに装着された少なくとも1つのカメラから捕捉された複数の画像を含み、
前記地上制御システムは、
前記鉄道路線の欠陥状態について前記複数の画像をモニタすることを行うように構成され、
前記欠陥状態は、
前記飛行経路に沿って連続して撮影された第1の画像と第2の画像との違い、及び
前記第1の画像と、前記UAVの以前の飛行からの、同じ場所について捕捉された格納された画像との違いのうちの1つ以上から特定され、
前記地上制御システムは、前記欠陥状態を確認することを行うように構成され、
前記欠陥状態を確認することは、
前記UAVに装着された前記少なくとも1つのカメラから捕捉された少なくとも1つの追加の画像を受信することであって、前記少なくとも1つの追加の画像は、前記欠陥状態を含む前記鉄道路線の領域を拡大表示することによって捕捉される、少なくとも1つの追加の画像を受信すること、及び
前記欠陥状態が前記鉄道路線に存在することを確認することを含み、
前記欠陥状態が前記鉄道路線に存在することが確認されるか、あるいは前記欠陥状態が前記鉄道路線に存在しないことが確認されるまで、前記UAVが、前記欠陥状態を含む前記鉄道路線の領域を拡大表示し続ける、無人航空機(UAV)システム。 - 前記受信されたデータは、現在の航空交通データ、障害物データ、地理情報データ及び航空音声データを含む、請求項6に記載のUAVシステム。
- 前記複数の通信塔は、他の航空機とデータを通信するように構成された航空帯域無線機を含み、
前記飛行計画は、前記通信されたデータに基づいて調整される、請求項6に記載のUAVシステム。 - 前記地上制御システムは、
前記飛行計画からの逸脱について前記複数の画像をモニタすることと、
前記複数の画像において前記鉄道路線を維持するために前記飛行計画を調整することと
を行うようにさらに構成される、請求項6に記載のUAVシステム。 - 鉄道資産を検査するための無人航空機(UAV)の空中システム制御ネットワークのための方法であって、
複数の通信塔を介して、鉄道路線及び飛行経路を含む飛行計画を前記UAVに送信することと、
前記複数の通信塔を介して、前記UAVが前記鉄道路線をモニタしている間にデータを受信することと、
前記受信されたデータに基づいて前記飛行経路に沿って障害を検出することと、
前記障害に基づいて前記飛行計画を調整することと
を含み、
前記受信されたデータは、前記UAVに装着された少なくとも1つのカメラから捕捉された複数の画像を含み、
前記方法は、前記鉄道路線の欠陥状態について前記複数の画像をモニタすることをさらに含み、
前記欠陥状態は、
前記飛行経路に沿って連続して撮影された第1の画像と第2の画像との違い、及び
前記第1の画像と、前記UAVの以前の飛行からの、同じ場所について捕捉された格納された画像との違いのうちの1つ以上から特定され、
前記方法は、前記欠陥状態を確認することをさらに含み、
前記欠陥状態を確認することは、
前記UAVに装着された前記少なくとも1つのカメラから捕捉された少なくとも1つの追加の画像を受信することであって、前記少なくとも1つの追加の画像は、前記欠陥状態を含む前記鉄道路線の領域を拡大表示することによって捕捉される、少なくとも1つの追加の画像を受信すること、及び
前記欠陥状態が前記鉄道路線に存在することを確認することを含み、
前記欠陥状態が前記鉄道路線に存在することが確認されるか、あるいは前記欠陥状態が前記鉄道路線に存在しないことが確認されるまで、前記UAVが、前記欠陥状態を含む前記鉄道路線の領域を拡大表示し続ける、方法。 - 前記受信されたデータは、現在の航空交通データ、障害物データ、地理情報データ及び航空音声データを含む、請求項10に記載の方法。
- 前記複数の通信塔の航空帯域無線機を介して、他の航空機とデータを通信すること
をさらに含み、前記飛行計画は、前記通信されたデータに基づいて調整される、請求項10に記載の方法。 - 前記飛行計画からの逸脱について前記複数の画像をモニタすることと、
前記複数の画像において前記鉄道路線を維持するために前記飛行計画を調整することと
をさらに含む、請求項10に記載の方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2023122101A JP2023153890A (ja) | 2017-08-15 | 2023-07-27 | 鉄道資産を検査するための無人航空機システム |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762545946P | 2017-08-15 | 2017-08-15 | |
US62/545,946 | 2017-08-15 | ||
US201762548636P | 2017-08-22 | 2017-08-22 | |
US62/548,636 | 2017-08-22 | ||
US16/103,643 US20190054937A1 (en) | 2017-08-15 | 2018-08-14 | Unmanned aerial vehicle system for inspecting railroad assets |
US16/103,643 | 2018-08-14 | ||
PCT/US2018/000235 WO2019035960A1 (en) | 2017-08-15 | 2018-08-15 | PILOT-FREE AIR VEHICLE SYSTEM FOR INSPECTING RAIL ASSETS |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2023122101A Division JP2023153890A (ja) | 2017-08-15 | 2023-07-27 | 鉄道資産を検査するための無人航空機システム |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2020531349A JP2020531349A (ja) | 2020-11-05 |
JP7323509B2 true JP7323509B2 (ja) | 2023-08-08 |
Family
ID=65360188
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020509068A Active JP7323509B2 (ja) | 2017-08-15 | 2018-08-15 | 鉄道資産を検査するための無人航空機システム |
JP2023122101A Pending JP2023153890A (ja) | 2017-08-15 | 2023-07-27 | 鉄道資産を検査するための無人航空機システム |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2023122101A Pending JP2023153890A (ja) | 2017-08-15 | 2023-07-27 | 鉄道資産を検査するための無人航空機システム |
Country Status (10)
Country | Link |
---|---|
US (1) | US20190054937A1 (ja) |
EP (2) | EP4378791A2 (ja) |
JP (2) | JP7323509B2 (ja) |
KR (2) | KR102658343B1 (ja) |
CN (2) | CN110998694B (ja) |
AU (1) | AU2018317851B2 (ja) |
BR (1) | BR112020002331A2 (ja) |
CA (1) | CA3071373A1 (ja) |
MX (1) | MX2020001767A (ja) |
WO (1) | WO2019035960A1 (ja) |
Families Citing this family (48)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10362293B2 (en) | 2015-02-20 | 2019-07-23 | Tetra Tech, Inc. | 3D track assessment system and method |
US10829135B2 (en) * | 2018-04-25 | 2020-11-10 | International Business Machines Corporation | Railway monitoring system and method |
AU2019275113B2 (en) * | 2018-05-24 | 2021-12-16 | International Electronic Machines Corp. | Sensitive area management |
US10807623B2 (en) | 2018-06-01 | 2020-10-20 | Tetra Tech, Inc. | Apparatus and method for gathering data from sensors oriented at an oblique angle relative to a railway track |
US11377130B2 (en) | 2018-06-01 | 2022-07-05 | Tetra Tech, Inc. | Autonomous track assessment system |
TWI696907B (zh) * | 2018-11-26 | 2020-06-21 | 財團法人工業技術研究院 | 通訊失效偵測方法和裝置 |
CN109978913A (zh) * | 2019-03-01 | 2019-07-05 | 北京航空航天大学 | 一种无人机云台自动跟踪铁路区域的方法及系统 |
US11198431B2 (en) * | 2019-04-30 | 2021-12-14 | Retrospect Technology, LLC | Operational risk assessment for autonomous vehicle control |
CA3130198C (en) * | 2019-05-16 | 2022-05-17 | Darel Mesher | System and method for generating and interpreting point clouds of a rail corridor along a survey path |
CN110294124A (zh) * | 2019-05-28 | 2019-10-01 | 国网浙江省电力有限公司嘉兴供电公司 | 一种基于无线专网的无人机巡视系统 |
IL267356B2 (en) * | 2019-06-12 | 2024-05-01 | Israel Aerospace Ind Ltd | Autonomous three-dimensional navigation of aircraft under constraints |
JP2020199981A (ja) * | 2019-06-12 | 2020-12-17 | 九州旅客鉄道株式会社 | 飛行体の制御方法 |
US11703859B2 (en) * | 2019-07-05 | 2023-07-18 | Liebherr Mining Equipment Newport News Co. | Method for autonomously controlling a vehicle |
CN110703809A (zh) * | 2019-09-18 | 2020-01-17 | 同济大学 | 一种基于无线传感网络的无人机地铁隧道定点巡检方法 |
US11427232B2 (en) * | 2019-10-16 | 2022-08-30 | Bnsf Railway Company | Systems and methods for auditing assets |
US11449080B2 (en) | 2019-10-29 | 2022-09-20 | Honeywell International Inc. | UAV flight management planner |
US11173933B2 (en) | 2019-11-15 | 2021-11-16 | Nxp B.V. | System and method for monitoring a moving vehicle |
CN110766179B (zh) * | 2019-11-21 | 2023-02-03 | 中冶华天工程技术有限公司 | 一种采用风险优先策略的多站点巡检路径设计方法 |
CN111103898A (zh) * | 2019-12-25 | 2020-05-05 | 深圳市道通智能航空技术有限公司 | 无人机保护方法及装置、无人机 |
WO2021142787A1 (zh) * | 2020-01-17 | 2021-07-22 | 上海亦我信息技术有限公司 | 行进路线及空间模型生成方法、装置、系统 |
KR102263892B1 (ko) * | 2020-02-17 | 2021-06-15 | 한국철도기술연구원 | 멀티콥터의 전차선 근접시 지자기교란에 의한 항법정보 보정 시스템 및 그 제어방법 |
US20210309358A1 (en) * | 2020-04-06 | 2021-10-07 | Workhorse Group Inc. | Flying vehicle systems and methods |
EP4054915B1 (en) * | 2020-07-07 | 2024-02-14 | Amsted Rail Company, Inc. | Systems and methods for railway asset management |
US10946878B1 (en) | 2020-07-14 | 2021-03-16 | Bnsf Railway Company | Wireless slide fence system and method |
CN112100821B (zh) * | 2020-08-26 | 2022-03-22 | 西北工业大学 | 光伏电池的稳健性优化设计方法 |
US11438969B2 (en) | 2020-09-11 | 2022-09-06 | Rockwell Collins, Inc. | System and method for adaptive extension of command and control (C2) backhaul network for unmanned aircraft systems (UAS) |
US11304078B2 (en) | 2020-09-11 | 2022-04-12 | Rockwell Collins, Inc. | System and method for generating control and non-payload communication (CNPC) congestion metrics at a ground control station |
US11303368B2 (en) | 2020-09-11 | 2022-04-12 | Rockwell Collins, Inc. | System and method for same-channel out-of-band spectrum sensing for command and control (C2) communications to unmanned aircraft systems (UAS) |
US11304061B2 (en) | 2020-09-11 | 2022-04-12 | Rockwell Collins, Inc. | System and method for spectrum situational awareness via server-based fusion in a command and control (C2) link system for unmanned aircraft systems (UAS) |
CN112347090A (zh) * | 2020-10-30 | 2021-02-09 | 民航数据通信有限责任公司 | Rvsm运行偏差事件分析获取方法及系统 |
CN112859109B (zh) * | 2021-02-02 | 2022-05-24 | 北京大成国测科技有限公司 | 无人机全景图像处理方法、装置及电子设备 |
US11823578B2 (en) * | 2021-02-16 | 2023-11-21 | Easy Aerial Inc. | Unmanned aerial vehicle (UAV) systems and methods for maintaining railway situational awareness |
CN112596072A (zh) * | 2021-03-02 | 2021-04-02 | 北京大成国测科技有限公司 | 无人机视觉智能检测系统 |
US20220281599A1 (en) * | 2021-03-08 | 2022-09-08 | Shanghai Autoflight Co., Ltd. | Unmanned aerial vehicle and control method thereof |
CN113256186B (zh) * | 2021-07-15 | 2021-10-19 | 西南交通大学 | 一种高铁调度员综合能力测评方法及系统 |
US20230026834A1 (en) * | 2021-07-20 | 2023-01-26 | Honeywell International Inc. | Systems and methods for correlating a notice to airmen (notam) with a chart on an avionic display in a cockpit of an aircraft |
CN113900444B (zh) * | 2021-10-09 | 2024-02-23 | 广东汇天航空航天科技有限公司 | 一种飞行器的控制方法和装置 |
US11804138B2 (en) * | 2021-11-17 | 2023-10-31 | Beta Air, Llc | Systems and methods for automated fleet management for aerial vehicles |
US11454990B1 (en) * | 2021-12-27 | 2022-09-27 | Beta Air, Llc | Systems and methods for scaling lag based on flight phase of an electric aircraft |
KR102557637B1 (ko) * | 2021-12-30 | 2023-07-21 | 주식회사 디메타 (D-meta,corp.) | 인공 지능 기반의 철도 자산 관리 서버, 시스템 및 방법 |
CN114663504B (zh) * | 2022-02-18 | 2022-11-22 | 深圳大学 | 一种多相机连续视觉大型桥梁线形实时测量方法及系统 |
US11623669B1 (en) | 2022-06-10 | 2023-04-11 | Bnsf Railway Company | On-board thermal track misalignment detection system and method therefor |
KR102629467B1 (ko) | 2022-06-16 | 2024-01-30 | 한국철도기술연구원 | 철도 터널의 3d 모델 제작 방법 |
WO2024031197A1 (en) * | 2022-08-11 | 2024-02-15 | Les Systemes Flyscan Inc. | System and method for georeferencing of markers using aerial vehicle and use of the georeferenced position of the markers for detecting potential movement of the ground and/or overgrowth of vegetation |
US11954753B2 (en) * | 2022-08-29 | 2024-04-09 | Bnsf Railway Company | Railroad operations image detection and identification system and method therefor |
US11688169B1 (en) | 2022-08-29 | 2023-06-27 | Bnsf Railway Company | Drone based automated yard check |
US11978230B1 (en) * | 2023-08-08 | 2024-05-07 | Birdstop, Inc. | Aerial object position determination system |
CN116820014B (zh) * | 2023-08-24 | 2023-11-14 | 山西交通科学研究院集团有限公司 | 一种交通机电设备智能化监控预警方法及系统 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010063260A (ja) | 2008-09-03 | 2010-03-18 | Hitachi Ltd | 列車走行制御装置及び方法 |
US20150158513A1 (en) | 2002-06-04 | 2015-06-11 | General Electric Company | Aerial camera system and method for identifying route-related hazards |
JP2016052849A (ja) | 2014-09-04 | 2016-04-14 | 公益財団法人鉄道総合技術研究所 | 障害物検出装置及び方法 |
US20170012697A1 (en) | 2015-04-10 | 2017-01-12 | SZ DJI Technology Co., Ltd | Method, apparatus and system of providing communication coverage to an unmanned aerial vehicle |
US20170180460A1 (en) | 2015-12-16 | 2017-06-22 | Wal-Mart Stores, Inc. | Systems and methods of capturing and distributing imaging content captured through unmanned aircraft systems |
CN106954042A (zh) | 2017-03-13 | 2017-07-14 | 兰州交通大学 | 一种无人机铁路线路巡检装置、系统及方法 |
US20170229025A1 (en) | 2016-02-04 | 2017-08-10 | Proxy Technologies, Inc. | Unmanned vehicle, system and method for determining a planned path for unmanned vehicles |
US20170313332A1 (en) | 2002-06-04 | 2017-11-02 | General Electric Company | Autonomous vehicle system and method |
JP2018179534A (ja) | 2017-04-03 | 2018-11-15 | Jr東日本コンサルタンツ株式会社 | 無人飛行体の飛行システム |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3448088B2 (ja) * | 1993-12-24 | 2003-09-16 | 東日本旅客鉄道株式会社 | 支障物検知システム |
US20150235094A1 (en) * | 2014-02-17 | 2015-08-20 | General Electric Company | Vehicle imaging system and method |
US20060244830A1 (en) * | 2002-06-04 | 2006-11-02 | Davenport David M | System and method of navigation with captured images |
FR2913392B1 (fr) * | 2007-03-07 | 2009-05-22 | Jacques Clausin | Dispositif de surveillance en temps reel de ballast. |
US8643719B2 (en) * | 2008-02-29 | 2014-02-04 | The Boeing Company | Traffic and security monitoring system and method |
US8543265B2 (en) * | 2008-10-20 | 2013-09-24 | Honeywell International Inc. | Systems and methods for unmanned aerial vehicle navigation |
US20100215212A1 (en) * | 2009-02-26 | 2010-08-26 | Honeywell International Inc. | System and Method for the Inspection of Structures |
US9014415B2 (en) * | 2010-04-22 | 2015-04-21 | The University Of North Carolina At Charlotte | Spatially integrated aerial photography for bridge, structure, and environmental monitoring |
US9075415B2 (en) * | 2013-03-11 | 2015-07-07 | Airphrame, Inc. | Unmanned aerial vehicle and methods for controlling same |
US9105184B2 (en) * | 2013-03-11 | 2015-08-11 | Arinc Incorporated | Systems and methods for real-time data communications and messaging with operators of small unmanned aircraft systems (sUAS) |
US20160117929A1 (en) * | 2014-09-30 | 2016-04-28 | Elwha Llc | System and method for operation of unmanned aircraft within a managed airspace or flyway |
US9129355B1 (en) * | 2014-10-09 | 2015-09-08 | State Farm Mutual Automobile Insurance Company | Method and system for assessing damage to infrastructure |
CN104527721B (zh) * | 2014-12-18 | 2018-03-06 | 成都铁安科技有限责任公司 | 一种列车故障检测方法及系统 |
AU2016201290A1 (en) * | 2015-02-27 | 2016-09-15 | Smart Infrastructure Asset Management Australia Research And Development Pty Ltd | Local Positioning System for an Unmanned Aerial Vehicle |
US10187806B2 (en) * | 2015-04-14 | 2019-01-22 | ETAK Systems, LLC | Systems and methods for obtaining accurate 3D modeling data using multiple cameras |
US9678507B1 (en) * | 2015-06-25 | 2017-06-13 | Latitude Engineering, LLC | Autonomous infrastructure element survey systems and methods using UAV fleet deployment |
US10540901B2 (en) * | 2015-11-23 | 2020-01-21 | Kespry Inc. | Autonomous mission action alteration |
US10657827B2 (en) * | 2015-12-09 | 2020-05-19 | Dronesense Llc | Drone flight operations |
US10083616B2 (en) * | 2015-12-31 | 2018-09-25 | Unmanned Innovation, Inc. | Unmanned aerial vehicle rooftop inspection system |
CN105551108B (zh) * | 2016-02-16 | 2018-05-11 | 株洲时代电子技术有限公司 | 一种铁路线路巡检方法 |
US10170011B2 (en) * | 2016-07-26 | 2019-01-01 | International Business Machines Corporation | Guide drones for airplanes on the ground |
US11270130B2 (en) * | 2016-08-05 | 2022-03-08 | Transportation Ip Holdings, Llc | Route inspection system |
US11106911B1 (en) * | 2018-06-13 | 2021-08-31 | Pointivo, Inc. | Image acquisition planning systems and methods used to generate information for structures of interest |
-
2018
- 2018-08-14 US US16/103,643 patent/US20190054937A1/en active Pending
- 2018-08-15 CA CA3071373A patent/CA3071373A1/en active Pending
- 2018-08-15 WO PCT/US2018/000235 patent/WO2019035960A1/en unknown
- 2018-08-15 CN CN201880053102.6A patent/CN110998694B/zh active Active
- 2018-08-15 JP JP2020509068A patent/JP7323509B2/ja active Active
- 2018-08-15 BR BR112020002331-0A patent/BR112020002331A2/pt unknown
- 2018-08-15 EP EP24171141.5A patent/EP4378791A2/en active Pending
- 2018-08-15 KR KR1020207005739A patent/KR102658343B1/ko active IP Right Grant
- 2018-08-15 CN CN202210653728.9A patent/CN114911249A/zh active Pending
- 2018-08-15 MX MX2020001767A patent/MX2020001767A/es unknown
- 2018-08-15 AU AU2018317851A patent/AU2018317851B2/en active Active
- 2018-08-15 EP EP18846546.2A patent/EP3669342B1/en active Active
- 2018-08-15 KR KR1020247012260A patent/KR20240055125A/ko not_active Application Discontinuation
-
2023
- 2023-07-27 JP JP2023122101A patent/JP2023153890A/ja active Pending
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150158513A1 (en) | 2002-06-04 | 2015-06-11 | General Electric Company | Aerial camera system and method for identifying route-related hazards |
US20170313332A1 (en) | 2002-06-04 | 2017-11-02 | General Electric Company | Autonomous vehicle system and method |
JP2010063260A (ja) | 2008-09-03 | 2010-03-18 | Hitachi Ltd | 列車走行制御装置及び方法 |
JP2016052849A (ja) | 2014-09-04 | 2016-04-14 | 公益財団法人鉄道総合技術研究所 | 障害物検出装置及び方法 |
US20170012697A1 (en) | 2015-04-10 | 2017-01-12 | SZ DJI Technology Co., Ltd | Method, apparatus and system of providing communication coverage to an unmanned aerial vehicle |
US20170180460A1 (en) | 2015-12-16 | 2017-06-22 | Wal-Mart Stores, Inc. | Systems and methods of capturing and distributing imaging content captured through unmanned aircraft systems |
WO2017106248A1 (en) | 2015-12-16 | 2017-06-22 | Wal-Mart Stores, Inc. | Systems and methods of capturing and distributing imaging content captured through unmanned aircraft systems |
JP2019500263A (ja) | 2015-12-16 | 2019-01-10 | ウォルマート アポロ,エルエルシー | 無人航空機システムを通じてキャプチャされた画像コンテンツをキャプチャし及び配信するシステム及び方法 |
US20170229025A1 (en) | 2016-02-04 | 2017-08-10 | Proxy Technologies, Inc. | Unmanned vehicle, system and method for determining a planned path for unmanned vehicles |
US20170227470A1 (en) | 2016-02-04 | 2017-08-10 | Proxy Technologies, Inc. | Autonomous vehicle, system and method for structural object assessment and manufacture thereof |
CN106954042A (zh) | 2017-03-13 | 2017-07-14 | 兰州交通大学 | 一种无人机铁路线路巡检装置、系统及方法 |
JP2018179534A (ja) | 2017-04-03 | 2018-11-15 | Jr東日本コンサルタンツ株式会社 | 無人飛行体の飛行システム |
Also Published As
Publication number | Publication date |
---|---|
KR20240055125A (ko) | 2024-04-26 |
EP3669342A4 (en) | 2021-01-13 |
MX2020001767A (es) | 2020-07-29 |
KR20200035991A (ko) | 2020-04-06 |
EP4378791A2 (en) | 2024-06-05 |
BR112020002331A2 (pt) | 2020-09-01 |
AU2018317851B2 (en) | 2022-09-15 |
CA3071373A1 (en) | 2019-02-21 |
AU2018317851A1 (en) | 2020-03-12 |
CN110998694B (zh) | 2022-06-14 |
KR102658343B1 (ko) | 2024-04-19 |
US20190054937A1 (en) | 2019-02-21 |
EP3669342B1 (en) | 2024-05-22 |
CN114911249A (zh) | 2022-08-16 |
WO2019035960A1 (en) | 2019-02-21 |
JP2023153890A (ja) | 2023-10-18 |
JP2020531349A (ja) | 2020-11-05 |
EP3669342A1 (en) | 2020-06-24 |
CN110998694A (zh) | 2020-04-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7323509B2 (ja) | 鉄道資産を検査するための無人航空機システム | |
CN107131877B (zh) | 无人飞行器航线构建方法及系统 | |
US10332405B2 (en) | Unmanned aircraft systems traffic management | |
US8368584B2 (en) | Airspace risk mitigation system | |
US20210125507A1 (en) | Method and system for unmanned aerial vehicle flight highway | |
AU2009230765B2 (en) | System and method for detecting and preventing runway incursion, excursion and confusion | |
US20220189316A1 (en) | Unmanned aircraft control using ground control station | |
EP2770491A1 (en) | Navigation system for use in an airport or harbor transportation | |
Moore et al. | Testing enabling technologies for safe UAS urban operations | |
Spriesterbach et al. | Unmanned aircraft system airspace integration in the national airspace using a ground-based sense and avoid system | |
Askarzadeh et al. | Systematic literature review of drone utility in railway condition monitoring | |
Neogi et al. | A risk based assessment of a small UAS cargo delivery operation in proximity to urban areas | |
Andreeva-Mori et al. | Management of operations under visual flight rules in UTM for disaster response missions | |
CA3059698A1 (en) | Method and system for unmanned aerial vehicle flight highway | |
Lau Banh et al. | Evaluation of Feasibility of UAV Technologies for Remote Surveying BART Rail Systems | |
Cotton | Adaptive Airborne Separation to Enable UAM Autonomy in Mixed Airspace | |
Coldsnow et al. | Safety Case for Small Uncrewed Aircraft Systems (sUAS) Beyond Visual Line of Sight (BVLOS) Operations at NASA Langley Research Center | |
Mutuel et al. | Functional decomposition of Unmanned Aircraft Systems (UAS) for CNS capabilities in NAS integration | |
Simon et al. | Deriving sensible requirements for UAV sense-and-avoid systems | |
Leigh | National Campaign Development Test Executive Summary | |
Englund et al. | A new method for ground vehicle access control and situation awareness: experiences from a real-life implementation at an airport | |
Johnson et al. | Management of Operations under Visual Flight Rules in UTM for Disaster Response Missions | |
Shively | UAS Integration in the NAS Detect and Avoid Subproject: Kitty Hawk-NASA Collaboration Discussion | |
Zoldi et al. | Opening the aperture: Regulatory changes for safe autonomous flight in the US national airspace | |
Simon | A Systems Approach to the Formulation of Unmanned Air Vehicle Detect, Sense, and Avoid Performance Requirements |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20200325 |
|
RD01 | Notification of change of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7426 Effective date: 20200325 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20210420 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20220304 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220322 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220617 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220906 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20221201 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230314 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230609 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20230627 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20230727 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7323509 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |