JP7113469B1 - 物体認識システム、物体認識プログラム及び、物体認識方法 - Google Patents

物体認識システム、物体認識プログラム及び、物体認識方法 Download PDF

Info

Publication number
JP7113469B1
JP7113469B1 JP2021210042A JP2021210042A JP7113469B1 JP 7113469 B1 JP7113469 B1 JP 7113469B1 JP 2021210042 A JP2021210042 A JP 2021210042A JP 2021210042 A JP2021210042 A JP 2021210042A JP 7113469 B1 JP7113469 B1 JP 7113469B1
Authority
JP
Japan
Prior art keywords
registered
image
appearance
database
objects
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021210042A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023094636A (ja
Inventor
龍介 宮本
幹生 竹松
志帆 花城
正一 紀之定
雄二郎 北出
晃司 学多
悦志 山田
葵 刈谷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHINSEI PRINTING CO., LTD.
Meiji University
Original Assignee
SHINSEI PRINTING CO., LTD.
Meiji University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHINSEI PRINTING CO., LTD., Meiji University filed Critical SHINSEI PRINTING CO., LTD.
Priority to JP2021210042A priority Critical patent/JP7113469B1/ja
Priority to JP2022112137A priority patent/JP7808246B2/ja
Application granted granted Critical
Publication of JP7113469B1 publication Critical patent/JP7113469B1/ja
Priority to EP22910787.5A priority patent/EP4343692A4/en
Priority to PCT/JP2022/044134 priority patent/WO2023120070A1/ja
Priority to US18/573,636 priority patent/US12160653B2/en
Priority to CN202280043329.9A priority patent/CN117529746A/zh
Publication of JP2023094636A publication Critical patent/JP2023094636A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/20—Administration of product repair or maintenance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G06Q10/0875—Itemisation or classification of parts, supplies or services, e.g. bill of materials
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • G06V10/235—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on user input or interaction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/96—Management of image or video recognition tasks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G06V20/647—Three-dimensional [3D] objects by matching two-dimensional images to three-dimensional objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/10—Recognition assisted with metadata

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Quality & Reliability (AREA)
  • General Business, Economics & Management (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • General Health & Medical Sciences (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Evolutionary Computation (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Biomedical Technology (AREA)
  • Accounting & Taxation (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
JP2021210042A 2021-12-24 2021-12-24 物体認識システム、物体認識プログラム及び、物体認識方法 Active JP7113469B1 (ja)

Priority Applications (6)

Application Number Priority Date Filing Date Title
JP2021210042A JP7113469B1 (ja) 2021-12-24 2021-12-24 物体認識システム、物体認識プログラム及び、物体認識方法
JP2022112137A JP7808246B2 (ja) 2021-12-24 2022-07-13 物体認識システム、物体認識プログラム及び、物体認識方法
EP22910787.5A EP4343692A4 (en) 2021-12-24 2022-11-30 OBJECT RECOGNITION SYSTEM, OBJECT RECOGNITION PROGRAM AND OBJECT RECOGNITION METHOD
PCT/JP2022/044134 WO2023120070A1 (ja) 2021-12-24 2022-11-30 物体認識システム、物体認識プログラム及び、物体認識方法
US18/573,636 US12160653B2 (en) 2021-12-24 2022-11-30 Object recognition system, and object recognition method
CN202280043329.9A CN117529746A (zh) 2021-12-24 2022-11-30 物体识别系统、物体识别程序以及物体识别方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2021210042A JP7113469B1 (ja) 2021-12-24 2021-12-24 物体認識システム、物体認識プログラム及び、物体認識方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022112137A Division JP7808246B2 (ja) 2021-12-24 2022-07-13 物体認識システム、物体認識プログラム及び、物体認識方法

Publications (2)

Publication Number Publication Date
JP7113469B1 true JP7113469B1 (ja) 2022-08-05
JP2023094636A JP2023094636A (ja) 2023-07-06

Family

ID=82740504

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021210042A Active JP7113469B1 (ja) 2021-12-24 2021-12-24 物体認識システム、物体認識プログラム及び、物体認識方法
JP2022112137A Active JP7808246B2 (ja) 2021-12-24 2022-07-13 物体認識システム、物体認識プログラム及び、物体認識方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2022112137A Active JP7808246B2 (ja) 2021-12-24 2022-07-13 物体認識システム、物体認識プログラム及び、物体認識方法

Country Status (5)

Country Link
US (1) US12160653B2 (https=)
EP (1) EP4343692A4 (https=)
JP (2) JP7113469B1 (https=)
CN (1) CN117529746A (https=)
WO (1) WO2023120070A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119805900A (zh) * 2023-10-10 2025-04-11 表神集团有限公司 手表的鉴定方法、装置

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016115282A (ja) 2014-12-17 2016-06-23 カシオ計算機株式会社 商品識別装置および商品認識ナビゲーション方法
JP2018169752A (ja) 2017-03-29 2018-11-01 パナソニックＩｐマネジメント株式会社 商品認識システム、学習済みモデル、及び商品認識方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004164503A (ja) * 2002-11-15 2004-06-10 Olympus Corp 三次元モデル検索方法、三次元モデル検索装置、三次元モデル検索プログラム、及び三次元モデル検索システム
JP2005020692A (ja) * 2003-06-02 2005-01-20 Matsushita Electric Ind Co Ltd データ受信方法およびその装置、並びにデータ伝送システム
JP4961965B2 (ja) * 2006-11-15 2012-06-27 株式会社ニコン 被写体追跡プログラム、被写体追跡装置、およびカメラ
JP2009129337A (ja) * 2007-11-27 2009-06-11 Hitachi Ltd 三次元類似形状検索装置
EP2565844B1 (en) 2010-04-28 2016-04-06 Olympus Corporation Creation method and creation device of three-dimensional object recognition-use image database
US8332429B2 (en) * 2010-06-22 2012-12-11 Xerox Corporation Photography assistant and method for assisting a user in photographing landmarks and scenes
CN104902176B (zh) * 2015-05-22 2018-07-06 广东欧珀移动通信有限公司 一种调整拍摄角度的提示方法及终端
US10339661B2 (en) * 2015-07-28 2019-07-02 Panasonic Intellectual Property Management Co., Ltd. Movement direction determination method and movement direction determination device
JPWO2017094761A1 (ja) * 2015-11-30 2018-09-27 凸版印刷株式会社 識別方法、ならびに識別媒体
EP3179407B1 (en) * 2015-12-07 2022-07-13 Dassault Systèmes Recognition of a 3d modeled object from a 2d image
US10475195B2 (en) * 2017-03-09 2019-11-12 Intel Corporation Automatic global non-rigid scan point registration
JP2019191792A (ja) * 2018-04-23 2019-10-31 キヤノン株式会社 オブジェクト認識装置、オブジェクト認識方法及びプログラム
JP6517398B2 (ja) 2018-05-01 2019-05-22 東芝テック株式会社 情報処理装置及びプログラム
WO2020176773A1 (en) * 2019-02-27 2020-09-03 President And Fellows Of Harvard College System and method for quantification of exercise and physical therapy
CN110381250A (zh) * 2019-06-14 2019-10-25 北京百度网讯科技有限公司 提示拍照的方法及装置
US10726630B1 (en) * 2019-06-28 2020-07-28 Capital One Services, Llc Methods and systems for providing a tutorial for graphic manipulation of objects including real-time scanning in an augmented reality
CN110378303B (zh) 2019-07-25 2021-07-09 杭州睿琪软件有限公司 用于对象识别的方法及系统
CN113421100A (zh) 2020-03-03 2021-09-21 图灵深视(南京)科技有限公司 物品信息记录、流转、鉴别发起及服务方法、终端和系统

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016115282A (ja) 2014-12-17 2016-06-23 カシオ計算機株式会社 商品識別装置および商品認識ナビゲーション方法
JP2018169752A (ja) 2017-03-29 2018-11-01 パナソニックＩｐマネジメント株式会社 商品認識システム、学習済みモデル、及び商品認識方法

Also Published As

Publication number Publication date
EP4343692A4 (en) 2024-06-05
JP7808246B2 (ja) 2026-01-29
JP2023095748A (ja) 2023-07-06
US20240267608A1 (en) 2024-08-08
US12160653B2 (en) 2024-12-03
CN117529746A (zh) 2024-02-06
WO2023120070A1 (ja) 2023-06-29
EP4343692A1 (en) 2024-03-27
JP2023094636A (ja) 2023-07-06

Similar Documents

Publication Publication Date Title
CN106126579B (zh) 物体识别方法和装置、数据处理装置和终端设备
TW202026992A (zh) 行業識別模型確定方法和裝置
JP2009003701A (ja) 情報システム及び情報処理装置
JP2021077039A (ja) 画像処理装置、画像処理方法、及びプログラム。
JP2019174959A (ja) 商品棚位置登録プログラム、及び情報処理装置
US11836977B2 (en) System and method for hybrid visual searches and augmented reality
JP2023065371A (ja) 製造支援システム，方法，プログラム
JP7113469B1 (ja) 物体認識システム、物体認識プログラム及び、物体認識方法
TWI734054B (zh) 資訊處理裝置、顯示位置調整方法及儲存媒體
JP6695454B1 (ja) 情報処理装置、情報処理方法、及びプログラム
US11810231B2 (en) Electronic device and method for editing content of external device
US20190019339A1 (en) Systems and methods for dynamically displaying information about an object using augmented reality
JP7322945B2 (ja) 処理装置、処理方法及びプログラム
JP6769554B2 (ja) 物体識別装置、物体識別方法、計算装置、システムおよび記録媒体
JP2019185083A (ja) 買物支援システム及び買物支援方法
CN114119958A (zh) 基于级联回归的目标检测方法及装置
HK40106426A (en) Object recognition system, object recognition program, and object recognition method
JP6769555B2 (ja) 物品識別装置、物品識別方法、計算装置、システムおよびプログラム
US20230114462A1 (en) Selective presentation of an augmented reality element in an augmented reality user interface
JP7850971B2 (ja) ショッピングカートの中の商品数を確認する方法、システム及び記憶媒体
JP7810959B1 (ja) 情報処理システム
EP4636674A1 (en) System, store server, and storage medium
KR102744285B1 (ko) 증강현실을 이용한 실시간 시각화 장치 및 시스템과 이를 이용하는 실시간 시각화 방법 및 이를 위한 컴퓨터 판독 가능한 기록 매체
JP7736613B2 (ja) 学習装置、データ変化推定装置、学習方法、データ変化推定方法、学習プログラム、及びデータ変化推定プログラム
JP7700556B2 (ja) 画像処理装置、画像処理システム、画像処理方法、及びプログラム

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220105

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20220105

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220222

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220422

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220621

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220713

R150 Certificate of patent or registration of utility model

Ref document number: 7113469

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150