JP7228670B2 - 深層学習を使用したリアルタイム在庫追跡 - Google Patents

深層学習を使用したリアルタイム在庫追跡 Download PDF

Info

Publication number
JP7228670B2
JP7228670B2 JP2021504402A JP2021504402A JP7228670B2 JP 7228670 B2 JP7228670 B2 JP 7228670B2 JP 2021504402 A JP2021504402 A JP 2021504402A JP 2021504402 A JP2021504402 A JP 2021504402A JP 7228670 B2 JP7228670 B2 JP 7228670B2
Authority
JP
Japan
Prior art keywords
inventory
event
locations
location
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021504402A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021531595A5 (cg-RX-API-DMAC7.html
JP2021531595A (ja
Inventor
ジョーダン イー. フィッシャー,
ダニエル エル. フィシェッティ,
ニコラス ジェイ. ロカスチオ,
Original Assignee
スタンダード コグニション コーポレーション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/256,904 external-priority patent/US10445694B2/en
Application filed by スタンダード コグニション コーポレーション filed Critical スタンダード コグニション コーポレーション
Publication of JP2021531595A publication Critical patent/JP2021531595A/ja
Publication of JP2021531595A5 publication Critical patent/JP2021531595A5/ja
Application granted granted Critical
Publication of JP7228670B2 publication Critical patent/JP7228670B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G06Q10/0877—Inventory or stock management, e.g. order filling, procurement or balancing against orders by inventory control or reporting using inventory tracking or counting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/68—Food, e.g. fruit or vegetables

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Finance (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Economics (AREA)
  • Accounting & Taxation (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Tourism & Hospitality (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Biology (AREA)
  • Image Analysis (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
JP2021504402A 2018-07-26 2019-07-25 深層学習を使用したリアルタイム在庫追跡 Active JP7228670B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201862703785P 2018-07-26 2018-07-26
US62/703,785 2018-07-26
US16/256,904 US10445694B2 (en) 2017-08-07 2019-01-24 Realtime inventory tracking using deep learning
US16/256,904 2019-01-24
PCT/US2019/043519 WO2020023795A1 (en) 2018-07-26 2019-07-25 Realtime inventory tracking using deep learning

Publications (3)

Publication Number Publication Date
JP2021531595A JP2021531595A (ja) 2021-11-18
JP2021531595A5 JP2021531595A5 (cg-RX-API-DMAC7.html) 2022-07-28
JP7228670B2 true JP7228670B2 (ja) 2023-02-24

Family

ID=69181936

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021504402A Active JP7228670B2 (ja) 2018-07-26 2019-07-25 深層学習を使用したリアルタイム在庫追跡

Country Status (4)

Country Link
EP (1) EP3827392A4 (cg-RX-API-DMAC7.html)
JP (1) JP7228670B2 (cg-RX-API-DMAC7.html)
CA (1) CA3107485A1 (cg-RX-API-DMAC7.html)
WO (1) WO2020023795A1 (cg-RX-API-DMAC7.html)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2560387B (en) 2017-03-10 2022-03-09 Standard Cognition Corp Action identification using neural networks
US11232687B2 (en) 2017-08-07 2022-01-25 Standard Cognition, Corp Deep learning-based shopper statuses in a cashier-less store
US11250376B2 (en) 2017-08-07 2022-02-15 Standard Cognition, Corp Product correlation analysis using deep learning
US10853965B2 (en) 2017-08-07 2020-12-01 Standard Cognition, Corp Directional impression analysis using deep learning
US10474991B2 (en) 2017-08-07 2019-11-12 Standard Cognition, Corp. Deep learning-based store realograms
US10650545B2 (en) 2017-08-07 2020-05-12 Standard Cognition, Corp. Systems and methods to check-in shoppers in a cashier-less store
US10474988B2 (en) 2017-08-07 2019-11-12 Standard Cognition, Corp. Predicting inventory events using foreground/background processing
US11023850B2 (en) 2017-08-07 2021-06-01 Standard Cognition, Corp. Realtime inventory location management using deep learning
US11200692B2 (en) 2017-08-07 2021-12-14 Standard Cognition, Corp Systems and methods to check-in shoppers in a cashier-less store
US12333739B2 (en) 2019-04-18 2025-06-17 Standard Cognition, Corp. Machine learning-based re-identification of shoppers in a cashier-less store for autonomous checkout
US11232575B2 (en) 2019-04-18 2022-01-25 Standard Cognition, Corp Systems and methods for deep learning-based subject persistence
US11303853B2 (en) 2020-06-26 2022-04-12 Standard Cognition, Corp. Systems and methods for automated design of camera placement and cameras arrangements for autonomous checkout
US11361468B2 (en) 2020-06-26 2022-06-14 Standard Cognition, Corp. Systems and methods for automated recalibration of sensors for autonomous checkout
US12288294B2 (en) 2020-06-26 2025-04-29 Standard Cognition, Corp. Systems and methods for extrinsic calibration of sensors for autonomous checkout
US12373971B2 (en) 2021-09-08 2025-07-29 Standard Cognition, Corp. Systems and methods for trigger-based updates to camograms for autonomous checkout in a cashier-less shopping
KR102466020B1 (ko) * 2022-04-14 2022-11-10 주식회사 에루샤 인공지능 기반 명품 정보 및 셀러의 자동 매칭 방법, 장치 및 시스템
CN115511427B (zh) * 2022-11-23 2023-04-07 广州卓铸网络科技有限公司 一种基于二维码的仓储管理系统
US20250124368A1 (en) * 2023-10-12 2025-04-17 Carumai, Llc Systems and methods for controlling resource allocation

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015033577A1 (ja) 2013-09-06 2015-03-12 日本電気株式会社 顧客行動分析システム、顧客行動分析方法、非一時的なコンピュータ可読媒体及び棚システム
WO2015040661A1 (ja) 2013-09-19 2015-03-26 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 情報端末にマーチャンダイジング情報を表示させる制御方法
WO2015173869A1 (ja) 2014-05-12 2015-11-19 富士通株式会社 商品情報出力方法、商品情報出力プログラムおよび制御装置
WO2017163909A1 (ja) 2016-03-22 2017-09-28 日本電気株式会社 画像表示装置、画像表示システム、画像表示方法及びプログラム

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8189926B2 (en) * 2006-12-30 2012-05-29 Videomining Corporation Method and system for automatically analyzing categories in a physical space based on the visual characterization of people
US20130076898A1 (en) * 2011-08-01 2013-03-28 Richard Philippe Apparatus, systems, and methods for tracking medical products using an imaging unit
US9892438B1 (en) * 2012-05-03 2018-02-13 Stoplift, Inc. Notification system and methods for use in retail environments
US10268983B2 (en) * 2013-06-26 2019-04-23 Amazon Technologies, Inc. Detecting item interaction and movement
US9473747B2 (en) * 2013-07-25 2016-10-18 Ncr Corporation Whole store scanner
CN108780596B (zh) * 2016-02-29 2022-01-25 路标株式会社 信息处理系统
JP7009389B2 (ja) * 2016-05-09 2022-01-25 グラバンゴ コーポレイション 環境内のコンピュータビジョン駆動型アプリケーションのためのシステムおよび方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015033577A1 (ja) 2013-09-06 2015-03-12 日本電気株式会社 顧客行動分析システム、顧客行動分析方法、非一時的なコンピュータ可読媒体及び棚システム
WO2015040661A1 (ja) 2013-09-19 2015-03-26 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 情報端末にマーチャンダイジング情報を表示させる制御方法
WO2015173869A1 (ja) 2014-05-12 2015-11-19 富士通株式会社 商品情報出力方法、商品情報出力プログラムおよび制御装置
WO2017163909A1 (ja) 2016-03-22 2017-09-28 日本電気株式会社 画像表示装置、画像表示システム、画像表示方法及びプログラム

Also Published As

Publication number Publication date
CA3107485A1 (en) 2020-01-30
JP2021531595A (ja) 2021-11-18
EP3827392A1 (en) 2021-06-02
WO2020023795A1 (en) 2020-01-30
EP3827392A4 (en) 2022-03-30

Similar Documents

Publication Publication Date Title
JP7228671B2 (ja) 深層学習に基づく店舗リアログラム
US12056660B2 (en) Tracking inventory items in a store for identification of inventory items to be re-stocked and for identification of misplaced items
US12190285B2 (en) Inventory tracking system and method that identifies gestures of subjects holding inventory items
US11023850B2 (en) Realtime inventory location management using deep learning
US10445694B2 (en) Realtime inventory tracking using deep learning
US12321890B2 (en) Directional impression analysis using deep learning
US20220130220A1 (en) Assigning, monitoring and displaying respective statuses of subjects in a cashier-less store
US12231818B2 (en) Managing constraints for automated design of camera placement and cameras arrangements for autonomous checkout
JP2021531595A (ja) 深層学習を使用したリアルタイム在庫追跡
US20210350555A1 (en) Systems and methods for detecting proximity events
WO2020023796A2 (en) Realtime inventory location management using deep learning
US20200074432A1 (en) Deep learning-based actionable digital receipts for cashier-less checkout
JP2022123015A (ja) ディープ・ラーニング・ベースの被写体連続性のためのシステム及び方法
WO2020023799A1 (en) Product correlation analysis using deep learning
WO2020023926A1 (en) Directional impression analysis using deep learning
Xu et al. Robust object detection with real-time fusion of multiview foreground silhouettes

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220720

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220720

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20220720

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221025

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221107

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230207

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230213

R150 Certificate of patent or registration of utility model

Ref document number: 7228670

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250