JPWO2022024341A5 - Product detection device, product detection system, product detection method, and product detection program - Google Patents

Product detection device, product detection system, product detection method, and product detection program Download PDF

Info

Publication number
JPWO2022024341A5
JPWO2022024341A5 JP2022539938A JP2022539938A JPWO2022024341A5 JP WO2022024341 A5 JPWO2022024341 A5 JP WO2022024341A5 JP 2022539938 A JP2022539938 A JP 2022539938A JP 2022539938 A JP2022539938 A JP 2022539938A JP WO2022024341 A5 JPWO2022024341 A5 JP WO2022024341A5
Authority
JP
Japan
Prior art keywords
product
area
width
detection
shelf
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2022539938A
Other languages
Japanese (ja)
Other versions
JPWO2022024341A1 (en
JP7459947B2 (en
Filing date
Publication date
Application filed filed Critical
Priority claimed from PCT/JP2020/029427 external-priority patent/WO2022024341A1/en
Publication of JPWO2022024341A1 publication Critical patent/JPWO2022024341A1/ja
Publication of JPWO2022024341A5 publication Critical patent/JPWO2022024341A5/en
Application granted granted Critical
Publication of JP7459947B2 publication Critical patent/JP7459947B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

ステップS204において、検部14は、重み付けされた二値化画像(図18参照)から、商品領域および当該商品領域と隣り合う隙間との比率を算出する。具体的に検部14は、図18のxy平面において、上記比率の算出処理を行う。
In step S204, the detection unit 14 calculates the ratio of the product area and the gap adjacent to the product area from the weighted binarized image (see FIG. 18). Specifically, the detection unit 14 performs the ratio calculation process on the xy plane of FIG. 18 .

Claims (10)

商品を陳列する棚の画像を取得する画像取得手段と、
前記画像内の領域を、前記商品が写る商品領域と前記商品以外が写る非商品領域とに二値化する二値化手段と、
前記二値化された前記商品領域の幅に対する当該商品に隣接する隙間領域の幅の比率に基づいて、前記棚に陳列された前記商品の陳列の状態を検知する検知手段と
を備える商品検知装置。
an image acquisition means for acquiring an image of a shelf on which products are displayed;
a binarization means for binarizing an area in the image into a product area in which the product is shown and a non-product area in which the product other than the product is shown;
a detection means for detecting the display state of the product displayed on the shelf based on the ratio of the width of the gap area adjacent to the product to the binarized width of the product region. .
前記検知手段は前記商品領域の幅に対する前記隙間領域の幅の比率が所定値以上であると、前記商品の前記陳列の異常を検知する
請求項1に記載の商品検知装置。
2. The product detection device according to claim 1, wherein the detection means detects an abnormality in the display of the product when a ratio of the width of the gap region to the width of the product region is equal to or greater than a predetermined value.
前記二値化された前記商品領域の幅と前記隙間領域の幅とに応じて近似曲線を生成する生成手段をさらに備え、
前記検知手段は、前記比率が所定値以上となることに起因して前記近似曲線の少なくとも一部が所定の閾値を下回ると、前記商品の前記陳列の異常を検知する
請求項2に記載の商品検知装置。
further comprising generating means for generating an approximate curve according to the binarized width of the product area and the width of the gap area;
3. The product according to claim 2, wherein the detection means detects an abnormality in the display of the product when at least a portion of the approximated curve falls below a predetermined threshold value due to the ratio being equal to or greater than a predetermined value. detection device.
前記商品領域の幅は、複数の角度から撮影された前記商品に紐づけられる前記商品領域の幅を含む
請求項1から請求項3のいずれかに記載の商品検知装置。
The commodity detection device according to any one of claims 1 to 3, wherein the width of the commodity region includes the width of the commodity region linked to the commodity photographed from a plurality of angles.
前記棚の形状毎に、前記棚に陳列された前記商品の陳列の状態を検知するために学習されたモデルを一つ以上記憶するモデル記憶手段を更に備え、
前記検知手段は、前記モデル記憶手段から取得された前記モデルを用いて前記検知を行う
請求項1に記載の商品検知装置。
further comprising model storage means for storing one or more models learned for detecting the display state of the product displayed on the shelf for each shape of the shelf;
The product detection device according to claim 1, wherein the detection means performs the detection using the model acquired from the model storage means.
前記商品の陳列において、前記棚の手前から奥に向かって、前記商品領域および前記非商品領域の画素が大きくなるよう重み付けする重み付け手段
を更に備え、
前記検知手段は、前記重み付された前記商品領域の幅に対する前記隙間領域の幅の比率に基づいて、前記棚に陳列された前記商品の陳列の状態を検知する、
請求項1に記載の商品検知装置。
further comprising weighting means for weighting the pixels of the product area and the non-product area so that the pixels of the product area and the non-product area increase from the front to the back of the shelf in the display of the product;
The detection means detects the display state of the product displayed on the shelf based on the ratio of the width of the gap area to the weighted width of the product area.
The product detection device according to claim 1.
前記検知手段によって前記商品の前記陳列の状態の異常が検知されると、当該検知の結果を外の端末に通知する通知手段
を更に備える請求項1または請求項3に記載の商品検知装置。
4. The product detection device according to claim 1, further comprising: notification means for notifying an external terminal of a result of said detection when said detection means detects an abnormality in said display state of said product.
請求項1から請求項7のいずれかに記載の商品検知装置と、
前記画像を撮影し、前記商品検知装置に向けて送信するカメラと、
前記商品検知装置から前記検知に関する通知を受信する端末と、
を備える商品検知システム。
a product detection device according to any one of claims 1 to 7;
a camera that captures the image and transmits it to the product detection device;
a terminal that receives a notification regarding the detection from the product detection device;
product detection system.
商品を陳列する棚の画像を取得し
前記画像内の領域を、前記商品が写る商品領域と前記商品以外が写る非商品領域とに二値化し、
前記二値化された前記商品領域の幅に対する当該商品に隣接する隙間領域の幅の比率に基づいて、前記棚に陳列された前記商品の陳列の状態を検知する
ことを備える商品検知方法。
Acquiring an image of a shelf on which products are displayed, binarizing the area in the image into a product area in which the product is shown and a non-product area in which the product other than the product is shown,
A product detection method comprising detecting a display state of the product displayed on the shelf based on a ratio of a width of a gap region adjacent to the product to a width of the binarized product region.
商品を陳列する棚の画像を取得し
前記画像内の領域を、前記商品が写る商品領域と前記商品以外が写る非商品領域とに二値化し、
前記二値化された前記商品領域の幅に対する当該商品に隣接する隙間領域の幅の比率に基づいて、前記棚に陳列された前記商品の陳列の状態を検知する
ことをコンピュータに実現させるための商品検知プログラム。
Acquiring an image of a shelf on which products are displayed, binarizing the area in the image into a product area in which the product is shown and a non-product area in which the product other than the product is shown,
for causing a computer to detect the display state of the merchandise displayed on the shelf based on the ratio of the width of the gap area adjacent to the merchandise to the binarized width of the merchandise area Product detection program.
JP2022539938A 2020-07-31 2020-07-31 Commodity detection device, commodity detection system, commodity detection method and commodity detection program Active JP7459947B2 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/029427 WO2022024341A1 (en) 2020-07-31 2020-07-31 Commodity detection device, commodity detection system, commodity detection method, and recording medium

Publications (3)

Publication Number Publication Date
JPWO2022024341A1 JPWO2022024341A1 (en) 2022-02-03
JPWO2022024341A5 true JPWO2022024341A5 (en) 2023-03-24
JP7459947B2 JP7459947B2 (en) 2024-04-02

Family

ID=80035293

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022539938A Active JP7459947B2 (en) 2020-07-31 2020-07-31 Commodity detection device, commodity detection system, commodity detection method and commodity detection program

Country Status (3)

Country Link
US (1) US20230290105A1 (en)
JP (1) JP7459947B2 (en)
WO (1) WO2022024341A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024057387A1 (en) * 2022-09-13 2024-03-21 日本電気株式会社 Planogram data generation device, planogram data generation system, planogram data generation method, and storage medium
CN115482533B (en) * 2022-09-19 2023-06-16 北京百度网讯科技有限公司 Display case splitting method and device, electronic equipment and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6008339B1 (en) * 2015-04-28 2016-10-19 パナソニックIpマネジメント株式会社 Product monitoring device, product monitoring system and product monitoring method
JP6341388B2 (en) * 2016-01-20 2018-06-13 パナソニックIpマネジメント株式会社 Product monitoring device, product monitoring system and product monitoring method

Similar Documents

Publication Publication Date Title
US11640576B2 (en) Shelf monitoring device, shelf monitoring method, and shelf monitoring program
JP7147806B2 (en) Display situation analysis system, display situation analysis method and program
US11823126B2 (en) Shelf label detection device, shelf label detection method, and shelf label detection program
JP5942173B2 (en) Product monitoring device, product monitoring system and product monitoring method
JPWO2022024341A5 (en) Product detection device, product detection system, product detection method, and product detection program
CN109353397B (en) Commodity management method, device and system, storage medium and shopping cart
JP6145850B2 (en) Human behavior analysis device, human behavior analysis system, and human behavior analysis method
JP5673888B1 (en) Information notification program and information processing apparatus
EP3912124A1 (en) System and methods for automatic detection of product insertions and product extraction in an open shopping cart
CN111079478A (en) Unmanned goods selling shelf monitoring method and device, electronic equipment and system
JP6648408B2 (en) Product registration device, program, and control method
CN109711498B (en) Target object behavior prediction method and device, processing equipment and intelligent commodity shelf
JP6380543B2 (en) Information processing apparatus, information processing method, and program
JP7459947B2 (en) Commodity detection device, commodity detection system, commodity detection method and commodity detection program
JP7010030B2 (en) In-store monitoring equipment, in-store monitoring methods, and in-store monitoring programs
JP7476905B2 (en) Processing device, processing method, and program
JPWO2022024364A5 (en) Product detection device, product detection system, product detection method, and product detection program
JP7318680B2 (en) Information processing program, information processing method, and information processing apparatus
JP2017062623A (en) Image detection program, image detection method, and image detection device
JP6800347B2 (en) Video surveillance system
CN108229236B (en) Code reading system and code reading method
WO2021181597A1 (en) Recognition degree estimation device, recognition degree estimation method, and recording medium
US20230306741A1 (en) Product detection device, product detection method, and recording medium
WO2019151068A1 (en) Information processing method, information processing device, and recording medium
JPWO2021090753A5 (en)