KR20160136781A - Apparatus for monitoring shopping cart - Google Patents

Apparatus for monitoring shopping cart Download PDF

Info

Publication number
KR20160136781A
KR20160136781A KR1020150070782A KR20150070782A KR20160136781A KR 20160136781 A KR20160136781 A KR 20160136781A KR 1020150070782 A KR1020150070782 A KR 1020150070782A KR 20150070782 A KR20150070782 A KR 20150070782A KR 20160136781 A KR20160136781 A KR 20160136781A
Authority
KR
South Korea
Prior art keywords
shopping cart
image
area
point area
surveillance
Prior art date
Application number
KR1020150070782A
Other languages
Korean (ko)
Other versions
KR101707035B1 (en
Inventor
오익환
Original Assignee
(주)모든솔루션
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)모든솔루션 filed Critical (주)모든솔루션
Priority to KR1020150070782A priority Critical patent/KR101707035B1/en
Publication of KR20160136781A publication Critical patent/KR20160136781A/en
Application granted granted Critical
Publication of KR101707035B1 publication Critical patent/KR101707035B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19654—Details concerning communication with a camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/018—Certifying business or products
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/182—Level alarms, e.g. alarms responsive to variables exceeding a threshold
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/10—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using wireless transmission systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B3/00—Audible signalling systems; Audible personal calling systems
    • G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B5/00—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied
    • G08B5/22—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B5/00—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied
    • G08B5/22—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission
    • G08B5/36—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission using visible light sources

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Electromagnetism (AREA)
  • Engineering & Computer Science (AREA)
  • Emergency Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Finance (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Accounting & Taxation (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

The present invention relates to an apparatus to monitor a shopping cart and, more specifically, relates to an apparatus to monitor whether an article is loaded on a shopping cart used in a mart when payment is performed at a counter. According to an embodiment of the present invention, the apparatus to monitor the shopping cart comprises: a camera which captures an image of each of an entrance point region and an exit point region of a counter passage and a surveillance region between the entrance point region and the exit point region, and transmits the captured image; a point of sales (POS) terminal which displays a surveillance region image, which is the image of the surveillance region when a shopping cart is detected on both of the entrance point region and the exit point region, and does not display the surveillance region image when the shopping cart is not detected in the entrance point region and the exit point region; and a wired and wireless communication network which is a network allowing data transmission and reception to be performed between the camera and the POS terminal in a wired or wireless manner.

Description

{Apparatus for monitoring shopping cart}

The present invention relates to an apparatus for monitoring a shopping cart, and more particularly, to an apparatus for monitoring whether an article is loaded on a shopping cart used in a shopping mart or the like at the time of settlement of a counter.

Generally, a POS (Point of Sales) system is a system for recording the sales result of a product installed at a cashier's account such as a large discount store, a supermarket, and a convenience store. It is a system that processes data with a computer and is generally called a 'point-of-sale information management system'.

In the case of a store using a shopping cart and calculating with a POS terminal (for example, a general mart), the cashier pulls all the goods from the shopping cart, puts them in the cash register, Make sure you do not have any items. However, there is a case where a loss of the store occurs due to carelessly carrying out the goods without being calculated (not charged), usually without doing so.

Therefore, there is a need for means that can be checked by the cashier so that the items in the shopping cart are not accidentally or accidentally unloaded.

Korean Patent Laid-Open No. 10-2014-0115504

An object of the present invention is to provide an apparatus for monitoring whether an article is loaded in a shopping cart used in a mart or the like at the time of settlement of a counter. It is another object of the present invention to make it possible for a cashier to easily ascertain whether or not an article is loaded on a loading tray of a shopping cart without having to confirm the loading of the shopping cart.

An embodiment of the present invention is a camera comprising: an entrance point region, an exit point region, a camera for photographing and transmitting a surveillance region between the entrance point region and the exit point region; Wherein when the shopping cart is detected in the entrance point area and the exit point area, the surveillance area image is displayed in the surveillance area, and if the shopping cart is not detected in the entrance point area and the exit point area, Force terminal; And a wired / wireless communication network, which is a network that enables data transmission / reception between the camera and the POS terminal during wired or wireless communication.

The camera is installed on the upper side of the surveillance area between the entrance point area and the exit point area of the checkout passage and photographs the monitoring image including both the entrance point area, the exit point area, and the surveillance area, As shown in FIG.

Wherein the force terminal comprises: a terminal communication unit for performing a network communication with the camera; A payment settlement unit connected to the VAN network to perform settlement of accounts; Wherein when the shopping cart is detected in the entrance point area and the exit point area, the surveillance area image is extracted from the monitoring images received from the camera and displayed on the display unit in the form of a pop-up window, A control unit for removing a pop-up window of the surveillance region image if it is not detected; And a display unit for displaying the settlement settlement settlement settlement settlement and the surveillance region image through the settlement settlement unit.

The pop-up window may be displayed after the payment settlement history is displayed in the screen area where the settlement settlement details are displayed.

The force terminal includes: a basic plane image database storing a basic plane image, which is a planar image of a shopping cart in which a loading space inside the shopping cart is empty; A photographing plane image extracting unit for extracting a plane image of the shopping cart as a photographing plane image in the surveillance region image; A similarity calculating unit for calculating a similarity between the basic plane image and the photographing plane image; And an alarm generating unit for generating an alarm including at least one of a speaker and a lamp.

The shopping cart monitoring device is characterized in that the shopping cart monitoring device irradiates the laser light from the upper side to the lower side of the surveillance area between the entrance point area and the exit point area, And an optical transmitter / receiver for receiving the reflected light and detecting the reflection time.

The controller may generate the alarm by controlling the alarm generating unit only when the similarity degree is smaller than the set similarity threshold value and the reflection time is out of the error range of the set reflection time threshold value.

According to the embodiment of the present invention, the loading box of the shopping cart is photographed in the cash register passage and is displayed in the form of a pop-up window on the force terminal, so that the cashier can easily check whether the article is loaded in the loading box of the shopping cart without having to check the loading box have. In addition, it is possible to minimize the monitoring error by detecting whether the article is loaded using the optical sensor in addition to the camera photographing.

1 is a view of a shopping cart passing through a cash register passage according to an embodiment of the present invention;
2 is a block diagram of a configuration of a shopping cart monitoring apparatus according to an embodiment of the present invention;
3 is a block diagram of a configuration of a force terminal according to an embodiment of the present invention;
FIG. 4 is a view showing a shopping cart which has entered an entrance point area according to an embodiment of the present invention; FIG.
FIG. 5 is a view showing a state where a shopping cart has entered both an entrance point area and an exit point area according to an embodiment of the present invention; FIG.
6 is a block diagram of a shopping cart monitoring apparatus for implementing a method of utilizing similarity for alarm generation according to an embodiment of the present invention.
FIG. 7 is a block diagram of a shopping cart monitoring apparatus for implementing a method of utilizing reflection time of light for alarm generation according to an embodiment of the present invention; FIG.
FIG. 8 is a view showing a state in which laser light is irradiated toward a bottom surface of a loading space of a shopping cart to receive reflected light according to an embodiment of the present invention. FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order to explain the present invention in detail so that those skilled in the art can easily carry out the present invention. . Other objects, features, and operational advantages of the present invention, including its effects and advantages, will become more apparent from the description of the preferred embodiments. It should be noted that the same reference numerals are used to denote the same or similar components in the drawings.

FIG. 1 is a view showing a shopping cart passing through a checkout passage according to an embodiment of the present invention, and FIG. 2 is a block diagram of a shopping cart monitoring apparatus according to an embodiment of the present invention.

The present invention is characterized in that a camera 200 connectable to a force terminal 100 is installed at a position of a checkout passage through which a shopping cart 10 in front of a POS counter is passed, So that the customer's shopping cart 10 can be easily checked for emptiness, thereby reducing the number of cashiers' mistakes and reducing the number of malicious customers deliberately inducing them.

However, it is difficult to always display the image of the camera 200 on the screen of the POS terminal 100 because many contents are displayed for calculation in the POS terminal program and the screen relocation of the POS terminal 100 calculation program is required. Also, when the screen is continuously displayed, it is difficult for the cashier to dispense with it or to concentrate and to expect the effect. Accordingly, the present invention provides an image of the camera 200 in the form of a pop-up window on the screen of the force terminal 100. [ That is, the shopping cart 10 displays a pop-up on the screen of the force terminal 100 only at a time when the shopping cart 10 passes a specific position, thereby enhancing concentration.

To this end, the shopping cart monitoring apparatus of the present invention may include a wired / wireless communication network 300, a camera 200, and a force terminal 100, as shown in FIG.

The wired / wireless communication network 300 is a network that enables data transmission / reception between the camera 200 and the force terminal 100 via wireless such as wired or wireless LAN such as Ethernet.

The camera 200 has an entrance point area S1 and an exit point area S2 and an area between the entrance point area S1 and the exit point area S2 (hereinafter referred to as a 'surveillance area T') And transmits them to the force terminal 100. The camera 200 may be installed on the upper side (for example, the ceiling) of the surveillance area T between the entrance point area S1 and the exit point area S2 of the checkout passage, The region S1, the exit point region S2, and the surveillance region T can all be photographed from above. Therefore, if the shopping cart 10 is located in the surveillance area T, the loading space of the shopping cart 10 on which the article is loaded can be photographed from above. The camera 200 captures a monitoring image including both the entrance point area S1, the exit point area S2 and the surveillance area T and transmits the monitoring image to the force terminal 100 in real time.

For reference, as described above, it is possible to photograph all of the entrance point area S1, the exit point area S2, and the surveillance area T from the upper side by using one camera. However, And the like.

Hereinafter, a planar image including both the bulge point region S1 and the exit point region S2 of the checkout passage and the surveillance region T between the entrance point region S1 and the exit point region S2 will be referred to as a monitoring image Further, a planar image photographed from the upper side of the surveillance area T between the entrance point area S1 and the exit point area S2 of the checkout passage is referred to as a surveillance area image. Such a surveillance region image may be a still image, a moving image, or the like.

For reference, the camera 200 may include a lens assembly, a filter, a photoelectric conversion module, and an analog / digital conversion module. The lens assembly includes a zoom lens, a focus lens, and a compensation lens. The focus distance of the lens can be shifted under the control of the focus motor MF. The filters include an optical low pass filter and an optical low pass filter. And may include an Infra-Red Cut Filter. An optical low-pass filter removes the high-frequency component of optical noise, while the Infra-Red cut filter blocks the infrared component of incident light. The photoelectric conversion module may include an image pickup device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor). The photoelectric conversion module converts light from the optical system (OPS) into an electrical analog signal. The analog / digital conversion module may include a CDS-ADC (Correlation Double Sampler and Analog-to-Digital Converter) device. An analog / digital conversion module (not shown) processes an analog signal from the photoelectric conversion module OEC, removes the high-frequency noise, adjusts the amplitude, and converts the analog signal into a digital signal.

The POS terminal 100 is a terminal for performing calculation and settlement. When all the shopping carts 10 are detected in the entrance point area S1 and the exit point area S2, And does not display the surveillance area image unless the shopping cart 10 is detected in the entrance point area S1 and the exit point area S2. Hereinafter, the force terminal 100 will be described in detail with reference to FIG.

3 is a configuration block diagram of a force terminal according to an embodiment of the present invention.

The force terminal 100 may include a terminal communication unit 140, a payment settlement unit 120, a display unit 130, and a control unit 110.

The terminal communication unit 140 is a communication means for performing network communication with the camera 200. [ The communication between the terminal communication unit 140 and the camera 200 may be performed by a wired communication method such as Ethernet, a universal serial bus, IEEE 1394, serial communication, and parallel communication And a wireless communication method such as Infrared Radiation, Bluetooth, Home Radio Frequency (RF), and Wireless LAN may be used. The term "bluetooth" refers to short-range wireless communication technology that transmits information such as pictures and voice between portable devices such as a smart phone, an earphone, and a notebook.

The payment settlement unit 120 is connected to the VAN network and performs settlement of settlement. The Value Added Network (VAN) is a value-added network that performs functions such as transmission, exchange, communication processing, and information processing. For settlement of payment, credit card settlement can be made through VAN network and the like. Therefore, the price tag is displayed by symbolizing the type of the product, the price, etc., and reading it with a reader or the like to collect the sales information. The electronic money register, the reconnaissance reader and the credit card automatic discrimination device are interlocked, Let it be possible.

The display unit 130 is an LCD or an LED display window, and payment settlement details can be displayed. The display unit 130 may also be implemented as a touch screen panel that can be input. The touch screen panel is a display window provided on the front of the POS terminal 100 to provide a touch screen screen capable of simultaneously performing input and display, and is a display window for displaying a settlement settlement history screen. A graphical user interface GUI (Graphic User Interface). When the touch panel is implemented as a touch screen panel, the keyboard of the keyboard, which is the input unit, overlaps the work screen in a graphic form. The position and transparency of the keyboard layout input window can be adjusted by the user. The touch screen panel may be realized by a touch panel of any one of a resistance film type, a capacitive type, an infrared type, and an ultrasonic type.

In addition to the payment settlement details, a surveillance region image photographed through the camera 200 may be displayed on the display unit 130 in the form of a pop-up window. Therefore, the cashier merely needs to check the surveillance region image displayed in the form of a pop-up window on the display unit 130 of the POS terminal 100 without having to look inside the shopping cart 10 when the shopping cart 10 passes the cash register path .

The control unit 110 extracts a surveillance region image from the monitoring images received from the camera 200 when the shopping cart 10 is sensed in the entrance point region S1 and the exit point region S2 and displays the surveillance region image in the form of a pop- And removes the pop-up window of the surveillance area image if the shopping cart 10 is not detected in the entrance point area S1 and the exit point area S2.

The control section has an image taken from the upper side as a basic image when there is no shopping cart 10 in the checkout passage including the entrance point area S1, the exit point area S2 and the surveillance area T1. It is possible to know whether the shopping cart 10 is detected in both the entrance point area S1 and the exit point area S2 by comparing the basic image and the monitoring image received from the camera in real time on a video frame basis. For example, as shown in Fig. 4, when the shopping cart 10 enters the entrance point area S1, a change occurs when the image of the entrance point area S1 is compared with the base image as compared with the base image . When the change of the image of the entrance point area S1 is detected, the entrance point area S1 is judged that the shopping cart 10 is detected.

Likewise, when the shopping cart 10 enters the exit point area S2, a change occurs when the image of the exit point area S2 is compared with the base image as compared with the base image. When a change in the image of the exit point area S2 is detected, it is determined that the shopping cart 10 is detected in the exit point area S2.

5, if the shopping cart 10 is detected in both the entrance point region S1 and the exit point region S2, the surveillance region image is extracted from the monitoring images received from the camera 200, On the display unit 130. [

In addition to the implementation method to be sensed by the control unit as described above, there may be a configuration in which another sensing unit is provided. For example, a pressure sensing body may be placed on the bottom of the checkout passage to sense the weight of the shopping cart 10, or a shopping cart 10 passing through the checkout passage by placing laser transmission / reception means on both side walls of the checkout passage Can be detected.

The distance between the entrance point area S1 and the exit point area S2 is designed to be shorter than the distance between the front wheel and the rear wheel of the shopping cart 10. [ This is for displaying the surveillance area on the mobo's terminal 100 when the shopping cart 10 is detected in both the entrance point area S1 and the exit point area S2.

Also, the control unit 110 causes the pop-up window of the surveillance region image to be displayed after being displayed on the screen area where the payment settlement details are displayed. The cashier looks at the screen area where the payment settlement details are displayed at the time of calculating the goods, so that a popup window is temporarily displayed instead of the payment settlement details in the screen area where the settlement settlement details are displayed and then removed. Therefore, the cashier can easily view the popup window of the surveillance region image.

On the other hand, the shopper puts the items in the shopping cart 10 on the checkout table for payment and passes through the checkout passage in the empty shopping cart 10 state. The cashier checks the surveillance area image displayed on the POS terminal 100 of the present invention and displays the surveillance area image on the shopping area of the shopping cart 10, The inside of the cart 10 can be checked to prevent theft.

However, since the cashier has to check the surveillance region images displayed on the force terminal 100 every time the shopping cart 10 passes one by one, the surveillance region images can not be viewed in detail when the cashier is busy have.

In order to solve this problem, another embodiment of the present invention provides means for monitoring the inside of the shopping cart 10 to generate an alarm by analyzing whether or not the article is heard. As an analysis judgment method for generating an alarm, there are a method of utilizing image similarity, a method of using reflection time by transmitting and receiving light, and a method of using blocking time by transmitting and receiving light. 6 to 8 will be described below in detail.

6 is a block diagram of a shopping cart monitoring apparatus for implementing a method of utilizing similarity for alarm generation according to an embodiment of the present invention.

The shopping cart monitoring device includes a terminal communication unit 140, a payment settlement unit 120, a display unit 130 and a control unit 110. The shopping cart monitoring device includes an alarm generating unit 150, a basic plane image database 160, A flat image extracting unit 170, and a similarity calculating unit 180.

The operations of the terminal communication unit 140, the payment settlement unit 120, the display unit 130, and the control unit 110 have been described above, and a description thereof will be omitted.

The alarm generating unit 150 generates an alarm by including at least one of a speaker and a lamp. Therefore, an alarm can be generated through audio or lamp emission. In addition, an alarm can be displayed on the screen of the force terminal 100.

The basic plane image database 160 is a database storing a basic plane image, which is a plane image of the shopping cart 10 in which the loading space of the shopping cart 10 is empty. The shopping cart 10 in which the inside of the loading space is empty without the article is photographed by the camera 200 from above and stored as a basic plane image.

The basic plane image database 160 may be a hard disk drive, an SSD drive, a flash memory, a CF card, an SD card A module capable of inputting and outputting information such as a card, a smart card, an MMC card, a memory stick, or the like, There may be.

The photographing plane image extracting unit 170 extracts a plane image of the shopping cart 10 as a photographing plane image from the surveillance region image photographed through the camera 200 when the shopper passes the checkout passage. Only the image of the shopping cart 10 is extracted from all of the surveillance region images. This extraction method can extract only the image of the shopping cart 10 by registering the color of the ground in the surveillance area image and removing the color of the ground of the surveillance area image. Alternatively, the color of the shopping cart 10 may be extracted to extract only the image of the shopping cart 10. In addition, various known extraction algorithms such as a facial image extraction algorithm and the like can be utilized as the specific image extraction method.

The similarity calculating unit 180 calculates the similarity between the basic plane image and the photographing plane image. The degree of similarity is a numerical value of a degree of similarity. The degree of similarity calculation can be performed in various ways such as calculating the degree of similarity through color distribution comparison or calculating the degree of similarity through comparison of shape image.

The controller 110 may generate an alarm through the alarm generator 150 when the similarity calculated by the similarity calculator 180 is smaller than the set similarity threshold. For example, when the similarity threshold is set to 80%, an alarm is generated when the calculated similarity is 80% or less.

FIG. 7 is a block diagram of a shopping cart monitoring apparatus for implementing a method of utilizing a reflection time of light for alarm generation according to an embodiment of the present invention. FIG. And the reflection light is received by irradiating the bottom surface of the loading space.

The shopping cart monitoring apparatus includes a terminal communication unit 140, a payment settlement unit 120, a display unit 130, an alarm generation unit 150, and a control unit 110, and includes an optical transmitter / receiver unit 190 .

The operation of the terminal communication unit 140, the payment settlement unit 120, the display unit 130, the alarm generating unit 150, and the control unit 110 have been described above, and therefore the description thereof is omitted.

The optical transceiver 190 includes an optical transmission module 190a and a light receiving module 190b and is positioned above the monitoring area T between the entrance point area S1 and the exit point area S2. The optical transmission module 190a irradiates the laser light from the upper side to the lower side of the surveillance area T and then receives the reflection light reflected by the light reception module 190b to detect the reflection time.

The floor space of the loading space of the shopping cart 10 in which the article is placed is implemented as a reflecting surface in the form of a plate. The bottom surface is not mesh net structure but net plate net play plane. The bottom surface of the loading space of the shopping cart 10 is formed of an aluminum plate having good reflectivity so that the laser light emitted from the optical transmission module 190a is reflected on the bottom surface of the loading space of the shopping cart 10, Lt; RTI ID = 0.0 > 190b. ≪ / RTI >

When the reflection time from the transmission time to the reception time is out of the error range of the preset reflection time threshold value, the controller 110 controls the alarm generation unit 150 to generate an alarm.

For this, the laser light is irradiated in the state that the article is not contained in the shopping cart 10, and the time reflected on the bottom surface of the loading space of the shopping cart 10 is set as a reflection time threshold value and stored in the database. When the reflection time is measured in a state that the shopping cart 10 contains the article, since the article is raised on the bottom surface of the loading space of the shopping cart 10 and the laser light is reflected and received on the upper surface of the article, The reflected time must be greater than the bottom reflection time threshold. Accordingly, when the reflection time is out of the error range of the preset reflection time threshold value, it is determined that there is an article in the shopping cart 10, and the alarm generating unit 150 is controlled to generate an alarm.

For reference, the laser beam will be reflected not only on the end face of the loading space bar of the shopping cart 10 but also on the upper surface of the handle frame, the upper surface of the wall frame of the shopping cart 10, It is possible to grasp the reflection time of the laser light by the upper surface of the wall frame of the display unit 10 and to not alarm it. Or a handle frame of the shopping cart 10 and a wall frame of the shopping cart 10 so that only the cross section of the loading space bar of the shopping cart 10 is irradiated with laser light.

As described above, when the degree of similarity is less than the threshold value of similarity set, or when the reflection time is out of the error range of the preset reflection time threshold value, the controller 110 controls the alarm generating unit 150 to generate an alarm .

In addition, in order to minimize the detection error of whether or not the article is placed on the shopping cart, the embodiment of the present invention is characterized in that an error range of the reflection time threshold value at which the reflection time is set is set to The alarm generating unit 150 may be controlled so as to generate an alarm only when the condition for departing the vehicle is satisfied.

The embodiments of the present invention described above are selected and presented in order to facilitate the understanding of those skilled in the art from a variety of possible examples. The technical idea of the present invention is not necessarily limited to or limited to these embodiments Various changes, modifications, and other equivalent embodiments are possible without departing from the spirit of the present invention.

10: Shopping cart
100: Force terminal
200: camera
110,
120: Payment settlement department
130:
140:

Claims (7)

An entrance point area, an exit point area, and a surveillance area between the entrance point area and the exit point area of the checkout passage;
Wherein when the shopping cart is detected in the entrance point area and the exit point area, the surveillance area image is displayed in the surveillance area, and if the shopping cart is not detected in the entrance point area and the exit point area, Force terminal; And
A wired / wireless communication network, which is a network that enables data transmission / reception between the camera and the POS terminal during wired or wireless communication;
The shopping cart monitoring device comprising:
The camera according to claim 1,
And a control unit that is installed on the upper side of the surveillance area between the entrance point area and the exit point area of the checkout passage and photographs the monitoring image including both the entrance point area, the exit point area, and the surveillance area, Cart monitoring device.
The mobile terminal of claim 2,
A terminal communication unit for performing a network communication with the camera;
A payment settlement unit connected to the VAN network to perform settlement of accounts;
A display unit displaying the settlement settlement settlement settlement and the surveillance region image through the settlement unit; And
Wherein when the shopping cart is detected in the entrance point area and the exit point area, the surveillance area image is extracted from the monitoring images received from the camera and displayed on the display unit in the form of a pop-up window, A control unit for removing a pop-up window of the surveillance region image if it is not detected;
The shopping cart monitoring device comprising:
The method of claim 3,
Wherein the pop-up window is displayed after being displayed instead of the settlement account in the screen area where the settlement settlement details are displayed.
The mobile terminal of claim 1,
A basic plane image database storing a basic plane image which is a planar image of a shopping cart in which a loading space inside the shopping cart is empty;
A photographing plane image extracting unit for extracting a plane image of the shopping cart as a photographing plane image in the surveillance region image;
A similarity calculating unit for calculating a similarity between the basic plane image and the photographing plane image; And
An alarm generating unit for generating an alarm including at least one of a speaker and a lamp;
The shopping cart monitoring device comprising:
The method of claim 5,
The bottom surface of the loading space of the shopping cart is formed into a plate-like reflecting surface,
The shopping cart monitoring apparatus includes a light receiving and transmitting unit that irradiates a laser beam from an upper side to a lower side of a surveillance area between the entrance point area and an exit point area and then receives reflected light reflected from the surveillance area and detects a reflection time, Monitoring device.
The method of claim 6,
Wherein the controller generates the alarm by controlling the alarm generating unit only when the similarity degree is smaller than the set similarity threshold value and the reflection time is out of the error range of the set reflection time threshold value.
KR1020150070782A 2015-05-21 2015-05-21 Apparatus for monitoring shopping cart KR101707035B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150070782A KR101707035B1 (en) 2015-05-21 2015-05-21 Apparatus for monitoring shopping cart

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150070782A KR101707035B1 (en) 2015-05-21 2015-05-21 Apparatus for monitoring shopping cart

Publications (2)

Publication Number Publication Date
KR20160136781A true KR20160136781A (en) 2016-11-30
KR101707035B1 KR101707035B1 (en) 2017-02-16

Family

ID=57707410

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150070782A KR101707035B1 (en) 2015-05-21 2015-05-21 Apparatus for monitoring shopping cart

Country Status (1)

Country Link
KR (1) KR101707035B1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07277621A (en) * 1994-01-26 1995-10-24 Otis Elevator Co System and method to judge appropriateness condition of car
KR20060047799A (en) * 2004-05-28 2006-05-18 조원제 Unification system of a pos system and a cctv system and method managing image thereof
KR20080044936A (en) * 2006-11-17 2008-05-22 주식회사 도담시스템스 Watching control system having an auto picture pop-up function and controlling method for the same
KR20140115504A (en) 2013-03-20 2014-10-01 이광현 Production method of security paper to protect steal
KR101501540B1 (en) * 2014-04-16 2015-03-12 (주)조아전자 Payment System Capable Of Outputing Image

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07277621A (en) * 1994-01-26 1995-10-24 Otis Elevator Co System and method to judge appropriateness condition of car
KR20060047799A (en) * 2004-05-28 2006-05-18 조원제 Unification system of a pos system and a cctv system and method managing image thereof
KR20080044936A (en) * 2006-11-17 2008-05-22 주식회사 도담시스템스 Watching control system having an auto picture pop-up function and controlling method for the same
KR20140115504A (en) 2013-03-20 2014-10-01 이광현 Production method of security paper to protect steal
KR101501540B1 (en) * 2014-04-16 2015-03-12 (주)조아전자 Payment System Capable Of Outputing Image

Also Published As

Publication number Publication date
KR101707035B1 (en) 2017-02-16

Similar Documents

Publication Publication Date Title
US11514497B2 (en) Method of using, apparatus, product, and system for a no touch point-of-sale self-checkout
US20220198550A1 (en) System and methods for customer action verification in a shopping cart and point of sales
US10169752B2 (en) Merchandise item registration apparatus, and merchandise item registration method
US9589433B1 (en) Self-checkout anti-theft device
US9412099B1 (en) Automated item recognition for retail checkout systems
CN110866429B (en) Missing scanning identification method, device, self-service cashing terminal and system
US9916561B2 (en) Methods, devices and computer readable storage devices for tracking inventory
JP6724326B2 (en) Information processing apparatus, information processing method, and program
EP4075399A1 (en) Information processing system
US20180307891A1 (en) Information processing device, information processing method, and recording medium with program stored therein
JP6580651B2 (en) Information processing apparatus, information processing apparatus control method, information processing apparatus control program, and article providing system
US20140067574A1 (en) Information processing apparatus and information processing method
JP2019505920A (en) Intelligent shopping cart product identification method and system
US20190385141A1 (en) Check-out system with merchandise reading apparatus and pos terminal
JPWO2020027034A1 (en) Reading system, shopping support system, reading method and program
JP2015095028A (en) Pos terminal device, pos system, image processing method, and program
CN204614025U (en) A kind of shopping storing equipment
US20210272174A1 (en) Goods purchase analysis assist system
KR101707035B1 (en) Apparatus for monitoring shopping cart
JP6375926B2 (en) Product recognition device and product registration device
JP2023073292A (en) Information processing device, information processing system, information processing method, and information processing program
US20220292936A1 (en) Commodity sales data processing device and method
US11755989B2 (en) Preventing theft at retail stores
JP6569762B2 (en) POS terminal device, POS system, image processing method and program
JP6908491B2 (en) Product information reader and program

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant