CN113763629A - Intelligent sales counter and foreign matter detection method - Google Patents
Intelligent sales counter and foreign matter detection method Download PDFInfo
- Publication number
- CN113763629A CN113763629A CN202110319782.5A CN202110319782A CN113763629A CN 113763629 A CN113763629 A CN 113763629A CN 202110319782 A CN202110319782 A CN 202110319782A CN 113763629 A CN113763629 A CN 113763629A
- Authority
- CN
- China
- Prior art keywords
- sales counter
- intelligent sales
- weight
- article
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title description 2
- 238000012545 processing Methods 0.000 claims abstract description 76
- 230000005484 gravity Effects 0.000 claims abstract description 26
- 238000000034 method Methods 0.000 claims abstract description 21
- 238000004590 computer program Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 229910052742 iron Inorganic materials 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F11/00—Coin-freed apparatus for dispensing, or the like, discrete articles
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F9/00—Details other than those peculiar to special kinds or types of apparatus
- G07F9/02—Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus
- G07F9/026—Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus for alarm, monitoring and auditing in vending machines or means for indication, e.g. when empty
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Cash Registers Or Receiving Machines (AREA)
Abstract
The invention discloses an intelligent sales counter and a method for detecting foreign matters, and relates to the technical field of intelligent equipment. One specific implementation mode of the intelligent sales counter comprises a cabinet body, an article rack, a shooting device, a gravity sensor, processing equipment and alarm equipment; the article rack is used for placing a first article; the shooting device is used for shooting a first image of a first article placed on the article rack and a second image of a moving object; the gravity sensor is used for detecting a first weight of the first article; detecting a second weight of a second item when the second item is placed on the item rack; the processing module is used for determining whether foreign matters are placed in the intelligent sales counter; when the foreign matter is determined to be placed in the intelligent sales counter, triggering the alarm device; and the alarm equipment is used for responding to the triggering of the processing module and sending alarm information. This embodiment makes intelligent sales counter can detect the foreign matter and send alarm information.
Description
Technical Field
The invention relates to the technical field of intelligent equipment, in particular to an intelligent sales counter and a method for detecting foreign matters.
Background
At present, intelligent sales cabinets generally determine whether or not an article is taken away and what article is taken away according to an image recognition technology, so as to complete the function of automatically selling articles.
However, the existing intelligent sales counter provides convenience for users, and meanwhile, there are some hidden dangers, that is, if someone puts foreign matters in the intelligent sales counter, the intelligent sales counter cannot detect the foreign matters, and further, the situations that other articles in the intelligent sales counter are damaged and the like may be caused, and the normal use experience of the users is influenced.
Disclosure of Invention
In view of this, embodiments of the present invention provide an intelligent sales counter and a method for detecting a foreign object, which can determine whether a foreign object is placed in the intelligent sales counter according to information collected by a shooting device and a gravity sensor, and when it is determined that a foreign object is placed in the intelligent sales counter, can trigger an alarm device to send alarm information, so that the intelligent sales counter can detect the foreign object and send the alarm information, thereby preventing other objects in the intelligent sales counter from being damaged, and ensuring normal use experience of a user.
To achieve the above object, according to an aspect of an embodiment of the present invention, there is provided an intelligent sales counter.
The intelligent sales counter comprises a cabinet body, an article rack, a shooting device, a gravity sensor, a processing module and alarm equipment; wherein:
the article rack is arranged in the cabinet body and used for placing a first article;
a photographing device for photographing a first image of a first article placed on the article rack and a second image of a moving object;
the gravity sensor is arranged at the bottom of the article rack and used for detecting the first weight of the first article; detecting a second weight of a second item when the second item is placed on the item rack;
the processing module is used for determining whether foreign matters are placed in the intelligent sales counter or not according to the first image and the second image when the difference value between the first weight and the second weight is smaller than a preset first threshold value; when the foreign matter is determined to be placed in the intelligent sales counter, triggering the alarm device;
and the alarm equipment is used for responding to the triggering of the processing module and sending alarm information.
Alternatively,
the shooting device comprises a first camera, and the first camera is arranged in the cabinet body;
when a second object is placed in the cabinet, an image of the moving second object is taken as a second image.
Alternatively,
the shooting device comprises a second camera which is arranged outside the cabinet body;
the second camera is used for shooting an environment image containing a moving object outside the cabinet body and transmitting the environment image to the processing module;
and the processing module is used for determining whether foreign matters are placed in the intelligent sales counter or not according to the environment image and the first image.
Alternatively,
and the processing module is used for determining whether the moving object in the environment image comprises the first article or not, and if so, determining that the foreign object is placed in the intelligent sales counter.
Alternatively,
and the processing module is used for determining whether the similarity between the first image and the second image is greater than a preset second threshold value, and if so, determining that the moving object in the environment image is the first article.
Alternatively,
and the processing module is used for determining that foreign matters are placed in the intelligent sales counter when the difference value between the first weight and the second weight is not smaller than the first threshold value.
Alternatively,
a gravity sensor for detecting a third weight of the article rack when the first article is placed on the article rack and a fourth weight of the article rack after the first article is picked up from the article rack;
a processing module for determining a first weight from the third weight and the fourth weight.
Alternatively,
and the processing module is used for determining that foreign matters are placed in the intelligent sales counter when the difference value between the second weight and the third weight is larger than a preset third threshold value.
To achieve the above object, according to still another aspect of an embodiment of the present invention, there is provided a method of detecting a foreign object.
The method for detecting the foreign matters, which is provided by the embodiment of the invention, is applied to any intelligent sales counter provided by the embodiment, and comprises the following steps:
a shooting device of the intelligent sales counter shoots a first image of a first article placed on an article rack and a second image of a moving object;
the gravity sensor of the intelligent sales counter detects a first weight of a first article; detecting a second weight of a second item when the second item is placed on the item rack;
the processing module of the intelligent sales counter determines whether the difference value of the first weight and the second weight is smaller than a preset first threshold value;
when the difference value is smaller than the preset threshold value, the processing module determines whether foreign matters are placed in the intelligent sales counter or not according to the first image and the second image;
when the foreign matter is determined to be placed in the intelligent sales counter, the processing module triggers the alarm device;
the alarm device responds to the triggering of the processing module and sends out alarm information.
To achieve the above object, according to still another aspect of an embodiment of the present invention, there is provided a processing apparatus.
The processing equipment provided by the embodiment of the invention is arranged in any intelligent sales counter provided by the embodiment, and comprises: one or more processors; a storage device for storing one or more programs which, when executed by one or more processors, cause the one or more processors to implement a method for detecting a foreign object according to an embodiment of the present invention.
To achieve the above object, according to still another aspect of embodiments of the present invention, there is provided a computer-readable storage medium.
A computer-readable storage medium of an embodiment of the present invention has stored thereon a computer program that, when executed by a processor, implements a method of detecting foreign matter of an embodiment of the present invention.
One embodiment of the above invention has the following advantages or benefits: can confirm whether to have the foreign matter to be put into intelligent sales counter through the information of shooing device and gravity sensor collection, when determining that there is the foreign matter to put into intelligent sales counter, can trigger alarm equipment and send alarm information to make intelligent sales counter can detect the foreign matter and send alarm information, and then avoid other article in the intelligent sales counter impaired, guarantee user's normal use and experience.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
FIG. 1 is a schematic diagram of an intelligent sales cabinet according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of another intelligent sales cabinet according to an embodiment of the present invention;
FIG. 3a is a schematic view of yet another intelligent sales container according to an embodiment of the present invention;
FIG. 3b is a schematic view of yet another intelligent sales container according to an embodiment of the present invention;
FIG. 4 is a schematic view of yet another intelligent sales container according to an embodiment of the present invention;
FIG. 5 is a schematic view of yet another intelligent sales container according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of the main steps of a method of detecting foreign objects according to an embodiment of the present invention;
FIG. 7 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;
fig. 8 is a schematic structural diagram of a computer system suitable for implementing a terminal device or a server according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It should be noted that the embodiments of the present invention and the technical features of the embodiments may be combined with each other without conflict.
FIG. 1 is a schematic diagram of an intelligent sales counter according to an embodiment of the present invention.
As shown in fig. 1, an intelligent sales counter according to an embodiment of the present invention includes a cabinet 101, an article rack 102, a camera 103, a gravity sensor 104, a processing module, and an alarm device 105; wherein:
an article rack 102 is installed in the cabinet 101 for placing a first article;
a photographing device 103 for photographing a first image of a first article placed on the article rack 102 and a second image of a moving object;
a gravity sensor 104 is mounted at the bottom of the article rack 102 for detecting a first weight of the first article; detecting a second weight of a second item when the second item is placed on the item holder 102;
the processing module is used for determining whether foreign matters are placed in the intelligent sales counter or not according to the first image and the second image when the difference value between the first weight and the second weight is smaller than a preset first threshold value; when the foreign matter is determined to be placed in the intelligent sales counter, the alarm device 105 is triggered;
and the alarm device 105 is used for responding to the triggering of the processing module and sending alarm information.
In the embodiment of the present invention, the shooting device 103 may include a first camera, and the first camera is disposed inside the cabinet 101; when a second article is put into the cabinet 101, an image of the moving second article is taken as a second image.
For example, as shown in fig. 2 and fig. 3a, in fig. 2, the first weight detected by the gravity sensor 104 is the weight of the first article on the right side (i.e. the cylinder on the right side in fig. 2), specifically, the first weight is determined by: the gravity sensor 104 detects a third weight of the article rack 102 when the first article is placed in the article rack 102 and a fourth weight of the article rack 102 after the first article is picked up from the article rack 102; the first weight is then determined by the processing module based on the third weight and the fourth weight. Next, as shown in fig. 3a, the first article is taken out, and a second article (i.e. the shaded square in fig. 3 a) is placed on the article rack 102, at this time, the processing module first determines whether a difference between the first weight and the second weight of the second article is smaller than a preset first threshold, and if not, determines that a foreign object is placed in the intelligent sales container; if so, then it is determined whether a foreign object is placed in the intelligent sales counter based on the first image and the second image, obviously the cube in fig. 3a is different from the cylinder in fig. 2, so the processing module determines that a foreign object is placed in the intelligent sales counter at this time and triggers the alarm device 105.
In the embodiment of the present invention, the first camera disposed inside the cabinet 101 may be tilted outward, and has a certain tilt angle, which is related to the size of the cabinet, so that the first camera can shoot an environmental image in a certain area outside the cabinet. In a preferred embodiment of the invention, the angle of inclination is 23 degrees.
In the embodiment of the present invention, the first camera may be disposed on one side of the inside of the cabinet 101 as shown in fig. 3a, may also be disposed in a crossing manner on two sides of the inside of the cabinet 101 as shown in fig. 3b, and may also be disposed inside the cabinet 101 in other manners, which is not limited to this scheme.
In the embodiment of the present invention, the shooting device 103 includes a second camera, and the second camera is disposed outside the cabinet 101; the second camera is used for shooting an environment image containing a moving object outside the cabinet body 101 and transmitting the environment image to the processing module; and the processing module is used for determining whether foreign matters are placed in the intelligent sales counter or not according to the environment image and the first image.
In the embodiment of the present invention, the second camera disposed outside the cabinet 101 may also be used to monitor the environment around the cabinet, and when the alarm device 105 sends out alarm information, the situation can be traced back through the monitoring record of the second camera.
In an embodiment of the present invention, the processing module is configured to determine whether a first item is included in the moving object in the environment image, and if so, determine that a foreign object is placed in the smart sales counter.
For example, as shown in fig. 2 and 4, in fig. 2, the first weight detected by the gravity sensor 104 is the weight of the first item on the right side (i.e., the cylinder on the right side in fig. 2). Next, as shown in fig. 4, the first article is taken out, and a second article (i.e. a cylinder with a shadow in fig. 4) is placed on the article rack 102, at this time, the processing module first determines whether a difference between the first weight and the second weight of the second article is smaller than a preset first threshold, and if not, determines that a foreign object is placed in the intelligent sales container; if so, it is determined again whether the first item is included in the moving object in the environment image, as can be seen from fig. 4, the first item is included in the moving object (i.e., the black hand) in the environment image, so the processing module determines that a foreign object is placed in the smart sales counter at this time, and triggers the alarm device 105.
In an embodiment of the present invention, the processing module may determine whether the first item is included in the moving object in the environment image by using an edge algorithm.
In an embodiment of the invention, the alarm device 105 may be a display screen comprising a speaker, in which case the image of the environment determined by the processing module may be displayed on the display screen. And after receiving the trigger of the processing module, the alarm information containing sound and characters can be sent out through the loudspeaker and the display screen.
In an embodiment of the present invention, the display screen may be further configured to display a door opening two-dimensional code, a payment two-dimensional code, and a list of first items taken out by the user.
In the embodiment of the invention, when the user uses the intelligent terminal to scan the door-opening two-dimensional code to open the cabinet door, a shopping page can be displayed on the intelligent terminal, and when the user takes out one or more first articles, a list of the first articles taken out by the user is displayed on the shopping page.
In the embodiment of the invention, when the processing module determines that the second article put in the intelligent sales counter is not the foreign matter, the second article is a certain first article taken out before, so that the corresponding first article can be deleted from the list of the first articles displayed on the display screen and/or the list of the first articles displayed on the user intelligent terminal according to the recognition result of the put-back second article.
In an embodiment of the present invention, the processing module is configured to determine whether a similarity between the first image and the second image is greater than a preset second threshold, and if so, determine that the moving object in the environment image is the first item.
In an embodiment of the present invention, the processing module is configured to determine that a foreign object is placed in the intelligent sales counter when it is determined that the difference between the first weight and the second weight is not less than the first threshold.
In an embodiment of the present invention, the gravity sensor 104 is configured to detect a third weight of the article rack 102 when the first article is placed on the article rack 102 and a fourth weight of the article rack 102 after the first article is picked up from the article rack 102; a processing module for determining a first weight from the third weight and the fourth weight.
In an embodiment of the present invention, the processing module is configured to determine that a foreign object is placed in the intelligent sales counter when it is determined that a difference between the second weight and the third weight is greater than a preset third threshold.
In a preferred embodiment of the present invention, the preset third threshold is 0. For example, as shown in fig. 2 and 5, in fig. 2, the third weight detected by the gravity sensor 104 is the weight of two first articles in the figure (i.e. two cylinders in fig. 2), and in case that no first article is taken out, as shown in fig. 5, the gravity sensor 104 detects the second weight of a second article (i.e. a shaded square in fig. 5), so the processing module determines that a foreign object is put into the intelligent sales counter at this time and triggers the alarm device 105.
In the embodiment of the invention, the intelligent sales counter can further comprise an electronic lock, the electronic lock comprises an electromagnetic generator and an iron block, and the electromagnetic generator and the iron block are respectively arranged on the cabinet body and the cabinet door and are used for controlling the opening and closing of the cabinet door.
In the embodiment of the invention, the intelligent sales counter can further comprise a compressor for refrigerating the intelligent sales counter.
According to the intelligent sales counter disclosed by the embodiment of the invention, whether foreign matters are placed in the intelligent sales counter can be determined through the information acquired by the shooting device and the gravity sensor, and when the foreign matters are determined to be placed in the intelligent sales counter, the alarm device can be triggered to send alarm information, so that the intelligent sales counter can detect the foreign matters and send the alarm information, further, other articles in the intelligent sales counter are prevented from being damaged, and the normal use experience of a user is ensured.
Fig. 6 is a schematic diagram of main steps of a method for detecting foreign matter according to an embodiment of the present invention.
As shown in fig. 6, a method for detecting a foreign object according to an embodiment of the present invention mainly includes the following steps:
step S601: a shooting device of the intelligent sales counter shoots a first image of a first article placed on an article rack and a second image of a moving object;
step S602: the gravity sensor of the intelligent sales counter detects a first weight of a first article; detecting a second weight of a second item when the second item is placed on the item rack;
step S603: the processing module of the intelligent sales counter determines whether the difference value of the first weight and the second weight is smaller than a preset first threshold value;
step S604: when the difference value is smaller than the preset threshold value, the processing module determines whether foreign matters are placed in the intelligent sales counter or not according to the first image and the second image;
step S605: when the foreign matter is determined to be placed in the intelligent sales counter, the processing module triggers the alarm device;
step S606: the alarm device responds to the triggering of the processing module and sends out alarm information.
In the embodiment of the present invention, the shooting device may include a first camera, and the first camera is disposed inside the cabinet; when the second object is placed in the cabinet body, the first camera shoots an image of the moving second object to serve as a second image.
In the embodiment of the invention, the shooting device may include a second camera, and the second camera is arranged outside the cabinet body; the second camera shoots an environment image containing a moving object outside the cabinet body and transmits the environment image to the processing module; the processing module determines whether foreign matters are placed in the intelligent sales counter according to the environment image and the first image.
In an embodiment of the invention, the processing module may determine whether the first item is included in the moving object in the environment image, and if so, determine that the foreign object is placed in the smart sales counter.
In the embodiment of the present invention, the processing module may determine whether the similarity between the first image and the second image is greater than a preset second threshold, and if so, determine that the moving object in the environment image is the first item.
In an embodiment of the present invention, when it is determined that the difference between the first weight and the second weight is not less than the first threshold, the processing module may determine that a foreign object is placed in the intelligent sales counter.
In an embodiment of the present invention, the gravity sensor may detect a third weight of the article rack when the first article is placed on the article rack and a fourth weight of the article rack after the first article is picked up from the article rack; the processing module determines a first weight based on the third weight and the fourth weight.
In the embodiment of the present invention, when it is determined that the difference between the second weight and the third weight is greater than the preset third threshold, the processing module may determine that a foreign object is placed in the intelligent sales counter.
According to the method for detecting the foreign matters, whether the foreign matters are placed in the intelligent sales counter or not can be determined through the information collected by the shooting device and the gravity sensor, and when the fact that the foreign matters are placed in the intelligent sales counter is determined, the alarm device can be triggered to send alarm information, so that the intelligent sales counter can detect the foreign matters and send the alarm information, other articles in the intelligent sales counter are prevented from being damaged, and normal use experience of a user is guaranteed.
Fig. 7 shows an exemplary system architecture 700 of a method of detecting foreign objects or an intelligent sales counter to which embodiments of the invention can be applied.
As shown in fig. 7, the system architecture 700 may include terminal devices 701, 702, 703, a network 704 and an intelligent sales counter 705. The network 704 is used to provide a medium for communication links between the terminal devices 701, 702, 703 and the intelligent sales counter 705. Network 704 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The user may use the terminal devices 701, 702, 703 to interact with the intelligent sales counter 705 over the network 704, to receive or send messages or the like. Various communication client applications, such as shopping applications, may be installed on the terminal devices 701, 702, 703.
The terminal devices 701, 702, 703 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The intelligent sales counter 705 comprises a processing module, and can analyze and process the received data of taking out the first article, putting back the first article, and the like, and feed back the processing result (for example, information to be paid) to the terminal device.
It should be noted that, the method for detecting a foreign object provided by the embodiment of the present invention is generally executed by the intelligent sales counter 705, and accordingly, the processing module is generally disposed in the intelligent sales counter 705.
It should be understood that the number of terminal devices, networks and intelligent sales containers in fig. 7 is only illustrative. There may be any number of terminal devices, networks and intelligent sales counter as required by the implementation.
Referring now to FIG. 8, shown is a block diagram of a computer system 800 suitable for use with a terminal device implementing an embodiment of the present invention. The terminal device shown in fig. 8 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 8, the computer system 800 includes a Central Processing Unit (CPU)801 that can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data necessary for the operation of the system 800 are also stored. The CPU 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
The following components are connected to the I/O interface 805: an input portion 806 including a keyboard, a mouse, and the like; an output section 807 including a signal such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 808 including a hard disk and the like; and a communication section 809 including a network interface card such as a LAN card, a modem, or the like. The communication section 809 performs communication processing via a network such as the internet. A drive 810 is also connected to the I/O interface 805 as necessary. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as necessary, so that a computer program read out therefrom is mounted on the storage section 808 as necessary.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 809 and/or installed from the removable medium 811. The computer program executes the above-described functions defined in the system of the present invention when executed by the Central Processing Unit (CPU) 801.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise: a shooting device of the intelligent sales counter shoots a first image of a first article placed on an article rack and a second image of a moving object; the gravity sensor of the intelligent sales counter detects a first weight of a first article; detecting a second weight of a second item when the second item is placed on the item rack; the processing module of the intelligent sales counter determines whether the difference value of the first weight and the second weight is smaller than a preset first threshold value; when the difference value is smaller than the preset threshold value, the processing module determines whether foreign matters are placed in the intelligent sales counter or not according to the first image and the second image; when the foreign matter is determined to be placed in the intelligent sales counter, the processing module triggers the alarm device; the alarm device responds to the triggering of the processing module and sends out alarm information.
According to the technical scheme of the embodiment of the invention, whether foreign matters are placed in the intelligent sales counter or not can be determined through the information collected by the shooting device and the gravity sensor, and when the foreign matters are placed in the intelligent sales counter, the alarm device can be triggered to send alarm information, so that the intelligent sales counter can detect the foreign matters and send the alarm information, further, other articles in the intelligent sales counter are prevented from being damaged, and the normal use experience of a user is ensured.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (11)
1. An intelligent sales counter is characterized by comprising a counter body, an article rack, a shooting device, a gravity sensor, processing equipment and alarm equipment; wherein:
the article rack is arranged in the cabinet body and used for placing a first article;
the shooting device is used for shooting a first image of a first article placed on the article rack and a second image of a moving object;
the gravity sensor is arranged at the bottom of the article rack and used for detecting the first weight of the first article; detecting a second weight of a second item when the second item is placed on the item rack;
the processing equipment is used for determining whether foreign matters are put into the intelligent sales counter or not according to the first image and the second image when the difference value between the first weight and the second weight is smaller than a preset first threshold value; when the foreign matter is determined to be placed in the intelligent sales counter, triggering the alarm device;
and the alarm equipment is used for responding to the triggering of the processing equipment and sending alarm information.
2. The intelligent sales counter of claim 1,
the shooting device comprises a first camera, and the first camera is arranged in the cabinet body;
when the second object is placed in the cabinet body, an image of the moving second object is taken as the second image.
3. The intelligent sales counter of claim 1,
the shooting device comprises a second camera, and the second camera is arranged outside the cabinet body;
the second camera is used for shooting an environment image containing the moving object outside the cabinet body and transmitting the environment image to the processing equipment;
and the processing equipment is used for determining whether foreign matters are put into the intelligent sales counter or not according to the environment image and the first image.
4. The intelligent sales counter of claim 3,
the processing device is used for determining whether the first article is included in the moving object in the environment image, and if so, determining that the foreign object is placed in the intelligent sales counter.
5. The intelligent sales counter of claim 4,
the processing device is configured to determine whether the similarity between the first image and the second image is greater than a preset second threshold, and if so, determine that the moving object in the environment image is the first item.
6. The intelligent sales counter of claim 1,
the processing equipment is used for determining that foreign matters are placed in the intelligent sales counter when the difference value between the first weight and the second weight is not smaller than the first threshold value.
7. The intelligent sales counter of claim 1,
the gravity sensor is used for detecting a third weight of the article rack when the first article is placed on the article rack and a fourth weight of the article rack after the first article is taken up from the article rack;
the processing device is configured to determine the first weight based on the third weight and the fourth weight.
8. The intelligent sales counter of claim 7,
and the processing equipment is used for determining that foreign matters are placed in the intelligent sales counter when the difference value between the second weight and the third weight is larger than a preset third threshold value.
9. A method for detecting foreign matter, applied to the intelligent sales counter according to any one of claims 1 to 8, comprising:
the shooting device of the intelligent sales counter shoots a first image of a first article placed on an article rack and a second image of a moving object;
the gravity sensor of the intelligent sales counter detects a first weight of the first article; detecting a second weight of a second item when the second item is placed on the item rack;
the processing module of the intelligent sales counter determines whether the difference value between the first weight and the second weight is smaller than a preset first threshold value;
when the difference value is smaller than a preset threshold value, the processing module determines whether foreign matters are put into the intelligent sales counter or not according to the first image and the second image;
when the foreign matters are determined to be put into the intelligent sales counter, the processing module triggers an alarm device;
and the alarm equipment responds to the triggering of the processing module and sends alarm information.
10. A processing device, characterized in that the processing module is installed in the intelligent sales counter according to any of claims 1-8, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of claim 9.
11. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110319782.5A CN113763629A (en) | 2021-03-25 | 2021-03-25 | Intelligent sales counter and foreign matter detection method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110319782.5A CN113763629A (en) | 2021-03-25 | 2021-03-25 | Intelligent sales counter and foreign matter detection method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113763629A true CN113763629A (en) | 2021-12-07 |
Family
ID=78786763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110319782.5A Pending CN113763629A (en) | 2021-03-25 | 2021-03-25 | Intelligent sales counter and foreign matter detection method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113763629A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108154601A (en) * | 2018-01-09 | 2018-06-12 | 合肥美的智能科技有限公司 | Automatic vending machine and its control method |
| CN108335406A (en) * | 2018-02-08 | 2018-07-27 | 合肥美的智能科技有限公司 | Self-service equipment and its good selling method and self-service system |
| CN108389315A (en) * | 2018-03-02 | 2018-08-10 | 北京京东尚科信息技术有限公司 | Item identification method and device and computer readable storage medium |
| WO2018154411A2 (en) * | 2017-02-22 | 2018-08-30 | Savis Retail Private Limited | Vending machines and methods for dispensing products |
| CN109166000A (en) * | 2018-07-24 | 2019-01-08 | 虫极科技（北京）有限公司 | A kind of Intelligent cargo cabinet and the method for creating order |
| CN109632066A (en) * | 2018-09-07 | 2019-04-16 | 盈奇科技（深圳）有限公司 | A kind of unmanned gravity sensing sales counter gravimetric anomaly alarm method |
| CN109697786A (en) * | 2017-10-23 | 2019-04-30 | 北京京东尚科信息技术有限公司 | Operating method and operating device for vending machine |
| CN109872448A (en) * | 2019-01-19 | 2019-06-11 | 创新奇智(广州)科技有限公司 | A kind of foreign matter detecting method, computer readable storage medium and detection system |
| WO2019165895A1 (en) * | 2018-03-02 | 2019-09-06 | 北京京东尚科信息技术有限公司 | Automatic vending method and system, and vending device and vending machine |
| WO2019196500A1 (en) * | 2018-04-11 | 2019-10-17 | 合肥美的智能科技有限公司 | Self-service retail system and control method therefor, vending apparatus and cloud server |
-
2021
- 2021-03-25 CN CN202110319782.5A patent/CN113763629A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018154411A2 (en) * | 2017-02-22 | 2018-08-30 | Savis Retail Private Limited | Vending machines and methods for dispensing products |
| CN109697786A (en) * | 2017-10-23 | 2019-04-30 | 北京京东尚科信息技术有限公司 | Operating method and operating device for vending machine |
| CN108154601A (en) * | 2018-01-09 | 2018-06-12 | 合肥美的智能科技有限公司 | Automatic vending machine and its control method |
| CN108335406A (en) * | 2018-02-08 | 2018-07-27 | 合肥美的智能科技有限公司 | Self-service equipment and its good selling method and self-service system |
| CN108389315A (en) * | 2018-03-02 | 2018-08-10 | 北京京东尚科信息技术有限公司 | Item identification method and device and computer readable storage medium |
| WO2019165895A1 (en) * | 2018-03-02 | 2019-09-06 | 北京京东尚科信息技术有限公司 | Automatic vending method and system, and vending device and vending machine |
| WO2019196500A1 (en) * | 2018-04-11 | 2019-10-17 | 合肥美的智能科技有限公司 | Self-service retail system and control method therefor, vending apparatus and cloud server |
| CN109166000A (en) * | 2018-07-24 | 2019-01-08 | 虫极科技（北京）有限公司 | A kind of Intelligent cargo cabinet and the method for creating order |
| CN109632066A (en) * | 2018-09-07 | 2019-04-16 | 盈奇科技（深圳）有限公司 | A kind of unmanned gravity sensing sales counter gravimetric anomaly alarm method |
| CN109872448A (en) * | 2019-01-19 | 2019-06-11 | 创新奇智(广州)科技有限公司 | A kind of foreign matter detecting method, computer readable storage medium and detection system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10528638B1 (en) | Agent identification and disambiguation | |
| CN110866429B (en) | Missing scanning identification method, device, self-service cashing terminal and system | |
| US9916561B2 (en) | Methods, devices and computer readable storage devices for tracking inventory | |
| CN106250091B (en) | Information display method and mobile terminal | |
| US20180260877A1 (en) | Order determination in an unmanned store | |
| JP2022553174A (en) | Video retrieval method, device, terminal, and storage medium | |
| CN107315825A (en) | A kind of index upgrade system, method and device | |
| CN112488914A (en) | Image splicing method, device, terminal and computer readable storage medium | |
| CN113077299A (en) | Order processing method, device, equipment and storage medium | |
| CN111160410B (en) | Object detection method and device | |
| US20180108072A1 (en) | Systems, Devices and Methods for Monitoring Objects in a Cart | |
| CN111667639A (en) | Book return service realization method and device and intelligent book cabinet | |
| WO2023241447A1 (en) | Information acquisition method and apparatus, and electronic device | |
| CN113763629A (en) | Intelligent sales counter and foreign matter detection method | |
| CN112733611A (en) | Legacy article detection method and device, electronic equipment and storage medium | |
| CN108537149A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN113096324A (en) | Method and device for storing articles | |
| CN115082842A (en) | E-commerce goods appearance verification and warehousing processing method and device | |
| CN108829301A (en) | Replicate the method pasted and mobile terminal | |
| US11567822B2 (en) | Method of monitoring closed system, apparatus thereof and monitoring device | |
| US9256847B2 (en) | Detection, identification and integration of office squatters | |
| CN107707752B (en) | A kind of image processing method and mobile terminal | |
| US20190266742A1 (en) | Entity location provision using an augmented reality system | |
| CN110619734A (en) | Information pushing method and device | |
| CN111428536A (en) | Training method and device for detection network for detecting article category and position |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211207 |