CN108846449B - Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment - Google Patents
Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment Download PDFInfo
- Publication number
- CN108846449B CN108846449B CN201810377649.3A CN201810377649A CN108846449B CN 108846449 B CN108846449 B CN 108846449B CN 201810377649 A CN201810377649 A CN 201810377649A CN 108846449 B CN108846449 B CN 108846449B
- Authority
- CN
- China
- Prior art keywords
- commodity
- image
- shelf
- label
- commodities
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000000007 visual effect Effects 0.000 claims abstract description 19
- 238000012545 processing Methods 0.000 claims description 9
- 238000013459 approach Methods 0.000 claims description 6
- 238000003384 imaging method Methods 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 4
- 238000003860 storage Methods 0.000 abstract description 18
- 238000010586 diagram Methods 0.000 description 16
- 238000004590 computer program Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 9
- 230000006872 improvement Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012015 optical character recognition Methods 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011065 in-situ storage Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 229920001296 polysiloxane Polymers 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
- G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the specification discloses intelligent equipment, a commodity checking method, a commodity checking device and commodity checking equipment. The scheme comprises the following steps: the intelligent equipment which is movable, can make a video recording, can scan the code and can utilize visual identification service is utilized, commodity labels are positioned and the code is scanned through the video storage rack, corresponding commodities are positioned, commodities are made a video recording again, the quantity of the commodities are identified by the visual identification service according to obtained commodity images, and commodity counting is automatically completed.
Description
Technical Field
The specification relates to the technical field of computer software, in particular to an intelligent device, a commodity checking method, a commodity checking device and commodity checking equipment.
Background
In order to clear inventory details of commodities of merchants in an off-line retail store, commodity counting is often required at intervals, so that the actual quantity of the inventory commodities can be checked with the quantity recorded on a custody account, and inventory conditions can be accurately mastered.
In the prior art, the commodity counting is carried out manually, and personnel are required to count commodities on a shelf one by using handheld equipment.
Based on the prior art, there is a need for a more efficient inventory scheme.
Disclosure of Invention
The embodiment of the specification provides an intelligent device, a commodity checking method, a commodity checking device and a commodity checking device, and aims to solve the following technical problems: there is a need for a more efficient inventory scheme.
In order to solve the above technical problem, the embodiments of the present specification are implemented as follows:
an embodiment of this specification provides an intelligent device, includes: the device comprises a device body, a controller, a camera, a scanner and a power device, wherein the controller, the camera and the scanner are positioned on the device body;
the controller controls the camera to shoot the goods shelf to obtain a first image; locating the position of the merchandise tag on the shelf according to the first image; controlling the power device to drive the equipment main body to be close to the commodity label according to the position; controlling the scanner to scan the commodity label to obtain commodity information; controlling the camera to shoot the commodity on the goods shelf to obtain a second image; the merchandise information and the second image are used for further analysis processing.
An embodiment of the present specification provides a commodity inventory method based on the above-mentioned intelligent device, including:
the intelligent equipment shoots a shelf to obtain a first image;
locating the position of the merchandise tag on the shelf according to the first image;
approaching the merchandise tag according to the position;
scanning the commodity label to obtain commodity information;
shooting the commodity on the goods shelf to obtain a second image;
and sending the commodity information and the second image to a server so that the server visually identifies the quantity of commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
An article of manufacture device that this specification embodiment provided includes:
the first camera module is used for shooting the goods shelf to obtain a first image;
the positioning module is used for positioning the position of the commodity label on the shelf according to the first image;
a position moving module for enabling the device to approach the commodity label according to the position;
the scanning module scans the commodity label to obtain commodity information;
the second camera module is used for shooting the commodities on the goods shelf to obtain a second image;
and the sending module is used for sending the commodity information and the second image to a server so that the server visually identifies the quantity of the commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
An article of manufacture equipment that this specification embodiment provided includes:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
shooting a shelf to obtain a first image;
locating the position of the merchandise tag on the shelf according to the first image;
approaching the merchandise tag according to the position;
scanning the commodity label to obtain commodity information;
shooting the commodity on the goods shelf to obtain a second image;
and sending the commodity information and the second image to a server so that the server visually identifies the quantity of commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
The embodiment of the specification adopts at least one technical scheme which can achieve the following beneficial effects: the dependence on manpower can be reduced, and the commodity inventory can be automatically and efficiently carried out.
Drawings
In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort.
FIG. 1 is a schematic overall schematic diagram of the solution of the present disclosure in a practical application scenario;
fig. 2 is a schematic structural diagram of an intelligent device provided in an embodiment of the present specification;
fig. 3 is a schematic flowchart of a commodity checking method based on the intelligent device according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a specific implementation of the commodity inventory method in an actual application scenario provided in an embodiment of this specification;
fig. 5 is a schematic structural diagram of an article counting device corresponding to fig. 3 provided in an embodiment of the present disclosure.
Detailed Description
The embodiment of the specification provides intelligent equipment, a commodity checking method, a commodity checking device and commodity checking equipment.
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any inventive step based on the embodiments of the present disclosure, shall fall within the scope of protection of the present application.
In practical application, it is time-consuming and labor-consuming to perform commodity counting in a manual mode, and in the commodity counting process, the most troublesome is to confirm the actual condition of inventory, so that the scheme in the specification considers that at least the step is automated. Therefore, the scheme of the specification provides the intelligent equipment which is movable, can make a video recording and scan codes, can utilize visual identification services, is matched with a commodity label for determining the position of a commodity and providing commodity information by a graphic code and a visual identification technology for use, and therefore the actual condition of inventory can be automatically confirmed, and the commodity inventory efficiency can be improved.
Fig. 1 is a schematic overall principle diagram of the solution of the present specification in a practical application scenario. The intelligent equipment can move in the area of the goods shelf and shoot the goods shelf to locate the goods label on the goods shelf, then scan the graphic code on the goods label to obtain the goods information, and further can utilize the visual identification service provided by the module or other equipment to identify the goods number in the goods image obtained by shooting.
The following describes a scheme of the present specification, mainly based on the above principle.
Fig. 2 is a schematic structural diagram of an intelligent device provided in an embodiment of the present specification. In fig. 2, the smart device mainly includes: the device comprises a device body 11, a controller 12 positioned on the device body 11, a camera 13, a scanner 14, and a power device 15 capable of driving the device body 11 to move. The smart device can be applied to in-store merchandise situation confirmation and analysis, such as checking merchandise, detecting merchandise phase, registering merchandise image, and the like. In addition to the above-mentioned components, the smart device may further include other components such as a navigation module 16.
The intelligent equipment comprises a commodity storeroom, a commodity store and the like, wherein the commodity label can be in an Electronic or non-Electronic form, and the commodity label is in an Electronic form, such as an Electronic Shelf label (ES L), the Electronic Shelf label is an Electronic display device with an information receiving and sending function, is mainly applied to supermarkets, convenience stores, prescriptions and the like to display commodity information such as price, name and the like, is placed on a Shelf and can replace a traditional paper label, and each Electronic Shelf label is connected with a computer database through a wired or wireless network and displays the latest commodity information.
One workflow of the smart device of fig. 2 includes the following steps:
the controller 12 controls the camera 13 to shoot the shelf to obtain a first image; locating the position of the merchandise tag on the shelf according to the first image; according to the position, the power device 15 is controlled to drive the equipment main body 11 to approach the commodity label; controlling the scanner 14 to scan the commodity label to obtain commodity information; controlling a camera 13 to shoot the commodity on the shelf to obtain a second image; the commodity information and the second image are used for further analysis processing, for example, the second image is visually recognized, and then commodities are checked in combination with the commodity information.
The shape of the apparatus body 11 is not limited in this specification, and the shape is at least adapted to the movement manner thereof. The moving manner of the apparatus body 11 may be various. For example, the device can move on the ground by means of wheels or tracks; for another example, a shelf or other supports are reformed in advance to provide a rail for the apparatus main body 11, so that the apparatus main body 11 moves on the rail; for another example, if the device body 11 has a flying device (e.g., an intelligent device based on an unmanned aerial vehicle), the device can fly and move in the air; and so on.
In this embodiment of the present description, if the product tag includes an electronic shelf tag displaying a graphic code corresponding to a product, the scanning of the product tag by the scanner 14 may specifically include: the scanner 14 scans the graphic code corresponding to the article of merchandise displayed by the electronic shelf label.
In addition, in practical application, the scanner may not need to rely on the graphic code to obtain the commodity information. For example, the scanner may identify the name or model number of the product on the label of the product by Optical Character Recognition (OCR), and then query for some other information of the product, in which case, the product label may not display the graphic code.
In the embodiment of the present specification, since the article tag is generally close to the article corresponding to the article tag, the position of the article tag is determined, that is, the position of the article corresponding to the article tag is substantially determined. The imaging of the article on the shelf by the camera 13 may be generally performed in the process of the apparatus body 11 approaching the article label. The specific strategy can be configured according to actual conditions, for example, for small-sized commodities, the image can be shot when the small-sized commodities are relatively closer to the commodity label, and for large-sized commodities, the image can be shot when the large-sized commodities are relatively far away from the commodity label. Of course, in order to accurately photograph the goods on the shelf corresponding to the goods label, the distance and angle between the device main body 11 and the goods label during photographing may be intelligently adjusted, for example, the device main body may first approach the goods label, and after successfully reading the goods information from the goods label, the device main body may photograph in situ, or further approach or appropriately leave the goods label, so as to photograph at an appropriate position and angle, and the adjustment may depend on, for example, the relative size and relative position of the shelf or the goods in the viewing frame including the camera 13.
In this embodiment, the commodity information and the second image may be sent to the server by the smart device, and further analyzed and processed by the server. Or, if the intelligent device is powerful enough, the intelligent device can further analyze and process the commodity information and the second image without depending on the server.
Based on the same idea, the embodiment of the present specification further provides a schematic flow chart of a commodity checking method based on the intelligent device, where the flow chart is executed by the intelligent device, and it is assumed that the intelligent device is mainly responsible for acquiring commodity information and a second image, and the commodity information and the second image are further analyzed and processed by the server.
The flow in fig. 3 may include the following steps:
s302: the intelligent equipment shoots the goods shelf to obtain a first image.
S304: and positioning the position of the commodity label on the shelf according to the first image.
S306: approaching the merchandise tag according to the position.
S308: and scanning the commodity label to obtain commodity information.
S310: and shooting the commodity on the shelf to obtain a second image.
S312: and sending the commodity information and the second image to a server so that the server visually identifies the quantity of commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities. The adopted visual recognition algorithm is not specifically limited, and an existing visual recognition algorithm can be selected. The inventory includes, for example: and updating the inventory information of the commodity, and checking the selling condition of the commodity.
By the method of fig. 3, dependence on labor can be reduced, and product inventory can be performed automatically and efficiently.
In the embodiment of the specification, manual assistance can be added to improve the reliability of the scheme. For example, if the visual recognition of the number of the commodities fails or the recognition result is obviously unreasonable, the number of the commodities is manually re-recognized to obtain an accurate recognition result.
In the embodiment of the present specification, it has been mentioned above that the smart device may further have a navigation module thereon, and the navigation module is configured to help the smart device move more reasonably in the shelf area to be inventoried, so as to help the smart device collect the commodity information and the second image more comprehensively and accurately. In this case, for step S302, the intelligent device may specifically perform imaging on the shelf, and the imaging may specifically include: the intelligent equipment automatically navigates the goods shelf area to be checked and determines a navigation route; and moving in the shelf area according to the navigation route, and shooting nearby shelves.
In the embodiment of the present specification, a server may have multiple servers working cooperatively, and the work in this scheme may also be implemented by dividing multiple services. For example, the server may include a first server providing a visual recognition service for the goods and a second server providing a stock management service for the goods, and for step S312, the smart device may send only the goods information and the second image to the first server; furthermore, the server visually identifies the number of the commodities according to the second image, and performs inventory according to the commodity information and the number of the commodities, which may specifically include: the first server receives the commodity information and the second image sent by the intelligent equipment, visually identifies the quantity of commodities according to the second image, and sends the commodity information and the quantity of the commodities to the second server; and the second server checks according to the commodity information and the commodity quantity. It should be noted that, in practical applications, the visual recognition and the inventory may be performed by the same server.
According to the above description, more intuitively, the embodiment of the present specification further provides a schematic diagram of a specific implementation of the above commodity checking method in an actual application scenario, as shown in fig. 4. Under this practical application scene, the smart machine can be through the wheel subaerial removal, and camera and scanner are located the top of equipment main part. During operation, the intelligent equipment automatically navigates a shelf area to be checked, moves according to a navigation line, shoots nearby shelves, positions the commodity label through visual identification according to a shelf image, approaches the commodity label, scans a graphic code displayed by the commodity label to read commodity information, shoots a commodity corresponding to the commodity label, uploads the commodity information and the shot commodity image to a first server providing commodity visual identification service, the first server identifies the quantity of the commodity from the commodity image, and then sends the commodity information and the quantity of the commodity to a second server providing commodity inventory management service, and the second server performs commodity inventory management according to the received information.
Based on the same idea, the embodiment of the present specification further provides a device corresponding to the above method, as shown in fig. 5.
Fig. 5 is a schematic structural diagram of an article counting device corresponding to fig. 3 provided in an embodiment of the present specification, where a dashed box represents an optional module, and the device includes:
the first camera module 501 is used for shooting a shelf to obtain a first image;
a positioning module 502 for positioning the position of the merchandise tag on the shelf according to the first image;
a position moving module 503 for bringing the apparatus close to the merchandise tag according to the position;
a scanning module 504, configured to scan the product label to obtain product information;
a second camera module 505, which takes a picture of the goods on the shelf to obtain a second image;
the sending module 506 sends the commodity information and the second image to a server, so that the server visually identifies the quantity of the commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
Optionally, the apparatus further comprises a navigation module 507;
the first camera module 501 is used for shooting on a shelf, and specifically comprises:
the navigation module 507 automatically navigates the shelf area to be checked to determine a navigation route; the position moving module 503 moves the apparatus in the shelf area according to the navigation route, and the first imaging module 501 images a nearby shelf.
Based on the same idea, the embodiment of the present specification further provides an apparatus and a non-volatile computer storage medium corresponding to the above method.
An article checking device provided by the embodiment of the present specification and corresponding to fig. 3 includes:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
shooting a shelf to obtain a first image;
locating the position of the merchandise tag on the shelf according to the first image;
approaching the merchandise tag according to the position;
scanning the commodity label to obtain commodity information;
shooting the commodity on the goods shelf to obtain a second image;
and sending the commodity information and the second image to a server so that the server visually identifies the quantity of commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
A non-volatile computer storage medium corresponding to fig. 3 provided by the embodiments of the present description stores computer-executable instructions configured to:
shooting a shelf to obtain a first image;
locating the position of the merchandise tag on the shelf according to the first image;
approaching the merchandise tag according to the position;
scanning the commodity label to obtain commodity information;
shooting the commodity on the goods shelf to obtain a second image;
and sending the commodity information and the second image to a server so that the server visually identifies the quantity of commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the embodiments of the apparatus, the device, and the nonvolatile computer storage medium, since they are substantially similar to the embodiments of the method, the description is simple, and for the relevant points, reference may be made to the partial description of the embodiments of the method.
The apparatus, the device, the nonvolatile computer storage medium, and the method provided in the embodiments of the present specification correspond to each other, and therefore, the apparatus, the device, and the nonvolatile computer storage medium also have advantageous technical effects similar to those of the corresponding method.
In the 90 th generation of 20 th century, it is obvious that improvements in Hardware (for example, improvements in Circuit structures such as diodes, transistors and switches) or software (for improvement in method flow) can be distinguished for a technical improvement, however, as technology develops, many of the improvements in method flow today can be regarded as direct improvements in Hardware Circuit structures, designers almost all obtain corresponding Hardware Circuit structures by Programming the improved method flow into Hardware circuits, and therefore, it cannot be said that an improvement in method flow cannot be realized by Hardware entity modules, for example, Programmable logic devices (Programmable logic devices L organic devices, P L D) (for example, Field Programmable Gate Arrays (FPGAs) are integrated circuits whose logic functions are determined by user Programming of devices), and a digital system is "integrated" on a P L D "by self Programming of designers without requiring many kinds of integrated circuits manufactured and manufactured by special chip manufacturers to design and manufacture, and only a Hardware software is written in Hardware programs such as Hardware programs, software programs, such as Hardware programs, software, Hardware programs, software programs, Hardware programs, software, Hardware programs, software, Hardware programs, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software, Hardware, software.
A controller may be implemented in any suitable manner, e.g., in the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, Application Specific Integrated Circuits (ASICs), programmable logic controllers (PLC's) and embedded microcontrollers, examples of which include, but are not limited to, microcontrollers 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone L abs C8051F320, which may also be implemented as part of the control logic of a memory.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functions of the various elements may be implemented in the same one or more software and/or hardware implementations of the present description.
As will be appreciated by one skilled in the art, the present specification embodiments may be provided as a method, system, or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.
The description has been presented with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the description. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, the embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, the description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
This description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only an example of the present specification, and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A smart device, comprising: the device comprises a device body, a controller, a camera, a scanner and a power device, wherein the controller, the camera and the scanner are positioned on the device body;
the controller controls the camera to shoot the goods shelf to obtain a first image; wherein, commodity labels for visual identification are placed on the shelf;
positioning the position of the commodity label on the shelf through visual recognition according to the first image;
controlling the power device to drive the equipment main body to be close to the commodity label according to the position; controlling the scanner to scan the graphic code corresponding to the commodity displayed by the commodity label to obtain commodity information; controlling the camera to shoot the commodity corresponding to the commodity label on the goods shelf according to the position to obtain a second image corresponding to the commodity label; the merchandise information and the second image are used for further analysis processing.
2. The smart device of claim 1, wherein the device body is mobile, and specifically comprises:
the device body moves on the ground; or,
the device body moves on a track provided by the shelf or other support; or,
the device body moves in flight in the air.
3. The smart device of claim 1, wherein the merchandise tag comprises an electronic shelf tag displaying a graphic code corresponding to merchandise;
the scanner scans the commodity label, and specifically includes:
the scanner scans the graphic code corresponding to the commodity displayed by the electronic shelf label.
4. A commodity inventory method based on the intelligent device as claimed in any one of claims 1 to 3, comprising:
the intelligent equipment shoots a shelf to obtain a first image; wherein, commodity labels for visual identification are placed on the shelf;
positioning the position of the commodity label on the shelf through visual recognition according to the first image;
approaching the merchandise tag according to the position;
scanning the graphic code corresponding to the commodity displayed by the commodity label to obtain commodity information;
shooting the commodity corresponding to the commodity label on the shelf according to the position to obtain a second image corresponding to the commodity label;
and sending the commodity information and the second image to a server so that the server visually identifies the quantity of commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
5. The method of claim 4, wherein the intelligent device performs camera shooting on the shelf, and specifically comprises:
the intelligent equipment automatically navigates the goods shelf area to be checked and determines a navigation route;
and moving in the shelf area according to the navigation route, and shooting nearby shelves.
6. The method of claim 4, the server comprising a first server providing a visual identification service for the goods, a second server providing an inventory management service for the goods;
the server visually identifies the number of the commodities according to the second image, and performs inventory according to the commodity information and the number of the commodities, and the inventory method specifically comprises the following steps:
the first server receives the commodity information and the second image sent by the intelligent equipment, visually identifies the quantity of commodities according to the second image, and sends the commodity information and the quantity of the commodities to the second server;
and the second server checks according to the commodity information and the commodity quantity.
7. The method of any of claims 4 to 6, the inventorying comprising:
and updating the inventory information of the commodity and checking the selling condition of the commodity.
8. An article inventory device, comprising:
the first camera module is used for shooting the goods shelf to obtain a first image;
the positioning module is used for positioning the position of the commodity label on the shelf according to the first image;
a position moving module for enabling the device to approach the commodity label according to the position;
the scanning module is used for scanning the graphic code corresponding to the commodity displayed by the commodity label to obtain commodity information; wherein the merchandise tag includes: an electronic shelf label;
the second camera module is used for shooting the commodities on the goods shelf to obtain a second image;
and the sending module is used for sending the commodity information and the second image to a server so that the server visually identifies the quantity of the commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
9. The apparatus of claim 8, further comprising a navigation module;
first camera module makes a video recording to goods shelves specifically includes:
the navigation module automatically navigates the goods shelf area to be checked to determine a navigation route; the position moving module moves the apparatus in the shelf area according to the navigation route, and the first imaging module images a shelf nearby.
10. An article inventory device, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
shooting a shelf to obtain a first image; wherein, commodity labels for visual identification are placed on the shelf;
positioning the position of the commodity label on the shelf through visual recognition according to the first image;
approaching the merchandise tag according to the position;
scanning the graphic code corresponding to the commodity displayed by the commodity label to obtain commodity information;
shooting the commodity on the shelf according to the position to obtain a second image corresponding to the commodity label;
and sending the commodity information and the second image to a server so that the server visually identifies the quantity of commodities according to the second image and performs inventory according to the commodity information and the quantity of the commodities.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810377649.3A CN108846449B (en) | 2018-04-25 | 2018-04-25 | Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment |
| PCT/CN2019/073836 WO2019205761A1 (en) | 2018-04-25 | 2019-01-30 | Intelligent device, inventory taking method, device and apparatus |
| TW108105089A TW201945995A (en) | 2018-04-25 | 2019-02-15 | Smart equipment and commodity counting method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810377649.3A CN108846449B (en) | 2018-04-25 | 2018-04-25 | Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108846449A CN108846449A (en) | 2018-11-20 |
| CN108846449B true CN108846449B (en) | 2020-08-04 |
Family
ID=64212267
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810377649.3A Active CN108846449B (en) | 2018-04-25 | 2018-04-25 | Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN108846449B (en) |
| TW (1) | TW201945995A (en) |
| WO (1) | WO2019205761A1 (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108846449B (en) * | 2018-04-25 | 2020-08-04 | 阿里巴巴集团控股有限公司 | Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment |
| CN109300477A (en) * | 2018-11-29 | 2019-02-01 | 上海与德通讯技术有限公司 | A kind of tally method, apparatus, equipment and storage medium |
| CN109359928A (en) * | 2018-12-11 | 2019-02-19 | 成都精位科技有限公司 | Storehouse management shows equipment and warehouse management method |
| CN109754486A (en) * | 2019-01-14 | 2019-05-14 | 广东元古科技有限公司 | Garden management system |
| CN109754231A (en) * | 2019-01-14 | 2019-05-14 | 广东元古科技有限公司 | The asset management system |
| CN111476061B (en) * | 2019-01-23 | 2023-05-02 | 阿里巴巴集团控股有限公司 | Counting processing method, device and system in commodity production and electronic equipment |
| EP3751486A1 (en) * | 2019-06-11 | 2020-12-16 | Solum Co., Ltd. | Electronic label management apparatus and method |
| CN112185030A (en) * | 2019-07-13 | 2021-01-05 | 迅镭智能（广州）科技有限公司 | Code scanning settlement method, system, device and storage medium |
| CN110610149B (en) * | 2019-09-03 | 2023-01-20 | 卓尔智联(武汉)研究院有限公司 | Information processing method and device and computer storage medium |
| CN112950246B (en) * | 2019-12-11 | 2024-04-23 | 汉朔科技股份有限公司 | Commercial supercommodity positioning system and method |
| CN111275375B (en) * | 2020-01-10 | 2023-07-28 | 湖南一品佳餐饮管理有限公司 | Food classified transportation planning method |
| CN111432171B (en) * | 2020-03-19 | 2021-12-07 | 上海品览数据科技有限公司 | Vision-based commodity checking device and system and checking method thereof |
| CN113298452A (en) * | 2020-06-01 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Commodity inventory determining method and device, and commodity processing method and device |
| TWI790783B (en) | 2021-10-20 | 2023-01-21 | 財團法人工業技術研究院 | Encoded substrate, coordinate-positioning system and method thereof |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853387A (en) * | 2010-04-02 | 2010-10-06 | 北京物资学院 | Stereoscopic warehouse goods checking method and system |
| CN201628974U (en) * | 2010-04-02 | 2010-11-10 | 河南省烟草公司郑州市公司 | System for checking inventory in stereoscopic warehouse |
| JP2013097502A (en) * | 2011-10-31 | 2013-05-20 | Toppan Printing Co Ltd | Card supply device and card supply method |
| CN103593743A (en) * | 2012-08-17 | 2014-02-19 | 东莞市领先电子科技有限公司 | Warehouse management system based on RFID technology and free flight technology |
| US20140149256A1 (en) * | 2012-11-28 | 2014-05-29 | Samsung Electro-Mechanics Co., Ltd. | Esl system, method of checking informations of goods and paying therefor |
| CN103984346A (en) * | 2014-05-21 | 2014-08-13 | 上海第二工业大学 | System and method for intelligent warehousing checking |
| CN203894633U (en) * | 2014-05-21 | 2014-10-22 | 上海第二工业大学 | Cargo counting robot used for warehouse management |
| CN103971220B (en) * | 2014-05-21 | 2018-04-20 | 上海第二工业大学 | A kind of harmful influence intelligent warehouse management system |
| CN106002916A (en) * | 2016-06-08 | 2016-10-12 | 国网天津市电力公司 | Warehousing robot capable of automatically making tour for inspecting, cleaning and checking inventories |
| CN106096886A (en) * | 2016-06-13 | 2016-11-09 | 国网山东省电力公司龙口市供电公司 | Power domain warehouse material management system |
| CN107784469A (en) * | 2017-10-23 | 2018-03-09 | 国网江苏省电力公司南通供电公司 | A kind of articles from the storeroom checking method based on unmanned plane image technique |
| CN107730189A (en) * | 2017-11-23 | 2018-02-23 | 北京德鑫泉物联网科技股份有限公司 | RFID intelligent warehouse management systems and management method |
| CN108846449B (en) * | 2018-04-25 | 2020-08-04 | 阿里巴巴集团控股有限公司 | Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment |
-
2018
- 2018-04-25 CN CN201810377649.3A patent/CN108846449B/en active Active
-
2019
- 2019-01-30 WO PCT/CN2019/073836 patent/WO2019205761A1/en active Application Filing
- 2019-02-15 TW TW108105089A patent/TW201945995A/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| TW201945995A (en) | 2019-12-01 |
| WO2019205761A1 (en) | 2019-10-31 |
| CN108846449A (en) | 2018-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108846449B (en) | Intelligent equipment, commodity checking method, commodity checking device and commodity checking equipment | |
| CN108764391A (en) | A kind of smart machine, business suspended method, apparatus and equipment | |
| US11886954B2 (en) | Image analysis for mapping objects in an arrangement | |
| CN108416403B (en) | Method, system, equipment and storage medium for automatically associating commodity with label | |
| US11900653B1 (en) | Mapping items to locations within an environment based on optical recognition of patterns in images | |
| US9659204B2 (en) | Image processing methods and systems for barcode and/or product label recognition | |
| US20190258853A1 (en) | Visual task feedback for workstations in materials handling facilities | |
| US20190034864A1 (en) | Data Reduction in a Bar Code Reading Robot Shelf Monitoring System | |
| US11216628B2 (en) | High-speed scanning of optical patterns using a digital camera | |
| JP2020098617A (en) | Method for automatically generating a way point for photographing a shelf within a store | |
| CN110351678B (en) | Commodity positioning method and device, equipment and storage medium | |
| US11514665B2 (en) | Mapping optical-code images to an overview image | |
| EP3082018A1 (en) | Holographic picking system and method for picking products utilizing a holographic picking system | |
| US9123016B2 (en) | Method and apparatus pertaining to the use of group RFID tag information | |
| CN110795992A (en) | Training data acquisition method, commodity identification method and corresponding device | |
| JP2019125144A (en) | Merchandise information management program, method and device, and merchandise management program, method and device | |
| CN113168602A (en) | Customer-assisted robotic picking | |
| US20220318529A1 (en) | Error correction using combination rfid signals | |
| US11893786B1 (en) | Scan-free barcode reading | |
| US20190197467A1 (en) | Automated zone location characterization | |
| CN112785382A (en) | Shopping cart, shopping cart control method, and computer-readable storage medium | |
| US20240119408A1 (en) | Systems and methods of transforming image data to product storage facility location information | |
| US20230169452A1 (en) | System Configuration for Learning and Recognizing Packaging Associated with a Product | |
| US20220261578A1 (en) | Method, System and Apparatus for Dynamic Inventory Guidance and Mapping | |
| US20240135317A1 (en) | Image-based inventory system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40001402 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200924 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200924 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Patentee before: Alibaba Group Holding Ltd. |