WO2020114416A1 - 商品补货、商品识别的处理方法、装置及电子设备 - Google Patents

商品补货、商品识别的处理方法、装置及电子设备 Download PDF

Info

Publication number
WO2020114416A1
WO2020114416A1 PCT/CN2019/122931 CN2019122931W WO2020114416A1 WO 2020114416 A1 WO2020114416 A1 WO 2020114416A1 CN 2019122931 W CN2019122931 W CN 2019122931W WO 2020114416 A1 WO2020114416 A1 WO 2020114416A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
shelf
relative position
matching state
reference mark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/122931
Other languages
English (en)
French (fr)
Inventor
刘万钧
张家程
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of WO2020114416A1 publication Critical patent/WO2020114416A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Definitions

  • This application relates to a method, device and electronic device for processing product replenishment and product identification, and belongs to the field of computer technology.
  • the goods are generally displayed on the shelf. As the user purchases the goods, the goods on the shelf will gradually decrease. At this time, the staff in the store needs to replenish the goods from the warehouse or purchase the goods from the network platform. In response to this situation, it is necessary for staff to regularly check the inventory on the shelves to determine which goods need to be replenished and how much. Due to the complexity of shelves and commodities, manual inventory is very time-consuming and seriously affects the operational efficiency of the store.
  • Embodiments of the present invention provide a method, device, and electronic device for processing product replenishment and product identification, to ensure that the products on the shelf can be photographed in a predetermined manner, so as to determine the replenishment requirements more quickly and accurately.
  • an embodiment of the present invention provides a method for processing commodity replenishment, including:
  • Image recognition processing is performed on the first image to determine the name and/or number of goods to be replenished.
  • An embodiment of the present invention also provides a device for processing goods replenishment, including:
  • the reference mark display module is used to display the reference mark in the shooting interface of the mobile terminal
  • the relative position detection module is used to detect the relative position of the reference object on the photographed shelf and the reference mark in the captured image, and if the relative position satisfies the preset matching state, acquire the first in the matching state image;
  • the image recognition processing module is configured to perform image recognition processing on the first image to determine the name and/or number of goods to be replenished.
  • An embodiment of the present invention also provides an electronic device, including:
  • a processor coupled to the memory, is used to execute the program for the following processing:
  • Image recognition processing is performed on the first image to determine the name and/or number of goods to be replenished.
  • An embodiment of the present invention also provides a method for processing commodity identification, including:
  • Image recognition processing is performed on the first image to determine the name and/or the number of products on the shelf.
  • An embodiment of the present invention also provides an electronic device, including:
  • a processor coupled to the memory, is used to execute the program for the following processing:
  • Image recognition processing is performed on the first image to determine the name and/or the number of products on the shelf.
  • the embodiment of the present invention determines the positioning of the shooting area by displaying a reference mark on the shooting interface, so that the user can quickly find a suitable shooting area positioning without resorting to additional equipment, ensuring that the goods on the shelf can be Shoot to determine the replenishment requirements more quickly and accurately.
  • FIG. 1a is a schematic diagram of an application example of a method for processing commodity replenishment according to an embodiment of the present invention
  • FIG. 1b is a second schematic diagram of an application example of a method for processing commodity replenishment according to an embodiment of the present invention
  • FIG. 1c is a third schematic diagram of an application example of a method for processing commodity replenishment according to an embodiment of the present invention.
  • FIG. 1d is a fourth schematic diagram of an application example of a method for processing commodity replenishment according to an embodiment of the present invention.
  • FIG. 1e is a fifth schematic diagram of an application example of a method for processing commodity replenishment according to an embodiment of the present invention.
  • FIG. 2 is a schematic flow chart of a method for processing commodity replenishment according to an embodiment of the present invention
  • FIG. 3 is a sixth schematic diagram of an application example of a method for processing commodity replenishment according to an embodiment of the present invention.
  • FIG. 4 is a seventh schematic diagram of an application example of a method for processing commodity replenishment according to an embodiment of the present invention.
  • FIG. 5 is one of the structural schematic diagrams of the processing device of the product replenishment according to the embodiment of the present invention.
  • FIG. 6 is a second structural schematic diagram of a processing device for commodity replenishment according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
  • An embodiment of the present invention provides a method for processing commodity replenishment.
  • the technical principle is that the positioning of the shooting area is determined by displaying a reference mark on the shooting interface.
  • an APP with a replenishment recognition function can be installed on a mobile terminal, as shown in FIG. 1a
  • the APP calls the camera function to shoot the shelf.
  • the shooting reference mark will be displayed on the shooting interface, such as the two parallel horizontal lines in the figure.
  • a prompt message will be displayed on the shooting interface.
  • the user adjusts the position and angle of the mobile terminal to align the reference mark in the shooting interface with the reference object on the shelf (such as the shelf partition) to determine the best
  • the good shooting state allows more goods to be clearly identified, thereby achieving efficient replenishment.
  • the APP will continuously use the camera to detect the relative position between the reference object and the reference mark on the shelf to determine whether the reference mark is aligned with the reference object, and at the same time, it can give the user a hint on how to align or adjust .
  • the shooting interface will display a message prompting the user to hold and take a picture, and then take a picture of the shelf, and then undergo the image analysis processing of Figure 1d to determine the name of the product that needs to be restocked and/or Or the number of goods. Finally, a list of the number of commodities that need to be replenished in Figure 1e is generated, so that an order is sent for replenishment. In this way, users can quickly find a suitable location for the shooting area without the need for additional equipment, and ensure that the goods on the shelf can be photographed in a predetermined manner, thereby determining the need for replenishment more quickly and accurately.
  • FIG. 2 it is a schematic flowchart of a method for processing a product replenishment according to an embodiment of the present invention.
  • the method includes the following steps:
  • S101 Display a reference mark in the shooting interface of the mobile terminal.
  • a reference mark will be displayed.
  • the reference mark may be two or more parallel lines, or a rectangular frame or multiple calibration points. The selection of reference marks can be matched according to the specifications of the shelves, which will be described in detail in the following examples.
  • S102 Detect the relative position of the reference object and the reference mark on the photographed shelf in the captured image, and if the relative position satisfies the preset matching state, acquire the first image in the matching state.
  • the shelf partitions of the shelf can be used as reference objects.
  • the APP will continue to use the camera to detect the relative position between the reference object and the reference mark on the shelf being photographed, and analyze the captured image in real time to determine the shelf interval board and Whether the reference marks on the shooting interface are aligned, and it should be noted that the above-mentioned judgment of alignment can allow a certain error, that is, as long as the reference object and the reference mark are within a preset range, it can be considered to be in a matching state.
  • the shelf is photographed, and the visual field captured at this time covers the preset shelf range, thereby obtaining the photographed image.
  • shelves can be made with uniform and limited types of specifications.
  • APP for product replenishment testing, you can first select the specifications of the shelves, and then APP will automatically match the corresponding reference mark.
  • the distance between the parallel lines should be set according to the distance of the layer spacer as a reference, so that after each parallel line is aligned with the predetermined layer spacer, the shooting field of vision covers the preset shelf range. For example, it is hoped that after two parallel lines are aligned with the upper and lower partitions of one of the layers, the field of view can cover the entire shelf.
  • FIG. 3 it is a schematic diagram 6 of an application example of a method for processing a product replenishment according to an embodiment of the present invention.
  • Shelf partitions are distributed at equal intervals.
  • the corresponding The reference mark is two parallel lines.
  • the user can choose to align the reference mark with the corresponding two partitions according to the area to be shot.
  • the reference marks can be aligned with the partitions 2, 3 in the middle of the shelf.
  • the reference mark can also be a plurality of parallel lines, so that the shooting area can be determined more accurately, as shown in FIG.
  • FIG. 4 is a seventh schematic diagram of an application example of the processing method of the product replenishment according to the embodiment of the present invention.
  • the distance between the partitions is divided into two specifications.
  • the corresponding reference marks are matched according to the shelf specifications. Therefore, there is a distance between the reference marks a, b, and c corresponding to the distance between the partitions.
  • the user can align the reference mark with the partitions 2, 3, 4 located in the middle of the shelf to avoid the alignment of the upper or lower alignment and the shooting field of view cannot cover the entire shelf, so that more items can be photographed.
  • a first prompt message can be sent out on the shooting interface to remind the user to keep the matching state and click the shooting button to take a picture.
  • a shooting instruction such as clicking the shooting button or voice instruction
  • take a photo to obtain the captured image. It is also possible to automatically take an image directly after detecting the matching state.
  • a second prompt message for adjusting the position of the mobile terminal may be sent to the user according to the detected relative position, so that the user can adjust the position of the mobile terminal according to the prompt to place the reference mark and the reference object Align. For example, the user may be prompted to approach or move away from the shelf to align the reference object with the reference mark.
  • S103 Perform image recognition processing on the first image to determine the product name and/or product quantity to be replenished.
  • image analysis processing technology is used to perform recognition processing on the above-mentioned captured images, so as to determine the name and/or quantity of the commodity, and calculate the quantity that needs to be replenished for the commodity that is less than the preset quantity.
  • the name of the product can be identified by the words, trademarks or appearance on the remaining products on the shelf, and the amount of replenishment can be determined by identifying the space of the shelf and the current number of products based on the picture.
  • the product placement area and quantity of each type of shelf may be preset, and then combined with image recognition to determine the name and quantity of products that should be restocked.
  • the embodiment of the present invention may further include the following steps:
  • S104 Generate a purchase order for replenishment goods, and send a goods order request to the goods purchase platform.
  • the product name obtained from the above image and the quantity of the product that needs to be replenished can directly generate a purchase order. After the user checks and pays the order, the purchase order is sent to the purchase platform of the product, thereby Realize replenishment.
  • the embodiment of the present invention determines the positioning of the shooting area by displaying a reference mark on the shooting interface, so that the user can quickly find a suitable positioning of the shooting area without resorting to additional equipment, to ensure that the goods on the shelf can be scheduled Was photographed in order to determine the replenishment requirements more quickly and accurately.
  • FIG. 5 it is one of the structural schematic diagrams of the product replenishment processing device according to an embodiment of the present invention.
  • the device includes a reference mark display module 21, a relative position detection module 22, and an image recognition processing module 23.
  • the reference mark display module 21 is used to display the reference mark in the shooting interface of the mobile terminal.
  • a reference mark when a user uses a mobile terminal (such as the most commonly used mobile phone) to enter an APP with replenishment recognition function, a reference mark will be displayed on the shooting interface.
  • the reference mark may specifically be two or more parallel lines. It can be a rectangular frame or multiple calibration points.
  • the relative position detection module 22 is used to detect the relative position of the reference object and the reference mark on the photographed shelf in the captured image, and if the relative position satisfies the preset matching state, acquire the first image in the matching state.
  • the shelf partitions of the shelf can be used as reference objects.
  • the APP will continue to use the camera to detect the relative position between the reference object and the reference mark on the shelf being photographed, and analyze the captured images in real time to determine the shelf partition and the shooting.
  • the reference marks on the interface are aligned, and it should be noted that the above-mentioned judgment of alignment can allow a certain error, that is, as long as the reference object and the reference mark are within a preset range, they can be considered to be in a matching state.
  • the shelf is photographed, and the visual field captured at this time covers the preset shelf range, thereby obtaining the photographed image.
  • shelves can be made with uniform and limited types of specifications.
  • APP for product replenishment testing, you can first select the specifications of the shelves, and then APP will automatically match the corresponding reference mark.
  • the distance between the parallel lines should be set according to the distance of the layer spacer as a reference, so that after each parallel line is aligned with the predetermined layer spacer, the shooting field of vision covers the preset shelf range. For example, it is hoped that after two parallel lines are aligned with the upper and lower partitions of one of the layers, the field of view can cover the entire shelf.
  • a first prompt message can be sent out on the shooting interface to remind the user to keep the matching state and click the shooting button to take a picture.
  • a shooting instruction such as clicking the shooting button or voice instruction
  • take a photo to obtain the captured image. It is also possible to automatically take an image directly after detecting the matching state.
  • a second prompt message for adjusting the position of the mobile terminal may be sent to the user according to the detected relative position, so that the user can adjust the position of the mobile terminal according to the prompt to place the reference mark and the reference object Align. For example, the user may be prompted to approach or move away from the shelf to align the reference object with the reference mark.
  • the image recognition processing module 23 is configured to perform image recognition processing on the first image, and determine the name and/or number of goods to be restocked.
  • image analysis processing technology is used to perform recognition processing on the above-mentioned captured images, so as to determine the name and/or quantity of the commodity, and calculate the quantity that needs to be replenished for the commodity that is less than the preset quantity.
  • the product name can be determined by identifying the characters, trademarks, or appearance of the remaining products on the shelf
  • the quantity of replenishment can be determined by identifying the space of the shelf and the number of current products based on the picture.
  • the product placement area and quantity of each type of shelf may be preset, and then combined with image recognition to determine the name and quantity of products that should be restocked.
  • the above describes the process of determining the shooting area by displaying the reference mark on the shooting interface to obtain the shot image, and then determining the product name and quantity.
  • FIG. 6 which is a product replenishment according to an embodiment of the present invention
  • the second schematic structural diagram of the processing device of the embodiment of the present invention may further include the following modules:
  • the replenishment commodity order generation module 24 is used to generate a purchase order for replenishment commodities and send a commodity order request to the commodity purchase platform.
  • the product name obtained from the above image and the quantity of the product that needs to be replenished can directly generate a purchase order. After the user checks and pays the order, the purchase order is sent to the commodity purchase platform to realize the replenishment.
  • the embodiment of the present invention determines the positioning of the shooting area by displaying a reference mark on the shooting interface, so that the user can quickly find a suitable positioning of the shooting area without resorting to additional equipment, thereby ensuring that the products on the shelf can be It is filmed in a predetermined way to determine the replenishment requirements more quickly and accurately.
  • An embodiment of the present invention also provides a method for processing commodity identification, which includes:
  • S201 Display a reference mark in the shooting interface of the mobile terminal.
  • the specific form of the reference mark may adopt the specific form or mode described in the previous embodiment.
  • the setting of the reference mark focuses on being able to include the overall shape of the product, or the main part of the product in the graphic, so that the name and/or quantity of the product can be clearly identified.
  • the method of the embodiment of the present invention can be applied to an APP for store management.
  • a button to assist product identification can be set on the APP. When the user clicks the button, a reference mark will be displayed on the shooting interface to assist the user in shooting distance And angular positioning.
  • the specific form of the reference mark may vary depending on the shelf.
  • the user Before using this function, the user can enter the shelf model information (the input method can be selected from the APP or scan the shelf, etc.). After obtaining the shelf model information, the user can select the corresponding reference according to the shelf model information The mark is displayed for memory, so that the user can get a better product image.
  • S202 Detect the relative position of the reference object on the shelf taken and the reference mark in the captured image, and if the relative position satisfies the preset matching state, acquire the first image in the matching state.
  • S203 Perform image recognition processing on the first image to determine the name and/or the number of commodities on the shelf.
  • the identified product name and/or product quantity can be used for further processing by the user, for example, to understand the current inventory status or analyze whether the product placement on the shelf is reasonable.
  • the embodiment of the present invention determines the positioning of the shooting area by displaying reference marks on the shooting interface, so that the user can shoot the image of the commodity at a reasonable shooting distance and angle, thereby accurately and quickly identifying the commodity.
  • FIG. 7 is a schematic structural diagram of the electronic device of the embodiment of the present invention , Specifically including: memory 110 and processor 120.
  • the memory 110 is used to store programs.
  • the memory 110 may be configured to store various other data to support operations on the electronic device. Examples of these data include instructions for any application or method for operating on the electronic device, contact data, phone book data, messages, pictures, videos, etc.
  • the memory 110 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable and removable Programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM erasable and removable Programmable read only memory
  • PROM programmable read only memory
  • ROM read only memory
  • magnetic memory magnetic memory
  • flash memory magnetic disk or optical disk.
  • the processor 120 coupled to the memory 110, is used to execute the program in the memory 110 for performing the following processes:
  • Image recognition processing is performed on the first image to determine the name and/or number of goods to be replenished.
  • the above processing may also include:
  • obtaining the first image in the matching state includes:
  • the first image is acquired.
  • obtaining the first image in the matching state includes:
  • the photographing instruction is executed to acquire the first image.
  • the reference object is the shelf interval board
  • the reference mark is two or more parallel lines
  • the spacing between the parallel lines is such that each parallel line is aligned with the predetermined shelf interval board
  • the shooting field of view covers the pre- Set shelf range.
  • the electronic device includes a processor 120, coupled to the memory 110, for executing the program in the memory 110, for performing the following processes:
  • Image recognition processing is performed on the first image to determine the name and/or the number of products on the shelf.
  • the electronic device may further include: a communication component 130, a power component 140, an audio component 150, a display 160, and other components. Only some components are schematically shown in the figure, which does not mean that the electronic device includes only the components shown in the figure.
  • the communication component 130 is configured to facilitate wired or wireless communication between the electronic device and other devices.
  • Electronic devices can access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof.
  • the communication component 130 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 130 further includes a near field communication (NFC) module to facilitate short-range communication.
  • NFC near field communication
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • the power supply component 140 provides power for various components of the electronic device.
  • the power supply component 140 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for electronic devices.
  • the audio component 150 is configured to output and/or input audio signals.
  • the audio component 150 includes a microphone (MIC).
  • the microphone When the electronic device is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal.
  • the received audio signal may be further stored in the memory 110 or transmitted via the communication component 130.
  • the audio component 150 further includes a speaker for outputting audio signals.
  • the display 160 includes a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or sliding action, but also detect the duration and pressure related to the touch or sliding operation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Image Analysis (AREA)

Abstract

本发明实施例提供了一种商品补货、商品识别的处理方法、装置及电子设备，其中方法包括：在移动终端的摄像头拍摄界面中显示参考标记；检测被拍摄的货架上的参考物与所述参考标记之间在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；对该第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。本发明实施例通过在拍摄界面上显示参考标记的方式确定拍摄区域定位，使得用户能够在不需要借助额外设备的情况下快速找到适合的拍摄区域定位，保证货架上的商品能够按照预定的方式被拍摄，从而更加快速准确地确定出补货需求。

Description

商品补货、商品识别的处理方法、装置及电子设备
本申请要求2018年12月07日递交的申请号为201811497679.4、发明名称为“商品补货、商品识别的处理方法、装置及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及一种商品补货、商品识别的处理方法、装置及电子设备，属于计算机技术领域。
背景技术
在店铺中，商品一般都陈列于货架上，随着用户对商品的购买，货架上的商品会逐渐减少，这时，店铺中的工作人员就需要从仓库中补货或者从网络平台上进货。针对这种情况，需要工作人员经常性地检查货架上的存货情况，以确定需要补充哪些商品以及补充多少。由于货架和商品的复杂性，人工盘点非常耗时，严重影响店铺的运营效率。
发明内容
本发明实施例提供一种商品补货、商品识别的处理方法、装置及电子设备，保证货架上的商品能够按照预定的方式被拍摄，从而更加快速准确地确定出补货需求。
为了实现上述目的，本发明实施例提供了一种商品补货的处理方法，包括：
在移动终端的拍摄界面中显示参考标记；
检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
对该第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
本发明实施例还提供了一种商品补货的处理装置，包括：
参考标记显示模块，用于在移动终端的拍摄界面中显示参考标记；
相对位置检测模块，用于检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
图像识别处理模块，用于对所述第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
本发明实施例还提供了一种电子设备，包括：
存储器，用于存储程序；
处理器，耦合至所述存储器，用于执行所述程序，以用于如下处理：
在移动终端的拍摄界面中显示参考标记；
检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
对该第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
本发明实施例还提供了一种商品识别的处理方法，包括：
在移动终端的拍摄界面中显示参考标记；
检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
对该第一图像进行图像识别处理，确定所述货架上的商品的名称和/或商品数量。
本发明实施例还提供了一种电子设备，其中，包括：
存储器，用于存储程序；
处理器，耦合至所述存储器，用于执行所述程序，以用于如下处理：
在移动终端的拍摄界面中显示参考标记；
检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
对该第一图像进行图像识别处理，确定所述货架上的商品的名称和/或商品数量。
本发明实施例通过在拍摄界面上显示参考标记的方式确定拍摄区域定位，使得用户能够在不需要借助额外设备的情况下快速找到适合的拍摄区域定位，保证货架上的商品能够按照预定的方式被拍摄，从而更加快速准确地确定出补货需求。
上述说明仅是本发明技术方案的概述，为了能够更清楚了解本发明的技术手段，而可依照说明书的内容予以实施，并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂，以下特举本发明的具体实施方式。
附图说明
图1a为本发明实施例的商品补货的处理方法的应用示例的示意图之一；
图1b为本发明实施例的商品补货的处理方法的应用示例的示意图之二；
图1c为本发明实施例的商品补货的处理方法的应用示例的示意图之三；
图1d为本发明实施例的商品补货的处理方法的应用示例的示意图之四；
图1e为本发明实施例的商品补货的处理方法的应用示例的示意图之五；
图2为本发明实施例的商品补货的处理方法的流程示意图；
图3为本发明实施例的商品补货的处理方法的应用示例的示意图之六；
图4为本发明实施例的商品补货的处理方法的应用示例的示意图之七；
图5为本发明实施例的商品补货的处理装置的结构示意图之一；
图6为本发明实施例的商品补货的处理装置的结构示意图之二；
图7为本发明实施例的电子设备的结构示意图。
具体实施方式
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例，然而应当理解，可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反，提供这些实施例是为了能够更透彻地理解本公开，并且能够将本公开的范围完整的传达给本领域的技术人员
在零售业务中，店铺补货需要人工盘点，从而耗费大量时间，严重影响店铺的运营效率。本发明实施例提供了一种商品补货的处理方法，其技术原理在于：通过在拍摄界面上显示参考标记的方式，来确定拍摄区域的定位。
如图1a至图1e所示，其为本发明实施例的商品补货的处理方法的应用示例的示意图之一至之五，可以在移动终端上安装带有补货识别功能的APP，如图1a所示，该APP调用摄像头功能对货架进行拍摄，图1b中，当用户进入补货拍摄程序后，拍摄界面上将显示出拍摄参考标记，例如图中的两条平行横线，当用户的拍摄距离及角度不利于拍摄时，拍摄界面上将显示提示信息，用户通过调整移动终端的位置及角度将拍摄界面中的参考标记与货架上的参照物(例如货架的隔板)进行对齐，确定最佳的拍摄状态，使得更多货物可以被清晰的识别出来，从而实现高效率的补货。在这个过程中，APP会不断地利用摄像头检测被拍摄的货架上的参考物与参考标记之间的相对位置，以确定参考标记与参照物是否对齐，同时可以向用户发出如何对齐或者调整的提示。然后在对齐的状态下，如图1c所示，拍摄界面将显示提示用户保持并进行拍照的信息，然后对货架进行拍照，再经过图1d的图像分析处理，确定需要补货的商品名称和/或商品数量。最后生成图1e中的需要补货的商品数目列表，从而发送订单进行补货。由此用户能够在不需要 借助额外设备的情况下快速找到适合的拍摄区域定位，保证货架上的商品能够按照预定的方式被拍摄，从而更加快速准确地确定出补货需求。
下面通过一些具体实施例来进一步说明本发明的技术方案。
实施例一
基于上述的技术原理，如图2所示，其为本发明实施例的商品补货的处理方法的流程示意图，该方法包括如下步骤：
S101:在移动终端的拍摄界面中显示参考标记。
具体地，当用户利用移动终端(例如最为常用的手机)进入带有补货识别功能的APP(例如可以是为店铺提供服务的APP)后，通过调用移动终端的摄像头来进行拍摄，拍摄界面将会显示参考标记，参考标记具体可以为两条或者两条以上的平行线，还可以为矩形框或者多个校准点的方式。参考标记的选择可以根据货架的规格进行相应的匹配，具体将在下面的示例中详细描述。
S102：检测被拍摄的货架上的参考物与参考标记在拍摄图像中的相对位置，如果相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像。
由于货架的层间隔板之间的距离接近于隔板间所摆放物品的高度，为了所拍图像能够清晰的识别更多所拍摄的物品，可以将层间隔板作为参考物。
具体地，当用户进入拍摄界面，APP会不断地利用摄像头检测被拍摄的货架上的参考物与参考标记之间的相对位置，实时的分析所拍摄的图像，以确定货架的层间隔板与拍摄界面上的参考标记是否对齐，其中，需要说明的是，上述的是否对齐的判断可以允许有一定的误差，即只要参考物与参考标记在预设的范围内就可以认定为处于匹配状态。当检测到参考标记的平行线与预定的层间隔板对齐后，则对货架进行拍摄，这时所拍摄到的视野即覆盖了预设的货架范围，从而得到拍摄的图像。
在实际应用中，货架可以采用统一的有限类型的规格来制作，在使用APP进行商品补货检测时，可以先选择货架的规格，然后APP会自动匹配对应的参考标记。
进一步地，上述的平行线之间的间距要根据作为参照物的层间隔板的距离进行设置，从而使得各个平行线与预定的层间隔板对齐后，拍摄视野覆盖预设的货架范围。例如，希望两条平行线和其中某一层的上下层间隔板对齐后，拍摄视野能够覆盖整个货架。
例如，如图3所示，其为本发明实施例的商品补货的处理方法的应用示例的示意图之六，货架的隔板等间距分布，用户进入补货APP后，根据货架规格匹配对应的参考标记，参考标记为两条平行线，在拍摄的过程中，用户可以根据所要拍摄的区域选择将参 考标记与相应的两个隔板对齐，在普遍的情况下，为了能够使拍摄视野尽可能包括整个货架，可以将参考标记与货架中部的隔板2、3对齐。进一步地，参考标记还可以为多条平行线，从而可以更加准确的确定拍摄区域，如图4所示，其为本发明实施例的商品补货的处理方法的应用示例的示意图之七，货架的隔板间距分为两种规格，用户进入补货APP后，根据货架规格匹配对应的参考标记，从而，参考标记a、b、c之间有对应于隔板间距的距离，因此，在拍摄过程中，用户即可将参考标记与位于货架中部的隔板2、3、4对齐，以避免对齐偏上或偏下而造成的拍摄视野不能覆盖整个货架，从而可以拍摄到更多的物品。
另外，在检测到参考标记和参考物对齐后，可以在拍摄界面上发出第一提示信息，提示用户保持匹配状态并点击拍摄按键进行拍照，当用户发出拍照指令(例如点击拍摄按键或者语音指示)后，进行拍照，从而得到拍摄的图像。还可以在检测到匹配状态后直接自动拍摄得到图像。
此外，在步骤S102的检测过程中，也可以根据检测到的相对位置，向用户发出调整移动终端位置的第二提示信息，使得用户能够根据提示来调整移动终端的位置来将参考标记和参考物对齐。例如可以提示用户靠近或远离货架，以使参考物与参考标记对齐。
S103：对第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
具体地，利用图像分析处理技术对上述拍摄得到的图像进行识别处理，从而确定商品的名称和/或数量，并对不足预设数量的商品计算需要补货的数量。商品名称可以通过对货架上剩余的商品上的文字、商标或者外观形态来识别判定，而需要补货的数量，可以根据图片来识别货架的空间以及当前商品的数量来确定。此外，也可以对各个型号的货架的商品摆放区域以及数量进行预先设定，然后再结合图像识别，来确定应当补货的商品名称以及数量。
以上介绍了通过在拍摄界面上显示参考标记来确定拍摄区域从而得到拍摄图像，进而确定商品名称及数量的过程，在此基础上，本发明实施例还可以包括如下步骤：
S104：生成补货商品的采购订单，并向商品进货平台发送商品订购请求。
具体地，如图1所示，通过上述图像得到的商品名称及需要补货的商品的数量可以直接生成采购订单，用户对订单进行核对并支付后，向商品的进货平台发送该采购订单，从而实现补货。
由此，本发明实施例通过在拍摄界面上显示参考标记的方式确定拍摄区域定位，使得用户能够在不需要借助额外设备的情况下快速找到适合的拍摄区域定位，保证货架上 的商品能够按照预定的方式被拍摄，从而更加快速准确地确定出补货需求。
实施例二
如图5所示，其为本发明实施例的商品补货的处理装置的结构示意图之一，该装置包括参考标记显示模块21，相对位置检测模块22,图像识别处理模块23。
参考标记显示模块21，用于在移动终端的拍摄界面中显示参考标记。
具体地，当用户利用移动终端(例如最为常用的手机)进入带有补货识别功能的APP后，拍摄界面将会显示参考标记，参考标记具体可以为两条或者两条以上的平行线，还可以为矩形框或者多个校准点的方式。
相对位置检测模块22，用于检测被拍摄的货架上的参考物与参考标记在拍摄图像中的相对位置，如果相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像。
由于货架的层间隔板之间的距离接近于隔板间所摆放物品的高度，为了所拍图像能够清晰的识别更多所拍摄的物品，可以将层间隔板作为参考物。
具体地，当用户进入拍摄界面，APP会不断地利用摄像头检测被拍摄的货架上的参考物与参考标记之间的相对位置，实时的分析所拍摄的图像，以确定货架的曾间隔板与拍摄界面上的参考标记是否对齐，其中，需要说明的是，上述的是否对齐的判断可以允许有一定的误差，即只要参考物与参考标记在预设的范围内就可以认定为处于匹配状态。当检测到参考标记的平行线与预定的层间隔板对齐后，则对货架进行拍摄，这时所拍摄到的视野即覆盖了预设的货架范围，从而得到拍摄的图像。
在实际应用中，货架可以采用统一的有限类型的规格来制作，在使用APP进行商品补货检测时，可以先选择货架的规格，然后APP会自动匹配对应的参考标记。
进一步地，上述的平行线之间的间距要根据作为参照物的层间隔板的距离进行设置，从而使得各个平行线与预定的层间隔板对齐后，拍摄视野覆盖预设的货架范围。例如，希望两条平行线和其中某一层的上下层间隔板对齐后，拍摄视野能够覆盖整个货架。
另外，在检测到参考标记和参考物对齐后，可以在拍摄界面上发出第一提示信息，提示用户保持匹配状态并点击拍摄按键进行拍照，当用户发出拍照指令(例如点击拍摄按键或者语音指示)后，进行拍照，从而得到拍摄的图像。还可以在检测到匹配状态后直接自动拍摄得到图像。
此外，在步骤S102的检测过程中，也可以根据检测到的相对位置，向用户发出调整移动终端位置的第二提示信息，使得用户能够根据提示来调整移动终端的位置来将参考标记和参考物对齐。例如可以提示用户靠近或远离货架，以使参考物与参考标记对齐。
图像识别处理模块23，用于对第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
具体地，利用图像分析处理技术对上述拍摄得到的图像进行识别处理，从而确定商品的名称和/或数量，并对不足预设数量的商品计算需要补货的数量。具体地，商品名称可以通过对货架上剩余的商品上的文字、商标或者外观形态来识别判定，而需要补货的数量，可以根据图片来识别货架的空间以及当前商品的数量来确定。此外，也可以对各个型号的货架的商品摆放区域以及数量进行预先设定，然后再结合图像识别，来确定应当补货的商品名称以及数量。
以上介绍了通过在拍摄界面上显示参考标记来确定拍摄区域从而得到拍摄图像，进而确定商品名称及数量的过程，在此基础上，如图6所示，其为本发明实施例的商品补货的处理装置的结构示意图之二，本发明实施例还可以包括如下模块：
补货商品订单生成模块24，用于生成补货商品的采购订单，并向商品进货平台发送商品订购请求。
具体地，通过上述图像得到的商品名称及需要补货的商品的数量可以直接生成采购订单，用户对订单进行核对并支付后，向商品的进货平台发送该采购订单，从而实现补货。
由此，本发明实施例通过在拍摄界面上显示参考标记的方式确定拍摄区域定位，使得用户能够在不需要借助额外设备的情况下快速找到适合的拍摄区域定位，从而保证货架上的商品能够按照预定的方式被拍摄，从而更加快速准确地确定出补货需求。
实施例三
本发明实施例还提供了一种商品识别的处理方法，其包括：
S201：在移动终端的拍摄界面中显示参考标记，该参考标记的具体形态可以采用前面实施例所介绍的具体形态或者模式。
在本实施例中，参考标记的设置侧重于能够将整个商品的外形，或者商品的主要部分包含在图形中，以便能清晰识别出商品的名称和/或数量。本发明实施例的方法可以应用于店铺管理的APP上，在该APP上可以设置辅助商品识别的按键，当用户点击该按键时，将会在拍摄界面上显示参考标记，以辅助用户进行拍摄距离和角度的定位。
另外，参考标记的具体形态可以根据货架的不同而不同。用户使用该功能之前，可以先输入货架型号信息(输入方式可以从APP中进行选择或者对货架进行扫描等操作)，在获取了货架型号信息后，就可以根据该货架型号信息来选择对应的参考标记来记性显 示，以便用户能够获取到效果更好的商品图像。
S202：检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像。
S203：对该第一图像进行图像识别处理，确定所述货架上的商品的名称和/或商品数量。识别出来的商品的名称和/或商品数量可以供用户进行进一步的处理，比如，了解目前的库存状况或者分析一下货架上的商品摆放是否合理等。
本发明实施例通过在拍摄界面上显示参考标记的方式确定拍摄区域定位，使得用户能够在合理的拍摄距离和角度拍摄到商品的图像，从而有精准快速地进行商品识别。
实施例四
前面实施例描述了本发明实施例的流程处理及装置结构，上述的方法和装置的功能可借助一种电子设备实现完成，如图7所示，其为本发明实施例的电子设备的结构示意图，具体包括：存储器110和处理器120。
存储器110，用于存储程序。
除上述程序之外，存储器110还可被配置为存储其它各种数据以支持在电子设备上的操作。这些数据的示例包括用于在电子设备上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。
存储器110可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
处理器120，耦合至存储器110，用于执行存储器110中的程序，以用于执行如下处理：
在移动终端的拍摄界面中显示参考标记；
检测被拍摄的货架上的参考物与参考标记在拍摄图像中的相对位置，如果相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
对该第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
其中，上述处理还可以包括：
生成补货商品的采购订单，并向商品进货平台发送商品订购请求。
其中，获取在匹配状态下的第一图像包括：
在检测到相对位置满足预设的匹配状态后，发出第一提示信息；
当接收到拍照指令后，获取第一图像。
其中，获取在匹配状态下的第一图像包括：
在检测到相对位置满足预设的匹配状态后，执行拍照指令，获取第一图像。
其中，参考物为货架的层间隔板，参考标记为两条或者两条以上的平行线，在平行线之间的间距使得各个平行线与预定的层间隔板对齐后，拍摄视野覆盖预设的货架范围。
作为另外一种电子设备的实施方式，其包括处理器120，耦合至存储器110，用于执行存储器110中的程序，以用于执行如下处理：
在移动终端的拍摄界面中显示参考标记；
检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
对该第一图像进行图像识别处理，确定所述货架上的商品的名称和/或商品数量。
上述对于上述处理过程具体说明、技术原理详细说明以及技术效果详细分析在前面实施例中进行了详细描述，在此不再赘述。
进一步，如图所示，电子设备还可以包括：通信组件130、电源组件140、音频组件150、显示器160等其它组件。图中仅示意性给出部分组件，并不意味着电子设备只包括图中所示组件。
通信组件130被配置为便于电子设备和其他设备之间有线或无线方式的通信。电子设备可以接入基于通信标准的无线网络，如WiFi，2G或3G，或它们的组合。在一个示例性实施例中，通信组件130经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，通信组件130还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
电源组件140，为电子设备的各种组件提供电力。电源组件140可以包括电源管理系统，一个或多个电源，及其他与为电子设备生成、管理和分配电力相关联的组件。
音频组件150被配置为输出和/或输入音频信号。例如，音频组件150包括一个麦克风(MIC)，当电子设备处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器110或经由通信组件130发送。在一些实施例中，音频组件150还包括一个扬声器，用于输出音频信号。
显示器160包括屏幕，其屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如 果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与触摸或滑动操作相关的持续时间和压力。
本领域普通技术人员可以理解：实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时，执行包括上述各方法实施例的步骤；而前述的存储介质包括：ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。

Claims (17)

  1. 一种商品补货的处理方法，包括：
    在移动终端的拍摄界面中显示参考标记；
    检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
    对该第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
  2. 根据权利要求1所述的方法，其中，还包括：
    生成补货商品的采购订单，并向商品进货平台发送商品订购请求。
  3. 根据权利要求1所述的方法，其中，所述获取在匹配状态下的第一图像包括：
    在检测到所述相对位置满足预设的匹配状态后，发出第一提示信息；
    当接收到拍照指令后，获取所述第一图像。
  4. 根据权利要求1所述的方法，其中，所述获取在匹配状态下的第一图像包括：
    在检测到所述相对位置满足预设的匹配状态后，执行拍照指令，获取所述第一图像。
  5. 根据权利要求1所述的方法，其中，所述参考物为货架的层间隔板，所述参考标记为两条或者两条以上的平行线，在所述平行线之间的间距使得各个平行线与预定的层间隔板对齐后，所述拍摄视野覆盖预设的货架范围。
  6. 根据权利要求1所述的方法，其中，还包括：根据检测到被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，发出提示用户调整移动终端位置使得参考物与所述参考标记对齐的第二提示信息。
  7. 一种商品补货的处理装置，包括：
    参考标记显示模块，用于在移动终端的拍摄界面中显示参考标记；
    相对位置检测模块，用于检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
    图像识别处理模块，用于对所述第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
  8. 根据权利要求7所述的装置，其中，还包括：
    补货商品订单生成模块，用于生成补货商品的采购订单，并向商品进货平台发送商品订购请求。
  9. 根据权利要求7所述的装置，其中，所述获取在匹配状态下的第一图像包括：
    在检测到所述相对位置满足预设的匹配状态后，发出第一提示信息；
    当接收到拍照指令后，获取所述第一图像。
  10. 根据权利要求7所述的装置，其中，所述获取在匹配状态下的第一图像包括：
    在检测到所述相对位置满足预设的匹配状态后，执行拍照指令，获取所述第一图像。
  11. 根据权利要求7所述的装置，其中，所述参考物为货架的层间隔板，所述参考标记为两条或者两条以上的平行线，在所述平行线之间的间距使得各个平行线与预定的层间隔板对齐后，所述拍摄视野覆盖预设的货架范围。
  12. 根据权利要求7所述的装置，其中，所述相对位置检测模块，还用于根据检测到被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，发出提示用户调整移动终端位置使得参考物与所述参考标记对齐的第二提示信息。
  13. 一种电子设备，其中，包括：
    存储器，用于存储程序；
    处理器，耦合至所述存储器，用于执行所述程序，以用于如下处理：
    在移动终端的拍摄界面中显示参考标记；
    检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
    对该第一图像进行图像识别处理，确定待补货的商品名称和/或商品数量。
  14. 一种商品识别的处理方法，包括：
    在移动终端的拍摄界面中显示参考标记；
    检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
    对该第一图像进行图像识别处理，确定所述货架上的商品的名称和/或商品数量。
  15. 根据权利要求14所述的方法，其中，在移动终端的拍摄界面中显示参考标记之前还包括：
    响应于点击辅助商品识别的按键的操作，触发在移动终端的拍摄界面中显示参考标记。
  16. 根据权利要求14所述的方法，其中，所述在移动终端的拍摄界面中显示参考标记包括：
    获取用户输入的货架型号信息，并根据货架型号信息，在移动终端的拍摄界面中显示与该货架型号信息对应的参考标记。
  17. 一种电子设备，其中，包括：
    存储器，用于存储程序；
    处理器，耦合至所述存储器，用于执行所述程序，以用于如下处理：
    在移动终端的拍摄界面中显示参考标记；
    检测被拍摄的货架上的参考物与所述参考标记在拍摄图像中的相对位置，如果所述相对位置满足预设的匹配状态，则获取在匹配状态下的第一图像；
    对该第一图像进行图像识别处理，确定所述货架上的商品的名称和/或商品数量。
PCT/CN2019/122931 2018-12-07 2019-12-04 商品补货、商品识别的处理方法、装置及电子设备 Ceased WO2020114416A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811497679.4A CN111294503A (zh) 2018-12-07 2018-12-07 商品补货、商品识别的处理方法、装置及电子设备
CN201811497679.4 2018-12-07

Publications (1)

Publication Number Publication Date
WO2020114416A1 true WO2020114416A1 (zh) 2020-06-11

Family

ID=70974507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/122931 Ceased WO2020114416A1 (zh) 2018-12-07 2019-12-04 商品补货、商品识别的处理方法、装置及电子设备

Country Status (2)

Country Link
CN (1) CN111294503A (zh)
WO (1) WO2020114416A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113139957A (zh) * 2021-05-13 2021-07-20 青岛海尔工业智能研究院有限公司 产品装配过程中的检验方法、设备、系统及介质
CN115086539A (zh) * 2021-03-15 2022-09-20 虫极科技（北京）有限公司 拍摄点的定位方法和系统

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114387497A (zh) * 2021-12-31 2022-04-22 合肥美的智能科技有限公司 补货信息的推送方法、装置、服务器和可读存储介质
CN117255173A (zh) * 2022-06-07 2023-12-19 索尼半导体解决方案公司 监控系统
CN115496442A (zh) * 2022-09-23 2022-12-20 中国建设银行股份有限公司 物品补货方法、装置、计算机设备和存储介质
CN117151584A (zh) * 2023-08-29 2023-12-01 安徽三禾一信息科技有限公司 一种远程管理的仓库控制方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104917951A (zh) * 2014-03-14 2015-09-16 宏碁股份有限公司 摄像装置及其辅助拍摄人像方法
US9613448B1 (en) * 2014-03-14 2017-04-04 Google Inc. Augmented display of information in a device view of a display screen
CN107240212A (zh) * 2017-07-12 2017-10-10 合肥信亚达智能科技有限公司 一种超市监控管理系统
CN107945392A (zh) * 2017-11-23 2018-04-20 深圳市满心科技有限公司 自动售货机及采集证据的方法以及存储介质
CN108764778A (zh) * 2018-04-26 2018-11-06 东华大学 一种基于图像处理的仓库无人机补充货物方法
CN108833857A (zh) * 2018-07-10 2018-11-16 京东方科技集团股份有限公司 一种货架监控方法、系统以及货架

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104917951A (zh) * 2014-03-14 2015-09-16 宏碁股份有限公司 摄像装置及其辅助拍摄人像方法
US9613448B1 (en) * 2014-03-14 2017-04-04 Google Inc. Augmented display of information in a device view of a display screen
CN107240212A (zh) * 2017-07-12 2017-10-10 合肥信亚达智能科技有限公司 一种超市监控管理系统
CN107945392A (zh) * 2017-11-23 2018-04-20 深圳市满心科技有限公司 自动售货机及采集证据的方法以及存储介质
CN108764778A (zh) * 2018-04-26 2018-11-06 东华大学 一种基于图像处理的仓库无人机补充货物方法
CN108833857A (zh) * 2018-07-10 2018-11-16 京东方科技集团股份有限公司 一种货架监控方法、系统以及货架

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115086539A (zh) * 2021-03-15 2022-09-20 虫极科技（北京）有限公司 拍摄点的定位方法和系统
CN115086539B (zh) * 2021-03-15 2024-02-02 虫极科技（北京）有限公司 拍摄点的定位方法和系统
CN113139957A (zh) * 2021-05-13 2021-07-20 青岛海尔工业智能研究院有限公司 产品装配过程中的检验方法、设备、系统及介质

Also Published As

Publication number Publication date
CN111294503A (zh) 2020-06-16

Similar Documents

Publication Publication Date Title
WO2020114416A1 (zh) 商品补货、商品识别的处理方法、装置及电子设备
US10101156B2 (en) Method and apparatus for determining spatial parameter based on image and terminal device
KR20230020953A (ko) 다수의 광학 코드의 디코딩
US20150269643A1 (en) Systems, articles and methods related to retail framed image ordering and fulfillment, employing wireless communications
WO2017031898A1 (zh) 信息显示方法和装置
CN106648063B (zh) 手势识别方法及装置
US8983227B2 (en) Perspective correction using a reflection
CN109961594A (zh) 数据对象信息处理方法、装置及系统
CN107077823B (zh) 显示装置，显示系统，和显示控制程序
CN113256363A (zh) 信息处理方法、装置及电子设备
CN105515940B (zh) 信息交互方法及装置
US20160171722A1 (en) Method, device, and electronic device for background display
CN107622367A (zh) 进度显示方法及装置
CN112787829B (zh) 任务处理方法、装置及电子设备
CN108801161B (zh) 测量系统、方法及装置、可读存储介质
CN110069468A (zh) 一种获取用户需求的方法及装置、电子设备
CN111596812B (zh) 信息显示方法、设备及存储介质
CN106126132A (zh) 通过三维打印修复器具的方法及装置
KR101773772B1 (ko) 그림자 출력장치를 이용한 주문 관리 시스템
US20150332470A1 (en) Method, device, and electronic device for background display
CN107948507B (zh) 一种智能拍照方法、拍照终端及服务器
CN120372071A (zh) 房屋场景生成方法、装置及存储介质
CN106407372B (zh) 信息处理方法及装置
CN111723275A (zh) 车型推荐方法、终端设备及存储介质
CN109460277B (zh) 商品抢购流程的展示方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19892325

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19892325

Country of ref document: EP

Kind code of ref document: A1