WO2019154087A1 - 无人售货设备及其售货方法和无人售货系统 - Google Patents

无人售货设备及其售货方法和无人售货系统 Download PDF

Info

Publication number
WO2019154087A1
WO2019154087A1 PCT/CN2019/072838 CN2019072838W WO2019154087A1 WO 2019154087 A1 WO2019154087 A1 WO 2019154087A1 CN 2019072838 W CN2019072838 W CN 2019072838W WO 2019154087 A1 WO2019154087 A1 WO 2019154087A1
Authority
WO
WIPO (PCT)
Prior art keywords
goods
vending
weight
shelf
information
Prior art date
Application number
PCT/CN2019/072838
Other languages
English (en)
French (fr)
Inventor
戴江
季涛
张结龙
吕秀凤
Original Assignee
合肥美的智能科技有限公司
合肥华凌股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201820228875.0U external-priority patent/CN208156770U/zh
Priority claimed from CN201810130405.5A external-priority patent/CN108335406A/zh
Application filed by 合肥美的智能科技有限公司, 合肥华凌股份有限公司 filed Critical 合肥美的智能科技有限公司
Priority to JP2020540530A priority Critical patent/JP2021513140A/ja
Priority to US16/966,435 priority patent/US11501594B2/en
Priority to EP19751985.3A priority patent/EP3751530A4/en
Priority to SG11202006589YA priority patent/SG11202006589YA/en
Publication of WO2019154087A1 publication Critical patent/WO2019154087A1/zh
Priority to PH12020551196A priority patent/PH12020551196A1/en

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07FCOIN-FREED OR LIKE APPARATUS
    • G07F9/00Details other than those peculiar to special kinds or types of apparatus
    • G07F9/002Vending machines being part of a centrally controlled network of vending machines
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07FCOIN-FREED OR LIKE APPARATUS
    • G07F9/00Details other than those peculiar to special kinds or types of apparatus
    • G07F9/02Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus
    • G07F9/026Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus for alarm, monitoring and auditing in vending machines or means for indication, e.g. when empty
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G19/00Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/40Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight
    • G01G19/413Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means
    • G01G19/414Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means using electronic computing means only
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G19/00Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/40Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight
    • G01G19/413Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means
    • G01G19/414Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means using electronic computing means only
    • G01G19/4144Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means using electronic computing means only for controlling weight of goods in commercial establishments, e.g. supermarket, P.O.S. systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404Methods for optical code recognition
    • G06K7/1408Methods for optical code recognition the method being specifically adapted for the type of code
    • G06K7/14172D bar codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/18Payment architectures involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/20Point-of-sale [POS] network systems
    • G06Q20/208Input by product or record sensing, e.g. weighing or scanner processing
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00571Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated by interacting with a central unit
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07FCOIN-FREED OR LIKE APPARATUS
    • G07F11/00Coin-freed apparatus for dispensing, or the like, discrete articles
    • G07F11/02Coin-freed apparatus for dispensing, or the like, discrete articles from non-movable magazines
    • G07F11/04Coin-freed apparatus for dispensing, or the like, discrete articles from non-movable magazines in which magazines the articles are stored one vertically above the other
    • G07F11/06Coin-freed apparatus for dispensing, or the like, discrete articles from non-movable magazines in which magazines the articles are stored one vertically above the other supported individually on pivotally-mounted flaps or shelves
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00Cash registers
    • G07G1/0036Checkout procedures
    • G07G1/0045Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
    • G07G1/0054Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles
    • G07G1/0072Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles with means for detecting the weight of the article of which the code is read, for the verification of the registration
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G19/00Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/40Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight
    • G01G19/42Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight for counting by weighing

Definitions

  • the present disclosure belongs to the field of smart device technologies, and in particular, to a method for selling unmanned vending equipment, and an unmanned vending device and an unmanned vending system.
  • unmanned vending machines need to be affixed with RFID (Radio Frequency Identification) electronic tags to each product, and the electronic tags are used to identify the goods.
  • RFID Radio Frequency Identification
  • the method is simple and convenient, the cost of the electronic tags is too high. High, this method is still not popular.
  • the weight sensor is installed on the shelf to detect the difference in the weight of the goods on the shelf before and after the customer picks up the goods, but the method still has some problems: if the customer purchases, the A-layer partition If the goods are intentionally or unintentionally placed in the goods area of different price on the B-layer partition, the system pricing will be inaccurate, and the system cannot judge and discover the problem in time. Furthermore, if the goods continue to stay on the wrong partition, it will cause pricing errors in other customers' shopping, and the price of the whole system will be disordered. If the commodity price is low, the profit of the merchant will be lost; if the commodity is expensive, then Will affect the user experience, and even cause user complaints.
  • an infrared emitter and an infrared receiver are respectively installed on the upper and lower sides of the shelf, and the presence or absence of the current shelf item is determined by infrared sensing, but it is impossible to determine whether the article is displaced from the A position to the B position; RFID tags are used to attach to each item to further determine whether the item has been replaced, and the cost of the RFID tag is too high. Therefore, the method is currently not widely available.
  • the present disclosure is intended to solve at least one of the technical problems in the related art to some extent.
  • the first object of the present disclosure is to provide a method for selling an unmanned vending device, which is capable of identifying whether the product is misplaced or replaced, independent of the RFID tag. Guarantee the interests of merchants and users.
  • a second object of the present disclosure is to propose a non-transitory computer readable storage medium.
  • a third object of the present disclosure is to propose an unattended equipment.
  • a fourth object of the present disclosure is to propose an unattended system.
  • a first aspect of the present disclosure provides a method for selling an unmanned vending device, the unmanned vending device comprising a device body, a door body, and at least one installed in the device body.
  • the method for selling includes: collecting the weight of the goods on the shelf before and after the sale; detecting and confirming that the difference in the change of the weight is less than the first weight change threshold, and performing an alarm prompt, wherein The difference in weight is the difference between the weight of the goods on the shelf before the vending and the weight of the goods on the shelf after the vending, the first weight change threshold being less than or equal to zero.
  • the method of selling the unmanned goods device does not depend on the RFID tag of the goods, and judges whether the goods are misplaced or replaced according to the change in the weight of the goods before and after the sale, and promptly gives an alarm prompt. It can ensure the correct execution of the subsequent sales process, avoid the confusion of pricing, protect the interests of merchants and users, and the method is simple and easy to popularize.
  • the unmanned merchandise device further includes an image capturing device
  • the vending method further comprising: collecting an image of the item on the shelf before and after the vending; detecting and confirming the image according to the image The goods on the shelf are increased before and after the sale, and an alarm is given.
  • confirming that the change difference of the weight is greater than a second weight change threshold obtaining first sales information according to the change difference of the weight, wherein the second weight change threshold is greater than or Equivalent to zero; detecting and confirming the reduction of the goods on the shelf before and after the vending according to the image, obtaining the second vending information according to the change of the image; confirming that the first vending information and the second vending information are inconsistent , to make an alarm prompt, through the double comparison of weighing and image recognition, more safe and reliable.
  • the first vending information is confirmed to be consistent with the second vending information, and the first vending information or the second vending information is determined as final vending information.
  • the obtaining the first vending information according to the variation difference of the weight comprises: determining a vending item category according to the position of the goods; and, according to the difference in the weight, the selling The default unit of the goods category is the quantity of the goods obtained.
  • At least one tray is disposed on each shelf, the tray has a setting identifier and is used for placing items of a predetermined category, and at least one weighing device is disposed at the bottom of each tray, according to Obtaining the first vending information by the difference in the weight, comprising: obtaining the vending item according to the setting identifier of the tray; the difference in the change of the weight of the goods on each tray before and after the vending and the sales category of the corresponding tray The default unit item weight is obtained by the quantity of the item.
  • a second aspect of the present disclosure provides a non-transitory computer readable storage medium having stored thereon a computer program, which is implemented to implement the sale of the unattended device Method of delivery.
  • the non-transitory computer readable storage medium of the embodiment of the present disclosure can recognize whether the goods are misplaced or replaced, and ensure the interests of the merchant and the user by performing the above-described vending method of the unmanned vending equipment without relying on the RFID tag.
  • an embodiment of the third aspect of the present disclosure provides an unmanned vending apparatus, including: an apparatus body, a door body, at least one shelf mounted in the body of the device; a weighing device, a weighing device is disposed at the bottom of the shelf for collecting the weight of the goods on the shelf before and after the sale; the processing device is connected to the weighing device for calculating the a difference between a weight of the goods on the shelf and a weight of the goods on the shelf after the sale, the difference in the change in weight is less than the first weight change threshold, and a prompt control signal is issued, wherein the first weight change threshold Less than or equal to zero; a prompting device, the prompting device is connected to the processing device, and configured to perform an alarm prompt according to the prompting control signal.
  • the weight of the goods on the shelf before and after the sale is collected by the weighing device without relying on the RFID tag of the goods, and the processing device determines whether the product is based on the change in the weight of the goods before and after the sale. Being misplaced or replaced, and prompting the alarm prompt through the prompting device, the correct execution of the subsequent sales process can be ensured, the interests of the merchant and the user are guaranteed, the cost is low, and the popularity is more popular.
  • the unattended device further includes: an image capturing device coupled to the processing device for collecting an image of the item on the shelf before and after the sale;
  • the processing device is further configured to detect and confirm the increase of the goods on the shelf before and after the vending according to the image, and issue the prompt control signal.
  • the processing device is further configured to: the change difference of the weight is greater than a second weight change threshold, obtain first sales information according to the change difference of the weight, and according to the The image detects and confirms that the goods on the shelf are reduced before and after the vending, obtains the second vending information according to the change of the image, and the first vending information and the second vending information are inconsistent, and the A control signal is presented, wherein the second weight change threshold is greater than or equal to zero.
  • the processing device is further configured to: the first vending information is consistent with the second vending information, and the first vending information or the second vending information is Determined as final sales information.
  • the unattended device further includes: an infrared sensing device disposed in the device body, the infrared sensing device being coupled to the processing device, the processing device being The infrared sensing device controls the weighing device and the camera device to be activated when the hand is detected to leave; or the processing device controls the weighing device and the camera device when detecting a door opening signal or a door closing signal start up.
  • At least one tray is disposed on each shelf, the tray having a set identification code and for placing a predetermined category of goods, at least one weighing device is disposed at the bottom of each tray, The weighing device is used to collect the weight of the goods on the corresponding tray.
  • the unattended device further includes: a user information reading device connected to the processing device for reading user information.
  • the unattended device further includes: a monitoring device installed outside the device body for monitoring a user usage environment.
  • the monitoring apparatus includes: a camera module, the camera module is connected to the processing device, configured to collect a user and an environment image when a trigger signal is detected; a trigger module, the trigger module And connected to the camera module, configured to issue the trigger signal when a user trigger command is detected.
  • an embodiment of the fourth aspect of the present disclosure provides an unmanned vending system, including: an unmanned vending device, the unmanned vending device comprising: an apparatus body, a door body, and the device is installed At least one shelf in the body; a weighing device disposed at the bottom of the shelf for collecting the weight of the goods on the shelf before and after the sale; the camera device for collecting the goods before and after the sale An image of the goods on the shelf; a communication device and a processing device, the processing device being respectively connected to the weighing device, the imaging device, and the communication device, wherein the communication device is configured to upload the before and after the sale The weight of the goods on the shelf and the image of the goods on the shelf before and after the vending; the prompting device, the prompting device is connected to the processing device, and is configured to perform an alarm prompt according to the prompt control signal;
  • the server obtains first sales information according to the change of the weight of the goods on the shelf before and after the vending, and identifies an image of the goods on the
  • the unattended system of the embodiment of the present disclosure based on the unmanned vending equipment and the server, does not depend on the RFID tag of the goods, and determines whether the goods are misplaced or replaced according to the change in the weight of the goods before and after the sale and the image recognition. And prompting the alarm prompt through the prompting device, can ensure the correct execution of the subsequent sales process, protect the interests of the merchants and users, low cost, and more popular.
  • FIG. 1 is a flow chart of a method of vending a vending machine in accordance with an embodiment of the present disclosure
  • FIG. 2 is a flow chart of a method of vending a vending machine in accordance with an embodiment of the present disclosure
  • FIG. 3 is a flow chart of a method of vending a vending machine in accordance with one embodiment of the present disclosure
  • FIG. 4 is a block diagram of an unattended device in accordance with an embodiment of the present disclosure.
  • Figure 5 is a front elevational view of an unattended device in accordance with one embodiment of the present disclosure.
  • Figure 6 is a side elevational view of the unattended device of Figure 5;
  • FIG. 7 is a schematic illustration of the weight of a product on a weighing tray, in accordance with one embodiment of the present disclosure.
  • FIG. 8 is a block diagram of an unattended device communicating with a server in accordance with one embodiment of the present disclosure
  • FIG. 9 is a block diagram of an unattended system in accordance with an embodiment of the present disclosure.
  • Unmanned equipment 100 and server 200 are Unmanned equipment 100 and server 200;
  • Body 10 Door body 20, shelf 30, weighing device 40, prompting device 50, processing device 60, imaging device 70, infrared sensing device 80, user information reading device 90, monitoring device 91, tray 31;
  • the unattended device includes an apparatus body, a door body, at least one shelf mounted on the body of the device, and a weighing device camera device, wherein the shelf can be placed on the shelf, or Set the tray on the shelf and place the goods on the corresponding tray.
  • a vending method of an unattended device includes:
  • S1 collect the weight of the goods on the shelf before and after the sale.
  • the user can unlock the code by scanning code or other means
  • the unattended device acquires the user's information through the user information reading module
  • the server checks the user information, and sends an unlock command to the unattended device after confirmation.
  • the control door lock is opened.
  • the user can select the goods, and after the user selects the product, the device door lock is actively closed, and the main control module detects the door closing signal and then controls the door. The lock is closed, and processes such as identification and payment control of the vending goods are performed.
  • the weight of the goods on each shelf is collected by the weighing device and transmitted to the processing device, and the processing device records the weight of the goods on the shelf before the user picks up the goods, and records the shelves on the shelves after the user picks up the goods.
  • the weight of the goods For the case where the tray is set on the shelf, the weight of the goods on each tray before and after the user picks up the goods is collected.
  • the weight change of the goods on each shelf before and after the sale is obtained, and for the case where the tray is mounted on the shelf, each time before and after the sale can be obtained.
  • the weight of the goods on the pallet changes.
  • the first weight change threshold is less than or equal to zero, that is, the weight after the shelf is higher than the weight of the goods on the shelf before the sale, and the weight of the goods on the shelf after the sale increases.
  • the difference in the change in weight of the goods on the shelf before and after the vending is less than the first weight change threshold, it is determined that the user may place the item that is not a shelf or tray on the shelf or The tray may be misplaced with other shelves or the goods on the tray, or the user may have placed new items.
  • an alarm is given to prompt the user to place the goods in the correct position and send them at the same time.
  • the alarm information is sent to the background staff to facilitate the call of the full video after the door is opened, to further confirm whether the user has intentionally destroyed or replaced the goods.
  • the method of selling the unmanned goods device does not depend on the RFID tag of the goods, and judges whether the goods are misplaced or replaced according to the change in the weight of the goods before and after the sale, and promptly gives an alarm prompt. It can guarantee the correct execution of the subsequent sales process, protect the interests of merchants and users, and the method is simple and easy to popularize.
  • the unmanned merchandise device may also be provided with an imaging device that may be mounted within the device body for capturing images of the merchandise on the shelf.
  • the method for selling the unmanned vending equipment of the embodiment of the present disclosure further includes:
  • an image of the inside of the device body is collected by the image capturing device, and an image of the product on the shelf before and after the user picks up the product is recorded.
  • the image is identified, and according to the image before and after the sale, it can be determined that the goods on the shelf increase or decrease or not change after the sale, and the related information of the changed goods can be identified when the image changes after the sale. For example, color, type, name, volume, quantity.
  • the camera device activates the camera function, and takes an image of the goods on each floor, for example, a 1-m shelf, and numbers D1, D2, D3, ... Dm, and calls the user to pick up the shelf before picking up the product.
  • the previous images for example, numbers C1, C2, C3...Cm, are used for image recognition, comparing the image of the goods on the shelf before the sale with the image of the goods on the shelf after the sale to determine whether the goods are changing, and if so, further Determine whether the goods on the m-tier shelf are increased or decreased.
  • the user may misplace the goods, for example, the goods placed on the non-m shelf are on the m shelf, and may be the goods on the other shelves. It is also possible that the user has placed a new evaluation. At this time, an alarm prompt is given to prompt the user that the goods placed on the m-th shelf are incorrect, so that they can be placed in the correct position, so that the subsequent sales are made. The process is executed correctly to ensure the interests of the users. At the same time, the alarm information can be sent to the background staff to call all the videos after the door opening to further determine whether the user intentionally destroys, replaces the goods and other bad behaviors, and ensures the interests of the merchant.
  • ⁇ n is within a defined range that is considered to be unchanged, for example, -Kn ⁇ ⁇ n ⁇ Kn, where -Kn It may be a first weight change threshold, and Kn may be a second weight change threshold, and it is determined that the user has not taken the goods from the shelf. Alternatively, it is considered that the user has not taken the goods from the shelf based on the image of the goods on the shelves before and after the sale to judge that the goods have not changed.
  • the misplacement or replacement of the goods may also be determined in conjunction with weighing and image recognition, which are described below in the examples.
  • the difference in weight of the goods on the shelf before and after the sale is greater than the second weight change threshold, wherein the second weight change threshold is greater than or equal to zero, that is, the goods are reduced, and the user is considered to be taken away.
  • Some goods on the shelf can obtain the first sales information according to the difference value.
  • the sales item category can be determined according to the position of the goods, for example, the shelf or the tray placed according to the goods, which can be obtained according to the pre-stored information.
  • Information about the goods on the shelf or on the pallet such as the category, the weight of the unit, the unit price, etc., that is, the category of the goods based on the change in the weight can be determined; and, based on the weight difference and the preset unit weight of the item of sale
  • the quotient of the quantity of the goods sold, the difference between the weight and the weight of the preset unit of the item of sale is the quantity of the item sold. In order to avoid the deviation of the unit weight of the item, the quotient can be rounded to the integer value.
  • the tray for the case where the tray is placed on the shelf, at least one tray is disposed on each shelf, the tray has a set identification code and is used for placing goods of a predetermined category, and at least one scale is set at the bottom of each tray.
  • Heavy device the first sales information can be obtained by the following: the weighing device detects that the current weight value of each tray is set to, for example, B1, B2, B3, ... Bn, and the setting identifier of the tray is 1-m, and each item before the sales is called.
  • the quantity of goods, Zn is the default order of the sales category Item weight, wherein, in order to avoid bias by weight of units of goods, whichever Xn can be rounded integer value.
  • the weight information of each tray is processed as described above to determine the user's purchase price.
  • the second vending information is obtained according to the change of the image. Specifically, if the goods are reduced, it is determined that the user removes the goods from the m-th floor shelf, and when the goods are reduced, the items and the quantity of the reduced goods are obtained according to the image change, for example, but not limited to, the color, type, name, Volume, quantity, etc., that is, information about the user's choice of goods.
  • an alarm prompt is issued.
  • the sales item type and data determined based on the weight change of the goods on the shelf before and after the sale are inconsistent with the sales item type and quantity obtained according to the image recognition, it is considered that the user may misplace the goods or replace the goods.
  • the goods at this time, an alarm prompt, can prompt the user, in order to place the goods to the correct position, to ensure the normal execution of the subsequent procedures, and can send alarm prompt information to the background personnel to check whether malicious behavior occurs, to ensure the interests of the business .
  • the purchase information of the user may be determined in conjunction with weighing and image recognition. Specifically, if the first vending information is consistent with the second vending information, the first vending information or the second vending information is determined as the final vending information. Specifically, the vending information obtained by the weighing and the vending information obtained by the image recognition are compared, for example, the number Xn of the reduced goods on the nth tray on the mth shelf is reduced and the image recognition is reduced.
  • the sales quantity is Xn
  • the product category purchased by the user is output.
  • Quantity and total price, total price meets: Among them, Si is the number of the i-th goods, Ki is the unit price of the i-th item, n is the total number of pallets, and the server is notified to settle the amount.
  • the calculation process of the quantity of the goods and the image recognition comparison may be performed after the data information is acquired locally, and the data is sent to the server, and the weight calculation and image recognition are performed in the cloud, and then the sales are sent.
  • the type and data information is sent to the payment system, and after the deduction is made, the goods category, quantity and price are transmitted to the local area for output. It is also possible to calculate the number of goods and the operation data of the image recognition comparison locally, and then send the result to the cloud payment system, and then transfer the goods, the quantity and the price to the local, and output.
  • a flowchart of a vending method of an unattended device includes:
  • step S140 it is judged whether or not -Kn ⁇ ⁇ n ⁇ Kn is satisfied, and if it is satisfied, the process ends. If it is not satisfied, the process proceeds to step S210.
  • step S150 Aligning whether the reduced quantity Xn of the item on the nth tray on the mth shelf is consistent with the quantity of goods reduced by the image recognition. If yes, the process goes to step S160, otherwise the process goes to step S210.
  • step S180 the previous images C1, C2, C3, ... Cn of each shelf are called, and the image comparison is performed to determine whether there is a change in the goods on the m-floor shelf. If yes, the process proceeds to step S190, otherwise the process ends.
  • step S190 it is judged whether or not the goods on the m-floor shelf are reduced, and if there is a decrease, the sales information such as the color, category, name, volume, and quantity of the reduced goods is identified, and the process proceeds to step S150. Otherwise, it proceeds to step S200.
  • the prompting device is activated to prompt the user that the goods placed on the mth shelf are incorrect, please place it in the correct position, and at the same time, send an alarm message to the background personnel to call the full video after opening the door to confirm whether the user is There are bad behaviors such as destruction and replacement of goods.
  • the prompting device is activated to prompt the user to place the goods on the nth tray of the mth shelf. Please place it in the correct position, and send an alarm message to the background personnel to call the full video after the door is opened. Confirm whether the user has any bad behavior such as damage or replacement of goods.
  • the weight change of the goods can be detected by the weighing device, and the price calculation can be performed by itself, and the image of the goods is collected by the camera device, and the inspection is assisted by the image recognition, and the judgment is timely And found misplaced or replaced goods, to avoid business losses, safe and reliable, easy to implement, improve user experience.
  • Also disclosed in some embodiments of the present disclosure is a non-transitory computer readable storage medium having stored thereon a computer program that, when executed, implements the vending method of the unattended device of the first aspect.
  • the unmanned vending apparatus 100 of the embodiment of the present disclosure includes an apparatus body 10, a door body 20, at least one shelf 30 installed in the apparatus body 10, a weighing device 40, The device 50 and the processing device 60 are presented.
  • the door body 20 can be transparent to facilitate the inspection of the goods in the apparatus body 10; and further includes a door handle 11 mounted on the door body 20 to open and close the door body 20, and a lock controlled by the processing device 60 to keep the door body closed. 12.
  • the main body portion of the lock 12 is mounted on the apparatus body 10, and the lock is mounted on the door body 20.
  • the weighing device 40 is disposed at the bottom of the shelf 30 for collecting the weight of the goods on the shelf 30 before and after the sale; the processing device 60 is connected to the weighing device 40 for calculating the weight and sale of the goods on the shelf 30 before the vending a change in the weight of the goods on the shelf 30 after the goods, and a prompt control signal is issued when the change difference is less than the first weight change threshold, wherein the first weight change threshold is less than or equal to zero, that is, after the shelf is sold The weight is greater than the weight of the goods on the shelf before the sale, and the weight of the goods on the shelves after the sale increases.
  • the prompting device 50 is connected to the processing device 60 for alerting the alert according to the prompt control signal.
  • the difference in the change in weight of the goods on the shelf before and after the vending is less than the first weight change threshold, it is determined that the user may place the item that is not a shelf or tray on the shelf or The tray may be misplaced with other shelves or the goods on the tray, or the user may have placed new items.
  • an alarm is given to prompt the user to place the goods in the correct position and send them at the same time.
  • the alarm information is sent to the background staff to facilitate the call of the full video after the door is opened, to further confirm whether the user has intentionally destroyed or replaced the goods.
  • the weight of the goods on the shelf 30 before and after the vending is collected by the weighing device 40 without depending on the RFID tag of the article, and the processing device 60 changes according to the weight of the goods before and after the vending.
  • the processing device 60 changes according to the weight of the goods before and after the vending.
  • the unmanned vending apparatus 100 of the embodiment of the present disclosure further includes an image capturing device 70 connected to the processing device 60 for collecting before and after the sale.
  • the image of the goods on the shelf; the processing device 60 is further configured to determine the change of the goods on the shelf 30 before and after the sale according to the image, and issue a prompt control signal when the goods on the shelf 30 are increased before and after the sale according to the image, and the prompting device 50 performs Alarm prompt.
  • the processing device 60 is further configured to determine the change of the goods on the shelf 30 before and after the sale according to the image, and issue a prompt control signal when the goods on the shelf 30 are increased before and after the sale according to the image, and the prompting device 50 performs Alarm prompt.
  • the image when the weight of the goods on the shelf 30 before and after the sale is increased, it is considered that the user misplaces or replaces the goods or other bad behaviors, promptly gives an alarm prompt, which can avoid the loss of the merchant and improve the shopping safety.
  • the processing device 60 is further configured to: when the difference in weight of the goods on the shelf 30 before and after the vending is greater than the second weight change threshold, wherein the second weight change threshold is greater than or equal to zero, ie, When the weight of the product is reduced, it is determined that the user takes the goods of the shelf 30, and the first sales information is obtained according to the difference value.
  • the sales item category can be determined according to the position of the goods, for example, the shelf 30 or the tray placed according to the goods can be based on the pre-stored information.
  • Obtaining information related to the goods on the shelf 30 or the tray such as the category, the weight of the unit, the unit price, etc., that is, the category of the goods based on the change in the weight can be determined; and, according to the weight difference and the preset of the sales category
  • the weight of the unit goods is the quantity of the goods sold.
  • the difference between the weight difference and the weight of the preset unit of the goods is the quantity of the goods sold.
  • the quotient can be rounded to the nearest whole number. value.
  • At least one tray 31 is provided on each shelf 30, and the tray 31 has a setting identification code and is used for placing a predetermined category.
  • at least one weighing device 40 is disposed at the bottom of each tray 31.
  • each shelf 30 is placed with at least one tray 31, for example, the shelf 1 includes a tray 1 - a tray 4, and Each of the trays 31 is coded with a different serial number, and at least one weighing device 40 such as a pressure sensor is placed at the bottom of each tray 31, for example, including a weighing device 1 - weighing device 4.
  • the items placed on each of the trays 31 are only one type and weight, and the same weight but different items are not allowed to be placed in the same tray 31.
  • the measured weight of different physical objects of the same category of goods allows an error Kn
  • Kn is the allowable error between the standard weight Zn of the goods on each tray 31 and the measured weight
  • Zn is the serial number n
  • the processing device 60 prestores the related information of the goods placed in each tray 31, and obtains the sales item according to the setting identification code of the nth tray; and the difference and corresponding change according to the weight of the goods on each tray 31 before and after the sale.
  • the pre-set unit of the sales category of the pallet is the quantity of the item, and the quantity of the item is the quantity of the item purchased by the user.
  • the processing device 60 is further configured to obtain the second vending information according to the change of the image when the goods on the shelf are reduced before and after the sale according to the image. Specifically, if the goods are reduced, it is determined that the user removes the goods from the m-th floor shelf, and when the goods are reduced, the items and the quantity of the reduced goods are obtained according to the image change, for example, but not limited to, the color, type, name, Volume, quantity, etc., that is, information about the user's choice of goods.
  • the processing device 60 issues a cue control signal when the first vending information and the second vending information do not match. Specifically, if the sales item type and data determined based on the weight change of the goods on the shelf before and after the sale are inconsistent with the sales item type and quantity obtained according to the image recognition, it is considered that the user may misplace the goods or replace the goods.
  • the goods at this time, an alarm prompt, can prompt the user, in order to place the goods to the correct position, to ensure the normal execution of the subsequent procedures, and can send alarm prompt information to the background personnel to check whether malicious behavior occurs, to ensure the interests of the business .
  • the processing device 60 is further configured to determine the first vending information or the second vending information as final merchandising information when the first vending information is consistent with the second vending information. Specifically, the vending information obtained by the weighing and the vending information obtained by the image recognition are compared, for example, the number Xn of the reduced goods on the nth tray on the mth shelf is reduced and the image recognition is reduced. If the goods information is consistent, if the first sales information is consistent with the second sales information, it is determined that the user has taken out the goods on the nth tray from the m-floor shelf, the sales quantity is Xn, and the product category purchased by the user is output. Quantity and total price, total price meets: Among them, Si is the number of the i-th goods, Ki is the unit price of the i-th item, n is the total number of pallets, and the server is notified to settle the amount.
  • the unattended device 100 further includes an infrared sensing device 80 disposed within the device body 10.
  • the infrared sensing device 80 is connected to the processing device 60.
  • the processing device 60 controls the weighing device 40 and the camera device 70 to start; or the processing device 60 detects the door opening signal or the door closing signal.
  • the weighing device 40 and the camera device 70 are controlled to be activated.
  • a still image may be captured and uploaded to the processing device 60, and the processing device 60 performs image processing to compare the layers of the film when the two consecutive door closing signals are taken.
  • the static picture of the frame 30 further confirms the goods taken by the user; if the activation trigger signal of the camera device 70 is the door opening signal, when the door opening signal is detected, the camera device 70 can perform dynamic shooting video to monitor the behavior of the user during shopping. When there is an alarm signal, it is confirmed that there are enough bad behaviors such as damage and replacement of goods to check the cause of the alarm.
  • camera unit 70 is disposed within door body 20 for capturing images or video of items on shelf 30, and may also be used to monitor user behavior after door body 20 is opened.
  • at least one camera device 70 may be disposed at a corresponding door body position of each shelf 30 or above or to the left or right or upper right corner or upper left corner of the shelf 30, or a plurality of shelves may be collected by one camera device 70. An image of the goods on the shelf.
  • the steps of the weight change determination and the image comparison may be performed simultaneously, or may be adjusted in the order of the front and back. For example, taking a picture or video when opening the door, closing the door and detecting the weight change; or, taking the picture and detecting the weight change at the same time when closing the door; or detecting the weight change after closing the door, if there is a change, check the image.
  • the result of the recognition determines whether there is a change; or, it is first determined by image recognition that the image has changed, and then the weight change is called to determine the change in the quantity.
  • the unattended device 100 further includes a user information reading device 90 connected to the processing device 60 for reading user information for facilitating purchase payment.
  • the smart mobile terminal is used to scan the two-dimensional code; or the user's biological sign information such as the user's fingerprint information, palm print information, palm vein information, finger vein information, eye iris information or face information is collected.
  • the unmanned vending apparatus 100 of the embodiment of the present disclosure further includes a monitoring device 91 that is installed outside the device body 10 for monitoring a user environment.
  • the monitoring device 91 may include a camera module 911 and a trigger module 912 .
  • the camera module 911 is connected to the processing device 60 for collecting user and environment images when the trigger signal is detected.
  • the trigger module 912 is connected to the camera module 911 for issuing a trigger signal when the user trigger command is detected.
  • the triggering module 912 can include at least one of an infrared sensing sensor, a voice recognition module, and a triggering module.
  • the camera module 911 is mounted on the exterior of the device body 10 to cooperate with the trigger module to initiate operation.
  • the signal that triggers the operation of the camera module 911 is an infrared sensor, when the infrared sensor detects that someone is coming, the camera module 911 is activated to perform face recognition; if the signal that triggers the camera module 911 is a voice recognition module, then When coming to the front of the device body 10, the system wakes up with a certain keyword to perform voice recognition, face recognition, shooting, etc.; if the signal that triggers the operation of the camera module 911 is a button, when the person activates the button, the voice recognition and the face are performed. Identify, shoot, etc.
  • the unattended device 100 can also be provided with a lamp assembly 13, which can be composed of a plurality of sets of illumination lamps for use in the imaging device 70 during shooting. Fill light when not enough. And, the power is supplied through the power module 14, the data is transmitted through the communication module 15, and the switch module 16 is further provided.
  • the load control device 17 is connected to the processing device 60, that is, the main control module of the unmanned device 100, and the load control device 17 can control the lock.
  • the switch of 12, the switch of the illumination lamp, the switch of the camera device 70, and the electrical device of the refrigeration system work. Processing device 70 can communicate with cloud server 200 over a network.
  • the unmanned vending apparatus 100 of the embodiment of the present disclosure can take out a plurality of goods at a time as compared with the ordinary vending equipment, and the user operation is simple and the experience is good. Compared with the RFID tag identification, the cost is low. Provide users with a convenient life while saving money for the business.
  • an unattended system 1000 of an embodiment of the present disclosure includes an unattended device 100 and a server 200.
  • the unmanned vending apparatus 100 includes an apparatus body, a door body, at least one shelf, a weighing device, a camera device, a communication device, a processing device, and a prompting device installed in the device body.
  • the weighing device is arranged at the bottom of the shelf for collecting the weight of the goods on the shelf before and after the sale;
  • the camera device is used for collecting images of the goods on the shelf before and after the sale;
  • the processing device is respectively connected with the weighing device, the camera device and
  • the communication device is connected, and the communication device is configured to upload the weight of the goods on the shelf before and after the sale and the image of the goods on the shelf before and after the sale;
  • the prompting device is connected to the processing device for alerting according to the prompt control signal.
  • the server 200 obtains the first vending information according to the change of the weight of the goods on the shelf before and after the vending, and identifies the image of the goods on the shelf before and after the vending to obtain the second vending information, according to the first vending information and the second sale.
  • the goods information determines the final sales information, and sends a prompt control signal when judging the increase of the goods on the shelf before and after the sale, so that the goods can be promptly misplaced or replaced, to ensure the correct execution of the subsequent sales process, to ensure the merchant And the interests of users, low cost, and easier to popularize.
  • the unattended system 1000 of the embodiment of the present disclosure can open the door by scanning the code, and the user can select the goods at will, through the safe and convenient non-secure payment, the transaction is simple, the use is convenient, and the experience is good; and, the automatic identification and automatic transaction can be automatically performed. It does not change the user's shopping habits, and does not require any modification or labeling of the goods, and does not increase the cost of the goods.
  • the weighing information is automatically calculated by the weighing device, and the auxiliary identification is confirmed by image recognition. The double determination is more secure and reliable.
  • the unattended system 1000 of the embodiment of the present disclosure based on the unmanned vending apparatus 100 and the server 200, does not depend on the RFID tag of the goods, and determines whether the goods are misplaced according to the change in the weight of the goods before and after the sale and the image recognition. Or being replaced, and prompting the alarm prompt through the prompting device, can ensure the correct execution of the subsequent sales process, protect the interests of the merchants and users, low cost, and more popular.
  • any process or method description in the flowcharts or otherwise described herein may be understood to include one or more steps for implementing a particular logic function or process. Modules, segments or portions of code of executable instructions, and the scope of the preferred embodiments of the disclosure includes additional implementations, which may not be in the order shown or discussed, including in a substantially simultaneous manner depending on the functionality involved. The functions are performed in the reverse order, which should be understood by those skilled in the art to which the embodiments of the present disclosure pertain.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with such an instruction execution system, apparatus, or device.
  • computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
  • portions of the present disclosure can be implemented in hardware, software, firmware, or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Mathematical Physics (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • General Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Control Of Vending Devices And Auxiliary Devices For Vending Devices (AREA)
  • Cash Registers Or Receiving Machines (AREA)
  • Emergency Alarm Devices (AREA)
  • Alarm Systems (AREA)

Abstract

一种无人售货设备(100)及其售货方法和无人售货系统(1000),其中,无人售货设备(100)包括设备本体(10)、门体(20)、安装在设备本体(10)内的至少一层搁架(30)和称重装置(40),售货方法包括:采集售货前后搁架上货品的重量(S1);计算售货前搁架上货品的重量与售货后搁架上货品的重量的变化差值(S2);如果变化差值小于第一重量变化阈值,则进行报警提示(S3),其中,第一重量变化阈值小于或等于零。能够不依赖于RFID标签,及时判断货品错放和被置换的情况。

Description

无人售货设备及其售货方法和无人售货系统
相关申请的交叉引用
本公开基于申请号分别为201810130405.5和201820228875.0,对应的申请日均为2018年02月08日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本公开作为参考。
技术领域
本公开属于智能设备技术领域,尤其涉及一种无人售货设备的售货方法,以及无人售货设备和无人售货系统。
背景技术
目前的无人自动售货机,需要将每个商品上贴上RFID(Radio Frequency Identification,射频识别)电子标签,采用扫描电子标签的方式来识别货品,此方法虽然操作简单方便,但是电子标签成本过高,此方法仍无法普及。
在一些相关技术中,通过在搁架上安装重量传感器,检测顾客取货前后的搁架上货品重量差来进行计价,但是该方法仍然存在一些问题:若顾客选购时,将A层隔板的货品有意或无意地放到B层隔板上的不同价格的货品区域内,则系统计价会出现误差,且系统无法及时判断和发现此问题。更进一步地,若货品继续停留在错误的隔板上,会导致后面的其他顾客购物出现计价误差,整个系统出现价格紊乱,若商品计价低了,导致商家利益损失;若商品计价高了,则会影响用户体验感,甚至引起用户投诉。
在另一些相关技术中,在搁架的上下分别安装红外发射器和红外接收器,通过红外感应判断当前搁架物品的有无,但无法判断物品是否从A位置置换到B位置;同时该方法使用RFID电子标签贴于每一个商品上,用以进一步判断物品是否被更换,而RFID标签成本过高,因此,该方法目前无法广泛普及。
发明内容
本公开旨在至少从一定程度上解决相关技术中的技术问题之一。
为此,本公开的第一个目的在于提出一种无人售货设备的售货方法,该无人售货设备的售货方法,不依赖于RFID标签,能够识别货品是否错放或置换,保证商家和用户利益。
本公开的第二个目的在于提出一种非临时性计算机可读存储介质。
本公开的第三个目的在于提出一种无人售货设备。
本公开的第四个目的在于提出一种无人售货系统。
为了达到上述目的,本公开第一方面实施例提出了一种无人售货设备的售货方法,所述无人售货设备包括设备本体、门体、安装在所述设备本体内的至少一层搁架和称重装置,所述售货方法包括:采集售货前后所述搁架上货品的重量;检测并确认重量的变化差值小于第一重量变化阈值,进行报警提示,其中,所述重量的变化差值为售货前所述搁架上货品的重量与售货后所述搁架上货品的重量的变化差,所述第一重量变化阈值小于或等于零。
根据本公开实施例的无人售货设备的售货方法,不依赖于货品的RFID标签,根据售货前后货品的重量的变化来判断货品是否被错放或被置换,并及时进行报警提示,可以保证后续售货流程的正确执行,避免计价混乱,保障商家和用户的利益,方法简单易普及。
在本公开的一些实施例中,所述无人售货设备还包括摄像装置,所述售货方法还包括:采集售货前后所述搁架上货品的图像;根据所述图像检测并确认所述售货前后所述搁架上货品增加,进行报警提示。
在本公开的一些实施例中,确认所述重量的变化差值大于第二重量变化阈值,根据所述重量的变化差值获得第一售货信息,其中,所述第二重量变化阈值大于或等于零;根据所述图像检测并确认售货前后所述搁架上货品减少,根据所述图像的变化获得第二售货信息;确认所述第一售货信息和所述第二售货信息不一致,进行报警提示,通过称重和图像识别双重比对,更加安全可靠。
在本公开的一些实施例中,确认所述第一售货信息与所述第二售货信息一致,将所述第一售货信息或所述第二售货信息确定为最终售货信息。
在本公开的一些实施例中,所述根据所述重量的变化差值获得第一售货信息,包括:根据货品位置确定售货品类;以及,根据所述重量的变化差值和所述售货品类的预设单位货品重量获得售货数量。
在本公开的一些实施例中,每层搁架上设置至少一个托盘,所述托盘具有设定识别码且用于放置预定品类的货品,每个托盘底部设置至少一个称重装置,所述根据所述重量的变化差值获得第一售货信息,包括:根据托盘的设定识别码获得售货品类;根据售货前后每个托盘上货品的重量的变化差值和对应托盘的售货品类的预设单位货品重量获得售货数量。
为了达到上述目的,本公开第二方面实施例提出了一种非临时性计算机可读存储介质,其上存储有计算机程序,所述计算机程序被执行时实现所述的无人售货设备的售货方法。
本公开实施例的非临时性计算机可读存储介质,通过执行上述的无人售货设备的售货方法,不依赖于RFID标签,能够识别货品是否错放或置换,保证商家和用户利益。
为了达到上述目的,本公开第三方面实施例提出了一种无人售货设备,包括:设备本体、门体,安装在所述设备本体内的至少一层搁架;称重装置,所述称重装置设置在所述搁架底部,用于采集售货前后所述搁架上货品的重量;处理装置,所述处理装置与所述称重装置相连,用于计算售货前所述搁架上货品的重量与售货后所述搁架上货品的重量的变化差值,所述重量的变化差值小于第一重量变化阈值,发出提示控制信号,其中,所述第一重量变化阈值小于或等于零;提示装置,所述提示装置与所述处理装置相连,用于根据所述提示控制信号进行报警提示。
根据本公开实施例的无人售货设备,不依赖于货品的RFID标签,通过称重装置采集售货前后搁架上货品的重量,处理装置根据售货前后货品的重量的变化来判断货品是否被错放或被置换,并通过提示装置及时进行报警提示,可以保证后续售货流程的正确执行,保障商家和用户的利益,成本低,更加易于普及。
在本公开的一些实施例中,所述无人售货设备还包括:摄像装置,所述摄像装置与所述处理装置相连,用于采集售货前后所述搁架上货品的图像;所述处理装置,还用于根据所述图像检测并确认所述售货前后所述搁架上货品增加,发出所述提示控制信号。
在本公开的一些实施例中,所述处理装置还用于,所述重量的变化差值大于第二重量变化阈值,根据所述重量的变化差值获得第一售货信息,并根据所述图像检测并确认售货前后所述搁架上货品减少,根据所述图像的变化获得第二售货信息,以及,所述第一售货信息和所述第二售货信息不一致,发出所述提示控制信号,其中,所述第二重量变化阈值大于或等于零。
在本公开的一些实施例中,所述处理装置还用于,所述第一售货信息与所述第二售货信息一致,将所述第一售货信息或所述第二售货信息确定为最终售货信息。
在本公开的一些实施例中,所述无人售货设备还包括:设置在所述设备本体内的红外感测装置,所述红外感测装置与所述处理装置相连,所述处理装置在所述红外感测装置检测到手离开时,控制所述称重装置和所述摄像装置启动;或者,所述处理装置在检测到开门信号或关门信号时控制所述称重装置和所述摄像装置启动。
在本公开的一些实施例中,在每层搁架上设置至少一个托盘,所述托盘具有设定识别码且用于放置预定品类的货品,每个托盘底部设置至少一个称重装置,所述称重装置用于采集对应托盘上货品的重量。
在本公开的一些实施例中,所述无人售货设备还包括:用户信息读取装置,所述用户信息读取装置与所述处理装置相连,用于读取用户信息。
在本公开的一些实施例中,所述无人售货设备还包括:监控装置,所述监控装置安装于所述设备本体的外部,用于监控用户使用环境。
在本公开的一些实施例中,所述监控装置包括:摄像模块,所述摄像模块与所述处理装置相连,用于在检测到触发信号时采集用户和环境图像;触发模块,所述触发模块与所述摄像模块相连,用于在检测到用户触发指令时发出所述触发信号。
为了达到上述目的,本公开第四方面实施例提出了一种无人售货系统,包括:无人售货设备,所述无人售货设备包括:设备本体、门体,安装在所述设备本体内的至少一层搁架;称重装置,所述称重装置设置在所述搁架底部,用于采集售货前后所述搁架上货品的重量;摄像装置,用于采集售货前后所述搁架上货品的图像;通信装置和处理装置,所述处理装置分别与所述称重装置、所述摄像装置和所述通信装置相连,所述通信装置用于上传所述售货前后所述搁架上货品的重量和所述售货前后所述搁架上货品的图像;提示装置,所述提示装置与所述处理装置相连,用于根据提示控制信号进行报警提示;服务器,所述服务器根据所述售货前后所述搁架上货品的重量的变化获得第一售货信息,并识别所述售货前后所述搁架上货品的图像以获得第二售货信息,根据所述第一售货信息和所述第二售货信息确定最终售货信息,以及确认售货前后所述搁架上货品增加,发送所述提示控制信号。
本公开实施例的无人售货系统,基于无人售货设备和服务器,不依赖于货品的RFID标签,根据售货前后货品的重量的变化以及图像识别来判断货品是否被错放或被置换,并通过提示装置及时进行报警提示,可以保证后续售货流程的正确执行,保障商家和用户的利益,成本低,更加易于普及。
附图说明
图1是根据本公开实施例的无人售货设备的售货方法的流程图;
图2是根据本公开的一个实施例的无人售货设备的售货方法的流程图;
图3是根据本公开的一个实施例的无人售货设备的售货方法的流程图;
图4是根据本公开实施例的无人售货设备的框图;
图5是根据本公开的一个实施例的无人售货设备的前视图;
图6是针对图5的无人售货设备的侧视图;
图7是根据本公开的一个实施例的称重托盘上货品重量的示意图;
图8是根据本公开的一个实施例的无人售货设备与服务器通信的框图;以及
图9是根据本公开实施例的无人售货系统的框图。
附图标记:
无人售货系统1000;
无人售货设备100和服务器200;
本体10,门体20,搁架30,称重装置40,提示装置50,处理装置60,摄像装置70,红外感测装置80,用户信息读取装置90,监控装置91,托盘31;
锁12,电源模块14,通信模块15,开关模块16,负载控制装置17;
摄像模块911和触发模块912。
具体实施方式
下面详细描述本公开的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本公开,而不能理解为对本公开的限制。
下面参照附图描述根据本公开第一方面实施例的无人售货设备的售货方法。在本公开的实施例中,无人售货设备包括设备本体、门体、安装在设备本体内的至少一层搁架和称重装置摄像装置,其中,搁架上可以放置货品,或者,在搁架上设置托盘,将货品放置在对应托盘上。在实施例中,需要将同品类的货品放置在统一的位置例如预定搁架或者预定托盘。
图1是根据本公开实施例的无人售货设备的售货方法的流程图,如图1所示,本公开实施例的无人售货设备的售货方法包括:
S1,采集售货前后搁架上货品的重量。
在一些实施例中,用户可以通过扫码或其他方式开锁,无人售货设备通过用户信息读取模块获取用户的信息,服务器核对用户信息,并在确认之后发送开锁指令至无人售货设备,无人售货设备的主控模块接收到开锁指令之后控制门锁开启,此时用户可以进行选货,用户选货结束后,主动关闭设备门锁,主控模块检测到关门信号后控制门锁关闭,并进行售货货品的识别和支付控制等流程。
具体地,通过称重装置采集每层搁架上货品的重量,并传输至处理装置,处理装置记录用户取货之前搁架上货品的重量,并在用户取货之后记录售货后搁架上货品的重量。对于搁架上设置托盘的情况,则采集用户取货前后每个托盘上货品的重量。
S2,计算售货前搁架上货品的重量与售货后搁架上货品的重量的变化差值。
在本公开的实施例中,对于直接将货品分类放置于搁架上的情况,获得售货前后每层搁架上货品的重量变化,对于搁架上安装托盘的情况,可以获得售货前后每个托盘上货品的重量变化。
S3,如果变化差值小于第一重量变化阈值,则进行报警提示。
其中,第一重量变化阈值小于或等于零,即售货后搁架上后的重量比售货前搁架上货品的重量大,售货后搁架上货品重量增加。
在本公开的实施例中,如果售货前后搁架上货品的重量的变化差值小于第一重量变化阈值,则判定用户可能将不是某个搁架或托盘的货品放置在了该搁架或托盘,可能是将其他搁架或托盘上的货品放错,或者,也可能用户放入了新的货品,此时,进行报警提示,可以提示用户将货品摆放到正确的位置,同时可以发送报警信息给后台工作人员,以便于调用开门后的全程视频,进一步确认是否发生用户故意破坏、置换商品等不良行为。
根据本公开实施例的无人售货设备的售货方法,不依赖于货品的RFID标签,根据售货前后货品的重量的变化来判断货品是否被错放或被置换,并及时进行报警提示,可以保证后续售货流程的正确执行,保障商家和用户的利益,方法简单易普及。
在本公开的一些实施例中,无人售货设备还可以设置摄像装置,摄像装置可以安装在设备本体内,用于采集搁架上货品的图像。如图2所示,本公开实施例的无人售货设备的售货方法还包括:
S4,采集售货前后搁架上货品的图像。
具体地,通过摄像装置采集设备本体内的图像,记录用户取货前后搁架上货品的图像。
S5,根据图像判断售货前后搁架上货品的变化。
具体地,对图像进行识别,根据售货前后的图像,可以判断售货后,搁架上货品增加或减少或没有变化,以及,在售货后图像变化时还可以识别变化货品的相关信息,例如,颜色、种类、名称、体积、数量。
S6,如果根据图像判断售货前后搁架上货品增加,则进行报警提示。
例如,摄像装置接收到工作指令之后,启动摄像功能,拍摄售货后每层例如1-m层搁架上货品的图像并编号D1、D2、D3…Dm,并调用用户取货前即搁架前一次的图像例如编号分别为C1、C2、C3…Cm,进行图像识别,对比售货前搁架上货品的图像与售货后搁架上货品的图像以判断货品是否变化,如果变化则进一步判断m层搁架上货品是增加还是减少。如果根据图像判断售货前后搁架上货品增加,则判定用户可能将货品放错位置,例如放置了非m层搁架上的货品在m层搁架上,有可能是其他搁架上的货品,也有可能是用户放入了新的获评,此时,进行报警提示,可以提示用户第m层搁架上摆放的货品有误,以便于将其摆放至正确位置,使得后续售货流程正确执行,保证用户利益,同时可以发送报警信息给后台工作人员,以调用开门后的全部视频,以进一步确定是否发生用户故意破坏、置换货品等不良行为,保证商家利益。
在本公开的一些实施例中,如果售货前后搁架上货品的重量的变化差值例如设为δn在限定的认为无变化的范围内,例如满足-Kn≤δn≤Kn,其中,-Kn可以为第一重量变化阈值,Kn可以为第二重量变化阈值,则判定用户未从该搁架上取走货品。或者,根据售货前后搁架上货品的图像判断货品没有变化,则认为用户没有从该搁架上取走货品。
在本公开的实施例,还可以结合称重和图像识别来确定货品的错放或置换,下面在实施例中进行说明。
在本公开的一些实施例中,如果售货前后搁架上货品的重量的变化差值大于第二重量变化阈值,其中,第二重量变化阈值大于或等于零,即货品减少了,认为用户取走了该搁架上的一些货品,可以根据变化差值获得第一售货信息。在本公开的实施例中,规定预先按照类别将货品放置在搁架或托盘上,因而,可以根据货品位置确定售货品类,例如,根据货品放置的搁架或托盘,可以根据预存信息获得对应该搁架或托盘上的货品的相关信息例如品类、单位货品重量、单价等,即基于发生重量变化的货品位置可以确定售货品类;以及,根据重量差和售货品类的预设单位货品重量获得售货数量,重量差与该售货品类的预设单位货品重量的商值即为售出品类货品的数量,为了避免该品类货品单位重量的偏差,商值可以四舍五入取其整数值。
在本公开的实施例中,对于搁架上放置托盘的情况,每层搁架上设置至少一个托盘,托盘具有设定识别码且用于放置预定品类的货品,每个托盘底部设置至少一个称重装置。则第一售货信息可以通过以下获得:称重装置检测当前每个托盘的重量值例如设为B1、B2、B3…Bn,托盘的设定识别码为1-m,并调用售货之前每个托盘的重量值例如设为A1、A2…An,计算售货前第n个托盘上货品的重量与售货后第n个托盘上货品的重量之间的重量差例如δn=An-Bn,其中,n小于或等于托盘总数量;如果重量差大于对应第n个托盘的第一限值,第一限值大于零,即售货后第n个托盘上货品的重量减少,则判断用户选购了设定识别码为n的托盘中的货品,预存有各个托盘放置货品的相关信息,根据第n个托盘的设定识别码可以获得售货品类;以及,根据售货前后每个托盘上货品的重量的变化差值和对应托盘的售货品类的预设单位货品重量获得售货数量,售货数量即用户选购的该品类货品的数量,满足:Xn=Zn/δn,Xn为售货数量,Zn为该售货品类的预设单位货品重量,其中,为了避免单位货品重量的偏差,Xn可以四舍五入取其整数值。按照以上将每个托盘的重量信息进行处理以确定用户选购货品。
在本公开的一些实施例中,如果根据图像判断售货前后搁架上货品减少,则根据图像的变化获得第二售货信息。具体地,如果货品减少,则判定用户从第m层搁架上取走货品,并在货品减少时根据图像变化获得减少货品的品类和数量,例如包括但不限于货品的颜色、种类、名称、体积和数量等,也就是用户选择货品的相关信息。
在本公开的实施例中,如果第一售货信息和第二售货信息不一致,则进行报警提示。具体地,如果根据售货前后搁架上货品的重量变化判断的售货品类和数据,与根据图像识别来获得的售货品类和数量不一致,则认为有可能用户将货品放错位置或者置换了货品,此时进行报警提示,可以对用户进行提示,以便于将货品放置至正确的位置,保证后续程 序的正常执行,同时可以发送报警提示信息至后台人员以查看是否发生恶意行为,保证商家利益。
在本公开的实施例中,可以结合称重和图像识别来确定用户的选购信息即售货信息。具体地,如果第一售货信息与第二售货信息一致,则将第一售货信息或第二售货信息确定为最终售货信息。具体地,将通过称重获取的售货信息和通过图像识别获得的售货信息进行比较,例如,比对第m层搁架上第n个托盘上减少的货品数量Xn与图像识别出来减少的货品信息是否一致,如果第一售货信息与第二售货信息一致,则判定用户从m层搁架上取出了第n托盘上的货品,售货数量为Xn,输出用户购买的商品品类、数量和总价格,总价格满足:
Figure PCTCN2019072838-appb-000001
其中,Si为第i个货品的数量,Ki为第i个货品的单价,n为托盘的总个数,并通知服务器,进行金额结算。
在本公开的实施例中,计算货品的数量以及图像识别比对的运算过程,可以是在本地进行数据信息获取后,发送数据至服务器,经云端进行重量计算和图像识别后,再发送售货种类和数据信息至支付系统,进行扣款后,再传送货品品类、数量和价格至本地,进行输出。也可以是由本地进行计算货品的数量以及图像识别比对的运算数据处理,再发送结果至云端支付系统,进行扣款之后,再传送货品品类、数量和价格至本地,进行输出。
基于上述说明,如图3所示,为根据本公开的一个实施例的无人售货设备的售货方法的流程图,包括:
S100,判断是否检测到关门信号,如果是,分别进入步骤S110和S170,否则继续本步骤。
S110,检测当前每个托盘的重量值B1、B2、B3…Bn.
S120,调用每个托盘前一次重量A1、A2、A3…An,判断是否满足δn=An-Bn>Kn,Kn为每个托盘上货品的标准重量Zn与实测重量之间的允许误差。如果满足,则进入步骤S130,否则进入步骤S140。
S130,调用托盘n上的单个货品重量Zn,计算出售货数量Xn=Zn/δn.
S140,判断是否满足-Kn≤δn≤Kn,如果满足,则结束,不满足则进入步骤S210。
S150,比对第m层搁架上第n个托盘上减少的货品数量Xn与图像识别出来减少的货品数量是否一致,如果一致,则进入步骤S160,否则进入步骤S210。
S160,输出用户购买的货品品类和数量,每个货品的数量乘以单间,并累加计算总价,进行扣款。
S170,拍摄当前每层搁架上的图像并编号D1、D2、D3…Dn。
S180,调用每层搁架前一次图像C1、C2、C3…Cn,并进行图像比对,判断m层搁架上 是否有货品变化,如果有则进入步骤S190,否则结束。
S190,判断m层搁架上货品是否减少,如果有减少,识别减少货品的颜色、品类、名称、体积和数量等售货信息,并进入步骤S150。否则,进入步骤S200。
S200,启动提示装置,提示用户第m层搁架上摆放的货品有误,请将其摆放至正确位置,同时可以发送报警信息至后台人员,以调用开门后的全程视频,确认用户是否有破坏、置换货品等不良行为。
S210,启动提示装置,提示用户第m层搁架第n个托盘上摆放货品有误,请将其摆放至正确位置,同时可以发送报警信息至后台人员,以调用开门后的全程视频,确认用户是否有破坏、置换货品等不良行为。
根据本公开实施例的无人售货设备的售货方法,通过称重装置进行检测货品的重量变化,可以自行进行价格核算,同时通过摄像装置采集货品图像,通过图像识别来辅助检验,及时判断和发现放错或置换货品,避免商家损失,安全可靠,简单易实施,提升用户体验。
在本公开的一些实施例中还提出一种非临时性计算机可读存储介质,其上存储有计算机程序,计算机程序被执行时实现第一方面实施例的无人售货设备的售货方法。
下面参照附图描述根据本公开第二方面实施例的无人售货设备。
图4是根据本公开实施例的无人售货设备的框图,图5是根据本公开的一个实施例的无人售货设备的前视图,图6是针对图5的无人售货设备的侧视图,参见图4-6所示,本公开实施例的无人售货设备100包括设备本体10、门体20,安装在设备本体10内的至少一层搁架30、称重装置40、提示装置50和处理装置60。其中,门体20可以为透明,便于看见设备本体10内的货品;以及,还包括安装于门体20上可以开关门体20的门把手11、由处理装置60控制可以保持门体关闭的锁12,锁12的主体部分安装在设备本体10上,锁扣安装在门体20上。
称重装置40设置在搁架30底部,用于采集售货前后搁架30上货品的重量;处理装置60与称重装置40相连,用于计算售货前搁架30上货品的重量与售货后搁架30上货品的重量的变化差值,并在变化差值小于第一重量变化阈值时发出提示控制信号,其中,第一重量变化阈值小于或等于零,即售货后搁架上后的重量比售货前搁架上货品的重量大,售货后搁架上货品重量增加。
提示装置50与处理装置60相连,用于根据提示控制信号进行报警提示。
在本公开的实施例中,如果售货前后搁架上货品的重量的变化差值小于第一重量变化阈值,则判定用户可能将不是某个搁架或托盘的货品放置在了该搁架或托盘,可能是将其他搁架或托盘上的货品放错,或者,也可能用户放入了新的货品,此时,进行报警提示, 可以提示用户将货品摆放到正确的位置,同时可以发送报警信息给后台工作人员,以便于调用开门后的全程视频,进一步确认是否发生用户故意破坏、置换商品等不良行为。
根据本公开实施例的无人售货设备100,不依赖于货品的RFID标签,通过称重装置40采集售货前后搁架30上货品的重量,处理装置60根据售货前后货品的重量的变化来判断货品是否被错放或被置换,并通过提示装置60及时进行报警提示,可以保证后续售货流程的正确执行,保障商家和用户的利益,成本低,更加易于普及。
在本公开的一些实施例中,如图5或6所示,本公开实施例的无人售货设备100还包括摄像装置70,摄像装置70与处理装置60相连,用于采集售货前后搁架上货品的图像;处理装置60还用于根据图像判断售货前后搁架30上货品的变化,并在根据图像判断售货前后搁架30上货品增加时发出提示控制信号,提示装置50进行报警提示。具体地,根据图像判断售货前后搁架30上货品重量增加时,认为用户将货品错放或置换或其他不良行为,及时进行报警提示,可以避免商家损失,提高购物安全。
在本公开的实施例中,处理装置60还用于,在售货前后搁架30上货品的重量的变化差值大于第二重量变化阈值时,其中,第二重量变化阈值大于或等于零,即货品重量减少,则判定用户取走该搁架30的货品,根据变化差值获得第一售货信息。具体地,在实施例中,规定预先按照类别将货品放置在搁架30或托盘上,因而,可以根据货品位置确定售货品类,例如,根据货品放置的搁架30或托盘,可以根据预存信息获得对应该搁架30或托盘上的货品的相关信息例如品类、单位货品重量、单价等,即基于发生重量变化的货品位置可以确定售货品类;以及,根据重量差和售货品类的预设单位货品重量获得售货数量,重量差与该售货品类的预设单位货品重量的商值即为售出品类货品的数量,为了避免该品类货品单位重量的偏差,商值可以四舍五入取其整数值。
在本公开的实施例中,对于搁架30上放置托盘的情况,如图5所示,每层搁架30上设置至少一个托盘31,托盘31具有设定识别码且用于放置预定品类的货品,每个托盘31底部设置至少一个称重装置40。
如图7所示,为根据本公开的一个实施例的称重装置采集托盘上货品重量的示意图,每层搁架30摆放至少一个托盘31,例如搁架1包括托盘1-托盘4,并给每个托盘31进行不同序号编码,每个托盘31底部摆放至少一个称重装置40例如压力传感器,例如包括称重装置1-称重装置4。每个托盘31上摆放的商品仅为一种品类和重量,不允许同一个托盘31内摆放同一重量但不同品类的商品。其中,同一品类的商品的不同实物的实测重量,允许有误差Kn,Kn为每个托盘31上货品的标准重量Zn与实测重量之间的允许误差,0≤Kn≤Zn,Zn为序号为n的托盘31内的单个商品预置的标准重量,Kn的大小可以根据实际情况进行设定,也可以不进行设定,可以默认Kn=0。
处理装置60预存有各个托盘31放置货品的相关信息,根据第n个托盘的设定识别码可以获得售货品类;以及,根据售货前后每个托盘31上货品的重量的变化差值和对应托盘的售货品类的预设单位货品重量获得售货数量,售货数量即用户选购的该品类货品的数量。
在一些实施例中,处理装置60还用于,在根据图像判断售货前后搁架上货品减少时根据图像的变化获得第二售货信息。具体地,如果货品减少,则判定用户从第m层搁架上取走货品,并在货品减少时根据图像变化获得减少货品的品类和数量,例如包括但不限于货品的颜色、种类、名称、体积和数量等,也就是用户选择货品的相关信息。
在本公开的实施例中,处理装置60在第一售货信息和第二售货信息不一致时发出提示控制信号。具体地,如果根据售货前后搁架上货品的重量变化判断的售货品类和数据,与根据图像识别来获得的售货品类和数量不一致,则认为有可能用户将货品放错位置或者置换了货品,此时进行报警提示,可以对用户进行提示,以便于将货品放置至正确的位置,保证后续程序的正常执行,同时可以发送报警提示信息至后台人员以查看是否发生恶意行为,保证商家利益。
在一些实施例中,处理装置60还用于,在第一售货信息与第二售货信息一致时,将第一售货信息或第二售货信息确定为最终售货信息。具体地,将通过称重获取的售货信息和通过图像识别获得的售货信息进行比较,例如,比对第m层搁架上第n个托盘上减少的货品数量Xn与图像识别出来减少的货品信息是否一致,如果第一售货信息与第二售货信息一致,则判定用户从m层搁架上取出了第n托盘上的货品,售货数量为Xn,输出用户购买的商品品类、数量和总价格,总价格满足:
Figure PCTCN2019072838-appb-000002
其中,Si为第i个货品的数量,Ki为第i个货品的单价,n为托盘的总个数,并通知服务器,进行金额结算。
在本公开的实施例中,如图8所示为根据本公开的一个实施例的无人售货设备的框图,无人售货设备100还包括设置在设备本体10内的红外感测装置80,红外感测装置80与处理装置60相连,处理装置60在红外感测装置80检测到手离开时,控制称重装置40和摄像装置70启动;或者,处理装置60在检测到开门信号或关门信号时控制称重装置40和摄像装置70启动。
在一些实施例中,摄像装置70的启动的触发信号为关门信号时,可以拍摄静态图像,并上传至处理装置60,处理装置60进行图像处理,对比两次连续关门信号时拍摄的各层搁架30的静态图片,进而确认用户取走的货品;如果摄像装置70的启动触发信号为开门信号,在检测到开门信号时,摄像装置70可以进行动态拍摄视频,用以监控用户购物期间的行为,当有报警信号时,确认是够有破坏、置换货品等不良行为,以排查警报原因。
在一些实施例中,摄像装置70设置在门体20内部,用于拍摄搁架30上货品的图像或 视频,也可以用于在门体20开启之后对用户行为进行监控。其中,可以在每层搁架30的对应门体位置或者搁架30的上方或左侧或右侧或右上角或左上角设置至少一个摄像装置70,或者,由一个摄像装置70采集多层搁架上货品的图像。
在本公开的实施例中,重量变化判定和图像比对的步骤可以同时进行,也可以按照前后顺序有所调整。例如,在开门时拍照或者视频,关门拍摄并检测重量变化;也可以是,在关门时同时进行拍照和检测重量变化;还可以是在关门后,先检测重量变化,若有变化,再检查图像识别的结果,判断是否有变化;还可以是,先通过图像识别判断图像有变化,再调出重量变化,以判断数量的变化。
在一些实施例中,如图8所示,无人售货设备100还包括用户信息读取装置90,用户信息读取装置90与处理装置60相连,用于读取用户信息,便于进行购买支付。例如,采用智能移动终端扫描二维码;或者,采集用户的生物体征信息例如用户的指纹信息、掌纹信息、掌静脉信息、指静脉信息、眼虹膜信息或者人脸信息。
在本公开的一些实施例中,如图8所示,本公开实施例的无人售货设备100还包括监控装置91,监控装置91安装于设备本体10的外部,用于监控用户使用环境。具体来说,如图8所示,监控装置91可以包括摄像模块911和触发模块912。摄像模块911与处理装置60相连,用于在检测到触发信号时采集用户和环境图像;触发模块912与摄像模块911相连,用于在检测到用户触发指令时发出触发信号。在一些实施例中,触发模块912可以包括红外感应传感器、语音识别模块和触发模块中的至少一种。
作为示例,摄像模块911安装在设备本体10的外部,配合触发模块启动工作。例如,触发摄像模块911工作的信号若是红外感应传感器,则当红外感应传感器检测到有人到来时,启动摄像模块911进行人脸识别;如果触发摄像模块911工作的信号是语音识别模块,则当人来到设备本体10前时,以某个关键词唤醒系统,进行语音识别、人脸识别、拍摄等;触发摄像模块911工作的信号若是按钮,则当人启动按钮时,进行语音识别、人脸识别、拍摄等。
在本公开的一些实施例中,参见图4-8所示,无人售货设备100还可以设置灯组件13,灯组件13可以由多组照明灯组成,用于摄像装置70拍摄过程中光线不足时的补光。以及,通过电源模块14进行供电,通过通信模块15传输数据,还可以设置开关模块16,负载控制装置17连接处理装置60即无人售货设备100的主控模块,负载控制装置17可以控制锁12的开关、照明灯的开关、摄像装置70的开关和制冷系统的电器件工作。处理装置70可以通过网络与云端服务器200进行通信。
概括来说,本公开实施例的无人售货设备100,相比于普通的售货设备,可以一次取出多个货品,用户操作简单,体验好,相比于RFID标签识别,成本低,可以为用户带来便 利的生活,同时为商家节省成本。
在本公开的实施例中,数据计算和图像识别的过程,可以由无人售货设备的处理装置实现本地处理,如上述第二方面实施例的无人售货设备,也可以由服务器实现。如图9所示,为根据本公开实施例的无人售货系统,本公开实施例的无人售货系统1000包括无人售货设备100和服务器200。
其中,无人售货设备100包括设备本体、门体,安装在设备本体内的至少一层搁架、称重装置、摄像装置、通信装置、处理装置和提示装置。其中,称重装置设置在搁架底部,用于采集售货前后搁架上货品的重量;摄像装置用于采集售货前后搁架上货品的图像;处理装置分别与称重装置、摄像装置和通信装置相连,通信装置用于上传售货前后搁架上货品的重量和售货前后搁架上货品的图像;提示装置与处理装置相连,用于根据提示控制信号进行报警提示。
服务器200根据售货前后搁架上货品的重量的变化获得第一售货信息,并识别售货前后搁架上货品的图像以获得第二售货信息,根据第一售货信息和第二售货信息确定最终售货信息,以及在判断售货前后搁架上货品增加时发送提示控制信号,可以及时对货品错放或被置换的情况进行提醒,保证后续售货流程的正确执行,保障商家和用户的利益,成本低,更加易于普及。
另外,本公开实施例的无人售货系统1000,可以通过扫码开门,用户随意选取货品,通过安全便捷的无密支付,交易简单,使用方便,体验好;并且,可以自动识别、自动交易,不改变用户的购物习惯,无需对货品进行任何改造或附带标签,不额外增加货品成本;通过称重装置进行自动核算售货信息,并通过图像识别进行辅助确认,双重确定更加安全可靠。
本公开实施例的无人售货系统1000,基于无人售货设备100和服务器200,不依赖于货品的RFID标签,根据售货前后货品的重量的变化以及图像识别来判断货品是否被错放或被置换,并通过提示装置及时进行报警提示,可以保证后续售货流程的正确执行,保障商家和用户的利益,成本低,更加易于普及。
需要说明的是,在本说明书的描述中,流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本公开的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本公开的实施例所属技术领域的技术人员所理解。
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令 执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,“计算机可读介质”可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。
应当理解,本公开的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本公开的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
尽管上面已经示出和描述了本公开的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本公开的限制,本领域的普通技术人员在本公开的范围内可以对上述实施例进行变化、修改、替换和变型。

Claims (17)

  1. 一种无人售货设备的售货方法,其特征在于,所述无人售货设备包括设备本体、门体、安装在所述设备本体内的至少一层搁架和称重装置,所述售货方法包括:
    采集售货前后所述搁架上货品的重量;
    检测并确认重量的变化差值小于第一重量变化阈值,进行报警提示,其中,所述重量的变化差值为售货前所述搁架上货品的重量与售货后所述搁架上货品的重量的变化差,所述第一重量变化阈值小于或等于零。
  2. 如权利要求1所述的无人售货设备的售货方法,其特征在于,所述无人售货设备还包括摄像装置,所述售货方法还包括:
    采集售货前后所述搁架上货品的图像;
    根据所述图像检测并确认所述售货前后所述搁架上货品增加,进行报警提示。
  3. 如权利要求2所述的无人售货设备的售货方法,其特征在于,
    确认所述重量的变化差值大于第二重量变化阈值,根据所述重量的变化差值获得第一售货信息,其中,所述第二重量变化阈值大于或等于零;
    根据所述图像检测并确认售货前后所述搁架上货品减少,根据所述图像的变化获得第二售货信息;
    确认所述第一售货信息和所述第二售货信息不一致,进行报警提示。
  4. 如权利要求3所述的无人售货设备的售货方法,其特征在于,
    确认所述第一售货信息与所述第二售货信息一致,将所述第一售货信息或所述第二售货信息确定为最终售货信息。
  5. 如权利要求3所述的无人售货设备的售货方法,其特征在于,所述根据所述重量的变化差值获得第一售货信息,包括:
    根据货品位置确定售货品类;以及,
    根据所述重量的变化差值和所述售货品类的预设单位货品重量获得售货数量。
  6. 如权利要求1所述的无人售货设备的售货方法,其特征在于,每层搁架上设置至少一个托盘,所述托盘具有设定识别码且用于放置预定品类的货品,每个托盘底部设置至少一个称重装置,所述根据所述变化差值获得第一售货信息,包括:
    根据托盘的设定识别码获得售货品类;
    根据售货前后每个托盘上货品的重量的变化差值和对应托盘的售货品类的预设单位货品重量获得售货数量。
  7. 一种非临时性计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计 算机程序被执行时实现如权利要求1-6中任一项所述的无人售货设备的售货方法。
  8. 一种无人售货设备,其特征在于,所述无人售货设备包括:
    设备本体、门体,安装在所述设备本体内的至少一层搁架;
    称重装置,所述称重装置设置在所述搁架底部,用于采集售货前后所述搁架上货品的重量;
    处理装置,所述处理装置与所述称重装置相连,用于计算售货前所述搁架上货品的重量与售货后所述搁架上货品的重量的变化差值,所述变化差值小于第一重量变化阈值发出提示控制信号,其中,所述第一重量变化阈值小于或等于零;
    提示装置,所述提示装置与所述处理装置相连,用于根据所述提示控制信号进行报警提示。
  9. 如权利要求8所述的无人售货设备,其特征在于,所述无人售货设备还包括:
    摄像装置,所述摄像装置与所述处理装置相连,用于采集售货前后所述搁架上货品的图像;
    所述处理装置,还用于根据所述图像检测并确认所述售货前后所述搁架上货品增加,发出所述提示控制信号。
  10. 如权利要求9所述的无人售货设备,其特征在于,所述处理装置还用于,所述重量的变化差值大于第二重量变化阈值,根据所述重量的变化差值获得第一售货信息,并根据所述图像检测并确认售货前后所述搁架上货品减少,根据所述图像的变化获得第二售货信息,以及,所述第一售货信息和所述第二售货信息不一致,发出所述提示控制信号,其中,所述第二重量变化阈值大于或等于零。
  11. 如权利要求10所述的无人售货设备,其特征在于,所述处理装置还用于,所述第一售货信息与所述第二售货信息一致,将所述第一售货信息或所述第二售货信息确定为最终售货信息。
  12. 如权利要求9所述的无人售货设备,其特征在于,所述无人售货设备还包括:
    设置在所述设备本体内的红外感测装置,所述红外感测装置与所述处理装置相连,所述处理装置在所述红外感测装置检测到手离开时,控制所述称重装置和所述摄像装置启动;
    或者,所述处理装置在检测到开门信号或关门信号时控制所述称重装置和所述摄像装置启动。
  13. 如权利要求8所述的无人售货设备,其特征在于,
    在每层搁架上设置至少一个托盘,所述托盘具有设定识别码且用于放置预定品类的货品,每个托盘底部设置至少一个称重装置,所述称重装置用于采集对应托盘上货品的重量。
  14. 如权利要求10所述的无人售货设备,其特征在于,所述无人售货设备还包括:
    用户信息读取装置,所述用户信息读取装置与所述处理装置相连,用于读取用户信息。
  15. 如权利要求10或14所述的无人售货设备,其特征在于,所述无人售货设备还包括:
    监控装置,所述监控装置安装于所述设备本体的外部,用于监控用户使用环境。
  16. 如权利要求15所述的无人售货设备,其特征在于,所述监控装置包括:
    摄像模块,所述摄像模块与所述处理装置相连,用于在检测到触发信号时采集用户和环境图像;
    触发模块,所述触发模块与所述摄像模块相连,用于在检测到用户触发指令时发出所述触发信号。
  17. 一种无人售货系统,其特征在于,包括:
    无人售货设备,所述无人售货设备包括:
    设备本体、门体,安装在所述设备本体内的至少一层搁架;
    称重装置,所述称重装置设置在所述搁架底部,用于采集售货前后所述搁架上货品的重量;
    摄像装置,用于采集售货前后所述搁架上货品的图像;
    通信装置和处理装置,所述处理装置分别与所述称重装置、所述摄像装置和所述通信装置相连,所述通信装置用于上传所述售货前后所述搁架上货品的重量和所述售货前后所述搁架上货品的图像;
    提示装置,所述提示装置与所述处理装置相连,用于根据提示控制信号进行报警提示;
    服务器,所述服务器根据所述售货前后所述搁架上货品的重量的变化获得第一售货信息,并识别所述售货前后所述搁架上货品的图像以获得第二售货信息,根据所述第一售货信息和所述第二售货信息确定最终售货信息,以及确认售货前后所述搁架上货品增加,发送所述提示控制信号。
PCT/CN2019/072838 2018-02-08 2019-01-23 无人售货设备及其售货方法和无人售货系统 WO2019154087A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2020540530A JP2021513140A (ja) 2018-02-08 2019-01-23 無人販売機器、販売方法及び無人販売システム
US16/966,435 US11501594B2 (en) 2018-02-08 2019-01-23 Vending machine and vending method and vending system therefor
EP19751985.3A EP3751530A4 (en) 2018-02-08 2019-01-23 SALES MACHINE AND SALES PROCEDURE AND SALES SYSTEM FOR IT
SG11202006589YA SG11202006589YA (en) 2018-02-08 2019-01-23 Vending machine and vending method and vending system therefor
PH12020551196A PH12020551196A1 (en) 2018-02-08 2020-08-06 Vending machine and vending method and vending system therefor

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201820228875.0U CN208156770U (zh) 2018-02-08 2018-02-08 无人售货设备和无人售货系统
CN201820228875.0 2018-02-08
CN201810130405.5 2018-02-08
CN201810130405.5A CN108335406A (zh) 2018-02-08 2018-02-08 无人售货设备及其售货方法和无人售货系统

Publications (1)

Publication Number Publication Date
WO2019154087A1 true WO2019154087A1 (zh) 2019-08-15

Family

ID=67549211

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/072838 WO2019154087A1 (zh) 2018-02-08 2019-01-23 无人售货设备及其售货方法和无人售货系统

Country Status (6)

Country Link
US (1) US11501594B2 (zh)
EP (1) EP3751530A4 (zh)
JP (1) JP2021513140A (zh)
PH (1) PH12020551196A1 (zh)
SG (1) SG11202006589YA (zh)
WO (1) WO2019154087A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112634524A (zh) * 2020-12-18 2021-04-09 江苏生花汇享科技有限公司 一种称重式无人售货设备的称重纠错方法
KR20210141234A (ko) * 2020-05-15 2021-11-23 하나시스 주식회사 무인판매 시스템
CN114495353A (zh) * 2022-02-16 2022-05-13 拉扎斯网络科技(上海)有限公司 信息显示方法、装置、电子设备及存取柜
JP7512878B2 (ja) 2020-12-18 2024-07-09 トヨタ自動車株式会社 情報処理装置、及び、情報処理方法

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108389316B (zh) * 2018-03-02 2021-07-13 北京京东尚科信息技术有限公司 自动售货方法、装置和计算机可读存储介质
US11837044B2 (en) 2019-11-18 2023-12-05 Skoopin System and method for nutrition tracking
US20210383341A1 (en) * 2019-11-18 2021-12-09 Jun Wang Self-checkout method and apparatus for unpackaged products
US11694501B2 (en) 2020-02-17 2023-07-04 True Manufacturing Co., Inc. Refrigerated vending system and method
CN113574337A (zh) * 2020-02-27 2021-10-29 松下知识产权经营株式会社 收纳库
US11632258B1 (en) * 2020-04-12 2023-04-18 All Turtles Corporation Recognizing and mitigating displays of unacceptable and unhealthy behavior by participants of online video meetings
CN111765956B (zh) * 2020-06-30 2021-09-24 三一汽车制造有限公司 料仓物料称重称量方法、料仓、装置和计算机可读存储介质
JP2022134301A (ja) * 2021-03-03 2022-09-15 サンデン・リテールシステム株式会社 自動販売機
US11922386B2 (en) * 2021-03-12 2024-03-05 Amazon Technologies, Inc. Automated and self-service item kiosk
JP2023036472A (ja) * 2021-09-02 2023-03-14 日立グローバルライフソリューションズ株式会社 商品入れ替え提案システム、および、収納庫
PL443951A1 (pl) * 2023-02-25 2024-08-26 Hemitech Spółka Z Ograniczoną Odpowiedzialnością Regał do automatów automatycznie wydających towary
PL443950A1 (pl) * 2023-02-25 2024-08-26 Hemitech Spółka Z Ograniczoną Odpowiedzialnością Regał do automatów automatycznie wydających towary, zasobnik i półkozasobnik do tego regału

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120120327A1 (en) * 2010-11-12 2012-05-17 Marx David L Electronic Retail Shelf Pricing and Promotional Display Modular System
CN105427459A (zh) * 2014-09-17 2016-03-23 黄浩庭 一种自助售货方法其及自助售货机
CN106920152A (zh) * 2017-03-07 2017-07-04 深圳市楼通宝实业有限公司 自助售卖方法及系统
CN107274555A (zh) * 2017-06-06 2017-10-20 深圳正品创想科技有限公司 自动售货方法、装置及系统
CN107481414A (zh) * 2017-08-21 2017-12-15 文彬 一种开放式无人售卖装置的实时导购方法及系统
CN108335406A (zh) * 2018-02-08 2018-07-27 合肥美的智能科技有限公司 无人售货设备及其售货方法和无人售货系统

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6707381B1 (en) 2001-06-26 2004-03-16 Key-Trak, Inc. Object tracking method and system with object identification and verification
US20070050271A1 (en) 2003-07-11 2007-03-01 Rf Code, Inc. Presence, pattern and weight sensor surface
WO2005015510A1 (en) * 2003-07-29 2005-02-17 Minibar Ag Computerised-sensing system for a mini bar
JP2009169760A (ja) * 2008-01-17 2009-07-30 Toshiba Tec Corp 商品陳列装置
CN103026391B (zh) * 2010-06-04 2016-08-10 百事可乐公司 用于工作场所或受控环境的联网售卖机
US10378956B2 (en) 2011-03-17 2019-08-13 Triangle Strategy Group, LLC System and method for reducing false positives caused by ambient lighting on infra-red sensors, and false positives caused by background vibrations on weight sensors
US9536236B2 (en) * 2012-06-08 2017-01-03 Ronny Hay Computer-controlled, unattended, automated checkout store outlet and related method
US9349238B2 (en) * 2013-03-13 2016-05-24 Pantry Retail, Inc. Vending kit and method
CN108038973A (zh) * 2013-04-08 2018-05-15 罗尼·哈伊 计算机控制的、无人值守的自动结账零售店
US10268983B2 (en) 2013-06-26 2019-04-23 Amazon Technologies, Inc. Detecting item interaction and movement
US9224124B2 (en) * 2013-10-29 2015-12-29 Mobile Aspects, Inc. Item storage and tracking cabinet and arrangement
DE102013222263A1 (de) * 2013-10-31 2015-04-30 Adolf Würth GmbH & Co. KG Warenbestandsverwaltungssystem
US10810540B1 (en) * 2015-03-30 2020-10-20 Amazon Technologies, Inc. Item determination based on weight data
GB2565707A (en) 2016-05-27 2019-02-20 Walmart Apollo Llc Systems and methods for arranging sensors to monitor merchandise conditions at or near shelves
EP3555825A4 (en) * 2016-12-13 2019-11-27 Viatouch Media Inc. METHOD AND APPLICATIONS FOR CONSUMER INTERACTION WITH A SELF-OPERATING SYSTEM
US10282720B1 (en) * 2018-07-16 2019-05-07 Accel Robotics Corporation Camera-based authorization extension system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120120327A1 (en) * 2010-11-12 2012-05-17 Marx David L Electronic Retail Shelf Pricing and Promotional Display Modular System
CN105427459A (zh) * 2014-09-17 2016-03-23 黄浩庭 一种自助售货方法其及自助售货机
CN106920152A (zh) * 2017-03-07 2017-07-04 深圳市楼通宝实业有限公司 自助售卖方法及系统
CN107274555A (zh) * 2017-06-06 2017-10-20 深圳正品创想科技有限公司 自动售货方法、装置及系统
CN107481414A (zh) * 2017-08-21 2017-12-15 文彬 一种开放式无人售卖装置的实时导购方法及系统
CN108335406A (zh) * 2018-02-08 2018-07-27 合肥美的智能科技有限公司 无人售货设备及其售货方法和无人售货系统

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210141234A (ko) * 2020-05-15 2021-11-23 하나시스 주식회사 무인판매 시스템
KR102377562B1 (ko) 2020-05-15 2022-03-22 하나시스 주식회사 무인판매 시스템
CN112634524A (zh) * 2020-12-18 2021-04-09 江苏生花汇享科技有限公司 一种称重式无人售货设备的称重纠错方法
CN112634524B (zh) * 2020-12-18 2022-07-08 江苏生花汇享科技有限公司 一种称重式无人售货设备的称重纠错方法
JP7512878B2 (ja) 2020-12-18 2024-07-09 トヨタ自動車株式会社 情報処理装置、及び、情報処理方法
CN114495353A (zh) * 2022-02-16 2022-05-13 拉扎斯网络科技(上海)有限公司 信息显示方法、装置、电子设备及存取柜
CN114495353B (zh) * 2022-02-16 2023-09-22 拉扎斯网络科技(上海)有限公司 信息显示方法、装置、电子设备及存取柜

Also Published As

Publication number Publication date
EP3751530A4 (en) 2021-12-08
JP2021513140A (ja) 2021-05-20
EP3751530A1 (en) 2020-12-16
PH12020551196A1 (en) 2021-08-16
US11501594B2 (en) 2022-11-15
US20210035399A1 (en) 2021-02-04
SG11202006589YA (en) 2020-08-28

Similar Documents

Publication Publication Date Title
WO2019154087A1 (zh) 无人售货设备及其售货方法和无人售货系统
CN108460908A (zh) 自动售货方法和系统以及自动售货装置和自动贩售机
CN108335406A (zh) 无人售货设备及其售货方法和无人售货系统
WO2019161734A1 (zh) 无人售货设备及其售货方法和无人售货系统
US20120284132A1 (en) Display device attachable to shopping carts, shopping cart, and digital signage display
WO2019196500A1 (zh) 无人零售系统及其控制方法、售货装置和云服务器
CN108346221B (zh) 无人售货设备及其售货方法和无人售货系统
US10832311B2 (en) Method and medium for shopping in a physical store
WO2019184646A1 (zh) 货品识别方法及装置、货柜
US20210183212A1 (en) Skip-scanning identification method, apparatus, and self-service checkout terminal and system
RU2739542C1 (ru) Система автоматической регистрации для торговой точки
CN208156770U (zh) 无人售货设备和无人售货系统
US11908288B2 (en) Imaging used to reconcile cart weight discrepancy
WO2019165895A1 (zh) 自动售货方法和系统以及自动售货装置和自动贩售机
KR20120124198A (ko) 코드 리더를 탑재할 수 있는 카트 및 마트내에 위치한 디지털 싸이니지를 제어하는 방법
CN107945392B (zh) 自动售货机及采集证据的方法以及存储介质
US20200226544A1 (en) Dispensing and tracking system
CN109671227B (zh) 智能货柜消费行为识别方法、装置、存储介质和电子设备
CN109993891A (zh) 称重式智能货柜的控制方法
US10762557B2 (en) Shopping cart
CN209416390U (zh) 一种智能无人售货装置
CN104778618A (zh) 一种购物储物设备
CN208433046U (zh) 自动贩售机和自动售货系统
JP2022138779A (ja) 情報処理装置、商品受け渡し方法、及び商品受け渡しプログラム
CN110164031A (zh) 自动售货机

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19751985

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020540530

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019751985

Country of ref document: EP

Effective date: 20200908