WO2021238646A1 - 货架系统及控制方法 - Google Patents

货架系统及控制方法 Download PDF

Info

Publication number
WO2021238646A1
WO2021238646A1 PCT/CN2021/093178 CN2021093178W WO2021238646A1 WO 2021238646 A1 WO2021238646 A1 WO 2021238646A1 CN 2021093178 W CN2021093178 W CN 2021093178W WO 2021238646 A1 WO2021238646 A1 WO 2021238646A1
Authority
WO
WIPO (PCT)
Prior art keywords
display panel
shelf
touch display
shelf system
transparent
Prior art date
Application number
PCT/CN2021/093178
Other languages
English (en)
French (fr)
Inventor
牛汉章
栗首
苏俊宁
闫恒宇
Original Assignee
京东方科技集团股份有限公司
北京京东方显示技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方显示技术有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US17/761,533 priority Critical patent/US20230076584A1/en
Publication of WO2021238646A1 publication Critical patent/WO2021238646A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F9/00—Details other than those peculiar to special kinds or types of apparatus
    • G07F9/02—Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus
    • G07F9/023—Arrangements for display, data presentation or advertising
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00896—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys specially adapted for particular uses
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F11/00—Coin-freed apparatus for dispensing, or the like, discrete articles
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F9/00—Details other than those peculiar to special kinds or types of apparatus
    • G07F9/10—Casings or parts thereof, e.g. with means for heating or cooling

Definitions

  • This application relates to the technical field of product display, in particular to a shelf system and control method.
  • vending machines are a new form of commercial retail.
  • vending machines usually display internal goods through transparent glass cabinets, and use QR code scanning to realize mobile payment and realize goods transactions.
  • the vending machine of this kind of structure has a single structure and a large volume, which cannot meet the market needs of the vending machine with diverse structures, compactness and lightness, and diversified interaction and payment methods.
  • This application provides a shelf system, which includes:
  • a shelf body the shelf body including a storage space
  • the image acquisition component is installed on the shelf body
  • the transparent touch display panel is installed on the shelf body and covers at least a part of the storage space. Through the transparent touch display panel, the light incident on the side away from the shelf body can be transmitted to the shelf The interior of the space
  • a controller connected to the transparent touch display panel and the image acquisition element, and the controller is configured to acquire the image information collected by the image acquisition element and acquire the touch on the transparent touch display panel Operation, according to the image information and the touch operation, outputting a display signal of the transparent touch display panel and/or a control signal corresponding to the touch operation.
  • the shelf system wherein the shelf system further includes a door body, the first side of the door body and the shelf body are connected by a rotating shaft, and the second side of the door body is connected to the The shelf body is connected by an electric lock;
  • the controller is specifically configured to output a control signal for controlling the opening of the electric lock when the target user is recognized according to the image information and the touch operation on the transparent touch display panel is to open the door.
  • the shelf system wherein the controller is further configured to obtain the open state of the door according to the image acquisition element, and output when it is monitored that the door is switched from open to closed A control signal for controlling the closing of the electric lock, and acquiring image information inside the storage space according to the image acquisition element, and outputting a display signal for displaying an item settlement screen to the transparent touch display panel according to the image information .
  • the shelf system wherein the transparent touch display panel covers the first part of the storage space
  • the shelf system further includes a transparent glass plate, the transparent glass plate covers the first part of the storage space Two parts.
  • the shelf system wherein the display surface of the transparent touch display panel and the outer surface of the transparent glass plate are located on the same plane.
  • the shelf system wherein, when the shelf system further includes a door body installed on the shelf body, the transparent touch display panel and/or the transparent glass plate are installed on the door Physically.
  • the shelf system wherein the shelf system further includes an infrared identification element
  • the controller is also connected to the infrared identification element, and after identifying the human body information according to the infrared identification element, the transparent
  • the touch display panel outputs a display signal for displaying the face recognition interface, and controls the image collection element to start the collection of image information.
  • the shelf system wherein the transparent touch display panel includes a touch display drive chip, and the controller is connected to the touch display drive chip through a signal format conversion unit,
  • the display driver chip outputs display signals.
  • the controller is connected to the image acquisition element through a USB Ethernet adapter and a power-over-Ethernet POE switch in sequence.
  • the image collection element includes at least one web camera installed on the shelf body.
  • the image acquisition element further includes a 3D face recognition camera installed on the shelf body.
  • the controller is connected to the electric lock through a serial port control board.
  • the shelf system further includes a refrigeration component and a temperature sensor arranged on the shelf body; the refrigeration component and the temperature sensor are connected to the controller.
  • the shelf system further includes a heating element arranged in the storage space of the shelf body.
  • the temperature sensor, the refrigeration assembly and the heating element are all connected to the serial port control board, and connected to the controller via the serial port control board.
  • An embodiment of the present application further provides a method for controlling a shelf system, wherein the shelf system includes a shelf body, a transparent touch display panel and an image collection element installed on the shelf body, and the method includes:
  • the control method wherein the shelf system further includes a door body, the first side of the door body and the shelf body are connected by a rotating shaft, and the second side of the door body is connected to the The shelf body is connected by an electric lock, wherein according to the image information and the touch operation, outputting the display signal of the transparent touch display panel and/or the control signal corresponding to the touch operation includes:
  • a control signal for controlling the opening of the electric lock is output.
  • FIG. 1 is a schematic diagram of the appearance structure of a shelf system according to an embodiment of the application
  • Figure 2 is a circuit system connection diagram of the shelf system according to an embodiment of the application.
  • FIG. 3 is a schematic flowchart of the control method according to an embodiment of the application.
  • an embodiment of the present application provides a shelf system in which image collection elements and transparent touch controls are arranged on the shelf body.
  • the display panel using a transparent touch display panel, can not only realize the interaction with the user, but also display the internal scenes of the shelf body, which can meet the needs of the shelf system for its diverse structure and compactness and lightness.
  • image acquisition components are used for image acquisition.
  • Combining the image information collected by the image acquisition element and the touch operation on the transparent touch display panel can output the display signal of the transparent touch display panel and/or the control signal corresponding to the touch operation, satisfying the requirements of the shelf system and the user The interaction between the diversified use requirements.
  • the shelf system according to one of the embodiments of the present application, as shown in FIG. 1, includes:
  • a shelf body 100 which includes a storage space
  • the image acquisition element 200 is installed on the shelf body 100;
  • the transparent touch display panel 300 is installed on the shelf body 100 and covers at least a part of the storage space. Through the transparent touch display panel 300, the light incident on the side away from the shelf body 100 can be transmitted to the inside of the storage space;
  • the controller (not shown in the figure) is connected to the transparent touch display panel 300 and the image acquisition element 200.
  • the controller is configured to acquire the image information collected by the image acquisition element 200 and the touch control on the transparent touch display panel 300. Operation, according to the image information and the touch operation, output the display signal of the transparent touch display panel 300 and/or the control signal corresponding to the touch operation.
  • the number of image collection elements 200 can be multiple, for example, multiple web cameras can be included, which can collect image information inside the storage space of the shelf body 100 and the external environment of the shelf body 100. Image information.
  • the controller is connected to the image acquisition component 200, and can acquire the image information of the external environment of the shelf body 100 collected by the image acquisition component 200, and perform face recognition and analysis on the collected image information.
  • the touch display panel 300 displays an interactive interface, receives user operation input on the interactive interface of the transparent touch display panel 300, and outputs corresponding control signals according to the operation input.
  • the shelf system further includes a door body 110.
  • the first side of the door body 110 and the shelf body 100 are connected by a shaft, and the second side of the door body 110 is connected to The shelf body 100 is connected by an electric lock;
  • the controller is specifically configured to output a control signal for controlling the opening of the electric lock when the target user is recognized according to the image information and the touch operation on the transparent touch display panel 300 is to open the door 110.
  • the first side is opposite to the second side, or is an adjacent side.
  • the door 110 can switch between the open state and the locked state with respect to the shelf body 100, specifically, when the electric lock is in the locked state
  • the controller performs face recognition analysis based on the image information collected by the image acquisition component 200, and receives the user's operation input on the interactive interface of the transparent touch display panel 300, after confirming that the target user is recognized, it can output control The control signal for the electric lock to open.
  • the controller is also configured to acquire the open state of the door 110 according to the image acquisition element 200, and when it is monitored that the door 110 is switched from open to closed, it outputs a control signal for controlling the closing of the electric lock, and according to the image
  • the collection element 200 obtains image information inside the storage space, and outputs a display signal for displaying the item settlement screen to the transparent touch display panel 300 according to the image information.
  • the door body 110 covers the storage space, and the storage space can be exposed or closed by opening or closing the door body 110.
  • the controller is configured to monitor that the door 110 is switched from open to closed according to the image information of the image acquisition component 200, obtain the image information inside the storage space, and compare the changes of the items in the storage space before and after the door 110 is opened
  • the transparent touch display panel 300 is controlled to display the item settlement screen, so as to realize the automatic vending function of the shelf system.
  • the transparent touch display panel 300 covers the first part of the storage space
  • the shelf system further includes a transparent glass plate 120
  • the transparent glass plate 120 covers the second part of the storage space. part.
  • the transparent touch display panel 300 covers the first part of the storage space, and the items in the first part can be viewed through the transparent touch display panel 300; the transparent glass plate 120 covers the storage space In the second part, the items in the second part can be seen through the transparent glass plate 120.
  • the combination of the transparent glass plate 120 and the transparent touch display panel 300 can achieve the effect of viewing all the items in the storage space from the outside. There is no need to cover the entire storage space with the transparent touch display panel 300, as long as it is guaranteed
  • the area size of the transparent touch display panel 300 only needs to meet the touch operation requirements, so as to effectively ensure the low-cost requirements of the shelf system.
  • the display surface of the transparent touch display panel 300 and the outer surface of the transparent glass plate 120 are located on the same plane.
  • the storage space of the shelf body 100 is provided with an opening facing one side direction to expose the storage space, and the transparent touch display panel 300 and the transparent glass plate 120 cover the opening in different areas to completely close the storage space. And through the touch display panel 300 and the transparent glass plate 120, the items in the storage space can be displayed.
  • the shelf system further includes a door 110 installed on the shelf body 100
  • the transparent touch display panel 300 and/or the transparent glass plate 120 are installed on the door 110.
  • the first side of the door 110 and the shelf body 100 are connected by a rotating shaft
  • the second side and the shelf body 100 are connected by an electric lock.
  • the door 110 can be switched between the open state and the locked state with respect to the shelf body 100, because the transparent touch display panel 300 and/or the transparent glass plate 120 are installed On the door 110, as the door 110 rotates relative to the shelf body 100, the transparent touch display panel 300 and/or the transparent glass plate 120 provided on the door 110 can rotate with the door 110.
  • the transparent touch display panel 300 and the transparent glass plate 120 are both installed on the door body 110; in another embodiment, the door body 110 may include two parts separated from each other, each part being able to face each other.
  • the shelf body 100 rotates and is locked by an electric lock, wherein the touch display panel 300 and the transparent glass plate 120 are respectively arranged on a part of the door 110.
  • the shelf system of the embodiment of the present application further includes an infrared identification element 130
  • the controller is also connected to the infrared identification element 130
  • the controller is also configured to identify human body information according to the infrared identification element 130
  • Output a display signal for displaying the face recognition interface to the transparent touch display panel 300, and control the image acquisition element 200 to start the acquisition of image information.
  • the controller collects the sensing signal of the infrared recognition element 130 and the image information collected by the image acquisition element 200, and interacts with the user through the transparent touch display panel 300, Realize the self-selling of the built-in items of the shelf system.
  • the above-mentioned self-service sales processing flow includes:
  • the infrared recognition element 130 recognizes the human body induction signal, and the controller obtains the human body induction signal, and outputs the display signal to the transparent touch display panel 300, so that the transparent touch display panel 300 displays an interactive interface; optionally , The interactive interface displays a face recognition window, prompting the user to enter a face image in the face recognition window;
  • the face image entered by the user in the face recognition window is acquired through the image acquisition component 200, and the face image is compared with the pre-stored information of the registered user entered by the user on the interactive interface. After the comparison is passed, the user is confirmed as a registered user.
  • the target user is the target user, output a display signal to the transparent touch display panel 300, so that the transparent touch display panel 300 displays the prompt message for confirming the opening of the door of the shelf system;
  • the image information inside the storage space is collected by the image acquisition component 200, and the image information inside the storage space collected by the image acquisition component 200 before the door is opened, is determined by comparing the two image information Store a list of items in the storage space, and control the transparent touch display panel 300 to display the item settlement screen;
  • the payment information input by the user through the item settlement screen on the transparent touch display panel 300 is acquired, and the payment settlement of the sold item is performed.
  • the transparent touch display panel 300 may be any one of a transparent liquid crystal display panel and a transparent organic light-emitting diode (OLED) display panel.
  • OLED organic light-emitting diode
  • image acquisition elements 200 can be respectively arranged in multiple positions.
  • image acquisition elements 200 are also arranged in the storage space of the shelf body 100 for different locations. Location to carry image information.
  • the image acquisition component 200 may include a 3D face recognition camera for acquiring face images.
  • the shelf system further includes a refrigeration component arranged on the shelf body 100, such as a compressor, a condenser, and/or an evaporator, etc., for realizing fresh-keeping storage of items in the storage space.
  • a temperature sensor is also provided on the shelf system, which is connected to the controller, so that the controller can monitor the temperature inside the storage space, so as to be able to perform temperature adjustment and ensure the stability of the temperature in the storage space.
  • a heating element is also provided in the storage space of the shelf system for heating and demisting the transparent glass plate on the shelf body 100.
  • the transparent touch display panel includes a touch display drive chip 1
  • the controller 2 uses a signal format conversion unit 3 is connected to the touch display driver chip 1 and outputs a display signal to the touch display driver chip 1.
  • controller 2 is connected to the image acquisition element 200 through the USB Ethernet adapter 4 and the Power-over-Ethernet POE switch 5 in turn.
  • controller 2 is connected to the electric lock 7 through the serial port control board 6.
  • the temperature sensor 8, the refrigeration component 9 and the heating element of the shelf system are all connected to the serial port control board 6, through the serial port control board. 6.
  • the controller 2 can output control signals to the respective components.
  • a back light 10 and a light source 11 connected to the back light are further provided in the storage space of the shelf system to illuminate the interior of the storage space.
  • the backlight 10 can be connected to the serial port control board 6, and the controller 2 can control the backlight 10 through the serial port control board 6.
  • the image information collected by the image acquisition component 200 is transmitted to the controller 2 through the power-over-Ethernet POE switch 5 and the Ethernet adapter 4, and the image information is processed by the controller 2, and then converted through the signal format.
  • the unit is transmitted to the touch display driving chip 1 so that the touch display driving chip 1 drives the transparent touch display panel 300 to display images in a semi-transparent manner.
  • the shelf system described in the embodiment of the present application can normally view the scene inside the shelf body through the transparent touch display panel 300. Therefore, the transparent touch display panel can not only realize the interaction with the user, but also display the inside of the shelf body. Scenes, to meet the needs of the shelf system with diverse structures and compactness and lightness.
  • image acquisition elements are used for image acquisition, combined with image information collected by the image acquisition elements and touch operations on the transparent touch display panel, which can output transparent touch
  • the display signal of the display panel and/or the control signal corresponding to the touch operation meets the diversified use requirements of the interaction mode between the shelf system and the user.
  • FIG. 3 Another aspect of the embodiments of the present application also provides a control method of a shelf system, wherein the shelf system includes a shelf body, a transparent touch display panel installed on the shelf body, and an image collection element, as shown in FIG. 3 ,
  • the method includes:
  • S310 Acquire image information collected by the image collection element and touch operations on the transparent touch display panel
  • S320 According to the image information and the touch operation, output a display signal of the transparent touch display panel and/or a control signal corresponding to the touch operation.
  • the control method wherein the shelf system further includes a door body, the first side of the door body and the shelf body are connected by a rotating shaft, and the second side of the door body is connected to the The shelf body is connected by an electric lock, wherein in step S320, according to the image information and the touch operation, output the display signal of the transparent touch display panel and/or the control signal corresponding to the touch operation, include:
  • a control signal for controlling the opening of the electric lock is output.
  • the method further includes:
  • the method further includes:
  • a display signal showing the face recognition interface is output to the transparent touch display panel, and the image collection element is controlled to start the collection of the face image information.
  • the control method described in the embodiment of the application realizes self-help of the items in the shelf system by collecting the sensing signal of the infrared recognition element and the image information collected by the image collecting element, and interacting with the user through the transparent touch display panel sell.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Cash Registers Or Receiving Machines (AREA)
  • Control Of Vending Devices And Auxiliary Devices For Vending Devices (AREA)

Abstract

本申请提供一种货架系统及控制方法。该货架系统包括：货架本体，所述货架本体包括置物空间；图像采集元件，安装于货架本体上；透明触控显示面板，安装于货架本体上，且覆盖置物空间的至少一部分，透过透明触控显示面板，远离货架本体一侧入射的光线能够传输至置物空间的内部；控制器，与透明触控显示面板和图像采集元件连接，控制器被配置为获取图像采集元件所采集的图像信息以及获取透明触控显示面板上的触控操作，根据图像信息和触控操作，输出透明触控显示面板的显示信号和/或与触控操作对应的控制信号。

Description

货架系统及控制方法
相关申请的交叉引用
本申请主张在2020年5月27日在中国提交的中国专利申请号No.202010461742.X的优先权，其全部内容通过引用包含于此。
技术领域
本申请涉及产品展示技术领域，尤其是指一种货架系统及控制方法。
背景技术
目前，自动售货机是一种全新的商业零售形式，相关技术中的自动售货机通常通过透明玻璃柜展示内部货品，并利用二维码扫描的方式实现移动手机支付，实现货品交易。
该种结构的自动售货机结构单一、体积庞大，无法满足自动售货机结构多样、小巧轻便以及交互与支付方式多样化的市场使用需求。
发明内容
本申请提供一种货架系统，其中，包括：
货架本体，所述货架本体包括置物空间；
图像采集元件，安装于所述货架本体上；
透明触控显示面板，安装于所述货架本体上，且覆盖所述置物空间的至少一部分，透过所述透明触控显示面板，远离所述货架本体一侧入射的光线能够传输至所述置物空间的内部；
控制器，与所述透明触控显示面板和所述图像采集元件连接，所述控制器被配置为获取所述图像采集元件所采集的图像信息以及获取所述透明触控显示面板上的触控操作，根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号。
可选地，所述的货架系统，其中，所述货架系统还包括门体，所述门体的第一侧边与所述货架本体通过转轴连接，所述门体的第二侧边与所述货架本 体通过电动锁连接；
其中，所述控制器具体被配置为在根据所述图像信息识别到目标用户，所述透明触控显示面板上的触控操作为打开门体时，输出控制所述电动锁打开的控制信号。
可选地，所述的货架系统，其中，所述控制器还被配置为根据所述图像采集元件获取所述门体的打开状态，在监测到所述门体由打开切换为关闭时，输出控制所述电动锁关闭的控制信号，以及根据所述图像采集元件获取所述置物空间内部的图像信息，根据所述图像信息向所述透明触控显示面板输出用于显示物品结算画面的显示信号。
可选地，所述的货架系统，其中，所述透明触控显示面板覆盖所述置物空间的第一部分，所述货架系统还包括透明玻璃板，所述透明玻璃板覆盖所述置物空间的第二部分。
可选地，所述的货架系统，其中，所述透明触控显示面板的显示面与所述透明玻璃板的外表面位于同一平面。
可选地，所述的货架系统，其中，所述货架系统还包括安装于所述货架本体上的门体时，所述透明触控显示面板和/或所述透明玻璃板安装于所述门体上。
可选地，所述的货架系统，其中，所述货架系统还包括红外识别元件，所述控制器还与所述红外识别元件连接，根据所述红外识别元件识别人体信息后，向所述透明触控显示面板输出显示人脸识别界面的显示信号，且控制所述图像采集元件启动图像信息的采集。
可选地，所述的货架系统，其中，所述透明触控显示面板包括触控显示驱动芯片，所述控制器通过信号格式转换单元与所述触控显示驱动芯片连接，向所述触控显示驱动芯片输出显示信号。
可选地，所述的货架系统，其中，所述控制器依次通过USB以太网适配器和以太网供电POE交换机与所述图像采集元件连接。
可选地，所述图像采集元件包括安装于所述货架本体上的至少一个网络摄像头。
可选地，所述图像采集元件还包括安装于所述货架本体上的3D人脸识 别摄像头。
可选地，所述控制器通过串口控制板与所述电动锁连接。
可选地，所述货架系统还包括设置于所述货架本体上的制冷组件以及温度传感器；所述制冷组件以及温度传感器与所述控制器连接。
可选地，所述货架系统还包括设置于所述货架本体的置物空间内的加热元件。
可选地，所述温度传感器、所述制冷组件和所述加热元件均连接至所述串口控制板，并经由所述串口控制板与所述控制器连接。
本申请实施例还提供一种货架系统的控制方法，其中，所述货架系统包括货架本体、安装于所述货架本体上的透明触控显示面板和图像采集元件，所述方法包括：
获取所述图像采集元件所采集的图像信息以及所述透明触控显示面板上的触控操作；
根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号。
可选地，所述的控制方法，其中，所述货架系统还包括门体，所述门体的第一侧边与所述货架本体通过转轴连接，所述门体的第二侧边与所述货架本体通过电动锁连接，其中根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号，包括：
根据所述图像信息进行人脸图像识别；
在识别到目标用户，且根据所述透明触控显示面板上的触控操作，确定所述触控操作为打开门体时，输出控制所述电动锁打开的控制信号。
附图说明
图1为本申请实施例所述货架系统的外观结构示意图；
图2为本申请实施例所述货架系统的电路系统连接图；
图3为本申请实施例所述控制方法的流程示意图。
具体实施方式
为使本申请要解决的技术问题、技术方案和优点更加清楚，下面将结合附图及具体实施例进行详细描述。
为解决相关技术中的货架系统结构单一、体积庞大及能够提供的与用户之间的交互方式单一的问题，本申请实施例提供一种货架系统，在货架本体上设置图像采集元件和透明触控显示面板，利用透明触控显示面板，既能够实现与用户之间的交互，又能够展示货架本体内部场景，满足货架系统的结构多样及小巧轻便的使用需求，另外利用图像采集元件进行图像采集，结合图像采集元件所采集的图像信息和透明触控显示面板上的触控操作，能够输出透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号，满足货架系统与用户之间的交互方式多样化的使用需求。
本申请其中一实施例所述货架系统，如图1所示，包括：
货架本体100，所述货架本体100包括置物空间；
图像采集元件200，安装于所述货架本体100上；
透明触控显示面板300，安装于货架本体100上，且覆盖置物空间的至少一部分，透过透明触控显示面板300，远离货架本体100一侧入射的光线能够传输至置物空间的内部；
控制器(图中未显示)，与透明触控显示面板300和图像采集元件200连接，控制器被配置为获取图像采集元件200所采集的图像信息以及获取透明触控显示面板300上的触控操作，根据所述图像信息和所述触控操作，输出所述透明触控显示面板300的显示信号和/或与触控操作对应的控制信号。
本申请实施例中，可选地，图像采集元件200的数量可以为多个，如可以包括多个网络摄像头，能够采集货架本体100的置物空间内部的图像信息，以及货架本体100的外部环境的图像信息。
进一步，可选地，控制器与图像采集元件200连接，能够获取图像采集元件200所采集的货架本体100的外部环境的图像信息，并对所采集的图像信息进行人脸识别分析，以及在透明触控显示面板300上显示交互界面，接收用户在透明触控显示面板300的交互界面上的操作输入，根据操作输入输出对应的控制信号。
本申请实施例中，其中一实施方式，如图1所示，货架系统还包括门体 110，门体110的第一侧边与货架本体100通过转轴连接，门体110的第二侧边与货架本体100通过电动锁连接；
其中，控制器具体被配置为在根据图像信息识别到目标用户且透明触控显示面板300上的触控操作为打开门体110时，输出控制电动锁打开的控制信号。
其中，第一侧边与第二侧边相对，或者为相邻侧边。
采用该实施方式，利用门体110与货架本体100之间设置的电动锁，门体110能够相对于货架本体100在打开状态和锁闭状态之间切换，具体地，在电动锁处于锁闭状态时，控制器在根据图像采集元件200所采集的图像信息进行人脸识别分析，以及在接收用户在透明触控显示面板300的交互界面上的操作输入，确定识别到目标用户后，可以输出控制电动锁打开的控制信号。
进一步，可选地，控制器还被配置为根据图像采集元件200获取门体110的打开状态，在监测到门体110由打开切换为关闭时，输出控制电动锁关闭的控制信号，以及根据图像采集元件200获取置物空间内部的图像信息，根据图像信息向透明触控显示面板300输出显示物品结算画面的显示信号。
本申请实施例中，可选地，门体110覆盖于置物空间上，通过门体110的打开或关闭，能够使置物空间露出或封闭。通过使控制器被配置为根据图像采集元件200的图像信息，监测到门体110从打开切换为关闭后，获得置物空间内部的图像信息，并比较门体110被打开前后置物空间内的物品变化情况，以控制透明触控显示面板300显示物品结算画面，进而实现货架系统的自动售货功能。
本申请实施例中，可选地，如图1所示，透明触控显示面板300覆盖置物空间的第一部分，所述货架系统还包括透明玻璃板120，透明玻璃板120覆盖置物空间的第二部分。
采用该实施方式，在货架本体100上，透明触控显示面板300覆盖置物空间的第一部分，透过透明触控显示面板300可以观看到该第一部分内的物品；透明玻璃板120覆盖置物空间的第二部分，透过该透明玻璃板120可以观看到第二部分内的物品。这样，对应整个置物空间，透明玻璃板120与透 明触控显示面板300相组合能够达到从外部观看到置物空间内全部物品的效果，无需整个置物空间上均覆盖透明触控显示面板300，只要保证透明触控显示面板300的面积大小满足触控操作要求即可，以有效保证货架系统的低成本要求。
可选地，如图1所示，本申请实施方式中，透明触控显示面板300的显示面与透明玻璃板120的外表面位于同一平面。
也即，具体地，货架本体100的置物空间朝向一侧方向设置有开口，使置物空间露出，透明触控显示面板300与透明玻璃板120分区域覆盖在开口上，以整个地封闭置物空间，并通过触控显示面板300和透明玻璃板120能够展示置物空间内部的物品。
可选地，如图1所示，货架系统还包括安装于货架本体100上的门体110时，透明触控显示面板300和/或透明玻璃板120安装于门体110上。具体地，门体110的第一侧边与货架本体100通过转轴连接，第二侧边与货架本体100通过电动锁连接。利用门体110与货架本体100之间设置的电动锁，门体110能够相对于货架本体100在打开状态和锁闭状态之间切换，由于透明触控显示面板300和/或透明玻璃板120安装于门体110上，随着门体110相对于货架本体100的转动，设置于门体110上的透明触控显示面板300和/或透明玻璃板120能够跟随门体110转动。
可选地，其中一实施方式，透明触控显示面板300和透明玻璃板120均安装于门体110上；另一实施方式，门体110可以包括相互分离的两个部分，每一部分分别能够相对于货架本体100转动，并通过电动锁进行锁闭，其中触控显示面板300和透明玻璃板120分别设置于其中一部分的门体110上。
可选地，如图1所示，本申请实施例所述货架系统还包括红外识别元件130，控制器还与红外识别元件130连接，控制器还被配置为根据红外识别元件130识别人体信息后，向透明触控显示面板300输出显示人脸识别界面的显示信号，且控制图像采集元件200启动图像信息的采集。
具体地，采用本申请实施例所述货架系统，控制器通过采集红外识别元件130的感应信号和图像采集元件200所采集的图像信息，并通过透明触控显示面板300与用户之间进行交互，实现货架系统内置物空间物品的自助出 售。
具体地，上述自助出售处理流程，包括：
当有人员靠近货架系统时，红外识别元件130识别人体感应信号，控制器获取该人体感应信号，向透明触控显示面板300输出显示信号，使透明触控显示面板300显示交互界面；可选地，该交互界面显示人脸识别窗口，提示用户在该人脸识别窗口进行人脸图像录入；
通过图像采集元件200获取用户在人脸识别窗口录入的人脸图像，将该人脸图像与用户在交互界面输入的注册用户的预存信息进行比对，在比对通过，确认该用户为已注册的目标用户时，向透明触控显示面板300输出显示信号，使透明触控显示面板300显示货架系统的门体打开确认提示信息；
若接收到用户通过透明触控显示面板300触发的门体打开确认输入，则向门体的电动锁输出打开控制信号；
在向电动锁输出打开控制信号后，监测图像采集元件200采集的图像信息，判断门体是否由打开状态切换为关闭状态；
在监测到门体由打开状态切换为关闭状态后，向门体的电动锁输出锁闭控制信号；
在门体锁闭后，通过图像采集元件200采集置物空间内部的图像信息，以及调取在门体打开之前图像采集元件200采集的置物空间内部的图像信息，通过对比该两个图像信息，确定置物空间内物品的出售清单，并控制透明触控显示面板300显示物品结算画面；
获取用户通过透明触控显示面板300上的物品结算画面输入的支付信息，进行出售物品的支付结算。
本申请实施例中，可选地，透明触控显示面板300可以为透明液晶显示面板和透明有机发光二极管(Organic Light-Emitting Diode，OLED)显示面板的任一种。
进一步，如图1所示，在货架本体100上，多个位置可以分别设置图像采集元件200，可选地，在货架本体100的置物空间的内部也设置图像采集元件200，用于分别在不同位置进行图像信息。可选地，该图像采集元件200可以包括3D人脸识别摄像头，用于进行人脸图像采集。
进一步，可选地，货架系统还包括设置于货架本体100上的制冷组件，如包括压缩机、冷凝器和/或蒸发器等，用于实现置物空间内物品的保鲜储存。可选地，货架系统上还设置有温度传感器，与控制器连接，使控制器能够监测置物空间内部的温度，以能够进行温度调节，保障置物空间内温度的稳定。
可选地，货架系统的置物空间内还设置有加热元件，用于实现对货架本体100上透明玻璃板的加热除雾。
可选地，如图2所示本申请实施例所述货架系统的电路系统连接图，所述货架系统中，透明触控显示面板包括触控显示驱动芯片1，控制器2通过信号格式转换单元3与触控显示驱动芯片1连接，向触控显示驱动芯片1输出显示信号。
进一步，控制器2依次通过USB以太网适配器4和以太网供电POE交换机5与图像采集元件200连接。
另外，控制器2通过串口控制板6与电动锁7连接，在此基础上，可选地，货架系统的温度传感器8、制冷组件9和加热元件均连接至串口控制板6，通过串口控制板6，控制器2可以向该各个组件输出控制信号。
进一步，可选地，所述货架系统的置物空间内还设置有背光灯10和与背光灯连接的光源11，用于为置物空间的内部照明。其中，背光灯10可以与串口控制板6连接，通过串口控制板6，控制器2能够实现对背光灯10的控制。
采用上述实施结构的电路系统，图像采集元件200所采集的图像信息，通过以太网供电POE交换机5和以太网适配器4传输至控制器2，图像信息经控制器2进行处理后，通过信号格式转换单元传输至触控显示驱动芯片1，以使触控显示驱动芯片1驱动透明触控显示面板300呈半透明显示图像。
本申请实施例所述货架系统，通过透明触控显示面板300，能够正常观看到货架本体内部场景，因此利用透明触控显示面板，既能够实现与用户之间的交互，又能够展示货架本体内部场景，满足货架系统的结构多样及小巧轻便的使用需求，另外利用图像采集元件进行图像采集，结合图像采集元件所采集的图像信息和透明触控显示面板上的触控操作，能够输出透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号，满足货架系统与用户之间的交互方式多样化的使用需求。
本申请实施例另一方面还提供一种货架系统的控制方法，其中，所述货架系统包括货架本体、安装于所述货架本体上的透明触控显示面板和图像采集元件，如图3所示，所述方法包括：
S310，获取所述图像采集元件所采集的图像信息以及所述透明触控显示面板上的触控操作；
S320，根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号。
可选地，所述的控制方法，其中，所述货架系统还包括门体，所述门体的第一侧边与所述货架本体通过转轴连接，所述门体的第二侧边与所述货架本体通过电动锁连接，其中在步骤S320，根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号，包括：
根据所述图像信息进行人脸图像识别；
在识别到目标用户，且根据所述透明触控显示面板上的触控操作，确定所述触控操作为打开门体时，输出控制所述电动锁打开的控制信号。
进一步，可选地，所述方法还包括：
在监测到门体由打开切换为关闭时，输出控制电动锁关闭的控制信号，以及根据图像采集元件获取置物空间内部的图像信息，根据图像信息向透明触控显示面板输出显示物品结算画面的显示信号。
可选地，所述货架系统还包括红外识别元件时，所述方法还包括：
获取红外识别元件所采集的感应信号；
根据所述感应信号识别到人体信息后，向透明触控显示面板输出显示人脸识别界面的显示信号，且控制图像采集元件启动人脸图像信息的采集。
本申请实施例所述控制方法，通过采集红外识别元件的感应信号和图像采集元件所采集的图像信息，并通过透明触控显示面板与用户之间进行交互，实现货架系统内置物空间物品的自助出售。
以上所述的是本申请的可选实施方式，应当指出对于本技术领域的普通人员来说，在不脱离本申请所述原理前提下，还可以作出若干改进和润饰，这些改进和润饰也应视为本申请的保护范围。

Claims (16)

  1. 一种货架系统，包括：
    货架本体，所述货架本体包括置物空间；
    图像采集元件，安装于所述货架本体上；
    透明触控显示面板，安装于所述货架本体上，且覆盖所述置物空间的至少一部分；
    控制器，与所述透明触控显示面板和所述图像采集元件连接，所述控制器被配置为获取所述图像采集元件所采集的图像信息以及获取所述透明触控显示面板上的触控操作，根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号。
  2. 根据权利要求1所述的货架系统，其中，所述货架系统还包括门体，所述门体的第一侧边与所述货架本体通过转轴连接，所述门体的第二侧边与所述货架本体通过电动锁连接；
    其中，所述控制器具体被配置为在根据所述图像信息识别到目标用户，且所述透明触控显示面板上的触控操作为打开门体时，输出控制所述电动锁打开的控制信号。
  3. 根据权利要求2所述的货架系统，其中，所述控制器还被配置为根据所述图像采集元件获取所述门体的打开状态，在监测到所述门体由打开切换为关闭时，输出控制所述电动锁关闭的控制信号，以及根据所述图像采集元件获取所述置物空间内部的图像信息，根据所述图像信息向所述透明触控显示面板输出用于显示物品结算画面的显示信号。
  4. 根据权利要求1至3任一项所述的货架系统，其中，所述透明触控显示面板覆盖所述置物空间的第一部分，所述货架系统还包括透明玻璃板，所述透明玻璃板覆盖所述置物空间的第二部分。
  5. 根据权利要求2或3所述的货架系统，其中，所述透明触控显示面板覆盖所述置物空间的第一部分，所述货架系统还包括透明玻璃板，所述透明玻璃板覆盖所述置物空间的第二部分，所述透明触控显示面板和/或所述透明玻璃板安装于所述门体上。
  6. 根据权利要求1所述的货架系统，其中，所述货架系统还包括红外识别元件，所述控制器还与所述红外识别元件连接，根据所述红外识别元件识别人体信息后，向所述透明触控显示面板输出显示人脸识别界面的显示信号，且控制所述图像采集元件启动图像信息的采集。
  7. 根据权利要求1所述的货架系统，其中，所述透明触控显示面板包括触控显示驱动芯片，所述控制器通过信号格式转换单元与所述触控显示驱动芯片连接，向所述触控显示驱动芯片输出显示信号。
  8. 根据权利要求1所述的货架系统，其中，所述控制器依次通过USB以太网适配器和以太网供电POE交换机与所述图像采集元件连接。
  9. 根据权利要求1所述的货架系统，其中，所述图像采集元件包括安装于所述货架本体上的至少一个网络摄像头。
  10. 根据权利要求9所述的货架系统，其中，所述图像采集元件还包括安装于所述货架本体上的3D人脸识别摄像头。
  11. 根据权利要求2所述的货架系统，其中，所述控制器通过串口控制板与所述电动锁连接。
  12. 根据权利要求11所述的货架系统，其中，所述货架系统还包括设置于所述货架本体上的制冷组件以及温度传感器；所述制冷组件以及温度传感器与所述控制器连接。
  13. 根据权利要求12所述的货架系统，其中，所述货架系统还包括设置于所述货架本体的置物空间内的加热元件。
  14. 根据权利要求13所述的货架系统，其中，所述温度传感器、所述制冷组件和所述加热元件均连接至所述串口控制板，并经由所述串口控制板与所述控制器连接。
  15. 一种货架系统的控制方法，其中，所述货架系统包括货架本体、安装于所述货架本体上的透明触控显示面板和图像采集元件，所述方法包括：
    获取所述图像采集元件所采集的图像信息以及所述透明触控显示面板上的触控操作；
    根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号。
  16. 根据权利要求15所述的控制方法，其中，所述货架系统还包括门体，所述门体的第一侧边与所述货架本体通过转轴连接，所述门体的第二侧边与所述货架本体通过电动锁连接，其中根据所述图像信息和所述触控操作，输出所述透明触控显示面板的显示信号和/或与所述触控操作对应的控制信号，包括：
    根据所述图像信息进行人脸图像识别；
    在识别到目标用户，且根据所述透明触控显示面板上的触控操作，确定所述触控操作为打开门体时，输出控制所述电动锁打开的控制信号。
PCT/CN2021/093178 2020-05-27 2021-05-12 货架系统及控制方法 WO2021238646A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/761,533 US20230076584A1 (en) 2020-05-27 2021-05-12 Shelf system and control method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010461742.X 2020-05-27
CN202010461742.XA CN111612970A (zh) 2020-05-27 2020-05-27 货架系统及控制方法

Publications (1)

Publication Number Publication Date
WO2021238646A1 true WO2021238646A1 (zh) 2021-12-02

Family

ID=72196030

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/093178 WO2021238646A1 (zh) 2020-05-27 2021-05-12 货架系统及控制方法

Country Status (3)

Country Link
US (1) US20230076584A1 (zh)
CN (1) CN111612970A (zh)
WO (1) WO2021238646A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111612970A (zh) * 2020-05-27 2020-09-01 京东方科技集团股份有限公司 货架系统及控制方法
CN112767600A (zh) * 2021-01-19 2021-05-07 支付宝(杭州)信息技术有限公司 售卖柜及其控制方法
CN113192255A (zh) * 2021-03-12 2021-07-30 广州朗国电子科技有限公司 自动售货机用显示屏

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108389320A (zh) * 2018-04-17 2018-08-10 合肥美的智能科技有限公司 一种售货柜和一种售货柜的控制方法
CN108520594A (zh) * 2018-07-10 2018-09-11 合肥美的智能科技有限公司 一种自动售货机及其控制方法
US20180285959A1 (en) * 2017-03-30 2018-10-04 Crane Merchandising Systems, Inc. Product recommendation engine for consumer interface of unattended retail points of sale
CN108665623A (zh) * 2018-06-05 2018-10-16 科洛维特科技发展(北京)有限公司 一种自动售卖机
CN108710874A (zh) * 2018-08-23 2018-10-26 深圳码隆科技有限公司 一种基于图像采集装置的自动售货机
CN108922029A (zh) * 2018-08-15 2018-11-30 济南每日优鲜便利购网络科技有限公司 自动售货设备及其控制方法
CN209103314U (zh) * 2018-08-23 2019-07-12 深圳码隆科技有限公司 一种基于图像采集装置的自动售货机
CN209149428U (zh) * 2019-01-07 2019-07-23 易程(苏州)电子科技股份有限公司 一种智能自动售货机
CN111612970A (zh) * 2020-05-27 2020-09-01 京东方科技集团股份有限公司 货架系统及控制方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100403346C (zh) * 2002-10-12 2008-07-16 英特利马兹有限责任公司 具有可变图像取向的地面显示系统
US10641030B2 (en) * 2017-08-29 2020-05-05 Alarm.Com Incorporated Garage door authentication and automation
CN109697786A (zh) * 2017-10-23 2019-04-30 北京京东尚科信息技术有限公司 用于售货机的操作方法和操作装置
CN108495116B (zh) * 2018-03-29 2020-01-10 京东方科技集团股份有限公司 3d显示装置及其控制方法、计算机设备
CN208240123U (zh) * 2018-05-08 2018-12-14 北京蓝海华业工程技术有限公司 基于人脸识别的售货系统
CN109147170A (zh) * 2018-07-26 2019-01-04 上海凯景信息技术有限公司 一种基于图像识别的无人售货柜
CN110477631A (zh) * 2018-07-31 2019-11-22 广东云陪陪互联网科技有限公司 一种基于物联网的文件实时监控柜
US10925425B2 (en) * 2018-09-12 2021-02-23 Andre Lamont CHENIER Secure outdoor storage and delivery container
CN109637017B (zh) * 2018-12-27 2020-12-15 广州甘来信息科技有限公司 基于触摸膜的自动售货机的控制方法、装置、设备与介质
CN110853197A (zh) * 2019-11-28 2020-02-28 重庆汇锦工程技术(集团)有限公司 一种智能会议系统工程和控制方法

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180285959A1 (en) * 2017-03-30 2018-10-04 Crane Merchandising Systems, Inc. Product recommendation engine for consumer interface of unattended retail points of sale
CN108389320A (zh) * 2018-04-17 2018-08-10 合肥美的智能科技有限公司 一种售货柜和一种售货柜的控制方法
CN108665623A (zh) * 2018-06-05 2018-10-16 科洛维特科技发展(北京)有限公司 一种自动售卖机
CN108520594A (zh) * 2018-07-10 2018-09-11 合肥美的智能科技有限公司 一种自动售货机及其控制方法
CN108922029A (zh) * 2018-08-15 2018-11-30 济南每日优鲜便利购网络科技有限公司 自动售货设备及其控制方法
CN108710874A (zh) * 2018-08-23 2018-10-26 深圳码隆科技有限公司 一种基于图像采集装置的自动售货机
CN209103314U (zh) * 2018-08-23 2019-07-12 深圳码隆科技有限公司 一种基于图像采集装置的自动售货机
CN209149428U (zh) * 2019-01-07 2019-07-23 易程(苏州)电子科技股份有限公司 一种智能自动售货机
CN111612970A (zh) * 2020-05-27 2020-09-01 京东方科技集团股份有限公司 货架系统及控制方法

Also Published As

Publication number Publication date
US20230076584A1 (en) 2023-03-09
CN111612970A (zh) 2020-09-01

Similar Documents

Publication Publication Date Title
WO2021238646A1 (zh) 货架系统及控制方法
US11009289B2 (en) Refrigerator
US9661279B2 (en) Refrigerator
CN208141479U (zh) 一种门锁
US11980310B2 (en) Refrigerator for entrance gate
WO2020171635A1 (ko) 도어를 개방하여 상품을 선택할 수 있는 스마트 자판기
CN108492457A (zh) 自动售货装置及方法
US20140313331A1 (en) Refrigerator and operating method thereof
JP7445592B2 (ja) インテリジェントなマーケティングおよび広告のためのプラットフォーム
WO2018062102A1 (ja) 筐体及びシステム
EP3622232B1 (en) A cooling device
RU2714901C1 (ru) Способ и система распознавания образов из видеопотока
JP2014134906A (ja) 自動販売機
JP3217366U (ja) カバー部材及びこれを備えた扉アセンブリ
US10866779B2 (en) User interactive display device and operating device
CN206097306U (zh) 基于过程保护的证卡领取自助服务设备
JP5682329B2 (ja) 自動販売機
US11087302B2 (en) Installation and method for managing product data
CN113989979A (zh) 智能柜及其物品管理方法、电子设备、介质、产品
KR20170023465A (ko) 네트워크를 통해 냉장고의 관리 정보를 제공하기 위한 냉장고 제어 시스템 및 그 방법
CN215895932U (zh) 显示装置和货柜系统
JP2012064008A (ja) タッチパネル型液晶表示端末およびこれを備えた取引処理装置
KR101170133B1 (ko) 현금취급기의 보안용 녹화기 모니터 전원 제어장치 및 방법
WO2022247123A1 (zh) 显示装置、货柜系统和显示装置的控制方法
KR20200097129A (ko) 내용물의 인식이 용이한 투명기능 냉장고

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21811859

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21811859

Country of ref document: EP

Kind code of ref document: A1