WO2020211486A1 - 自助收银台 - Google Patents

自助收银台 Download PDF

Info

Publication number
WO2020211486A1
WO2020211486A1 PCT/CN2020/071402 CN2020071402W WO2020211486A1 WO 2020211486 A1 WO2020211486 A1 WO 2020211486A1 CN 2020071402 W CN2020071402 W CN 2020071402W WO 2020211486 A1 WO2020211486 A1 WO 2020211486A1
Authority
WO
WIPO (PCT)
Prior art keywords
self
light source
counter according
cameras
checkout counter
Prior art date
Application number
PCT/CN2020/071402
Other languages
English (en)
French (fr)
Inventor
宋杨
Original Assignee
创新先进技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 创新先进技术有限公司 filed Critical 创新先进技术有限公司
Priority to US16/816,503 priority Critical patent/US11182759B2/en
Publication of WO2020211486A1 publication Critical patent/WO2020211486A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/12—Cash registers electronically operated
    • G07G1/14—Systems including one or more distant stations co-operating with a central processing unit

Definitions

  • the invention relates to the technical field of cashier counters, in particular to a self-service cashier counter.
  • the embodiment of this specification provides a self-service cash register.
  • the cashier counter includes: a countertop for carrying at least one commodity; an illumination panel arranged opposite to the countertop, including at least one light source, the at least one light source providing illumination for at least one commodity carried on the countertop; and a pillar , Connect the countertop and the lighting panel, and are used to support the lighting panel; a plurality of cameras are used to capture images of the at least one commodity, and the images are used for commodity identification and pricing; wherein, the multiple At least a part of the cameras are arranged on the illumination panel.
  • the lighting panel includes a shading plate, the shading plate is made of opaque or semi-transparent material, and is used to block light from above; the at least one light source is arranged on the side of the shading plate. Said one side of the countertop.
  • the lighting panel includes an upper surface and a lower surface, the upper surface is made of opaque or semi-transparent material facing away from the table, and the lower surface faces the table and is made of transparent material
  • the at least one light source is arranged between the upper surface and the lower surface, and illuminates the table surface through the lower surface.
  • the at least one light source is a surface light source substantially the same size as the illumination panel.
  • the at least one light source includes a plurality of point light sources, and the plurality of point light sources are dispersedly arranged in the lighting panel.
  • the multiple point light sources include multiple LED lights, and the multiple LED lights are controlled by an LED controller.
  • the pillar is a hollow pillar, and a connection line that provides power and/or control for the light source and/or the camera is accommodated therein.
  • a display device is installed on the pillar to display the pricing result of the at least one commodity.
  • the plurality of cameras includes a first camera, and the first camera is disposed on the pillar.
  • the illumination panel is a rectangular panel
  • the plurality of cameras includes cameras arranged at four top corners of the rectangular panel.
  • the multiple cameras face at least one of the top view direction, the front view direction, the left view direction, the right view direction, and the rear view direction of the product.
  • the plurality of cameras includes a second camera, and the angle between the direction in which the second camera faces and the vertical direction of the table surface is between 30 degrees and 60 degrees.
  • the cashier counter further includes a processing device connected to the multiple cameras to obtain images taken by the processing device.
  • the processing device includes a communication unit for sending the image to the server and receiving the category or price of each commodity in at least one commodity
  • an opaque or translucent lighting panel is arranged on the self-service checkout counter. On the one hand, it shields the uncontrollable lighting on the ceiling, and on the other hand provides stable and controllable lighting, which improves the quality of photography and avoids shadows. . In addition, deploying more than two cameras on the lighting panel can effectively improve the quality of image collection when the products are obstructed by each other.
  • Figure 1 is a schematic structural diagram of a self-service cashier in an embodiment of this specification
  • Figure 2a shows a schematic diagram of the structure of the cash register in an embodiment
  • Figure 2b shows a schematic diagram of the structure of the cash register in another embodiment
  • Figure 3 illustrates a bottom view of the lighting panel 120 seen from below
  • Figure 4 shows a schematic structural diagram of the cash register in an embodiment
  • Figure 5 shows a schematic structural diagram of a cash register according to an embodiment
  • FIG. 6 is a schematic diagram of the structure of the processing equipment of the self-service cash register in the embodiment of the present specification.
  • FIG. 7 is a schematic flowchart of a self-service cashier method according to an embodiment of this specification.
  • Fig. 8 is a schematic flowchart of a self-service cashier method according to another embodiment of the present specification.
  • FIG. 1 is a schematic diagram of the structure of a self-service cashier in an embodiment of the present specification.
  • the self-service cashier counter 12 includes a countertop 130 and a lighting panel 120, which are arranged opposite to each other.
  • one or more pillars 30 may be used to connect the countertop 130 and the lighting panel 120 to support the panel 120.
  • the pillars may be provided with circuits for providing power or control for electronic or electrical equipment embedded or installed in the panel 120.
  • the countertop 130 is located below and is used to carry one or more commodities 132 and 134.
  • the lighting panel 120 is located above, and is used to block uncontrollable light from above the cashier counter and provide an ideal lighting environment for the commodities on the countertop, so that the lighting of the commodities is stable, and it is helpful for the operation of commodity detection or recognition algorithms.
  • the lighting panel 120 may include at least one light source.
  • at least one light source is exemplarily shown as light source A, light source B, light source C, and light source D.
  • the self-service cash register can be equipped with multiple cameras for taking images of the commodities 132 and 134, and the captured images are used for commodity identification and pricing.
  • a plurality of cameras are exemplarily shown as camera A and camera B, and are arranged on the lighting panel 120.
  • the lighting panel 120 may have a variety of shapes, such as a rectangular shape, an arc shape, and extension covers on both sides. As long as it can block or partially block the light source above the panel, any panel shape is acceptable.
  • the size of the lighting panel 120 can be comparable to the size of the countertop, and can also be slightly larger or slightly smaller than the size of the countertop.
  • Figure 2a shows a schematic diagram of the structure of the cash register in an embodiment.
  • the lighting panel 120 includes a light-shielding plate 121, which is made of an opaque material or a semi-transparent material for shielding uncontrollable light from above.
  • the light source 122 is arranged on the side of the light-shielding plate facing the table top to provide illumination for the table top.
  • Fig. 2b shows a schematic diagram of the structure of the cash register in another embodiment.
  • the lighting panel 120 includes an upper surface 1201 and a lower surface 1202.
  • the lower surface 1202 faces the table top, or is closer to the table top, and may be made of a transparent material.
  • the upper surface 1201 faces away from the table top, or is farther away from the table top, and is made of opaque or semi-transparent material.
  • the light source 122 is arranged between the two surfaces, illuminates the table surface through the transparent lower surface, and at the same time shields light from above through the opaque or semi-transparent upper surface.
  • the lower surface can be made of a material with diffuse reflection such as frosted glass, which can transmit light while making the light more uniform, which is more conducive to the light environment of the commodity.
  • the light source in the lighting panel 120 can be arranged in various ways.
  • the light source can be a surface light source with substantially the same size as the lighting panel.
  • the light source may include a linear light source, for example, composed of a plurality of light-emitting rods.
  • the light source may include a plurality of point light sources, and the point light sources are dispersedly arranged in the lighting panel.
  • FIG. 3 illustrates a bottom view of the lighting panel 120 viewed from below.
  • the lighting panel includes a plurality of light sources 122. These light sources 122 are dispersedly arranged in the lighting panel, and specifically can be installed on the lower surface facing the countertop, or between the upper and lower surfaces.
  • the light source can be an LED lamp or a light source in other ways. In a specific application scenario, there can be more choices for the number and arrangement of the light sources 122, such as dual light sources, 4 light sources, or even more light sources.
  • the layout method can also be customized according to requirements.
  • the key to vision-based product recognition is to obtain clear pictures, and stable and uniform illumination is a good guarantee.
  • the light source can take the form of a controllable light source, and the brightness of the light source can be adjusted according to changes in the working environment.
  • an LED controller can be used to control multiple LED lights.
  • the self-service cash register may be provided with multiple cameras 124, 125, and 126, and these cameras may be arranged on the lighting panel 120.
  • the camera can be an ordinary RGB camera or a 3D camera; the number of cameras can be two or more. These cameras are arranged according to the field of view (FOV) of the cameras and the size of the product placement table.
  • FOV field of view
  • the lighting panel is a rectangular panel; cameras can be arranged at the four top corners of the rectangular panel. Further, a camera can also be arranged in the center of the rectangular panel. In another specific example, several cameras may be arranged along the outer edge of the lighting panel. For example, if the lighting panel has an oval shape, several cameras can be arranged at certain intervals along the circumference of the oval.
  • the purpose of arranging multiple cameras is to take pictures of commodities placed on the table from different angles to obtain images from multiple angles, so as to effectively avoid occlusion between commodities.
  • multiple cameras can be arranged to shoot at different angles.
  • the angle at which the camera faces may be the direction of the center line of its field of view FOV.
  • different cameras are arranged to obtain videos or images of the product toward at least one of the top view direction, the front view direction, the left view direction, the right view direction, and the rear view direction of the product.
  • the camera can be installed on objects other than the lighting panel.
  • a camera may also be arranged on the pillar 30 supporting the lighting panel 120, so as to take pictures toward the front view or the rear view direction of the product.
  • Fig. 4 shows a schematic diagram of the structure of the cash register in an embodiment.
  • a camera 127 is arranged at the center of the lighting panel 120, and the camera can photograph the product 132 from a top view direction.
  • a camera 128 is arranged at the top corner of the lighting panel 120, and the direction the camera faces is shown as arrow F1.
  • the direction of F1 can be regarded as the oblique direction of the product.
  • the oblique direction can be considered, for example, as an angle between 30 and 60 degrees with respect to the vertical direction of the table.
  • a camera 129 is also arranged on the pillar 30, and the direction the camera faces is shown as an arrow F2.
  • the direction of F2 can be considered as the front or rear direction of the product.
  • the above pillar 30 can also have more functions.
  • the pillar 30 is a hollow pillar, and the hollow part can accommodate a connection line that provides power and/or control for the light source and/or the camera.
  • Fig. 5 shows a schematic structural diagram of a cash register according to an embodiment. In the example of FIG. 5, a display device 31 is installed on the pillar 30 for displaying the result of pricing the commodity.
  • the self-service cashier In order to realize self-service cashier, the self-service cashier also needs to be equipped with corresponding electronic equipment or pricing equipment, collectively referred to as processing equipment.
  • the processing device is used to price the commodities according to the category or price of the corresponding commodity determined by the image of each commodity.
  • the processing device includes a communication unit.
  • the communication unit sends the image to the server.
  • the server performs various processing based on the image to determine the category or price of each commodity.
  • the category or price of each commodity is received from the server, and the commodity on the cash register is calculated accordingly.
  • the sending function and receiving function of the communication unit can be separated; the sending function is bound with the camera, and the receiving function is combined with the processing device.
  • the processing device can process the collected images by itself to obtain the image part of each commodity, and determine the category and/or price of each commodity from it.
  • FIG. 6 is a schematic diagram of the structure of the processing equipment of the self-service cash register in the embodiment of the present specification.
  • the processing equipment of the self-service cash register may include multiple electronic devices or devices.
  • the processor 210 controls the overall operation of the processing device.
  • the LED controller 232 can be used to control a plurality of LED lights (LED#1, LED#2, LED#N) so as to provide uniform and stable lighting.
  • CAM HUB 234 is a camera hub, which can be used to control multiple cameras (CAM#1, CAM#2, CAM#N) to acquire images.
  • the device can also include a network/bus interface 226 coupled to the data link for data communication with the server; the network/bus interface 226 can also receive images from the camera; in the case of wireless connection
  • the network/bus interface 226 may include a wireless transceiver.
  • Electronic equipment also includes flash memory FLASH 224.
  • the FLASH 224 can store software, which is loaded from the FLASH into the DRAM 222, and thereby controls the CPU 210 to perform corresponding operations.
  • Fig. 7 is a schematic flowchart of a self-service cash register method according to an embodiment of the present specification. This process can be implemented by the processing device of FIG. 6.
  • the user places multiple commodities on the countertop of the cash register.
  • multiple cameras are used to take pictures of the product at the same time, where the product is illuminated by the aforementioned lighting panel.
  • the image is sent to the server system.
  • the category or price information of a plurality of commodities from the server system is received.
  • multiple commodities are priced according to the commodity category or price information.
  • Fig. 8 is a schematic flowchart of a self-service cashier method according to another embodiment of the present specification. This process can be implemented by processing equipment. This embodiment is different from FIG. 7 in that, instead of the above steps S706 and S708, in step S806 of FIG. 8, the processing device itself performs product recognition on the image obtained by the camera.
  • the product identification may include barcode detection and/or visual recognition, so as to identify the category of the product and obtain its price.
  • the lighting panel blocks the external uncontrollable light, and at the same time provides a controllable and stable lighting environment for the products on the countertop, which is very conducive to the image quality of the products.
  • multiple cameras take pictures from multiple angles, so that the form of the product can be obtained from different angles, and the occlusion of the product can be avoided. In this way, obtaining high-quality, multi-angle commodity images is very helpful to improve the accuracy of the self-service cashier's product recognition based on the image and the efficiency of self-service cashier.
  • a self-service cashier can be set up in the express channel, allowing users who have not purchased many commodities to complete price calculation through self-service cashier. It not only satisfies the user's sense of participation, but also greatly shortens the checkout time.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

一种自助收银台。在本说明书实施例中，该收银台包括：台面，用于承载至少一个商品；照明面板，与所述台面相对设置，其中包括至少一个光源，所述至少一个光源为承载在所述台面上的至少一个商品提供照明；支柱，连接所述台面和所述照明面板，并用于支撑所述照明面板；多个摄像头，用于拍摄所述至少一个商品的图像，所述图像用以进行商品识别和计价；所述多个摄像头中的至少一部分设置于所述照明面板上。本说明书实施例提供稳定可控的照明，提升拍照的质量。

Description

自助收银台 技术领域
本发明涉及收银台技术领域，尤其涉及一种自助收银台。
背景技术
技术的发展推动了零售领域的变革。新零售领域采用自助收银台来提升收银效率并减少人工成本。其中，基于机器视觉进行商品识别的方案由于其成本和精度成为业界主流方案之一。但是，视觉商品识别是采用机器视觉算法通过商品的外观来进行识别的。商品外观受外部光线的强度影响(例如强光、或者光线不足)，或者外部光线的颜色影响(不同颜色的灯光)，或者商品之间的相互遮挡，上述这些因素会影响成像质量，从而降低识别精度或者引起识别错误。有必要消除上述因素的影响。
发明内容
本说明书实施例提供一种自助收银台。该收银台包括：台面，用于承载至少一个商品；照明面板，与所述台面相对设置，其中包括至少一个光源，所述至少一个光源为承载在所述台面上的至少一个商品提供照明；支柱，连接所述台面和所述照明面板，并用于支撑所述照明面板；多个摄像头，用于拍摄所述至少一个商品的图像，所述图像用以进行商品识别和计价；其中，所述多个摄像头中的至少一部分设置于所述照明面板上。
在一种可能实施方式中，照明面板包括遮光板，所述遮光板由不透明材料或半透明材料制成，用于遮挡来自上方的光线；所述至少一个光源设置在所述遮光板的面向所述台面的一侧。
在一种可能实施方式中，照明面板包括上表面和下表面，所述上表面背离所述台面，由不透明材料或半透明材料制成；所述下表面朝向所述台面，由透明材料制成；所述至少一个光源设置于所述上表面和下表面之间，透过所述下表面照射所述台面。
在一种可能实施方式中，所述至少一个光源为与所述照明面板大小基本相同的面光源。
在一种可能实施方式中，所述至少一个光源包括多个点光源，所述多个点光源分散设置于所述照明面板中。
进一步的，在一种可能实施方式中，所述多个点光源包括多个LED灯，所述多个LED灯通过LED控制器控制。
在一种可能实施方式中，支柱为中空支柱，其中容纳为所述光源和/或所述摄像头提供电源和/或控制的连接线路。
在一种可能实施方式中，支柱上安装有显示设备，用于显示对所述至少一个商品的计价结果。
在一种可能实施方式中，多个摄像头中包括第一摄像头，所述第一摄像头设置于所述支柱上。
在一种可能实施方式中，照明面板为矩形面板，所述多个摄像头包括，设置于所述矩形面板四个顶角处的摄像头。
在一种可能实施方式中，所述多个摄像头朝向商品的俯视方向、前视方向、左视方向、右视方向、后视方向中的至少一个方向。
在一种可能实施方式中，所述多个摄像头中包括第二摄像头，所述第二摄像头朝向的方向与所述台面的垂直方向之间的夹角在30度-60度之间。
在一种可能实施方式中，收银台还包括处理设备，所述处理设备连接到所述多个摄像头，以获取其拍摄的图像。
在一种可能实施方式中，所述处理设备包括通信单元，用于将所述图像发送至服务器，并且接收至少一个商品中各商品的类别或者价格
因此，本说明书实施例在自助收银台上布置不透明或半透明的照明面板，一方面遮挡天花板上不可控的照明光线，另一方面提供稳定可控的照明，提升拍照的质量，避免产生阴影等。除此之外，在照明面板上部署2个以上摄像头，在商品有互相遮挡的情况下，也可有效提升图像采集质量。
附图说明
图1是本说明书实施例的自助收银台的结构示意图；
图2a示出在一个实施例中收银台的结构示意图；
图2b示出在另一个实施例中收银台的结构示意图；
图3示意了从下方看到的照明面板120的底视图；
图4示出在一个实施例中收银台的结构示意图；
图5示出根据一个实施例的收银台的结构示意图；
图6是本说明书实施例的自助收银台的处理设备结构示意图；
图7是本说明书实施例的自助收银方法的流程示意图；
图8是本说明书另一实施例的自助收银方法的流程示意图。
具体实施方式
为使本发明实施例的技术方案以及优点表达的更清楚，下面通过附图和实施例，对本发明的技术方案做进一步的详细描述。
在本申请的描述中，术语“中心”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本申请和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本申请的限制。
图1是本说明书一个实施例的自助收银台的结构示意图。如图1所示，自助收银台12包括台面130和照明面板120，彼此相对设置。其间，可以采用一根或者多根支柱30，将台面130和照明面板120连通，并用于支撑面板120。支柱内可以设置为面板120内嵌入或设置的电子或电器设备提供电源或者控制的线路。台面130位于下方，用于承载一件或多件商品132、134。照明面板120位于上方，用于遮挡来自收银台上方的不可控的光线，并为台面上的商品提供理想的照明环境，使得商品的光照稳定，有助于商品检测或识别算法的运行。
具体的，照明面板120可以包括至少一个光源。在图1的示例中，至少一个光源被示例性示出为光源A，光源B，光源C和光源D。
自助收银台可以设置多个摄像头，用于拍摄商品132、134的图像，拍摄的图像用以进行商品识别和计价。在图1的示例中，多个摄像头被示例性示出为摄像头A和摄像头B，设置于照明面板120上。
下面分别描述收银台各个部件的各种具体实施方式。
照明面板120可以有多种形状，比如长方形、弧形，两侧有延伸盖板等。只要能 遮挡或部分遮挡面板上方光源，任何面板形状都可以接受。照明面板120的大小可以与台面相当，也可以略大于或略小于台面大小。
图2a示出在一个实施例中收银台的结构示意图。在图2a的例子中，照明面板120包括遮光板121，该遮光板由不透明材料或半透明材料制成，用于遮挡来自上方的不可控的光线。光源122设置在遮光板的面向台面的一侧，从而为台面提供照明。
图2b示出在另一个实施例中收银台的结构示意图。在图2b的例子中，照明面板120包括上表面1201和下表面1202，下表面1202朝向台面，或者说更靠近台面，可以由透明材料制成。而上表面1201背离台面，或者说更远离台面，由不透明材料或半透明材料制成。光源122设置在两个表面之间，透过透明的下表面照射台面，同时通过不透明或半透明的上表面遮挡上方的光线。在一个例子中，下表面可以由磨砂玻璃之类的具有漫反射的材料制成，在透光的同时，使得光照更加均匀，更有利于商品的光照环境。
照明面板120中的光源可以有多种设置方式。在一个例子中，光源可以采用与照明面板大小基本相同的面光源。在另一例子中，光源可以包括线性光源，例如由多个发光棒组成。在又一例子中，光源可以包括多个点光源，这些点光源分散设置于照明面板中。
图3示意了从下方看到的照明面板120的底视图。在图3的示例中，照明面板包括多个光源122。这些光源122分散地设置于照明面板中，具体可以安装在朝向台面的下表面上，或者设置在上下表面之间。光源可以是LED灯或者采用其它方式的光源。在具体应用场景中，光源122的数量和布置情况可以有较多选择，双光源、4光源，甚至更多的光源都可以。布局方法也可以根据需求来定制。基于视觉的商品识别关键就是需要获取清晰的图片，稳定且均匀的光照是良好保证。
光源可以采取可控光源的形式，根据工作环境的变化而调整光源的亮度。例如，可以采取LED控制器对多个LED灯进行控制。
在图3的示例中，自助收银台可以设置多个摄像头124、125、126，这些摄像头可以布置在照明面板120上。摄像头可以是普通的RGB摄像头，也可以是3D摄像头；摄像头的数量可以是两个或两个以上。根据采用摄像头的视场(FOV)及商品放置台的大小，布置这些摄像头。
在不同应用场景中，摄像头的数量和布置情况可以有较多选择，2摄像头，3摄像头及更多摄像头都可能。布局方法也可以根据需求来定制。例如，在一个具体例子中， 照明面板为矩形面板；可以在该矩形面板四个顶角处分别布置摄像头。进一步的，还可以在矩形面板的中心布置摄像头。在另一具体例子中，可以沿着照明面板的外边沿布置若干摄像头。例如，如果照明面板为椭圆形，则可以沿着椭圆圆周，以一定间隔布置若干摄像头。
需要理解，布置多个摄像头的目的在于，从不同角度对台面上放置的商品进行拍摄，获得多角度的图像，从而有效避免商品之间的遮挡。为此，多个摄像头可以被布置为，朝向不同角度进行拍摄。这里摄像头朝向的角度可以是其视场FOV的中心线的方向。
在一个例子中，不同摄像头被布置为，朝向商品的俯视方向、前视方向、左视方向、右视方向、后视方向中的至少一个方向获取商品的视频或图像。为了获取前视、后视、左视或者右视方向的图像，摄像头可以安装在照明面板以外的其它物体上。例如，在一个实施例中，还可以在支撑照明面板120的支柱30上布置摄像头，从而朝向商品的前视或后视方向进行拍摄。
图4示出在一个实施例中收银台的结构示意图。在图4的示例中，照明面板120的中心处布置有摄像头127，该摄像头可以从俯视方向，对商品132进行拍摄。照明面板120的顶角处布置有摄像头128，该摄像头朝向的方向示出为箭头F1。F1的方向可以认为属于商品的斜视方向。斜视方向例如可以认为是，与台面的垂直方向的夹角在30-60度之间。
此外，在支柱30上还布置有摄像头129，该摄像头朝向的方向示出为箭头F2。F2的方向可以认为是商品的前视或后视方向。
当然，还可以在此基础上布置更多的摄像头，从而从更多角度进行拍摄。
以上的支柱30除了用于支撑照明面板120，安装摄像头，还可以有更多的作用。
在一个实施例中，支柱30为中空支柱，中空部分可以容纳为光源和/或摄像头提供电源和/或控制的连接线路。图5示出根据一个实施例的收银台的结构示意图。在图5的示例中，支柱30上安装有显示设备31，用于显示对商品的计价结果。
为了实现自助收银，自助收银台还需要配备相应的电子设备或计价设备，统称为处理设备。处理设备用于根据由各商品的图像确定的对应商品的类别或者价格，对商品进行计价。
在一个例子中，处理设备包括通信单元。通信单元将图像发送至服务器。服务器 根据图像进行各种处理以确定各商品的类别或价格。从服务器接收各商品的类别或者价格，并且由此对收银台上的商品计价。在一种可能的例子中，通信单元的发送功能和接收功能可以分离；发送功能和摄像头绑定，而接收功能则与处理设备结合在一起。
在另一个例子中，处理设备可以自行对采集的图像进行处理，获得各商品的图像部分，并且从中确定各商品的类别和/或价格。
图6是本说明书实施例的自助收银台的处理设备结构示意图。自助收银台的处理设备可包括多个电子器件或装置。如图6所示，处理器210控制处理设备的总体操作。LED控制器232可用于对多个LED灯(LED#1，LED#2，LED#N)进行控制，使得其提供均匀稳定的照明。CAM HUB 234是一种摄像头集线器，可用于控制多个以上摄像头(camera)(CAM#1，CAM#2,CAM#N)获取图像。在可选的情况下，设备还可包括耦接至数据链路的网络/总线接口226，用于和服务器进行数据通信；网络/总线接口226还可以接收来自摄像头的图像；在无线连接的情况下，网络/总线接口226可包括无线收发器。电子设备还包括闪存FLASH 224。在一个例子中，FLASH 224可存储软件，软件自FLASH中加载于DRAM 222中，并且由此控制CPU 210执行相应操作。
图7是本说明书实施例的自助收银方法的流程示意图。该流程可以由图6的处理设备实施。在步骤S702，用户将多个商品放置在收银台的台面上。在步骤S704，利用多个摄像头对商品同时拍照，其中商品通过前述的照明面板进行照明。在步骤S706，将图像发送给服务器系统。在步骤S708，接收来自服务器系统的多个商品的类别或价格信息。在步骤S710，根据商品类别或价格信息，对多个商品进行计价。
图8是本说明书另一实施例的自助收银方法的流程示意图。该流程可以由处理设备实施。该实施例与图7的不同在于，取代于以上的步骤S706和S708，在图8的步骤S806中，由处理设备自身对摄像头获得的图像进行商品识别。该商品识别可以包括条形码检测和/或视觉识别，从而识别出商品的类别，进而获得其价格。
在以上实施过程中，照明面板遮挡住外部的不可控光线，同时为台面上的商品提供可控而稳定的照明环境，非常有利于商品的成像质量。另外，多个摄像头从多个角度进行拍摄，从而不同角度获得商品的形态，避免商品的遮挡。如此，获得高质量、多角度的商品图像，非常有利于提高自助收银台基于图像进行的商品识别准确性和自助收银效率。
本说明书披露的技术方案可以适用于超市、便利店。比如，在快速通道可以设置 自助收银台，允许购买商品不多的用户通过自助收银的方式完成计价。既满足用户参与感，也使得收银时间大为缩短。
以上所述的具体实施方式，对本发明的目的、技术方案和有益效果进行了进一步详细说明，所应理解的是，以上所述仅为本发明的具体实施方式而已，并不用于限定本发明的保护范围，凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (14)

  1. 一种自助收银台，其中，包括：
    台面，用于承载至少一个商品；
    照明面板，与所述台面相对设置，其中包括至少一个光源，所述至少一个光源为承载在所述台面上的至少一个商品提供照明；
    支柱，连接所述台面和所述照明面板，并用于支撑所述照明面板；
    多个摄像头，用于拍摄所述至少一个商品的图像，所述图像用以进行商品识别和计价；
    所述多个摄像头中的至少一部分设置于所述照明面板上。
  2. 根据权利要求1所述的自助收银台，其中，所述照明面板包括遮光板，所述遮光板由不透明材料或半透明材料制成，用于遮挡来自上方的光线；所述至少一个光源设置在所述遮光板的面向所述台面的一侧。
  3. 根据权利要求1所述的自助收银台，其中，所述照明面板包括上表面和下表面，所述下表面靠近并朝向所述台面，由透明材料制成；所述上表面背离所述台面，由不透明材料或半透明材料制成；所述至少一个光源设置于所述上表面和下表面之间，透过所述下表面照射所述台面。
  4. 根据权利要求1所述的自助收银台，其中，所述至少一个光源为与所述照明面板大小基本相同的面光源。
  5. 根据权利要求1所述的自助收银台，其中，所述至少一个光源包括多个点光源，所述多个点光源分散设置于所述照明面板中。
  6. 根据权利要求5所述的自助收银台，其中，所述多个点光源包括多个LED灯，所述多个LED灯通过LED控制器控制。
  7. 根据权利要求1所述的自助收银台，其中，所述支柱为中空支柱，其中容纳为所述光源和/或所述摄像头提供电源和/或控制的连接线路。
  8. 根据权利要求1所述的自助收银台，其中，所述支柱上安装有显示设备，用于显示对所述至少一个商品的计价结果。
  9. 根据权利要求1所述的自助收银台，其中，所述多个摄像头中包括第一摄像头，所述第一摄像头设置于所述支柱上。
  10. 根据权利要求1所述的自助收银台，其中，所述照明面板为矩形面板，所述多个摄像头包括，设置于所述矩形面板四个顶角处的摄像头。
  11. 根据权利要求1所述的自助收银台，其中，所述多个摄像头朝向商品的俯视方 向、前视方向、左视方向、右视方向、后视方向中的至少一个方向。
  12. 根据权利要求1所述的自助收银台，其中，所述多个摄像头中包括第二摄像头，所述第二摄像头朝向的方向与所述台面的垂直方向之间的夹角在30度-60度之间。
  13. 根据权利要求1所述的自助收银台，其中，还包括处理设备，所述处理设备连接到所述多个摄像头，以获取其拍摄的图像。
  14. 根据权利要求13所述的自助收银台，其中，所述处理设备包括通信单元，用于将所述图像发送至服务器，并且接收至少一个商品中各商品的类别或者价格。
PCT/CN2020/071402 2019-04-15 2020-01-10 自助收银台 WO2020211486A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/816,503 US11182759B2 (en) 2019-04-15 2020-03-12 Self-service checkout counter

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201920505397.8U CN210072835U (zh) 2019-04-15 2019-04-15 自助收银台
CN201920505397.8 2019-04-15

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/816,503 Continuation US11182759B2 (en) 2019-04-15 2020-03-12 Self-service checkout counter

Publications (1)

Publication Number Publication Date
WO2020211486A1 true WO2020211486A1 (zh) 2020-10-22

Family

ID=69437041

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/071402 WO2020211486A1 (zh) 2019-04-15 2020-01-10 自助收银台

Country Status (2)

Country Link
CN (1) CN210072835U (zh)
WO (1) WO2020211486A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11134798B1 (en) 2020-06-29 2021-10-05 Ncr Corporation Vision-based frictionless self-checkouts for small baskets

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6457644B1 (en) * 1998-11-10 2002-10-01 Ncr Corporation Item checkout device including a bar code data collector and a produce data collector
CN105718833A (zh) * 2014-12-23 2016-06-29 东芝泰格有限公司 图像识别装置及商品信息处理装置
CN207529487U (zh) * 2017-03-22 2018-06-22 东芝泰格有限公司 自助式收银机
CN109558867A (zh) * 2017-09-27 2019-04-02 北京缤歌网络科技有限公司 信息采集装置、方法及应用

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6457644B1 (en) * 1998-11-10 2002-10-01 Ncr Corporation Item checkout device including a bar code data collector and a produce data collector
CN105718833A (zh) * 2014-12-23 2016-06-29 东芝泰格有限公司 图像识别装置及商品信息处理装置
CN207529487U (zh) * 2017-03-22 2018-06-22 东芝泰格有限公司 自助式收银机
CN109558867A (zh) * 2017-09-27 2019-04-02 北京缤歌网络科技有限公司 信息采集装置、方法及应用

Also Published As

Publication number Publication date
CN210072835U (zh) 2020-02-14

Similar Documents

Publication Publication Date Title
CN103048333B (zh) 外观检测设备及方法
WO2017126253A1 (ja) 情報処理装置、情報処理方法、及び、プログラム
US8619061B2 (en) Optical touch apparatus and operating method thereof
US9600754B2 (en) Machine-readable glass
US11113680B2 (en) Self-service checkout counter checkout
US10901548B2 (en) Touch screen rear projection display
US20110074738A1 (en) Touch Detection Sensing Apparatus
CN107222591A (zh) 影像传感器、相机模组和电子装置
WO2020211486A1 (zh) 自助收银台
US20100295823A1 (en) Apparatus for touching reflection image using an infrared screen
CN102591532A (zh) 双反射镜交叉定位电子白板装置
CN103348306B (zh) 交互式显示设备以及交互式显示设备中的方法
CN109634646A (zh) 基于sftp的扫码终端匹配升级固件的方法和装置
WO2015147328A1 (ja) Ｐｏｓ端末装置
TWI610282B (zh) 拼接螢幕顯示方法及系統
US11182759B2 (en) Self-service checkout counter
CN109636405A (zh) 基于人脸识别功能的扫码支付方法和装置
CN109886671A (zh) 基于双屏幕的二维码支付方法和装置
CN109961283A (zh) 基于动态口令和数字证书的二维码支付方法和装置
JP2019159433A (ja) 画像認識システム
US11269183B2 (en) Display information on a head-mountable apparatus corresponding to data of a computing device
CN208794067U (zh) 一种用于机器视觉的光源装置
JP6326866B2 (ja) 表示装置、表示方法及びプログラム
CN113920342A (zh) 一种交互式投影仪多屏联动的方法、系统、装置和介质
US20210149544A1 (en) Information processing apparatus, information processing method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20790814

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20790814

Country of ref document: EP

Kind code of ref document: A1