WO2019080674A1

WO2019080674A1 - Self-service checkout device, method, apparatus, medium and electronic device

Info

Publication number: WO2019080674A1
Application number: PCT/CN2018/106540
Authority: WO
Inventors: 周鸣; 陈宇; 王永杰; 冯亦军; 刘强; 翁志
Original assignee: 北京京东尚科信息技术有限公司; 北京京东世纪贸易有限公司
Priority date: 2017-10-23
Filing date: 2018-09-19
Publication date: 2019-05-02
Also published as: CN109697801A

Abstract

A self-service checkout device, method, apparatus, medium and electronic device, the self-service checkout method comprising: identifying whether an item to be checked out is an item of a target type when the item to be checked out is placed in a checkout area (S402); if the item to be checked out is an item of the target type, then identifying the quantity of the item to be checked out, acquiring the unit price of the item to be checked out, and generating checkout information according to the quantity and the unit price of the item to be checked out (S404); if the item to be checked out is not an item of the target type, then identifying the category of the item to be checked out, acquiring the weight of the item to be checked out, and generating checkout information according to the category and the weight of the item to be checked out (S406). The present technical solution improves the range of application of self-service checkout and is beneficial in improving the self-service checkout experience of users.

Description

Self-service settlement equipment, methods, devices, media and electronic devices

The present disclosure claims the priority of the invention patent application whose application date is October 23, 2017, the application number is CN201710994598.4, and the invention creation name is "self-checkout device, method, device, medium and electronic device".

Technical field

The present invention relates to the field of computer technologies, and in particular, to a self-service settlement device, method, device, medium, and electronic device.

Background technique

Traditional offline retailing is usually settled by a cashier model, which mainly includes cashier scanning, ticketing, payment and other processes. In this scenario, a cashier needs a cashier and the labor costs are higher. With the introduction of the new retail concept, there is a self-service settlement machine on the market. This self-service settlement machine requires the customer to operate the scan code gun to scan the barcode on the back of the product. Although the cashier is liberated and the labor cost is reduced, the scan code pair The customer's operational proficiency requirements are high, which affects the efficiency of self-checkout. At the same time, the customer self-scanning code is only applicable to the settlement of standard products, but it is not supported for non-standard products such as fruits and vegetables that need to be weighed and settled.

Therefore, how to improve the scope of self-checkout and improve the self-service settlement experience of users has become a technical problem to be solved.

It should be noted that the information disclosed in the Background section above is only for enhancement of understanding of the background of the invention, and thus may include information that does not constitute the prior art known to those of ordinary skill in the art.

Summary of the invention

It is an object of the present invention to provide a self-checkout device, method, apparatus, medium, and electronic device that overcomes at least some of the problems due to limitations and disadvantages of the related art.

Other features and advantages of the present invention will be apparent from the description and appended claims.

According to a first aspect of the present invention, a self-service settlement device is provided, comprising: a settlement station, wherein the settlement station is provided with a commodity placement area; and a weighing device is disposed on the settlement desk for settlement The product is weighed; the identification device is disposed on the settlement counter for identifying information of the item to be settled; the processor is electrically connected to the weighing device and the identification device for use according to the weighing device The obtained weight information and the recognition result of the identification device generate settlement information; and an output device electrically connected to the processor for outputting the settlement information.

In some embodiments of the present invention, based on the foregoing aspect, the identification device includes: at least one image acquisition device, configured to collect image information of the commodity to be settled, and transmit the acquired image information to the processor.

In some embodiments of the present invention, based on the foregoing aspect, the image collection area formed by the at least one image acquisition device covers the item placement area.

In some embodiments of the present invention, based on the foregoing aspect, the output device is disposed on the settlement table by a bracket extending from the carrier corresponding to the commodity placement area, the at least one image acquisition The device is disposed on the carrier.

In some embodiments of the present invention, based on the foregoing solution, the identification device includes: a radio frequency identifier, configured to identify a radio frequency tag set on the commodity to be settled to obtain information of the commodity to be settled.

In some embodiments of the present invention, based on the foregoing solution, the identification device includes: a barcode identifier, configured to identify a barcode set on the commodity to be settled to obtain information of the commodity to be settled.

In some embodiments of the present invention, based on the foregoing aspect, the output device includes: a display device disposed on the settlement station for displaying the settlement information; and/or an audio playback device, The settlement information is played by voice.

According to a second aspect of the embodiments of the present invention, a self-service settlement method is provided, which is applied to the self-service settlement device according to the first aspect of the present invention, the self-service settlement method includes: when the goods to be settled are placed in the settlement area Identifying whether the item to be settled is a product of a target type; if the item to be settled is an item of the target type, identifying the quantity of the item to be settled and acquiring the unit price of the item to be settled, according to the The settlement information is generated by the quantity and the unit price of the goods to be settled; if the goods to be settled are not the goods of the target type, the type of the goods to be settled is identified and the weight of the goods to be settled is obtained, according to the goods to be settled The type and weight of the settlement information is generated.

In some embodiments of the present invention, based on the foregoing solution, identifying whether the item to be settled is a target type of item comprises: determining whether information of the item to be settled can be identified by a radio frequency identifier and/or a barcode identifier If the information of the item to be settled can be identified by the radio frequency identifier and/or the barcode identifier, it is determined that the item to be settled is the item of the target type.

In some embodiments of the present invention, based on the foregoing solution, identifying whether the item to be settled is a target type of item comprises: collecting an image including the item to be settled by an image collection device; and identifying the to-be-according according to the image The type of the settled item; determining, based on the identified type, whether the item to be settled is the item of the target type.

In some embodiments of the present invention, identifying the category of the item to be settled according to the image according to the foregoing solution, comprising: identifying item information in the image based on a target detection technology; performing feature encoding on the item information, Obtaining the feature of the commodity to be settled; comparing the feature of the commodity to be settled with the pre-stored feature to determine the type of the commodity to be settled.

In some embodiments of the present invention, the feature information is encoded according to the foregoing solution to obtain the feature of the commodity to be settled, including: separately encoding the commodity information by using a plurality of deep neural networks. Obtaining a plurality of coding results; splicing the plurality of coding results to obtain features of the commodity to be settled.

In some embodiments of the present invention, based on the foregoing solution, comparing the feature of the item to be settled with the pre-stored feature to determine the type of the item to be settled includes: calculating a feature of the item to be settled a distance from the pre-stored feature; a feature in which a distance between the pre-stored feature and the feature of the item to be settled is less than a predetermined threshold is used as a matching target feature; and a product type corresponding to the target feature is used as The type of the item to be settled.

In some embodiments of the invention, based on the aforementioned scheme, the item information in the image is identified based on the Faster-RCNN algorithm.

In some embodiments of the present invention, based on the foregoing solution, the self-service settlement method further includes: outputting the settlement information.

According to a third aspect of the present invention, there is provided a self-service settlement device, which is applied to the self-service settlement device according to the first aspect of the above embodiment, the self-service settlement device comprising: an identification unit, configured to: When the settlement area is placed, the first processing unit is configured to identify the quantity of the goods to be settled when the goods to be settled are the goods of the target type, and Obtaining the unit price of the goods to be settled, generating settlement information according to the quantity and unit price of the goods to be settled; and the second processing unit, configured to identify the to-be-settled when the goods to be settled are not the goods of the target type The type of the product is obtained, and the weight of the item to be settled is acquired, and settlement information is generated according to the type and weight of the item to be settled.

According to a fourth aspect of the embodiments of the present invention, there is provided a computer readable medium having stored thereon a computer program, the program being executed by a processor to implement the self-service settlement method as described in the first aspect of the above embodiments.

According to a fifth aspect of the embodiments of the present invention, there is provided an electronic device comprising: one or more processors; storage means for storing one or more programs when the one or more programs are When executed by the plurality of processors, the one or more processors are caused to implement the self-service settlement method as described in the first aspect of the above embodiments.

In the technical solution provided by some embodiments of the present invention, since the self-service settlement device includes the weighing device and the identification device, when the item to be settled is placed in the item placement area on the settlement counter, if the identification device identifies the item to be settled For the standard product, the settlement can be directly performed. If the identification device recognizes that the goods to be settled are non-standard products, the weight information can be obtained by the weighing device to perform settlement according to the weight information. It can be seen that the self-checkout device in the embodiment of the present invention can not only settle the standard product, but also can settle the non-standard product, improve the applicable scope of the self-service settlement, and is beneficial to improving the self-service settlement experience of the user.

In a technical solution provided by some embodiments of the present invention, when the item to be settled is placed in the settlement area, it is identified whether the item to be settled is a target type of product (eg, whether it is a standard product), if the item to be settled is a target type The item is generated based on the quantity and unit price of the item to be settled, and if the item to be settled is not the item of the target type, the settlement information is generated according to the weight and type of the item to be settled, so that different types of goods (such as standards) can be generated. Both non-standard products can automatically generate billing information, which improves the scope of self-checkout and helps improve the user's self-checkout experience.

The above general description and the following detailed description are intended to be illustrative and not restrictive.

DRAWINGS

The accompanying drawings, which are incorporated in the specification It is apparent that the drawings in the following description are only some of the embodiments of the present disclosure, and other drawings may be obtained from those skilled in the art without departing from the drawings.

1 is a block diagram showing the structure of a self-checkout device according to a first embodiment of the present invention;

2 is a schematic view showing a setting position of a camera according to an embodiment of the present invention;

FIG. 3 is a block diagram showing the structure of a self-checkout device according to a second embodiment of the present invention; FIG.

4 is a flow chart schematically showing a self-checkout method according to an embodiment of the present invention;

FIG. 5 is a view schematically showing a flowchart for identifying a kind of an item to be settled based on an image according to an embodiment of the present invention; FIG.

Figure 6 is a schematic block diagram of a self-service settlement device in accordance with an embodiment of the present invention;

Figure 7 shows a block diagram of a computer system suitable for use in implementing an electronic device in accordance with an embodiment of the present invention.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be embodied in a variety of forms and should not be construed as being limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more complete and complete, To those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are set forth However, one skilled in the art will appreciate that one or more of the specific details may be omitted or other methods, components, devices, steps, etc. may be employed. In other instances, various aspects of the present disclosure are not obscured by the details of the invention.

In addition, the drawings are merely schematic representations of the present disclosure and are not necessarily to scale. The same reference numerals in the drawings denote the same or similar parts, and the repeated description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily have to correspond to physically or logically separate entities. These functional entities may be implemented in software, or implemented in one or more hardware modules or integrated circuits, or implemented in different network and/or processor devices and/or microcontroller devices.

Fig. 1 is a block diagram showing the structure of a self-checkout apparatus according to a first embodiment of the present invention.

Referring to Fig. 1, the self-checkout device includes a settlement station 11 on which a commodity placement area 111 is provided, and a settlement device 11 is provided with a weighing device and an identification device. Among them, the weighing device is preferably disposed in the product placement area 111, so that the goods to be settled are easily weighed. The identification device is used to identify information of the item to be settled.

The self-checkout device further includes: a processor and an output device. The processor is electrically connected to the weighing device and the identification device, and configured to generate settlement information according to the weight information obtained by the weighing device and the recognition result of the identification device; the output device is electrically connected to the processor, Used to output the settlement information.

In an embodiment of the present invention, as shown in FIG. 1, the above output device may be a display device 16, which is used to display settlement information, and the display device 16 is disposed on the settlement table 11 via the cradle 14. Of course, the output device may also include an audio playback device that can be used to play settlement information.

In an embodiment of the present invention, the identification device may include a radio frequency identifier for identifying a radio frequency tag set on the item to be settled to obtain information of the item to be settled. Alternatively, as shown in FIG. 1, the radio frequency identifier may be disposed at the area 13 below the display device 16, such that when the item to be settled is placed on the item placement area 111, the radio frequency identifier can conveniently identify the item to be settled. Information.

In an embodiment of the invention, the identification device may further comprise at least one image acquisition device for collecting image information of the item to be settled. Optionally, the image acquisition device can be a camera. The image collection area formed by the at least one image acquisition device may cover the commodity placement area 111 to facilitate collecting the product image placed in the commodity placement area 111.

Optionally, in the embodiment of the present invention, as shown in FIG. 1, the carrier 14 corresponding to the product placement area 111 is extended on the bracket 14, and the at least one image capturing device is disposed on the carrying portion 15. In the embodiment of the present invention, as shown in FIG. 2, four cameras 12 may be disposed on the carrying portion 15 for collecting image information of the goods to be settled.

It should be noted that, in other embodiments of the present invention, the number of cameras may be adjusted according to actual needs, and a camera may be disposed on the settlement table 11 to perform all-round shooting of the goods to be settled. In addition, a separate stand for placing the image capture device can be provided.

In an embodiment of the present invention, the identification device may further include: a barcode identifier, configured to identify a barcode set on the commodity to be settled to obtain information of the commodity to be settled.

In the embodiment of the present invention, the self-checkout device can also be set to be portable, as shown in FIG. 3, which can improve the flexibility of the self-checkout device.

After the structure of the self-checkout device of the embodiment of the present invention is introduced, the self-checkout method of the embodiment of the present invention will be described below.

4 is a flow chart schematically showing a self-checkout method according to an embodiment of the present invention, which can be applied to the self-checkout device described in the above embodiment.

Referring to FIG. 4, a self-checkout method according to an embodiment of the present invention includes:

Step S402, when the item to be settled is placed in the settlement area, it is identified whether the item to be settled is an item of the target type.

In the embodiment of the present invention, the target type of goods is an item that can be settled without weighing, such as a packaged standard having a bar code or a radio frequency tag.

The present invention proposes the following identification schemes for identifying whether the goods to be settled are of a target type:

Identification scheme one:

Determining whether the information of the commodity to be settled can be recognized by the radio frequency identifier; if the information of the commodity to be settled can be identified by the radio frequency identifier, determining that the commodity to be settled is the commodity of the target type.

In the identification scheme 1, it is necessary to set a radio frequency tag on the commodity, so that the RFID reader can be used to identify whether the commodity to be settled is a target type of commodity.

Identification scheme two:

Determining whether the information of the item to be settled can be recognized by the barcode identifier; if the information of the item to be settled can be identified by the barcode identifier, determining that the item to be settled is the item of the target type.

Identification scheme three:

Collecting, by the image collecting device, an image including the item to be settled; identifying the type of the item to be settled according to the image; and determining, according to the identified type, whether the item to be settled is the item of the target type.

For the identification scheme 3, referring to FIG. 5, identifying the type of the commodity to be settled according to the image includes the following steps:

Step S501, identifying the commodity information in the image based on the target detection technology.

In an embodiment of the invention, the target detection technique requires the construction of a corresponding distance function to capture the corresponding features for detection. For example, if the goal is to recognize a human face, then you need to construct a distance function to enhance the appropriate features (such as hair color, face, etc.); and if the target is to recognize the gesture, then you need to construct a distance function that captures the similarity of the pose. To handle a wide variety of feature similarities, the distance function can be manually constructed by selecting the appropriate features for a particular task. However, this method requires a lot of manual input, and there is also a problem that the adaptability to the data change is not strong. Thus, embodiments of the present invention employ a metric learning alternative as an alternative to learning the metric distance function for a particular task from the master based on different tasks.

It should be noted that Metric Learning is the similarity learning that is often said. If it is necessary to calculate the similarity between two pictures, how to measure the similarity between the pictures is such that the similarity of the pictures of different categories is small and the pictures of the same category are similar (maximize the inter-class variations and minimize the intra-class variations ) is to measure the goal of learning.

In the embodiment of the present invention, the Faster-RCNN may be used for commodity detection, and the Faster-RCNN is composed of an RPN (Region Proposal Network) and an RCNN (Region CNN), and the RPN output may be the position and size of the object of interest. The RCNN classifies each candidate location. RPN and RCNN are essentially Convolutional Neural Network (CNN), but they share the feature extraction layer, so Faster-RCNN is highly efficient, with the help of GPU (Graphics Processing Unit). Can do it in real time.

Step S502, feature encoding the product information to obtain the feature of the commodity to be settled.

In an exemplary embodiment of the present invention, step S502 includes: separately encoding the commodity information by using a plurality of depth neural networks to obtain a plurality of encoding results; and splicing the plurality of encoding results to obtain a Describe the characteristics of the settled item.

Specifically, the detection result of step S501 is a rectangular frame including the item to be settled, so the purpose of step S502 is to feature-encode the image information in the rectangular frame. Alternatively, the two neural network models, softmax loss and triplet loss, can be trained, and then the commodity information is feature-coded based on the training result. Of course, embodiments of the invention are not limited thereto, and other neural network models may also be employed.

Step S503, comparing the feature of the commodity to be settled with the pre-stored feature to determine the type of the commodity to be settled.

In an exemplary embodiment of the present invention, step S503 includes: calculating a distance between a feature of the item to be settled and a pre-stored feature; and a distance between a feature of the pre-stored feature and a feature of the item to be settled A feature that is less than a predetermined threshold is used as the matched target feature; the product category corresponding to the target feature is used as the type of the commodity to be settled.

It should be noted that the type of goods to be settled may be identified by a SKU (Stock Keeping Unit, which has been extended to the abbreviation of the product uniform number, and each product has a unique SKU number). If there is no match to the target feature, the algorithm returns null.

Continuing to refer to FIG. 4, the self-service settlement method shown further includes:

Step S404: If the item to be settled is the item of the target type, identify the quantity of the item to be settled and obtain the unit price of the item to be settled, and generate settlement information according to the quantity and unit price of the item to be settled.

In an embodiment of the invention, the number of items to be settled may be identified by an image capture device, such as a camera. The unit price of the goods to be settled can be determined based on the identified product information.

Step S406: If the item to be settled is not the item of the target type, identify the type of the item to be settled and obtain the weight of the item to be settled, and generate settlement information according to the type and weight of the item to be settled.

In an embodiment of the present invention, after the settlement information is generated, the settlement information may be output. The settlement information is displayed, for example, by the display device, and/or played by the audio playback device. Of course, the settlement information can also be sent to a designated device, such as a user's mobile phone.

Based on the self-checkout device and the self-service settlement method in the above embodiments, a specific application scenario of the present invention is described below:

a. The customer places the item in the identification area on the settlement counter.

b. After the weight is stabilized, the weighing platform obtains the weight information and triggers the image collecting device to collect the image information of the commodity.

c. The image collection device set at different positions uploads the collected image information to the background for algorithm processing, and returns the identified product SKU.

d. The background also accepts the recognition result of RFID (Radio Frequency Identification) reader.

e. If the RFID has a result, the purchased item can be displayed directly on the display. If the algorithm for image processing returns a result (ie, returns the SKU of the item), then distinguish whether the SKU is a standard product or a non-standard product: if it is a standard product, the number of SKUs is returned according to the algorithm result, and is settled by quantity and unit price; Standard products are settled based on weight information.

f. If the customer does not place the product, but directly scans the code with the scan code gun, the scan code identification settlement is directly performed.

The image processing scheme proposed in the self-checkout method of the above embodiment of the present invention has a fast recognition speed for goods and a high recognition rate. At the same time, the self-settlement method in the embodiment of the present invention supports the identification and settlement of standard products and non-standard products, and supports RFID, barcode, image recognition and settlement, and has wide application range, which is beneficial to improving the settlement experience of users.

Fig. 6 schematically shows a block diagram of a self-checkout device that can be applied to a self-checkout device as described in the above embodiments, in accordance with an embodiment of the present invention.

Referring to FIG. 6, a self-checkout apparatus 600 according to an embodiment of the present invention includes an identification unit 602, a first processing unit 604, and a second processing unit 606.

Specifically, the identifying unit 602 is configured to identify, when the item to be settled is placed in the settlement area, whether the item to be settled is an item of a target type; the first processing unit 604 is configured to: when the item to be settled is the target type When the product is in use, the quantity of the goods to be settled is identified and the unit price of the item to be settled is obtained, and the settlement information is generated according to the quantity and unit price of the item to be settled; the second processing unit 606 is configured to: When the target type of product is described, the type of the item to be settled is identified and the weight of the item to be settled is acquired, and settlement information is generated according to the type and weight of the item to be settled.

In some embodiments of the present invention, based on the foregoing scheme, the identification unit 602 is configured to: determine whether information of the item to be settled can be identified by the radio frequency identifier and/or the barcode identifier; if by radio frequency identifier and/or The barcode identifier can identify the information of the item to be settled, and then determine that the item to be settled is the item of the target type.

In some embodiments of the present invention, based on the foregoing solution, the identification unit 602 is configured to: collect an image including the item to be settled by an image collection device; identify a category of the item to be settled according to the image; Kind, determining whether the item to be settled is an item of the target type.

In some embodiments of the present invention, based on the foregoing scheme, the identifying unit 602 includes: an executing unit, configured to identify item information in the image based on a target detection technology; and a feature encoding unit configured to perform feature encoding on the item information And obtaining a feature of the item to be settled; a determining unit, configured to compare the feature of the item to be settled with the pre-stored feature to determine the type of the item to be settled.

In some embodiments of the present invention, based on the foregoing solution, the feature coding unit is configured to separately perform feature coding on the commodity information through a plurality of deep neural networks to obtain a plurality of coding results; The result is spliced to obtain the characteristics of the item to be settled.

In some embodiments of the present invention, based on the foregoing aspect, the determining unit is configured to: calculate a distance between a feature of the item to be settled and a pre-stored feature; and store the pre-stored feature with the item to be settled The feature that the distance between the features is less than the predetermined threshold is used as the matched target feature; the product category corresponding to the target feature is used as the category of the commodity to be settled.

In some embodiments of the invention, based on the foregoing scheme, the recognition unit 602 identifies the item information in the image based on the Faster-RCNN algorithm.

In some embodiments of the present invention, based on the foregoing solution, the self-service settlement device 600 further includes: an output unit, configured to output the settlement information.

Referring now to Figure 7, a block diagram of a computer system 700 suitable for use in implementing an electronic device in accordance with an embodiment of the present invention is shown. The computer system 700 of the electronic device shown in FIG. 7 is merely an example and should not impose any limitation on the function and scope of use of the embodiments of the present invention.

As shown in FIG. 7, computer system 700 includes a central processing unit (CPU) 701 that can be loaded into a program in random access memory (RAM) 703 according to a program stored in read only memory (ROM) 702 or from storage portion 708. And perform various appropriate actions and processes. In the RAM 703, various programs and data required for system operation are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also coupled to bus 704.

The following components are connected to the I/O interface 705: an input portion 706 including a keyboard, a mouse, etc.; an output portion 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), and the like, and a speaker; a storage portion 708 including a hard disk or the like And a communication portion 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the Internet. Driver 710 is also connected to I/O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like, is mounted on the drive 710 as needed so that a computer program read therefrom is installed into the storage portion 708 as needed.

In particular, the processes described above with reference to the flowcharts may be implemented as a computer software program in accordance with an embodiment of the present invention. For example, an embodiment of the invention includes a computer program product comprising a computer program carried on a computer readable medium, the computer program comprising program code for executing the method illustrated in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via communication portion 709, and/or installed from removable media 711. When the computer program is executed by the central processing unit (CPU) 701, the above-described functions defined in the system of the present application are executed.

It should be noted that the computer readable medium shown in the present invention may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain or store a program, which can be used by or in connection with an instruction execution system, apparatus or device. In the present invention, a computer readable signal medium may include a data signal that is propagated in the baseband or as part of a carrier, in which computer readable program code is carried. Such propagated data signals can take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer readable signal medium can also be any computer readable medium other than a computer readable storage medium, which can transmit, propagate, or transport a program for use by or in connection with the instruction execution system, apparatus, or device. . Program code embodied on a computer readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality and operation of possible implementations of systems, methods and computer program products in accordance with various embodiments of the invention. In this regard, each block of the flowchart or block diagrams can represent a module, a program segment, or a portion of code that includes one or more Executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two successively represented blocks may in fact be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams or flowcharts, and combinations of blocks in the block diagrams or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be used A combination of dedicated hardware and computer instructions is implemented.

The units involved in the embodiments of the present invention may be implemented by software or by hardware, and the described units may also be disposed in the processor. The names of these units do not in any way constitute a limitation on the unit itself.

In another aspect, the present application further provides a computer readable medium, which may be included in an electronic device described in the above embodiments, or may be separately present without being assembled into the electronic device. in. The computer readable medium carries one or more programs that, when executed by one of the electronic devices, cause the electronic device to implement the self-service settlement method as described in the above embodiments.

For example, the electronic device may implement, as shown in FIG. 4, step S402, when the item to be settled is placed in the settlement area, identify whether the item to be settled is a product of a target type; and step S404, if the item to be settled If the product is the product of the target type, the quantity of the item to be settled is identified, and the unit price of the item to be settled is obtained, and settlement information is generated according to the quantity and unit price of the item to be settled; and step S406, if the item is to be settled If the product is not the target type of product, the type of the item to be settled is identified and the weight of the item to be settled is obtained, and settlement information is generated according to the type and weight of the item to be settled.

As another example, the electronic device can implement various steps as shown in FIG.

It should be noted that although several modules or units of equipment for action execution are mentioned in the detailed description above, such division is not mandatory. In fact, the features and functions of the two or more modules or units described above may be embodied in one module or unit in accordance with the embodiments of the invention. Conversely, the features and functions of one of the modules or units described above may be further divided into multiple modules or units.

Through the description of the above embodiments, those skilled in the art will readily understand that the example embodiments described herein may be implemented by software or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network. A number of instructions are included to cause a computing device (which may be a personal computer, server, touch terminal, or network device, etc.) to perform a method in accordance with an embodiment of the present invention.

Other embodiments of the invention will be apparent to those skilled in the <RTIgt; The present application is intended to cover any variations, uses, or adaptations of the present invention, which are in accordance with the general principles of the present invention and include common general knowledge or conventional technical means in the art that are not disclosed in the present invention. . The specification and examples are to be considered as illustrative only,

It is to be understood that the invention is not limited to the details of the details of The scope of the invention is limited only by the appended claims.

Claims

A self-service settlement device, comprising:

a settlement counter, wherein the settlement counter is provided with a commodity placement area;

a weighing device, disposed on the settlement counter, for weighing the goods to be settled;

Identifying a device, disposed on the settlement counter, for identifying information of the item to be settled;

a processor, electrically connected to the weighing device and the identification device, configured to generate settlement information according to weight information obtained by the weighing device and a recognition result of the identification device;

An output device electrically coupled to the processor for outputting the settlement information.
The self-checkout device according to claim 1, wherein the identification device comprises:

At least one image acquisition device is configured to collect image information of the item to be settled, and transmit the collected image information to the processor.
The self-checkout device according to claim 2, wherein the image collection area formed by the at least one image acquisition device covers the commodity placement area.
The self-checkout device according to claim 2, wherein the output device is disposed on the settlement table via a bracket, and the bracket extends a bearing portion corresponding to the product placement area, the at least one An image capture device is disposed on the carrier.
The self-checkout device according to claim 1, wherein the identification device comprises:

The radio frequency identifier is configured to identify the radio frequency tag set on the commodity to be settled to obtain the information of the commodity to be settled.
The self-checkout device according to claim 1, wherein the identification device comprises:

The barcode identifier is configured to identify a barcode set on the commodity to be settled to obtain information of the commodity to be settled.
The self-checkout device according to any one of claims 1 to 6, wherein the output device comprises:

a display device, the display device being disposed on the settlement counter for displaying the settlement information; and/or

An audio playback device for playing the settlement information by voice.
A self-service settlement method, which is applied to the self-checkout device according to any one of claims 1 to 7, characterized in that it comprises:

When the item to be settled is placed in the settlement area, it is identified whether the item to be settled is a target type of item;

If the item to be settled is the item of the target type, identifying the quantity of the item to be settled and acquiring the unit price of the item to be settled, and generating settlement information according to the quantity and unit price of the item to be settled;

If the item to be settled is not the item of the target type, the type of the item to be settled is identified and the weight of the item to be settled is acquired, and settlement information is generated according to the type and weight of the item to be settled.
The self-service settlement method according to claim 8, wherein the identifying whether the item to be settled is a target type of goods comprises:

Determining whether information of the item to be settled can be identified by the radio frequency identifier and/or the barcode identifier;

If the information of the item to be settled can be identified by the radio frequency identifier and/or the barcode identifier, it is determined that the item to be settled is the item of the target type.
The self-service settlement method according to claim 8, wherein the identifying whether the item to be settled is a target type of goods comprises:

Acquiring an image including the item to be settled by an image collecting device;

Identifying the type of the item to be settled according to the image;

Based on the identified category, it is determined whether the item to be settled is an item of the target type.
The self-service settlement method according to claim 10, wherein the identifying the type of the item to be settled according to the image comprises:

Identifying product information in the image based on a target detection technique;

Characterizing the commodity information to obtain characteristics of the commodity to be settled;

The features of the item to be settled are compared with pre-stored features to determine the type of the item to be settled.
The self-service settlement method according to claim 11, wherein the feature information is encoded to obtain the features of the goods to be settled, including:

Feature information is separately encoded by a plurality of deep neural networks to obtain a plurality of coding results;

The plurality of encoded results are spliced to obtain features of the item to be settled.
The self-service settlement method according to claim 11, wherein comparing the feature of the item to be settled with the pre-stored feature to determine the type of the item to be settled comprises:

Calculating a distance between a feature of the item to be settled and a pre-stored feature;

And a feature that the distance between the pre-stored feature and the feature of the commodity to be settled is less than a predetermined threshold is used as the matched target feature;

The item type corresponding to the target feature is used as the type of the item to be settled.
The self-checkout method according to claim 11, wherein the item information in the image is identified based on a Faster-RCNN algorithm.
The self-service settlement method according to any one of claims 8 to 14, further comprising: outputting the settlement information.
A self-service settlement device, which is applied to the self-service settlement device according to any one of claims 1 to 7, characterized in that it comprises:

a identifying unit, configured to identify, when the item to be settled is placed in the settlement area, whether the item to be settled is a target type of item;

a first processing unit, configured to: when the item to be settled is an item of the target type, identify the quantity of the item to be settled and obtain the unit price of the item to be settled, according to the quantity and unit price of the item to be settled Generate billing information;

a second processing unit, configured to: when the item to be settled is not the item of the target type, identify the type of the item to be settled and obtain the weight of the item to be settled, according to the type and weight of the item to be settled Generate billing information.
A computer readable medium having stored thereon a computer program, wherein the program is executed by a processor to implement the self-service settlement method according to any one of claims 8 to 15.
An electronic device, comprising:

One or more processors;

a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, causing the one or more processors to perform as claimed in claims 8 to 15 A self-service settlement method as described.