RU2726227C1 - Method and system for recognizing encoded data by scanning images - Google Patents

Abstract

FIELD: computer equipment.SUBSTANCE: receiving common list of goods codes, which were loaded into kiosk; receiving from the camera at least one frame containing at least one item from the kiosk, each article containing a code which encodes information on the product after the user has withdrawn the goods from the kiosk; method includes transmitting, at least, one frame with an article code obtained at a previous step, a computer vision algorithm which identifies a commodity code on the frame by obtaining coordinates of said article code; converting by means of a computing device one computer-vision-based code located on the commodity into a text form; determining codes of goods, which user withdrew from kiosk by comparing common list of goods codes, obtained at first step before door user opened and converted previously code, wherein said codes are removed from common list of goods codes; sending a command to the server to debit funds based on certain codes of goods, which the user has withdrawn.EFFECT: technical result is improved accuracy of object recognition inside a vending machine.10 cl, 9 dwg

Description

FIELD OF TECHNOLOGY

[001] This technical solution generally relates to the field of computer technology, and in particular to methods and systems for recognizing codes on objects in vending machines and self-service kiosks.

BACKGROUND

[002] Currently, vending machines are popular because of convenience because they are ready to work at any time of the day or night. In addition, vending machines can be placed in remote places, such as train stations, hotel corridors and the like, which are convenient for customers.

[003] At the same time, with the development of computer technology, it has become possible to solve a number of problems arising in the process of life, to facilitate, accelerate, and improve the quality of the result. For example, the operation of various life support systems, human-computer interaction, the appearance of robotic systems, etc. However, at present, it is not possible to provide a satisfactory result in some tasks (object recognition).

[004] the Creation of devices that perform the functions of recognition of various objects, in most cases, provides the ability to replace a person with a specialized machine. Thanks to this, the capabilities of complex systems that perform various informational, logical, analytical tasks are greatly expanded. It should be noted that the quality of the work performed by a person in the workplace depends on many factors (qualifications, experience, integrity, etc.). Automatic control of complex systems allows monitoring and ensuring timely maintenance, identification of interference and the automatic application of appropriate data processing methods, which improves the quality of information transfer. It is also obvious that the use of automatic systems for the recognition of goods can provide impossible performance for humans.

ESSENCE OF TECHNICAL SOLUTION

[005] This technical solution is aimed at eliminating the disadvantages known from the prior art.

[006] The technical task or technical problem to be solved in this technical solution is the recognition of goods inside the vending machine.

[007] The technical result is to increase the accuracy of recognition of objects inside a vending machine.

[008] This technical result is achieved by implementing a method for recognizing encoded data by scanning images, performed by at least one computing device, in which a general list of product codes that have been downloaded to the kiosk is obtained; receive from at least one camera at least one frame containing at least one product from the kiosk, and each product contains at least one code that encodes product information after the user has removed at least one from the kiosk product; at least one frame with the product code obtained in the previous step is transmitted to the computer vision algorithm, which identifies at least one product code on the frame by obtaining the coordinates of the given product code; by means of a computing device, converting at least one code located on the product identified by the computer vision algorithm into a text view; determining product codes that the user removed from the kiosk by comparing the general list of product codes obtained in the first step before the user opens the door and at least one previously converted code, and these codes are removed from the general list of product codes; send to the server a command to write off funds based on certain codes of goods that the user withdrew.

[009] In some embodiments of the technical solution, the product code is a linear code or a two-dimensional code.

[0010] In some embodiments of the technical solution, the code is affixed to a destructible sticker.

[0011] In some embodiments of the technical solution, a computer age algorithm is implemented in the OpenCV library or libdwt or SimpleCV.

[0012] In some embodiments of the technical solution, the coordinates of the product code on the image in pixels are determined.

[0013] In some embodiments of the technical solution, the door locking unit is an electromagnetic lock, which consists of a metal plate and a magnetic sensor, and / or an electromechanical lock.

[0014] In some embodiments of the technical solution, the system further comprises a temperature information reading unit, which is a set of temperature sensors for generating temperature readings within the kiosk.

[0015] In some embodiments of the technical solution, the information input unit is a contactless card reader.

[0016] In some embodiments of the technical solution, the system interaction unit is a Raspberry Pi.

BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The features and advantages of this technical solution will become apparent from the following detailed description and the accompanying drawings, in which:

[0018] In FIG. Figure 1 shows an example implementation of the architecture of a system for recognizing codes on an object in a vending machine.

[0019] In FIG. 2 shows an example of the implementation of a technical solution, which shows a view from the camera on the product with a glued code.

[0020] In FIG. Figure 3 shows an example implementation in which four cameras are located above a shelf.

[0021] In FIG. 4 shows an example implementation in which a top view with a camera mounted above a shelf is displayed.

[0022] In FIG. 5 shows an example of implementation in which they found the product code, circled it with a frame, and below is written the code that will be sent to 104 block.

[0023] In FIG. Figure 6 shows an embodiment of source images containing products with pasted codes.

[0024] In FIG. 7 shows an embodiment of a source image containing products with a pasted code converted to a black and white version.

[0025] In FIG. Figure 8 shows an embodiment of a source image containing products with a pasted code in which black to white transition gradients are found.

[0026] In FIG. 9 shows an embodiment of an original image containing a product with a glued code in which contours that are highlighted are found.

DETAILED DESCRIPTION OF THE INVENTION

[0027] Below will be discussed in detail the terms and their definitions used in the description of this technical solution.

[0028] In the present invention, a system is understood to mean a computer system, a computer (electronic computer), CNC (numerical control), PLC (programmable logic controller), computerized control systems and any other devices capable of performing a given, well-defined sequence of operations (actions, instructions), centralized and distributed databases, smart contracts.

[0029] An instruction processing device is understood to mean an electronic unit or an integrated circuit (microprocessor) executing machine instructions (programs), or the like. A command processing device reads and executes machine instructions (programs) from one or more data storage devices. Storage devices may include, but are not limited to, hard disks (HDDs), flash memory, ROM (read only memory), solid state drives (SSDs), and optical drives.

[0030] A program is a sequence of instructions for execution by a computer control device or an instruction processing device.

[0031] Server (Eng. Server) - an electronic device that performs service functions at the request of the client, giving him access to certain resources. For the purposes of the present description, a server is considered having a permanent connection to a federated network that can transmit data to a client device. The server can process this data and transfer the processing result back to the client device.

[0032] A data exchange module is a server module that can represent a receiver of incoming signals, and a converter for subsequent processing, and a translator for further sending.

[0033] A computing module is a server module that is a microprocessor specially adapted for complex signal processing.

[0034] A database storage module is a server module that stores data that can be executed as a hard disk drive or as flash memory, which refers to semiconductors of electrically reprogrammable memory.

[0035] An electronic lock is an electromechanical lock with a remote control system (DU) and a power supply. An electromechanical lock consists of three parts: a lock, a crossbar and mounting brackets.

[0036] This technical solution uses the concepts of "vending machine", "self-service kiosk", "kiosk", however, it is obvious to any person skilled in the art that any vending equipment can be used, for example, vending machines for selling drinks, vending machines food, vending machines for the sale of non-food items, amusement rides, etc.

[0037] The proposed device can be used to work with any industrially produced vending machines, including previously installed ones. Moreover, for the functioning of the proposed system, it is not essential that the machine has such components as a product selection panel, a display, a bill acceptor, a coin acceptor, a change issuing device, a bank card reader, a check printer. In fact, the vending machine or kiosk in the proposed solution is an automatic point of delivery of goods, which may contain only means of storing goods and the mechanism for their delivery, controlled by a controller, which is connected via a telecommunication network to the server through a modem and a payment converter - a device necessary for the presence in the machine of blocks for accepting coins or notes to confirm payment and authorize the delivery of goods.

[0038] In some embodiments, the presence of a transparent display case, as is the case in a typical kiosk design, is also not significant, because the full range of goods can be transferred directly to the user's mobile device upon purchase. The absence of a display case in the machine contributes to its vandal proof.

[0039] This technical solution works as follows.

[0040] Step 110: obtain a list of product codes that have been uploaded to the kiosk.

[0041] Previously, various goods offered for sale, such as food, are loaded into the refrigerator of a vending machine or kiosk. Having expressed a desire to buy this or that product from a particular kiosk, the user opens (or installs) the corresponding mobile application on the mobile device or immediately opens the door of the kiosk or vending machine directly if he does not use the mobile application. In the database of the refrigerator in the interaction block of systems 104, a list of goods (or their codes, not limited to) is stored. The user opens the door, picks up the goods he needs or many of them, and then closes the door.

[0042] A code is pasted on goods inside the kiosk or vending machine, as shown in FIG. 2, in which product information can be encoded, for example, product code, expiration date, unique product number, etc. In some embodiments, the code may be a linear code or two-dimensional. As a two-dimensional code, Aztec Code, Data Matrix, MaxiCode, PDF417, QR code, Microsoft Tag, etc. can be used, but not limited to. As a linear code, EAN can be used (EAN-8 consists of 8 digits, EAN-13 - 13 digits are used), UPC (UPC-A, UPC-E), Code56, Code128 (UPC / EAN-128), Codabar, etc. .d., not limited. In some implementations, RFID tags are used to track products.

[0043] In some embodiments, cameras are located above the shelves for viewing goods and unit 100. In a specific implementation example, four cameras are hanging above each shelf. Two cameras are connected to one unit 100 (in a specific embodiment, from 1 to 4 cameras can be connected). If there are 4 shelves in the refrigerator, then it turns out that there are 16 chambers and 8 blocks 100 in the refrigerator. The chambers and block 100 are located in the body under the shelf, as shown in FIG. 3.

[0044] The cameras are directed to product codes, as shown in FIG. 4, and in such a way that the camera visibility area overlaps and the cameras overlap the entire shelf.

[0045] Camera (s) may be provided (s) in the form of a digital camera configured to receive still images and moving images (eg, video). The camera may include a lens and one or more image sensors configured to capture and convert light into electrical signals. By way of example only, an image sensor may include a CMOS-based image sensor (e.g., an Active Pixel Sensor (APS) based on CMOS) or a CCD-based sensor (charge-coupled device). In general, an image sensor in a camera includes an integrated circuit having a matrix of pixels in which each pixel includes a photodetector detecting light. It will be apparent to those skilled in the art that photodetectors in image forming pixels generally record the intensity of light captured through camera lenses. However, photodetectors, by themselves, in the general case, are not able to detect the wavelength of the captured light and, thus, are not able to determine color information.

[0046] Accordingly, the image sensor may further include a color filter matrix (CFA), which may overlap or be placed on top of the pixel matrix of the image sensor to capture color information. The color filter matrix may include a matrix of small color filters, each of which can overlap the corresponding pixel of the image sensor and filter the captured light by wavelength. Thus, when used together, the color filter matrix and photo detectors can provide wavelength and intensity information regarding light captured by a camera, which can represent a captured image.

[0047] In one embodiment, the color filter matrix may include a Bayesian color filter matrix that provides a filter template that is 50% green, 25% red and 25% blue. Thus, an image sensor that uses a matrix of Bayesian color filters can provide information regarding the intensity of light received by the camera at wavelengths of green, red and blue, so that each pixel in the image registers only one of three colors (RGB). This information, which may be referred to as “primary image data” or data in the “primary region,” can then be processed using one or more demosaicing methods to convert the primary image data into a full color image, generally by interpolating a set of red, green, and blue for each pixel.

[0048] Step 120: receive from at least one camera at least one frame containing at least one item from the kiosk, each item containing at least one code in which the product information is encoded.

[0049] After the user has closed the door and collected the necessary goods, the system interaction block 104 sends a command to block 100. Block 100 takes photographs of the shelves, finds codes on them and decodes them, and then transmits in text form the codes of all goods in the refrigerator in block interaction systems 104.

[0050] Then, the system interaction block 104 compares the list of codes that is stored in the database with that received from block 100. When loading goods into the vending machine, a list of codes of goods that have been loaded into the kiosk is obtained. After closing the refrigerator, block 100 returns a list of codes that it could recognize. Then compare the list of codes that was before the opening of the kiosk with the list received from block 100 after closing. Next, the difference in values is determined, which is the codes of goods that the user removed from the refrigerator, and then the removed goods are removed from the presence of the kiosk.

[0051] Having determined the codes that the user has taken, the system interaction unit 104 sends a command to write off money.

[0052] More detailed image processing is disclosed below.

[0053] Image processing may be understood as the various stages of image processing, for example, operations for detecting / correcting defective pixels, correcting lens shading, demosaicing and sharpening an image, reducing noise, gamma correction, improving an image, converting color space, compressing an image, color sub-sampling and scaling an image, etc. In some embodiments, an image processing pipeline may be used to implement each of the various image processing steps. This conveyor can consist of a set of components, according to each necessary step, and the components can be implemented using equipment (for example, digital signal processors or ASIC) or software, or through a combination of hardware and software components.

[0054] Before proceeding, it should be noted that although the various embodiments of the various image processing methods discussed below may use Bayesian CFA, the invention described herein is not to be limited in this regard. Indeed, it will be apparent to those skilled in the art that the image processing techniques presented here can be applied to any type of color filter matrix including RGBW filters, CYGM filters, etc.

[0055] Step 130: at least one frame with the product code obtained in the previous step is transmitted to a computer vision algorithm that identifies at least one product code on the frame by obtaining the coordinates of the product code.

[0056] Block 100 receives at least one camera image, as shown in FIG. 6, and using, for example, a library of computer vision algorithms OpenCV or alternative libraries for image processing, for example, libdwt, SimpleCV, not limited to, processes the frame. The task of the algorithm is to determine the coordinates of the product code in the image in pixels, "cut out" the area with the code and read this code - converting it into a text view.

[0057] To localize the code, images from the camera or cameras are converted as follows:

• remove distortion of the fish eye of the lens by means of a correction function where several lens parameters are set and the image is corrected (in the OpenCV library this function is called cv2.fisheye.initUndistortRectifyMap);

• translate images in black and white, as shown in FIG. 7, remove noise by, for example, using two dilate and erode operations. The first removes rare pixels of white color, the second rare pixels of black color;

• find the places of the maximum color gradient (abrupt transition from white to black or vice versa), as shown in FIG. 8.

[0058] The purpose of all these transformations is to highlight frames around the code on the images. In various embodiments, the frame selection may have a square, round, rectangular and so on shape, depending on the type of barcode.

[0059] After the frames are selected, the contours are searched for in the images, as shown in FIG. 9. As a result, from all the found contours, contours with four angles and an aspect ratio of 0.5 to 2 are obtained. This range of values is selected empirically for a particular implementation, where the contour is a square, and it is obvious to any person skilled in the art that the ratio can be changed . These can be rectangles that look like squares. The contours of too small or large area are also cut off (for example, an area of size from 2000 to 30000 pixels). The experimentally selected parameters of the area make it possible to distinguish among all the contours contours containing, for example, datamatrix codes.

[0060] Step 140: by means of a computing device, at least one code located on the product, identified by a computer vision algorithm, is converted into a text view.

[0061] These areas are cut out by copying the image area into an array and transferred to a code-to-text conversion algorithm that is well known in the art. This is a standard datamatrix code reader library.

[0062] Due to the fact that the cameras only read codes at the moment the door is closed, a scenario is possible when the user took the goods, unfastened the code and returned the code back to the refrigerator. Destructible code stickers are used to protect against such fraud.

[0063] As additional protection, weight sensors on shelves are introduced. In this case, the sensors are connected to block 100 via an adapter. Together with the list of codes, block 100 sends the shelf weight to block 104. Block 104 analyzes the change in weight and the change in the quantity of goods. If the data does not match, this is reported to the administration panel. A person can connect to the refrigerator to look at the images from the cameras and determine what goods were really bought.

[0064] A system for recognizing encoded data by image scanning will be described in detail below.

[0065] The door locking unit 107 (or the electrical locking system) may be an electromagnetic lock consisting of a metal plate and a magnetic sensor, or, for example, an electromechanical lock. This unit sends a 12V signal to the server to unlock the lock. When the signal stops, the lock is locked. The principle of operation of an electromagnetic lock is based on the interaction of a magnet (built into the lock case) and the counterpart (a metal plate attached to the door). Unlike an electromechanical lock, in this case, the power on the coil is constantly present, when the power is turned off, the contact between the magnet and the contact plate opens and the door opens. The power of the magnet should be large enough to prevent the door from opening by force. In some embodiments, electromagnetic locks of magnetic locking or magnetic mechanical locking may be used.

[0066] An information input unit 108, which may be a contactless card reader. A credit card reader is a special device that recognizes data from various types of plastic cards using the following methods:

[0067] 1. The magnetic tape on the map;

[0068] 2. The chip is embedded in the card;

[0069] 2. Contactless payment method.

[0070] The credit card reader, when reading from a magnetic tape or chip, has a special analysis slot through which the card is passed. The necessary information is then scanned automatically.

[0071] The non-contact method works according to the following principle: the card is brought to the module at a distance of 30 to 250 mm. Its identifier falls under the electromagnetic radiation generated by the device and scans an individual code. Information is redirected to the controller, which occurs within a split second.

[0072] The user brings the plastic card to the reader, and the card and reader interact with the EMV protocol. The information input unit 108 may be a universal payment and information terminal made in the form of a computer and equipped with external control and monitoring ports that are used to connect to the central control unit via interface lines of the information display device, the information input device, the control unit, the reader for plastic electronic or magnetic cards, sound device, characterized in that it is equipped with a USB port.

[0073] The temperature information readout unit 106, which is a block N of temperature sensors, where N> = 0. The unit interrogates temperature sensors with a given frequency and generates data on temperature readings. A sensor for measuring temperature is based on the dependence of electrical resistance on temperature. In an exemplary embodiment, the sensor may be a low-power temperature sensor, for example, LM20 from Texas Instruments ™ or Ds18b20 from Dallas Semiconductor ™.

[0074] A network interaction unit 103, for example, implemented as a router for connecting all components via an Ethernet network and Internet access. The router is equipped with N slots for sim cards, where N = 2 and M Ethernet slots, where M> = 2. Duplication of sim cards is necessary for the smooth operation of the kiosk. The block performs a connecting function between the kiosk and its internal components, as well as between the kiosk and the server. The router also has a firewall to protect the kiosk from cyber attacks. In general, the aforementioned network communication unit 103 may comprise a mobile radio network communication interface, such as, for example, a GPRS (General Packet Radio Communication) modem, a UMTS (Universal Mobile Telecommunication System) modem, an HSPA (High Speed Packet Data Transfer) modem, or an LTE modem (Long-Term Development Standard), in which the aforementioned interface is connected via a mobile communication protocol to a base station to provide communication with the Internet. In this case, the system may include a router, such as, for example, an ADSL router or a fiber optic router that connects a LAN to the Internet and provides data exchange with a laptop computer that communicates via the Internet.

[0075] The system interaction unit 104, is a computing device that polls the temperature information reading unit 106 with a certain frequency to obtain temperature data inside the kiosk.

[0076] An information processing unit (processor), which is a computer for pattern recognition in a video stream.

[0077] An information input / output unit 105, implemented as a touch screen display for interacting with a user. The display receives a signal from the system interconnect 104, for example, via an HDMI cable and displays this signal. Through the touchscreen, the display sends a signal to the system interaction unit 104, which is a computer, data about the coordinates of the user's touch on the display. As further shown, the display 105 may be configured to form various images that the user can view. For example, during operation of a kiosk for purchasing goods, the display 105 may display a graphical user interface ("GUI") that allows a user to interact with an operating system and / or application running on a kiosk. The GUI may include various layers, windows, screens, templates or other graphic elements that can be displayed on the entire, or portion, of the display device. For example, in the present embodiment, the operating system GUI may include various graphical icons, each of which may correspond to different applications that can be opened or executed upon detection of a user’s choice (for example, by input using a keyboard or touch screen). Icons can be displayed in the dock or in one or more graphical window elements displayed on the screen. In some embodiments, the selection of an icon may lead to a hierarchical navigation process, whereby the selection of an icon leads to a screen or opens another graphic window that includes one or more additional icons or other GUI elements.

[0078] The system interaction unit 104, which is a computing device containing a set of modules, which can be either software or hardware, are described below.

[0079] In an exemplary embodiment, the system comprises the following modules:

• a module for pattern recognition in the sequence of frames and counting the goods that the user bought;

• a module for performing interaction between kiosk components;

• cash module for settlements with the user;

• operating system;

• database;

• web server.

[0080] The interaction of the above modules and components is as follows:

[0081] The user physically approaches the kiosk or any other vending machine at a sufficient distance to start interaction, for example, one meter.

[0082] The user then unlocks the kiosk through his mobile application 200 or by attaching a plastic card to a plastic card reader 108. The plastic card reader 108 sends a signal to the kiosk systems interaction unit 104 to a module for interaction between kiosk objects. This module sends a signal to a remote server 109 to check the plastic card and determine the client on it.

[0083] Upon successful client determination, the kiosk door is unlocked, and upon unsuccessful determination, an error is displayed, for example, on the kiosk display and asked to repeat the previous step on the kiosk display or in the user's mobile application.

[0084] A user opens a kiosk door by the hand of a kiosk door handle.

[0085] When the door is opened, the signal from the door lock 107 is sent to the interaction block of kiosk systems 104 per module for interaction between kiosk objects.

[0086] The user closes the kiosk door, the door is locked.

[0087] The door lock 107 provides a signal to the interaction unit of kiosk systems 104 to a module for interaction between kiosk objects.

[0088] The module for interaction between kiosk objects sends a signal to the server via the Internet to obtain a list of actions that must be performed when the signal is received.

[0089] Further, this module for interaction between kiosk objects sends a signal to the cash register module to perform calculations with the user for the extracted object (s).

[0090] A module for interaction between kiosk objects sends a signal to the server based on the results of the calculation operation with the client for the extracted object (s).

[0091] The module for interaction between kiosk objects sends a signal to the kiosk display device about the result of the operation.

[0092] All components of this technical solution can be connected by bus. In some examples, an information bus includes one or more information buses. The information bus can be implemented in accordance with the bus protocol of the local area network of the controllers (CAN), which is defined by the International Organization for Standardization (ISO) 11898-1, the protocol of the data bus of multimedia systems (MOST), the protocol of the flexible information CAN bus (CAN-FD) (ISO 11898-7) and / or the K-line bus protocol (ISO 9141 and ISO 14230-1) and / or the IEEE 802.3 Ethernet ™ bus protocol (2002 onwards), etc.

[0093] Elements of the claimed technical solution are in a functional relationship, and their joint use leads to the creation of a new and unique technical solution. Thus, all blocks are functionally connected.

[0094] All the blocks used in the system can be implemented using electronic components used to create digital integrated circuits, which is obvious to a person skilled in the art. Not limited to, can be used microcircuits, the logic of which is determined during manufacture, or programmable logic integrated circuits (FPGA), the logic of which is set by programming. For programming, programmers and debugging environments are used to set the desired structure of a digital device in the form of a circuit diagram or a program in special equipment description languages: Verilog, VHDL, AHDL, etc. Programmable logic controllers (PLCs), base matrix crystals can be an alternative to FPGAs ( BMK) requiring a factory production process for programming; ASIC specialized custom large integrated circuits (LSI), which are much more expensive in small-scale and single-unit production.

[0095] Typically, the FPGA chip itself consists of the following components:

• configurable logic blocks that implement the required logical function;

• programmable electronic communications between configurable logic blocks;

• programmable I / O blocks, providing the connection of the external output of the microcircuit with internal logic.

[0096] Also, blocks can be implemented using read-only memory devices.

[0097] Thus, the implementation of all used blocks is achieved by standard means based on the classical principles of implementation of the foundations of computer technology.

[0098] As one skilled in the art will understand, aspects of the present technical solution may be implemented as a system, method, or computer program product. Accordingly, various aspects of the present technical solution can be implemented solely as hardware, as software (including application software and so on) or as an embodiment combining software and hardware aspects, which in general can be referred to as a “module” , “System” or “architecture”. In addition, aspects of the present technical solution may take the form of a computer program product implemented on one or more computer-readable media having a computer-readable program code that is implemented on them.

[0099] Any combination of one or more computer-readable media may also be used. The computer-readable storage medium may be, without limitation, an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system, apparatus, device, or any suitable combination thereof. More specifically, examples (non-exhaustive list) of computer-readable storage media include: electrical connection using one or more wires, a portable computer diskette; hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), fiber optic connection, read-only memory on a compact disc (CD-ROM), optical storage device, magnetic storage device or any combination of the above. In the context of the present description, a computer-readable storage medium may be any flexible data medium that can contain or store a program for use by or in connection with the system, device, apparatus.

[00100] The program code embedded in a computer-readable medium can be transmitted using any medium, including, without limitation, wireless, wired, fiber optic, infrared, and any other suitable network or combination of the above.

[00101] The computer program code for performing operations for the steps of the present technical solution can be written in any programming language or combinations of programming languages, including an object-oriented programming language, for example, Java, Smalltalk, C ++ and so on, and ordinary procedural languages programming, for example, programming language "C" or similar programming languages. The program code can be executed on a user's computer completely, partially, or as a separate software package, partially on a user's computer and partially on a remote computer, or completely on a remote computer. In the latter case, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN), wide area network (WAN) or a connection to an external computer (for example, via the Internet using Internet providers).

[00102] Aspects of the present technical solution have been described in detail with reference to flowcharts, schematic diagrams and / or diagrams of methods, devices (systems) and computer program products in accordance with embodiments of the present technical solution. It should be borne in mind that each block from the block diagram and / or diagrams, as well as combinations of blocks from the block diagram and / or diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a general purpose computer processor, special purpose computer, or other data processing device to create a procedure so that instructions executed by a computer processor or other programmable data processing device provide means for implementing the functions / actions specified in block or blocks of a flowchart and / or diagram.

[00103] These computer program instructions can also be stored on a computer-readable medium that can control a computer other than a programmable data processing device or other devices that operate in a specific way, such that the instructions stored on the computer-readable medium create a device including instructions that carry out the functions / actions indicated in the block block diagram and / or diagram.

Claims (26)

1. A method for recognizing encoded data by scanning images, performed by at least one computing device and comprising the following steps: get a general list of product codes that have been uploaded to the kiosk; receive from at least one camera at least one frame containing at least one product from the kiosk, and each product contains at least one code that encodes product information after the user has removed at least one from the kiosk product; at least one frame with the product code obtained in the previous step is transmitted to the computer vision algorithm, which identifies at least one product code on the frame by obtaining the coordinates of the given product code; by means of a computing device, converting at least one code located on the product identified by the computer vision algorithm into a text view; determining product codes that the user removed from the kiosk by comparing the general list of product codes obtained in the first step before the user opens the door and at least one previously converted code, and these codes are removed from the general list of product codes; send to the server a command to write off funds based on certain codes of goods that the user withdrew. 2. The method according to p. 1, characterized in that the code on the product is a linear code or two-dimensional code. 3. The method according to p. 1, characterized in that the code is glued to destructible sticker. 4. The method according to claim 1, characterized in that the computer age algorithm is implemented in the OpenCV library or libdwt, or SimpleCV. 5. The method according to p. 1, characterized in that determine the coordinates of the product code on the image in pixels. 6. A system for recognizing encoded data by image scanning, comprising: at least one door locking unit configured to send a signal to the at least one server to unlock the door lock; at least one information input unit, configured to receive commands from a user; at least one system interaction unit, configured to transmit signals between system units; at least one computing device configured to: receiving a general list of product codes that have been uploaded to the kiosk; receiving from at least one camera at least one frame containing at least one item from the kiosk, each item containing at least one code that encodes product information after the user has removed at least one item from the kiosk product; transmitting the at least one frame with the product code obtained in the previous step to the computer vision algorithm, which identifies at least one product code on the frame by obtaining the coordinates of the product code; converting at least one code located on a product identified by a computer vision algorithm into a text view; determining product codes that the user removed from the kiosk by comparing the general list of product codes obtained in the first step before the user opens the door and at least one previously converted code, and these codes are removed from the general list of product codes; sending commands to the server to write off funds on the basis of certain codes of goods that the user withdrew. 7. The system according to claim 6, characterized in that the door locking unit is an electromagnetic lock, which consists of a metal plate and a magnetic sensor, and / or an electromechanical lock. 8. The system according to claim 6, characterized in that it further comprises a temperature information reading unit, which is a set of temperature sensors for generating data on temperature readings inside the kiosk. 9. The system according to claim 6, characterized in that the information input unit is a contactless card reader. 10. The system according to claim 6, characterized in that the system interaction unit is a Raspberry Pi.

Images