CN112580379A - Data processing system and method, electronic device, and computer-readable storage medium - Google Patents
Data processing system and method, electronic device, and computer-readable storage medium Download PDFInfo
- Publication number
- CN112580379A CN112580379A CN201910936976.2A CN201910936976A CN112580379A CN 112580379 A CN112580379 A CN 112580379A CN 201910936976 A CN201910936976 A CN 201910936976A CN 112580379 A CN112580379 A CN 112580379A
- Authority
- CN
- China
- Prior art keywords
- image
- data processing
- identification code
- information
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 89
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000004458 analytical method Methods 0.000 claims abstract description 8
- 238000003672 processing method Methods 0.000 claims description 20
- 238000012795 verification Methods 0.000 claims description 8
- 238000011084 recovery Methods 0.000 claims description 7
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims description 5
- 230000009466 transformation Effects 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 description 9
- 238000012937 correction Methods 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
- G06K7/1417—2D bar codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1439—Methods for optical code recognition including a method step for retrieval of the optical code
- G06K7/1456—Methods for optical code recognition including a method step for retrieval of the optical code determining the orientation of the optical code with respect to the reader and correcting therefore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Economics (AREA)
- Health & Medical Sciences (AREA)
- Electromagnetism (AREA)
- General Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Operations Research (AREA)
- Development Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Quality & Reliability (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the invention provides a data processing system and method, electronic equipment and a computer readable storage medium. The system comprises: the system comprises an image acquisition module, a storage module and a display module, wherein the image acquisition module is used for shooting according to at least one shooting route set for a shelf and acquiring an image containing an information identification code of an object placed on the shelf, and the shooting route is composed of a plurality of shooting points; the image processing module is used for processing the image acquired by the image acquisition module to acquire the information identification code; and the analysis module is used for analyzing the object information of the object according to the information identification code acquired by the image processing module. According to the embodiment of the invention, the goods shelf is shot to obtain the information identification code of the object placed on the goods shelf, so that the object information can be rapidly and accurately analyzed, and the digitalization speed and accuracy of the goods shelf are improved.
Description
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to a data processing system and method, an electronic device, and a computer-readable storage medium.
Background
In an online store, various commodities are displayed on shelves. If the shelf is subjected to digital operation, namely the shelf and the information of the commodities displayed on the shelf are structurally stored, a salesperson can be reminded of replenishing goods in time, or the salesperson is informed of the wrong information of commodity display so as to correct the wrong information in time, so that better store management and management can be realized.
In the prior art, the commodity information of the commodity is generally obtained by taking a picture of the commodity displayed on a shelf and adopting an image feature recognition method.
On one hand, however, the sample training speed of the feature recognition algorithm model is far lower than the commodity updating speed, so that the shelf digitization efficiency is low; on the other hand, due to the fact that commodities in stores are various in category and scenes are complex and changeable, the digital accuracy of the goods shelf is low.
Disclosure of Invention
Embodiments of the present invention provide a data processing system and method, an electronic device, and a computer-readable storage medium, so as to overcome the defects of low data processing efficiency and low accuracy in the prior art.
To achieve the above object, an embodiment of the present invention provides a data processing system, including:
the system comprises an image acquisition module, a storage module and a display module, wherein the image acquisition module is used for shooting according to at least one shooting route set for a shelf and acquiring an image containing an information identification code of an object placed on the shelf, and the shooting route is composed of a plurality of shooting points;
the image processing module is used for processing the image acquired by the image acquisition module to acquire the information identification code;
and the analysis module is used for analyzing the object information of the object according to the information identification code acquired by the image processing module.
The embodiment of the invention also provides a data processing method, which comprises the following steps:
shooting according to at least one shooting route set for a shelf, and acquiring an image containing an information identification code of an object placed on the shelf, wherein the shooting route is composed of a plurality of shooting points;
performing image processing operation on the image to acquire the information identification code;
and analyzing the information identification code to acquire the object information of the object.
An embodiment of the present invention further provides an electronic device, including:
a memory for storing a program;
a processor for executing the program stored in the memory for:
shooting according to at least one shooting route set for a shelf, and acquiring an image containing an information identification code of an object placed on the shelf, wherein the shooting route is composed of a plurality of shooting points;
performing image processing operation on the image to acquire the information identification code;
and analyzing the information identification code to acquire the object information of the object.
An embodiment of the present invention further provides a computer-readable storage medium, where instructions are stored on the computer-readable storage medium, where the instructions include:
shooting according to at least one shooting route set for a shelf, and acquiring an image containing an information identification code of an object placed on the shelf, wherein the shooting route is composed of a plurality of shooting points;
performing image processing operation on the image to acquire the information identification code;
and analyzing the information identification code to acquire the object information of the object.
The data processing system and method, the electronic device and the computer readable storage medium provided by the embodiment of the invention can quickly and accurately analyze the object information by shooting the goods shelf and acquiring the information identification code of the object placed on the goods shelf, thereby improving the speed and accuracy of the digitization of the goods shelf.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a schematic diagram of an application scenario of an embodiment of a data processing system provided in the present invention;
FIG. 2 is a system block diagram of another embodiment of a data processing system provided by the present invention;
FIG. 3 is a flow chart of one embodiment of a data processing method provided by the present invention;
FIG. 4 is a flow chart of another embodiment of a data processing method provided by the present invention;
fig. 5 is a schematic structural diagram of an embodiment of an electronic device provided in the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
In the prior art, the commodity information of the commodities displayed on the shelf is generally obtained by photographing the commodities displayed on the shelf and recognizing the photographed commodity picture by adopting an image feature recognition method. On one hand, however, the training speed of the sample of the feature recognition algorithm model is far lower than the updating speed of the commodity, so that the data processing efficiency is very low; on the other hand, due to the fact that commodities in stores are various in category and scenes are complex and changeable, data processing accuracy is low.
Therefore, aiming at the defects of the prior art, the application provides a data processing system for a shelf digital scene, and the main principle is as follows: the method comprises the steps of presetting a fixed shooting route for a shelf set in a store, shooting at a fixed point according to a shooting point in the shooting route through an image acquisition module (for example, a navigation positioning store patrol robot based on a laser radar) to acquire an image containing an information identification code of an object, processing the image through an image processing module to acquire the information identification code of the object, and analyzing object information identified by the information identification code through an analysis module. The object information of the objects (commodities) placed on the shelf can be quickly and accurately obtained, so that the speed and the accuracy of shelf digitization are improved. In addition, the image acquisition module can acquire multi-frame images aiming at the same information identification code, for example, video data is formed, the image processing module can process the video data, and the obtained object identification code has higher accuracy.
The above embodiments are illustrations of technical principles of the embodiments of the present invention, and specific technical solutions of the embodiments of the present invention are further described in detail below by using a plurality of embodiments.
Example one
Fig. 1 is a schematic diagram of an application scenario of an embodiment of a data processing system provided in the present invention, and the structure shown in fig. 1 is only one example of a data processing system to which the technical solution of the present invention can be applied. As shown in fig. 1, in a shelf digitalization scene, an imaging route composed of a plurality of imaging points is set for a shelf. The shooting route can be one or more, when the shooting route is multiple, the shooting route can be selected for shooting according to the input of a user, and the optimal shooting route can be calculated in a self-adaptive mode. An image acquisition module, such as a shop patrol robot, is arranged in the data processing system to perform fixed-point shooting according to each shooting point in a shooting route so as to acquire an image, wherein the image comprises an information identification code of an object placed on a shelf, such as a commodity identification code. Specifically, the information identification code can uniquely identify object information of an object, and may be, for example, a barcode, a two-dimensional code, or the like. After the shop patrol robot collects the images, the images are sent to the image processing module to be processed, so that each information identification code in the images can be obtained. Then, the image processing module sends the acquired information identification codes to the analysis module so as to analyze the object information of the corresponding object according to the information identification code, and therefore the object information is sent to a database for storage, and shelf digitalization is achieved.
The data processing system provided by the embodiment of the invention can be used for rapidly and accurately analyzing the object information by shooting the goods shelf and acquiring the information identification code of the object placed on the goods shelf, thereby improving the digitalization speed and accuracy of the goods shelf.
Example two
FIG. 2 is a system block diagram of another embodiment of a data processing system provided by the present invention. As shown in fig. 2, based on the embodiment shown in fig. 1, the data processing system according to the embodiment of the present invention processes the two-dimensional code of the object information uniquely identifying the object. Specifically, the data processing system provided in the embodiment of the present invention includes: an image acquisition module 21, an image processing module 22 and an analysis module 23. Among them, the image processing module 22 may include: an area cropping unit 221, a calculation unit 222, an image restoration unit 223, and a two-dimensional code correction unit 224.
The region clipping unit 221 may be configured to detect quadrilateral graphics in the image acquired by the image acquisition module 21, and expand each quadrilateral graphic as an upper left corner, a lower left corner, an upper right corner, and a lower right corner in the image according to a preset length to form a target region for the quadrilateral graphic; the calculating unit 222 is configured to calculate the number of similar quadrangles in each target region, where the similar quadrangles are a plurality of quadrangle graphics with area differences smaller than a first preset threshold; the image recovery unit 223 is configured to perform image recovery processing on a target area with less than three similar quadrilaterals, so that the number of similar quadrilaterals in the target area is three; the two-dimensional code correction unit 224 is configured to detect a vertex of the two-dimensional code for a target area with three similar quadrilaterals, reduce the target area into a square area through affine transformation operation, and perform rotation operation for the square area, so that the three similar quadrilaterals are respectively located at an upper left corner, a lower left corner, and an upper right corner of the square area.
In the embodiment of the present invention, the image acquisition module 21 may capture the shelf and the object on the shelf according to a fixed step length on the capture route, and send the image containing the two-dimensional code of the object to the image processing module 22 for image processing operation, so as to obtain the two-dimensional code in the image. After receiving the image acquired by the image acquisition module 21, the region cropping unit 221 in the image processing module 22 first detects quadrilateral graphics in the image, and expands each quadrilateral graphic into a target region, i.e., a two-dimensional code region of interest (two-dimensional code ROI), according to a preset length in the image. Specifically, a quadrilateral graph may be expanded as the upper left corner to obtain a target area. Therefore, a quadrangle graphic is respectively used as the upper left corner, the lower left corner, the upper right corner and the lower right corner, and four target areas aiming at the quadrangle graphic can be acquired.
Then, the number of the similar quadrangles in each target area is calculated by the calculation unit 222. When there are three similar quadrangles in a target area, the figure in the target area can be basically determined to be a two-dimensional code, and therefore, the target area can be corrected by the two-dimensional code correction unit 224. Specifically, the two-dimensional code fixed-point detection operation may be performed in the target area, the target area is reduced to a square through affine transformation, and the square is rotated so that the three similar quadrilaterals are respectively at the upper left corner, the lower left corner and the upper right corner of the square area. Thereby obtaining the two-dimensional code.
When the calculation unit 222 calculates less than three similar quadrilaterals in one target area, the image restoration processing may be performed on the target area by the image restoration unit 223. If the restored target area contains three similar quadrilaterals, the two-dimensional code correction unit 224 performs correction processing to obtain a two-dimensional code; if the similarity quadrangles are still not three after the recovery processing, the target area is not recoverable, and the target area is directly discarded.
If the number of the quadrangles in the target area calculated by the calculating unit 222 is more than three, or the number of the quadrangles in the target area restored by the image restoring unit 223 is more than three, it indicates that the target area is not a two-dimensional code, and the target area is discarded as well.
In addition, when the shooting points are set, the image acquisition module 21 can make two adjacent left and right images acquired by the adjacent shooting points contain an overlapping area, so that missing detection of the two-dimensional codes is compensated, and the upturning rate of the shelf is improved, namely, the ratio of the number of the different identified two-dimensional codes to the total number of the two-dimensional codes on the shelf is detected.
Further, at least two upper and lower acquisition sub-modules may be disposed in the image acquisition module 21, for example, two cameras are vertically disposed, so that two adjacent upper and lower images acquired at the same shooting point include an overlapping region. Therefore, the missing detection of the two-dimensional code can be compensated, and the upturning rate of the goods shelf is improved.
In addition, in the embodiment of the present invention, a hybrid processing mode may be set, that is, the image acquisition module 21 and the image processing module 22 may be adopted to acquire the information identification code in the scene of the irregular shelf; for a scenario of a regular shelf (e.g., a smart shelf or a shelf with an electronic price tag, etc.), a receiving module 24 may be provided in the data processing system, which receiving module 24 may be used to receive object information of an object automatically sent by the shelf. The regular goods shelf can report the object information by itself, thereby improving the data processing efficiency.
On this basis, the data processing system provided in the embodiment of the present invention may further include: a verification module 25. The checking module 25 may be configured to check the object information analyzed by the analyzing module 23 according to the object information received by the receiving module 24.
In the embodiment of the present invention, when the goods are misplaced, the verification failure information may be fed back to the user, and therefore, the data processing system may further include: a feedback module 26, where the feedback module 26 may be configured to send check failure feedback information when the checking module 25 fails to check the object information.
Furthermore, in the embodiment of the present invention, a "dual engine" mode may be set, that is, when the two-dimensional code cannot be identified, a commodity picture is triggered to be collected, and the commodity is directly identified. Accordingly, the data processing system may further comprise: an object information acquiring module 27, where the object information acquiring module 27 may be configured to acquire an image of the object and identify the image to acquire the object information of the object when the parsing module 23 fails to acquire the object information of the object.
Still further, in this embodiment of the present invention, the data processing system may further include: and a route adjusting module 28, wherein the route adjusting module 28 may be configured to generate a new shooting route according to the acquisition result of the information identification code by the image processing module 22, so as to adjust the shooting route.
In addition, in the embodiment of the present invention, the image capturing module 21 may be an automatic moving image capturing device (e.g., a robot with an image capturing function), a handheld image capturing device (a user holds the image capturing device), a monitoring camera device (a camera for multiplexing monitoring people stream during off-peak shopping period), or the like.
According to the data processing system provided by the embodiment of the invention, the image acquisition module is used for shooting the goods shelves in a store according to the preset shooting route, acquiring the images of all the goods shelves in batch, automatically acquiring the two-dimensional codes in the images, rapidly and accurately analyzing the object information, improving the upturning rate of the goods shelves, and structurally storing the complete goods shelf information, so that the digitalization speed and accuracy of the goods shelves are improved.
EXAMPLE III
Fig. 3 is a flowchart of an embodiment of a data processing method provided in the present invention. The execution main body of the method can be the data processing system, various terminal devices with functions of image acquisition, image processing, data processing and the like, and devices or chips integrated on the devices. As shown in fig. 3, the data processing method includes the steps of:
s301, shooting is carried out according to at least one shooting route set for the shelf, and images containing information identification codes of objects placed on the shelf are collected.
In the embodiment of the present invention, the shooting route is constituted by a plurality of shooting points. After a shooting route formed by a plurality of shooting points is set for the shelf, when shelf digitalization processing is carried out, firstly, shooting is carried out according to the preset shooting route so as to obtain an image containing an information identification code. Specifically, the information identification code is object information capable of uniquely identifying an object set on the shelf, and may be, for example, a barcode, a two-dimensional code, or the like.
S302, performing image processing operation on the image to acquire an information identification code.
In the embodiment of the invention, after the image is acquired, the image is processed to acquire each information identification code in the image.
S303, analyzing the information identification code to acquire object information of the object.
Then, the object information of the corresponding object is analyzed according to the information identification code, so that the object information is sent to a database for storage, and shelf digitalization is realized.
According to the data processing method provided by the embodiment of the invention, the goods shelf is shot to obtain the information identification code of the object placed on the goods shelf, so that the object information can be rapidly and accurately analyzed, and the digitalization speed and accuracy of the goods shelf are improved.
Example four
Fig. 4 is a flowchart of another embodiment of a data processing method provided by the present invention. As shown in fig. 4, on the basis of the embodiment shown in fig. 3, the data processing method provided in this embodiment may further include the following steps:
s401, shooting according to a shooting route set for the shelf, and collecting images containing information identification codes of objects placed on the shelf.
In the embodiment of the invention, when the shooting points are set, the image acquisition module can enable the left and right adjacent images acquired by the adjacent shooting points to contain the overlapping area, so that the missing detection of the two-dimensional codes is compensated, and the upturning rate of the goods shelf is improved, namely, the ratio of the number of the different two-dimensional codes detected to the total number of the two-dimensional codes on the goods shelf is detected.
Furthermore, at least two vertically adjacent images can be collected at the same shooting point in the shooting route, so that the two images contain an overlapping area. Therefore, the missing detection of the two-dimensional code can be compensated, and the upturning rate of the goods shelf is improved.
S402, detecting quadrilateral graphs in the image, and expanding each quadrilateral graph as an upper left corner, a lower left corner, an upper right corner and a lower right corner respectively according to a preset length in the image to form a target area for the quadrilateral graphs.
In the embodiment of the invention, after the image is acquired, quadrilateral graphics in the image are detected firstly, and each quadrilateral graphic is expanded into a target region, namely a two-dimensional code region of interest (two-dimensional code ROI) according to a preset length in the image. Specifically, a quadrilateral graph may be expanded as the upper left corner to obtain a target area. Therefore, a quadrangle graphic is respectively used as the upper left corner, the lower left corner, the upper right corner and the lower right corner, and four target areas aiming at the quadrangle graphic can be acquired.
S403, calculating the number of the similar quadrangles in each target area.
In the embodiment of the invention, the similar quadrangles are a plurality of quadrangle graphs of which the area difference is smaller than a first preset threshold value.
S404, judging whether the two-dimensional code in the target area is complete according to the number of the similar quadrangles. If the number of the similar quadrangles is three, it indicates that the two-dimensional code in the target area is complete, step S406 is executed for the target area, and if the number of the similar quadrangles is less than three, it indicates that the two-dimensional code in the target area is incomplete, step S405 is executed for the target area.
S405, image restoration processing is performed on the target area where the number of the similar quadrangles is less than three, so that the number of the similar quadrangles in the target area is three.
If the restored target area contains three similar quadrangles, executing the following step S406 to obtain a two-dimensional code; if the similarity quadrangles are still not three after the recovery processing, the target area is not recoverable, and the target area is directly discarded.
And S406, performing correction operation on the target area.
In the embodiment of the present invention, when there are three similar quadrangles in a target area, it may be basically determined that the graph in the target area is a two-dimensional code, and therefore, a correction operation may be performed on the target area. Specifically, the two-dimensional code fixed-point detection operation may be performed in the target area, the target area is reduced to a square area through affine transformation, and the square area is rotated, so that the three similar quadrilaterals are respectively at the upper left corner, the lower left corner, and the upper right corner of the square area. Thereby obtaining the two-dimensional code.
If the number of the similar quadrangles in the target area is more than three, the target area is not the two-dimensional code, and the target area is discarded as well.
And S407, analyzing the two-dimensional code to acquire object information of the object.
In the embodiment of the invention, if the two-dimensional code is failed to be analyzed, the target area is discarded.
S408, judging whether the analyzed object information is overlapped with the analyzed object information, if so, discarding the overlapped object information, and keeping the object information analyzed firstly.
In addition, in the embodiment of the invention, a hybrid processing mode can be set, that is, the information identification code can be obtained by adopting the steps aiming at the scene of an irregular shelf; for a scenario of a regular shelf (e.g., a smart shelf or a shelf with an electronic price tag, etc.), object information for an object automatically sent by the shelf may be received. The regular goods shelf can report the object information by itself, thereby improving the data processing efficiency.
On this basis, in the embodiment of the present invention, the object information obtained by analyzing the information identification code may also be verified according to the object information automatically sent by the shelf. When the goods are misplaced and the verification of the object information fails, feedback can be given to the user, namely, verification failure feedback information is sent.
Furthermore, in the embodiment of the present invention, a "dual engine" mode may be set, that is, when the two-dimensional code cannot be identified, a commodity picture is triggered to be collected, and the commodity is directly identified. That is, when the analysis of the information identification code fails, an image of the object is acquired and recognized to acquire object information of the object.
Still further, in the embodiment of the present invention, a new shooting route may be generated according to the acquisition result for the information identification code, so as to adjust the shooting route.
According to the data processing method provided by the embodiment of the invention, the shelves are shot according to the preset shooting route in the store, the images of all the shelves are collected in batch, the two-dimensional codes in the images are automatically obtained, the object information can be rapidly and accurately analyzed, the upturning rate of the shelves is improved, and the complete shelf information is structurally stored, so that the digitalization speed and the accuracy of the shelves are improved. .
EXAMPLE five
The internal functions and structures of a data processing system, which may be implemented as an electronic device, are described above. Fig. 5 is a schematic structural diagram of an embodiment of an electronic device provided in the present invention. As shown in fig. 5, the electronic device includes a memory 51 and a processor 52.
The memory 51 stores programs. In addition to the above-described programs, the memory 51 may also be configured to store other various data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device, contact data, phonebook data, messages, pictures, videos, and so forth.
The memory 51 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The processor 52 is not limited to a Central Processing Unit (CPU), but may be a processing chip such as a Graphic Processing Unit (GPU), a Field Programmable Gate Array (FPGA), an embedded neural Network Processor (NPU), or an Artificial Intelligence (AI) chip. A processor 52, coupled to the memory 51, for executing programs stored in the memory 51 for:
shooting according to at least one shooting route set for the shelf, and acquiring an image containing an information identification code of an object placed on the shelf, wherein the shooting route is composed of a plurality of shooting points;
performing image processing operation on the image to acquire an information identification code;
and analyzing the information identification code to acquire the object information of the object.
Further, as shown in fig. 5, the electronic device may further include: communication components 53, power components 54, audio components 55, display 56, and other components. Only some of the components are schematically shown in fig. 5, and it is not meant that the electronic device comprises only the components shown in fig. 5.
The communication component 53 is configured to facilitate wired or wireless communication between the electronic device and other devices. The electronic device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 53 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 53 further comprises a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
A power supply component 54 provides power to the various components of the electronic device. The power components 54 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for an electronic device.
The audio component 55 is configured to output and/or input audio signals. For example, the audio component 55 includes a Microphone (MIC) configured to receive external audio signals when the electronic device is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 51 or transmitted via the communication component 53. In some embodiments, audio assembly 55 also includes a speaker for outputting audio signals.
The display 56 includes a screen, which may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (24)
1. A data processing system, comprising:
the system comprises an image acquisition module, a storage module and a display module, wherein the image acquisition module is used for shooting according to at least one shooting route set for a shelf and acquiring an image containing an information identification code of an object placed on the shelf, and the shooting route is composed of a plurality of shooting points;
the image processing module is used for processing the image acquired by the image acquisition module to acquire the information identification code;
and the analysis module is used for analyzing the object information of the object according to the information identification code acquired by the image processing module.
2. The data processing system of claim 1, further comprising:
and the receiving module is used for receiving the object information of the object automatically sent by the shelf.
3. The data processing system of claim 2, further comprising:
and the checking module is used for checking the object information analyzed by the analyzing module according to the object information received by the receiving module.
4. The data processing system of claim 3, further comprising:
and the feedback module is used for sending feedback information of verification failure when the verification module fails to verify the object information.
5. The data processing system of claim 1, wherein the image capture module is an automated mobile image capture device, a handheld image capture device, or a surveillance camera device.
6. The data processing system of claim 1, further comprising:
and the object information acquisition module is used for acquiring the image of the object when the analysis module fails to acquire the object information of the object, identifying the image and acquiring the object information of the object.
7. The data processing system of claim 1, further comprising:
and the route adjusting module is used for generating a new shooting route according to the acquisition result of the image processing module aiming at the information identification code.
8. The data processing system according to any one of claims 1 to 7, wherein the information identification code is a barcode or a two-dimensional code that uniquely identifies object information of the object.
9. The data processing system according to any one of claims 1 to 7, wherein the information identification code is a two-dimensional code of object information that uniquely identifies the object, the image processing module includes:
the region cutting unit is used for detecting quadrilateral graphs in the image according to the image acquired by the image acquisition module, and expanding each quadrilateral graph as an upper left corner, a lower left corner, an upper right corner and a lower right corner respectively according to a preset length in the image to form a target region for the quadrilateral graphs;
the calculation unit is used for calculating the number of similar quadrangles in each target area, wherein the similar quadrangles are a plurality of quadrangle graphs of which the area difference is smaller than a first preset threshold;
the image recovery unit is used for performing image recovery processing on the target area with less than three similar quadrangles so that the number of the similar quadrangles in the target area is three;
and the two-dimensional code correcting unit is used for detecting the vertex of the two-dimensional code aiming at the target area with the number of the similar quadrangles being three, restoring the target area into a square area through affine transformation operation, and performing rotation operation aiming at the square area, so that the three similar quadrangles are respectively arranged at the upper left corner, the lower left corner and the upper right corner of the square area.
10. The data processing system of claim 1, wherein the shots are arranged such that the image capture module includes an overlap region in two left and right adjacent images captured by adjacent shots.
11. The data processing system of claim 1, wherein the image capturing module comprises at least two capturing sub-modules disposed above and below, so that two adjacent images captured at the same shooting point include an overlapping region.
12. A data processing method, comprising:
shooting according to at least one shooting route set for a shelf, and acquiring an image containing an information identification code of an object placed on the shelf, wherein the shooting route is composed of a plurality of shooting points;
performing image processing operation on the image to acquire the information identification code;
and analyzing the information identification code to acquire the object information of the object.
13. The data processing method of claim 12, further comprising:
and receiving the object information of the object automatically sent by the shelf.
14. The data processing method of claim 13, further comprising:
and checking the object information acquired by analyzing the information identification code according to the object information automatically sent by the shelf.
15. The data processing method of claim 14, further comprising:
and when the verification of the object information fails, sending verification failure feedback information.
16. The data processing method of claim 12, further comprising:
and when the object information of the object fails to be acquired, acquiring an image of the object, identifying the image and acquiring the object information of the object.
17. The data processing method of claim 12, further comprising:
and generating a new shooting route according to the acquisition result aiming at the information identification code.
18. The data processing method according to any one of claims 12 to 17, wherein the information identification code is a barcode or a two-dimensional code that uniquely identifies object information of the object.
19. The data processing method according to any one of claims 12 to 17, wherein the information identification code is a two-dimensional code that uniquely identifies object information of the object, and the performing an image processing operation on the image to acquire the information identification code comprises:
detecting quadrilateral graphs in the image, and expanding each quadrilateral graph as an upper left corner, a lower left corner, an upper right corner and a lower right corner respectively according to a preset length in the image to form a target area for the quadrilateral graphs;
calculating the number of similar quadrangles in each target area, wherein the similar quadrangles are a plurality of quadrangle graphs of which the area difference is smaller than a first preset threshold value;
and aiming at the target area with the number of the similar quadrangles being three, detecting the vertex of the two-dimensional code, reducing the target area into a square area through affine transformation operation, and rotating the square area, so that the three similar quadrangles are respectively positioned at the upper left corner, the lower left corner and the upper right corner of the square area.
20. The data processing method according to claim 19, wherein before detecting a two-dimensional code vertex for the two-dimensional code region whose number of similar quadrangles is three, the method further comprises:
and performing image recovery processing on the target area with the number of the similar quadrangles less than three to enable the number of the similar quadrangles in the target area to be three.
21. The data processing method according to claim 12, wherein the shot points are set such that overlapping regions are included in two images adjacent to each other on the left and right acquired at adjacent shot points.
22. The data processing method of claim 12, wherein the photographing according to the at least one photographing route set for the shelf, and acquiring the image including the information identification code of the object placed on the shelf, comprises:
and at least two vertically adjacent images are collected at the same shooting point in the shooting route, so that the two images contain an overlapping area.
23. An electronic device, comprising:
a memory for storing a program;
a processor for executing the program stored in the memory for:
shooting according to at least one shooting route set for a shelf, and acquiring an image containing an information identification code of an object placed on the shelf, wherein the shooting route is composed of a plurality of shooting points;
performing image processing operation on the image to acquire the information identification code;
and analyzing the information identification code to acquire the object information of the object.
24. A computer-readable storage medium having instructions stored thereon, the instructions comprising:
shooting according to at least one shooting route set for a shelf, and acquiring an image containing an information identification code of an object placed on the shelf, wherein the shooting route is composed of a plurality of shooting points;
performing image processing operation on the image to acquire the information identification code;
and analyzing the information identification code to acquire the object information of the object.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910936976.2A CN112580379B (en) | 2019-09-29 | 2019-09-29 | Data processing system and method, electronic device, and computer-readable storage medium |
| PCT/CN2020/117621 WO2021057879A1 (en) | 2019-09-29 | 2020-09-25 | Data processing system and method, electronic device, and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910936976.2A CN112580379B (en) | 2019-09-29 | 2019-09-29 | Data processing system and method, electronic device, and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112580379A true CN112580379A (en) | 2021-03-30 |
| CN112580379B CN112580379B (en) | 2024-06-14 |
Family
ID=75110874
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910936976.2A Active CN112580379B (en) | 2019-09-29 | 2019-09-29 | Data processing system and method, electronic device, and computer-readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112580379B (en) |
| WO (1) | WO2021057879A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113945063A (en) * | 2021-10-15 | 2022-01-18 | 福建瑞雪制冷设备有限公司 | Internet of things-based refrigeration house control method and system and storage medium thereof |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005208789A (en) * | 2004-01-21 | 2005-08-04 | Matsushita Electric Ind Co Ltd | Optical information reading device and optical information reading method |
| CN1924899A (en) * | 2006-09-26 | 2007-03-07 | 福建榕基软件开发有限公司 | Precise location method of QR code image symbol region at complex background |
| CN101149792A (en) * | 2006-09-21 | 2008-03-26 | 国际商业机器公司 | System and method for performing inventory using a mobile inventory robot |
| CN103593664A (en) * | 2013-11-29 | 2014-02-19 | 重庆大学 | Preprocessing method for distorted image of QR (Quick Response) code |
| KR20170143471A (en) * | 2016-06-21 | 2017-12-29 | 김남현 | Online and offline data integration and management, sharing method and system using the binary code |
| CN107944324A (en) * | 2017-11-16 | 2018-04-20 | 凌云光技术集团有限责任公司 | A kind of Quick Response Code distortion correction method and device |
| CN108009460A (en) * | 2017-12-29 | 2018-05-08 | 姚佑霖 | The recognition methods of various characters and the superposition Quick Response Code of numeral mixing under complex background |
| CN109344928A (en) * | 2018-09-19 | 2019-02-15 | 中国科学院信息工程研究所 | The accurate checking method of cargo and system based on unmanned plane in a kind of bulk storage plant |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105730950B (en) * | 2014-12-10 | 2019-06-21 | 阿里巴巴集团控股有限公司 | A kind of Intelligent cargo cabinet and the delivery system based on Intelligent cargo cabinet |
| CN109849008A (en) * | 2019-02-21 | 2019-06-07 | 广州高新兴机器人有限公司 | A kind of robot checking method and system based on national treasury |
| CN110040412A (en) * | 2019-04-24 | 2019-07-23 | 深圳市海柔创新科技有限公司 | Intelligent warehousing system, processing terminal, storage robot and intelligent storage method |
-
2019
- 2019-09-29 CN CN201910936976.2A patent/CN112580379B/en active Active
-
2020
- 2020-09-25 WO PCT/CN2020/117621 patent/WO2021057879A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005208789A (en) * | 2004-01-21 | 2005-08-04 | Matsushita Electric Ind Co Ltd | Optical information reading device and optical information reading method |
| CN101149792A (en) * | 2006-09-21 | 2008-03-26 | 国际商业机器公司 | System and method for performing inventory using a mobile inventory robot |
| CN1924899A (en) * | 2006-09-26 | 2007-03-07 | 福建榕基软件开发有限公司 | Precise location method of QR code image symbol region at complex background |
| CN103593664A (en) * | 2013-11-29 | 2014-02-19 | 重庆大学 | Preprocessing method for distorted image of QR (Quick Response) code |
| KR20170143471A (en) * | 2016-06-21 | 2017-12-29 | 김남현 | Online and offline data integration and management, sharing method and system using the binary code |
| CN107944324A (en) * | 2017-11-16 | 2018-04-20 | 凌云光技术集团有限责任公司 | A kind of Quick Response Code distortion correction method and device |
| CN108009460A (en) * | 2017-12-29 | 2018-05-08 | 姚佑霖 | The recognition methods of various characters and the superposition Quick Response Code of numeral mixing under complex background |
| CN109344928A (en) * | 2018-09-19 | 2019-02-15 | 中国科学院信息工程研究所 | The accurate checking method of cargo and system based on unmanned plane in a kind of bulk storage plant |
Non-Patent Citations (1)
| Title |
|---|
| 陈超;徐和根;: "运动图像中QR码分割与识别", 微型电脑应用, no. 10, 20 October 2017 (2017-10-20) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113945063A (en) * | 2021-10-15 | 2022-01-18 | 福建瑞雪制冷设备有限公司 | Internet of things-based refrigeration house control method and system and storage medium thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112580379B (en) | 2024-06-14 |
| WO2021057879A1 (en) | 2021-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109299703B (en) | Method and device for carrying out statistics on mouse conditions and image acquisition equipment | |
| US10592726B2 (en) | Manufacturing part identification using computer vision and machine learning | |
| CN110659397B (en) | Behavior detection method and device, electronic equipment and storage medium | |
| WO2019221994A1 (en) | System and method of determining a location for placement of a package | |
| CN110491060B (en) | Robot, safety monitoring method and device thereof, and storage medium | |
| CN108062763B (en) | Target tracking method and device and storage medium | |
| CN111369590A (en) | Multi-target tracking method and device, storage medium and electronic equipment | |
| CN103888658A (en) | Information Processing Device And Recording Medium | |
| US20140270362A1 (en) | Fast edge-based object relocalization and detection using contextual filtering | |
| CN111291601B (en) | Lane line identification method and device and electronic equipment | |
| CN106384348B (en) | The method for detecting abnormality and device of monitoring image | |
| CN109948479B (en) | Factory monitoring method, device and equipment | |
| WO2021233058A1 (en) | Method for monitoring articles on shop shelf, computer and system | |
| CN112580379B (en) | Data processing system and method, electronic device, and computer-readable storage medium | |
| CN114549578A (en) | Target tracking method, device and storage medium | |
| EP3929804A1 (en) | Method and device for identifying face, computer program, and computer-readable storage medium | |
| CN112613358A (en) | Article identification method, article identification device, storage medium, and electronic device | |
| CN102044079A (en) | Apparatus and method for tracking image patch in consideration of scale | |
| KR20150137698A (en) | Method and apparatus for movement trajectory tracking of moving object on animal farm | |
| CN114255477A (en) | Smoking behavior detection method and related device | |
| CN111177449B (en) | Multi-dimensional information integration method based on picture and related equipment | |
| CN114187322A (en) | Cross-camera continuous tracking method and device for same object based on different features and scenes, and electronic equipment | |
| CN113515986A (en) | Video processing method, data processing method and equipment | |
| CN117896626B (en) | Method, device, equipment and storage medium for detecting motion trail by multiple cameras | |
| CN113128246B (en) | Information processing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |