CN112883965A

CN112883965A - Date detection method on packaging vessel, electronic device and computer-readable storage medium

Info

Publication number: CN112883965A
Application number: CN202110179982.5A
Authority: CN
Inventors: 叶卫国; 张瑞敏; 朱庆乐
Original assignee: Crsdet Electric Technology Zhengzhou Co ltd
Current assignee: Crsdet Electric Technology Zhengzhou Co ltd
Priority date: 2021-02-08
Filing date: 2021-02-08
Publication date: 2021-06-01

Abstract

Embodiments of the present invention provide a date detection method on a packaging vessel, an electronic device and a computer readable storage medium. The detection method disclosed by the invention comprises the following steps: obtaining an image of the packaging vessel; analyzing the image through a neural network to obtain a character string in the image; judging whether the character string contains preset indication characters and date characters; and comparing the date indicated by the date character with the current time according to the selected rule in a state of containing a preset indication character and containing the date character, and judging and outputting the usability of the packaging vessel. The detection method disclosed by the invention can effectively avoid the overdue problem in the secondary recycling process of the packaging vessels of various beverages such as wines, liquid beverages and the like.

Description

Date detection method on packaging vessel, electronic device and computer-readable storage medium

Technical Field

The present invention relates to a method for detecting date on a packaging container, and more particularly, to a method for detecting date on a packaging container, an electronic device, and a computer-readable storage medium.

Background

In the fields of consumer goods, food, beverages and the like, various marks for indicating production date, service life and the like need to be marked on packaging vessels, such as plastic boxes, glass bottles, plastic bottles and other various packaging vessels, according to the requirements of regulations, industrial specifications and the like, so that purchasers can judge whether the purchased products are within the shelf life or not.

If the conditions of date missing, fuzzy incomplete and the like occur, the consumer can generate doubt when purchasing and abandon the purchase of related products, and the confidence of the consumer on the related products and the reputation of brands can be seriously shaken due to the occurrence of a large number of defects.

Meanwhile, in the field of production of related products, it is also common to perform secondary recycling of, for example, beer bottles, in order to reduce waste. Beer bottles have fixed service lives, and overdue bottles can be used if date detection is not carried out, so that products cannot be delivered and sold.

Disclosure of Invention

Aiming at the requirements in the related art, the invention provides a date detection method on a packaging container, electronic equipment and a computer readable storage medium, which can quickly and accurately obtain the date on the packaging container and judge whether the date is out of date and is not suitable for use by introducing a neural network.

In one aspect of the invention, there is provided a date detection method on a packaging vessel, comprising the steps of:

obtaining an image of the packaging vessel;

analyzing the image through a neural network to obtain a character string in the image;

judging whether the character string contains preset indication characters and date characters;

and comparing the date indicated by the date character with the current time according to the selected rule in a state of containing a preset indication character and containing the date character, and judging and outputting the usability of the packaging vessel.

For example, obtaining an image of a packaging vessel includes: and in the rotating process of the packaging vessel, shooting and imaging the preset position of the packaging vessel.

For example, determining whether the character string includes a preset indication character and a date character includes: judging whether the character string contains preset indication characters or not; and under the state of containing preset indication characters, judging whether the character strings contain date characters or not according to the number and the content of the character strings.

For example, the preset indicator characters contain a marking for indicating the life of the packaging vessel.

Analyzing the image, for example, by a neural network, to obtain a character string in the image, including: preprocessing the image; inputting the preprocessed image into a pre-trained target detection neural network; and outputting a character string detection result.

For example, the target detection neural network includes YOLO v 3.

For example, the packaging vessel includes a beer bottle of glass material; the indicator letter comprises B; the date characters include year and quarter; the selected rule includes comparing the date indicated by the date character plus two years to the current time.

In another aspect of the invention, an electronic device is provided, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method of date detection on a packaging vessel as in any of the previous embodiments when executing the program.

In a further aspect of the invention, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the method of date detection on a packaging vessel according to any of the preceding embodiments.

Drawings

FIG. 1 shows a flow chart of a method of date detection on a packaging vessel according to an embodiment of the invention;

FIG. 2 shows a block diagram of a date detection system on a packaging vessel according to an embodiment of the invention;

FIG. 3 is a schematic diagram showing a beer bottle detected by the detection method according to the embodiment of the present invention;

fig. 4 shows a frame profile of an electronic device according to an embodiment of the present invention.

Detailed Description

In order to more clearly explain the present application, the present application is further described below with reference to the embodiments and the accompanying drawings. Similar parts in the figures are denoted by the same reference numerals. It is to be understood by persons skilled in the art that the following detailed description is illustrative and not restrictive, and is not intended to limit the scope of the present application.

In the description of the present application, it should be noted that the terms "upper", "lower", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, which are only for convenience in describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and operate, and thus, should not be construed as limiting the present application. Unless expressly stated or limited otherwise, the terms "mounted," "connected," and "connected" are intended to be inclusive and mean, for example, that they may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.

It is further noted that, in the description of the present application, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

Referring to fig. 1, an embodiment of the present invention provides a date detection method of a packing vessel, which may be performed in conjunction with the detection system of fig. 2, such as illuminating the packing vessel by a light source such as an LED, driving the position and angle of the packing vessel with a motor, obtaining a picture of the packing vessel with an imaging device such as a camera or a video camera, analyzing and processing the picture with a computer device or the like, and outputting the detection result on a display screen, etc.

The date detection method provided by the embodiment of the invention comprises the following steps:

s101, obtaining an image of a packaging vessel;

for example, the packaging container may be a packaging container for various liquid beverages such as beer bottles, white spirit bottles, and wine bottles, or a packaging box made of plastic, metal, or the like such as medicines and foods.

In one embodiment of the invention, the packaging vessel is a beer bottle made of glass.

For example, the image of the packaging vessel may be obtained by an imaging device such as a camera, a video camera, etc., which may be based on various imaging elements such as CCD, CMOS, infrared, etc.

For example, the obtained image may be a color image, a grayscale image, a black-and-white image, or an image obtained by binarizing the obtained color image.

For example, the packaging vessel may be in a stationary fixed state by the imaging device to obtain an image of the whole or a preset local position.

In one embodiment of the invention, the preset local position comprises the bottom and/or the top of the packaging vessel with the associated character string.

For example, the packaging container may be in a moving state, such as rotating, etc., and an image of the whole or a preset local position is obtained by the imaging device.

For example, the packaging container may be in a stationary fixed state, and the imaging device may be moved to obtain an image of the entire or a preset local position.

For example, the movement of the packaging vessel, the image forming apparatus, and the like may be driven by various power devices such as motors, drivers, and the like.

In one embodiment of the invention, the imaging device may be arranged to image at an angle with respect to a predetermined local position of the packaging container in order to limit as much as possible the influence of external light interference on the imaging quality.

For example, the photographic imaging may be performed at an angle of 30 °, 45 °, or the like with respect to the bottom or top.

In a particular embodiment of the invention, the packaging vessel comprises a beer bottle, and the imaging device is arranged below the beer bottle at an angle of 45 ° to the horizontal, and photographs the bottom of the beer bottle upwards. The beer bottle is driven by the motor to rotate for a circle, and the character string part of the beer bottle is imaged in the rotating process of the beer bottle.

S102, analyzing the image through a neural network to obtain a character string in the image;

in some embodiments, to improve the performance efficiency of the neural network, the images input to the neural network may be pre-processed.

For example, the pre-processing includes one or more of binarization, normalization, resize, denoising, contrast enhancement, and the like.

For example, the binarization may be performed by using a global threshold or a local threshold.

For example, normalization may divide the pixel value of each pixel by 255 such that the range of the entire input image is limited to between (0, 1).

For example, resize may modify the size of the image input to the network to a desired size of 416 × 416, 320 × 320, etc., by opencv, etc.

For example, denoising may reduce random interference signals in the image by a gaussian filter, a median filter, or the like.

For example, contrast enhancement may be performed by gray scale conversion, histogram equalization, or the like, to make the black-and-white contrast in the image more vivid.

In the embodiment of the present invention, the neural network used may be various neural networks with character recognition function and target recognition function, such as convolutional neural network CNN, BP neural network, recurrent neural network RNN, etc., and various neural networks derived based on these basic neural network architectures, such as LSTM, DNN, YOLO, R-CNN, R-FCN, etc.

Those skilled in the art will readily appreciate that training is required to enable the neural network to function as desired. For example, through supervised training, each character in the captured image is individually labeled by using labeling software to obtain information of the category and coordinates (x, y, w, h) of each character, and then the information is stored as a txt file and stored in the same folder with the corresponding image. Randomly dividing the marked files into a training set and a testing set, wherein the proportion of the training set to the testing set is approximately 3: 1, and then training the neural network using the training set.

In one embodiment of the invention, a YOLO neural network, such as YOLO V3, is used for character recognition in images.

The main framework of the YOLO V3 network uses Darknet-53, which is mainly composed of 1 × 1 and 3 × 3 convolutional layers, each convolutional layer is followed by a batch normalization layer and an leakage ReLU, and the convolutional layers, the batch normalization layer and the leakage ReLU together constitute a basic convolution unit DBL in Darknet-53, and contain 53 such DBLs. As shown in table 1 below:

TABLE 1 YOLO V3 network architecture

YOLO V3 has three scales of output. The mesh is responsible for predicting 3 bounding boxes at each scale.

Assuming that the number of indicator characters in the character string is a (e.g. 1) and the number of date characters is B (e.g. 10), the category can be divided into 11, and the tensor of the network output should be: n × [3 (4+1+11) ]. The obtained N is different according to different down-sampling times, and finally three output shape are respectively as follows: [13,13,48], [26,26,48], [52,52,48 ].

In the embodiment of the invention, the position loss part adopts a sum-square error loss calculation method, and the confidence loss and the category prediction are cross entropy loss calculation methods.

For example, as shown in the following formula:

wherein, the first term in the formula indicates that when the jth anchor box of the ith grid is responsible for a certain real target, the bounding box generated by the anchor box should be compared with the box of the real target, and the central coordinate error is obtained by calculation; the second term indicates that when the jth anchor box of the ith grid is responsible for a certain real target, the bounding box generated by the anchor box should be compared with the box of the real target, and the width and height errors are calculated; the third item represents the degree of confidence that the boxed object does have an object within it and the degree of confidence that the boxed object includes all of the features of the entire object.

S103, judging whether the character string contains preset indication characters and date characters;

the format of the indicator characters, date characters may be varied for different types of packaging containers, different inspection purposes.

For example, the indication characters may include B, expirary date (exp. date), Expirationdate, Expire, Use before, bb (best before), bb (best by), Stebilty, Validity, and the like, which may indicate a shelf life or a valid period.

For example, in the case of a beer bottle, the indication character may be B, and according to the provisions of the national standard GB 4544-1996, the B indication character may indicate that the service life of the beer bottle must not exceed two years.

For example, the date characters may include 8 or 6 characters of complete year, month, day information, such as 20201005, 150315; also year and month information such as 202006, 1505; also year quarter information such as 202001 (quarter 2020), 1604 (quarter fourth 2016); also, the number of year weeks, such as 202040 (40 weeks 2020), 1822 (22 weeks 2018).

For example, in the case of a beer bottle, the date character following the indicator character is usually a date character of the type of year, month, quarter, and week.

The number of date characters can be preset in the software to quickly avoid misidentification, for example, the number of characters is set to 8, 6,4, etc.

As shown in fig. 3-a, the absence of an indication character in the detection result is displayed, which indicates that the usability of the beer bottle does not need to be judged through the detection of the subsequent date character;

as shown in fig. 3-B, the presence of the indicator character B in the detection result is displayed, followed by a date character 202040 as week 40 of 2020.

And S104, comparing the date indicated by the date character with the current time according to the selected rule under the state of containing the preset indication character and the date character, and judging and outputting the usability of the packaging vessel.

The manner of judging the usability may be determined according to the purpose of the detection.

For example, if the indication character is Exp, BB, Expire, Use before, or the like, and the date indicated by the indication character is an expiration time, the rule selected may be to compare the time indicated by the date character with the current time. The rule selected may directly compare the identified date with the current time, indicating that the contents of the packaging vessel have expired and are unusable, prior to the current date.

For example, if the indication character is B and the date indicated by the indication is the factory time of the packaging vessel, for example, in the case of a beer bottle, a beer bottle two years after the factory date cannot be recycled, the availability is judged by comparing the current time with the production date two years after the indication character B, and the beer bottle is not reusable earlier than the current time.

The operator output regarding usability may be provided in a number of ways, such as displaying the result on a display of a computer device, indicating the result by flashing a different color on an LED light, broadcasting the result through a speaker, etc.

Taking the repeated utilization detection of beer bottles as an example, the time for detecting a single beer bottle by the method provided by the invention is shortened to 15ms, and the detection precision is improved to 99%.

Referring to fig. 4, an embodiment of the present invention provides an electronic device, which includes a memory, a processor and a computer program stored on the memory and running on the processor, and the processor executes the program to implement the date detection method on the packaging vessel according to any one of the foregoing embodiments.

The electronic device may take the form of a computer-general-purpose computing device including, for example, a memory 1010, a processor 1020, and a bus 1000 that couples the various system components.

The memory 1010 may include, for example, system memory, non-volatile storage media, and the like. The system memory stores, for example, an operating system, an application program, a BootLoader (BootLoader), and other programs. The system memory may include volatile storage media such as Random Access Memory (RAM) and/or cache memory. The non-volatile storage medium stores, for example, instructions to perform a corresponding embodiment of the sharpness calculation method. Non-volatile storage media include, but are not limited to, magnetic disk storage, optical storage, flash memory, and the like.

The processor 1020 may be implemented as discrete hardware components, such as a Central Processing Unit (CPU), Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gates or transistors, or the like.

Bus 1000 may use any of a variety of bus architectures. For example, bus structures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, and Peripheral Component Interconnect (PCI) bus.

The electronic device may also include input-output interface 1030, network interface 1040, storage interface 1050, and the like. These

interfaces

1030, 1040, 1050 and the memory 1010 and the processor 1020 may be connected by a bus 1000. The input/output interface 1030 may provide a connection interface for input/output devices such as a display, a mouse, and a keyboard. Network interface 1040 provides a connection interface for various networking devices. The storage interface 1040 provides a connection interface for external storage devices such as a floppy disk, a U disk, and an SD card.

An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the steps in the track date detection method provided in the embodiment of the present invention, and the implementation of the storage medium can be shown with reference to the above-mentioned memory 1010.

Although the basic principles, essential features and technical solutions of the present invention have been described and illustrated in greater detail by the inventors, it should be understood that modifications to the above-described embodiments or equivalent alternatives will be apparent to those skilled in the art, and any modifications or improvements made without departing from the spirit of the present invention are within the scope of the claimed invention.

Claims

1. A method of date detection on a packaging vessel, comprising: obtaining an image of the packaging vessel; analyzing the image through a neural network to obtain a character string in the image; judging whether the character string contains preset indication characters and date characters; and comparing the date indicated by the date character with the current time according to the selected rule in a state of containing a preset indication character and containing the date character, and judging and outputting the usability of the packaging vessel.

2. The date detection method of claim 1, wherein obtaining an image of a packaging vessel comprises: and in the rotating process of the packaging vessel, shooting and imaging the preset position of the packaging vessel.

3. The date detection method of claim 1, wherein determining whether the character string includes a preset indication character and a date character comprises: judging whether the character string contains preset indication characters or not; and under the state of containing preset indication characters, judging whether the character strings contain date characters or not according to the number and the content of the character strings.

4. The date detection method of claim 3, wherein the predetermined indication character includes a mark for indicating the life of the packing vessel.

5. The date detection method of claim 1, wherein analyzing the image through a neural network to obtain a character string in the image comprises: preprocessing the image; inputting the preprocessed image into a pre-trained target detection neural network; and outputting a character string detection result.

6. The date detection method of claim 5, wherein the target detection neural network comprises YOLO v 3.

7. The date detecting method according to claim 1, wherein the packaging vessel includes a beer bottle of glass material; the indicator letter comprises B; the date characters include year and week number; the selected rule includes comparing the date indicated by the date character plus two years to the current time.

8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor, when executing the program, implements the date detection method on a packaging vessel according to any one of claims 1 to 7.

9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out a method of date detection on a packaging vessel according to any one of claims 1 to 7.