CN113758938A

CN113758938A - Cigarette packet appearance camera device, cigarette packet appearance image management method and system

Info

Publication number: CN113758938A
Application number: CN202111187711.0A
Authority: CN
Inventors: 陈晓淼; 舒芳誉; 陈捷; 严剑凡; 吕健; 魏步建; 曹炜
Original assignee: Xiamen Tobacco Industry Co Ltd
Current assignee: Xiamen Tobacco Industry Co Ltd
Priority date: 2021-10-12
Filing date: 2021-10-12
Publication date: 2021-12-07

Abstract

The disclosure relates to a cigarette packet appearance camera device, a cigarette packet appearance image management method and a cigarette packet appearance image management system. The cigarette packet appearance camera device comprises a camera unit, wherein the camera unit is installed on a cigarette packet conveying belt, and the camera unit is used for shooting photos of the front surfaces of all 6 surfaces of cigarette packets on the cigarette packet conveying belt without deformation and sending the photos to an image recognition device. The front clear images of all surfaces of the cigarette packet can be acquired through the cigarette packet appearance camera device, so that the packaging and printing quality of the cigarette packet appearance can be controlled by the image recognition device, the recognition requirement of the cigarette packet two-dimensional code can be met, and the application requirements of the cigarette product appearance quality control and the cigarette packet two-dimensional code information can be met.

Description

Cigarette packet appearance camera device, cigarette packet appearance image management method and system

Technical Field

The disclosure relates to the technical field of internet of things and the field of cigarette product quality control, in particular to a cigarette packet appearance camera device, a cigarette packet appearance image management method and a cigarette packet appearance image management system.

Background

Along with the rise of the internet of things technology, the tobacco industry has more urgent needs for the anti-counterfeiting traceability of cigarette products, particularly cigarette packets, and the anti-counterfeiting traceability intelligent marketing of tobacco can be realized by endowing the cigarette packets with unique identification codes, so that the sales volume of tobacco is increased, all tobacco products can be helped to carry out the full-flow traceability of business, and the benefits of tobacco suppliers, distributors and customers are maximized.

Disclosure of Invention

The inventor finds out through research that: the method for realizing that one object of cigarette packet is relatively commonly used in the correlation technique is to print independent two-dimensional codes on the packaging material of the cigarette packet, but face some difficult problems when the industrial end is actually applied, lead to unable comprehensive popularization and application, for example, the two-dimensional codes of the cigarette packets of different brands may be printed on different surfaces of the cigarette packet, if the code reading equipment commonly used is used, a code reader needs to be arranged on each surface of the cigarette packet, not only the space occupying other detection devices is crowded, the input cost is increased, during the actual test, because the cigarette packet running speed is relatively fast, the code success rate is also difficult to meet the requirements dynamically.

In the related art, the cigarette packet appearance quality is an important quality index in the cigarette production process, and many cigarette packet appearance detection devices in the related art shoot partial photos of cigarette packets in a shooting mode, judge abnormal cigarette packets by comparing the gray level change of preset positions of cigarette packet images through a software algorithm, and can detect the defects of the cigarette packet appearance part to a certain extent, but still have the following problems:

1. only certain surfaces of the cigarette packet can be detected, for example, the surfaces of the cigarette packet, which are tightly attached to the conveying belt, cannot be detected.

2. In order to achieve the purpose that one camera device shoots a plurality of faces, the camera is not perpendicular to the shooting face, the deformation of the shot image is serious, only part of obvious defects can be identified, and the defects on a plurality of details cannot be detected, such as character errors, bar code errors and the like.

In view of at least one of the above technical problems, the present disclosure provides a cigarette packet appearance camera device, a cigarette packet appearance image management method and system, and a storage medium, by which a clear front image of all surfaces of a cigarette packet can be acquired by the cigarette packet appearance camera device.

According to an aspect of the present disclosure, a cigarette packet appearance camera device is provided, including a camera unit, wherein:

the camera shooting unit is installed on the cigarette packet conveying belt and used for shooting photos of the front surfaces of all 6 surfaces of the cigarette packets on the cigarette packet conveying belt without deformation and sending the photos to the image recognition device.

In some embodiments of the present disclosure, the camera unit comprises a first camera, a second camera, and a third camera, wherein:

the first camera and the second camera are arranged on the first cigarette packet conveying belt, and the first surface of the cigarette packet is attached to the first cigarette packet conveying belt for transmission;

the first camera is used for shooting a second surface, a third surface and a fourth surface of the cigarette packet, wherein the second surface is the opposite side of the first surface, the third surface is the left side surface relative to the transmission direction of the first cigarette packet conveying belt, and the fourth surface is the right side surface relative to the transmission direction of the first cigarette packet conveying belt;

the second camera is used for shooting a fifth surface and a sixth surface of the cigarette packet, wherein the fifth surface is a front side surface relative to the transmission direction of the first cigarette packet conveyer belt, and the sixth surface is a rear side surface relative to the transmission direction of the first cigarette packet conveyer belt;

the third camera is arranged on the second cigarette packet conveying belt, and the third surface or the fourth surface of the cigarette packet is attached to the second cigarette packet conveying belt for transmission;

and the third camera is used for shooting the first surface of the cigarette packet.

In some embodiments of the present disclosure, the camera unit further comprises a first mirror and a second mirror, wherein:

the first camera is arranged right above the first cigarette packet conveying belt;

the first reflecting mirror and the second reflecting mirror are arranged at opposite positions on the left side and the right side of the transmission direction of the first cigarette packet conveying belt; the first reflecting mirror and the second reflecting mirror are used for reflecting the third surface image and the fourth surface image of the cigarette packet to the first camera completely without deformation.

In some embodiments of the present disclosure, the distance from the first camera lens to the second surface of the cigarette packet should be greater than twice the distance from the second surface of the cigarette packet to the imaging position of the first reflector on the third surface of the cigarette packet.

In some embodiments of the present disclosure, the distance from the first camera lens to the second surface of the cigarette packet should be greater than twice the distance from the second surface of the cigarette packet to the position where the second reflector images the back of the cigarette packet.

In some embodiments of the present disclosure, the image pickup unit further comprises a third mirror, wherein:

the second camera and the third reflector are arranged on the same side of the first cigarette packet conveying belt;

the mirror surface of the third reflector is vertical to the plane where the first cigarette packet conveying belt is located, and the included angle between the mirror surface of the third reflector and the transmission direction of the first cigarette packet conveying belt is a first preset angle; the third reflector is used for reflecting the sixth surface image of the cigarette packet to the direction of the fifth surface completely without deformation.

In some embodiments of the present disclosure, the distance from the second camera lens to the fifth surface of the cigarette packet should be greater than twice the distance from the fifth surface of the cigarette packet to the position of the sixth surface of the cigarette packet by the third reflecting mirror.

In some embodiments of the present disclosure, the first predetermined angle ranges between 70 and 80 degrees.

In some embodiments of the present disclosure, the third camera is installed above the second cigarette packet conveying belt, and an included angle between a direction in which the third camera lens faces and the first surface of the cigarette packet should be a first predetermined angle, wherein a value range of the second predetermined angle is 70 to 80 degrees.

In some embodiments of the present disclosure, the cigarette packet appearance camera device further includes a cigarette packet positioning unit and a control unit, wherein:

the cigarette packet positioning unit is arranged on the cigarette packet conveying belt;

the control unit is in communication connection with the cigarette packet positioning unit and the camera shooting unit;

the cigarette packet positioning unit is used for acquiring cigarette packet position information and transmitting the cigarette packet position information to the control unit;

the control unit is used for sending a shooting signal to the camera shooting unit under the condition that the cigarette packet reaches a shooting position, and indicating the camera shooting unit to shoot front non-deformation photos of all 6 surfaces of the cigarette packet on the cigarette packet conveying belt; and transmits the picture taken by the camera unit to the image recognition device.

In some embodiments of the present disclosure, the cigarette packet positioning unit comprises a first cigarette packet presence detector, a shaft encoder, and a second cigarette packet presence detector, wherein:

the first cigarette packet existence detector is arranged on the side edge of the first cigarette packet conveying belt, the mounting direction of the first cigarette packet existence detector is vertical to the second surface of the cigarette packet, and the first cigarette packet existence detector is used for detecting whether the cigarette packet passes through or not and whether the cigarette packet is blocked or not;

the shaft encoder is arranged on a transmission shaft of the first cigarette packet conveying belt and used for acquiring the running speed of the cigarette packet longitudinal conveying belt;

and the second cigarette packet existence detector is arranged above the second cigarette packet conveying belt, and the installation direction of the second cigarette packet existence detector is vertical to that of the second cigarette packet conveying belt, and is used for detecting whether the cigarette packets reach the shooting position or not.

In some embodiments of the present disclosure, the signal input of the control unit is connected with the first cigarette packet presence detector, the shaft encoder and the second cigarette packet presence detector; a signal output unit of the control unit is connected with the first camera, the second camera and the third camera;

the control unit is used for calculating the real-time position of the cigarette packet through the cigarette packet speed obtained by the shaft encoder under the condition that the first cigarette packet existence detector of the cigarette packet detects that the cigarette packet passes through, controlling the first camera or the second camera to shoot the cigarette packet image under the condition that the cigarette packet reaches the shooting position of the first camera or the second camera, and storing the image returned by the first camera or the second camera; and when the cigarette packet exists in the second cigarette packet existence detector and the cigarette packet is detected, controlling a third camera to shoot the cigarette packet image and storing the cigarette packet image.

According to another aspect of the present disclosure, there is provided a cigarette packet appearance image management system, including a cigarette packet appearance camera device and an image recognition device, wherein:

the cigarette packet appearance camera device is connected with the image recognition device;

the cigarette packet appearance camera device is the cigarette packet appearance camera device as claimed in any one of claims 1 to 10;

and the image recognition device is used for recognizing the cigarette packet image, the characters and the two-dimensional code information in the photo, matching the cigarette packet image, the characters and the two-dimensional code information with the standard sample in the database and judging whether the cigarette packet appearance printing and the packaging quality have defects or not.

In some embodiments of the present disclosure, the tobacco bale appearance image management system further comprises a background management server, wherein:

the image recognition device is connected with the background management server;

the image recognition device is used for sending the cigarette packet photo, the production time and the two-dimensional code information to the background management server;

and the background management server is used for storing the pictures and the two-dimension code information of the cigarette packets, calling cigarette packet processing process information according to the cigarette packet production time and establishing association with the unique cigarette packet identification in the two-dimension code.

According to another aspect of the present disclosure, there is provided a cigarette packet appearance image management method, including:

the cigarette packet appearance camera shooting device shoots the front non-deformation photos of all 6 surfaces of the cigarette packet on the cigarette packet conveying belt, wherein the cigarette packet appearance camera shooting device is the cigarette packet appearance camera shooting device in any embodiment;

and the cigarette packet appearance camera device sends the picture to an image recognition device.

In some embodiments of the present disclosure, the capturing a front non-deformation photograph of all 6 faces of the cigarette packet on the cigarette packet conveying belt by the cigarette packet appearance camera device includes:

the first reflector and the second reflector of the cigarette packet appearance camera device are arranged on the first cigarette packet conveying belt and respectively reflect the third surface image and the fourth surface image of the cigarette packet to the direction of the second surface of the cigarette packet, and the first camera of the cigarette packet appearance camera device simultaneously shoots the second surface real image and the front images of the third surface image and the fourth surface image of the cigarette packet;

a third reflector of the cigarette packet appearance camera device arranged on the first cigarette packet conveying belt reflects the sixth surface image of the cigarette packet to the fifth surface direction of the cigarette packet, and a second camera of the cigarette packet appearance camera device simultaneously shoots the real object image of the fifth surface of the cigarette packet and the front image of the mirror surface image of the sixth surface of the cigarette packet;

the third camera of the cigarette packet appearance camera device arranged on the second cigarette packet transverse conveying belt shoots the front image of the first surface of the cigarette packet.

In some embodiments of the present disclosure, the method for managing an appearance image of a cigarette packet further includes:

the image recognition device recognizes cigarette packet images, characters and two-dimensional codes in the pictures shot by the cigarette packet appearance camera device, matches the cigarette packet images, characters and two-dimensional codes with standard samples in a database, and judges whether the printing of cigarette packet appearance and the packaging quality have defects or not;

and under the condition that the image recognition device recognizes that the appearance of the cigarette packet has defects, sending a removing instruction to a controller of the cigarette packet packaging equipment, and instructing the cigarette packet packaging equipment to remove the cigarette packet in the next procedure.

the image recognition device sends the image, the production time and the two-dimensional code information of the flawless cigarette packet to a background management server;

the background management server stores the pictures and the two-dimension code information of the cigarette packets, activates the two-dimension code and supplies the two-dimension code to the application terminal for code scanning;

and the background management server calls cigarette packet processing process information according to the cigarette packet production time, establishes association with the unique cigarette packet identifier in the two-dimensional code and provides support for upper-layer application.

According to another aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein the non-transitory computer-readable storage medium stores computer instructions which, when executed by a processor, implement the cigarette packet appearance image management method according to any one of the above embodiments.

The front clear images of all surfaces of the cigarette packet can be acquired through the cigarette packet appearance camera device, and the image recognition device controls the packaging and printing quality of the cigarette packet appearance, so that the appearance quality control requirement of cigarette products can be met.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a schematic diagram of some embodiments of the cigarette packet appearance image management system of the present disclosure.

Fig. 2a is a schematic view of some embodiments of the cigarette packet appearance camera device of the present disclosure.

Fig. 2b is a schematic view of another embodiment of the cigarette packet appearance camera device of the present disclosure.

Fig. 3 is a schematic deployment view of a cigarette packet appearance camera device on a first cigarette packet conveyor belt according to some embodiments of the present disclosure.

Fig. 4 is a schematic deployment view of a cigarette packet appearance camera device on a second cigarette packet conveyor belt in some embodiments of the present disclosure.

Fig. 5 is a schematic view of the disposition of the first mirror, the second mirror, and the first camera on the first cigarette packet conveyor belt in some embodiments of the present disclosure.

Fig. 6 is a schematic view of the disposition of the third mirror and the second camera on the second cigarette packet conveyor belt in some embodiments of the present disclosure.

Fig. 7 is a schematic diagram of some embodiments of the tobacco bale appearance image management method of the present disclosure.

Fig. 8 is a schematic diagram of other embodiments of the cigarette packet appearance image management method of the present disclosure.

Detailed Description

The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.

The relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.

In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

The inventor also finds out through research that: because the position where the cigarette packet packaging equipment can be provided with the detector is limited, the appearance detection device and the code reading device are easy to conflict.

The appearance detection device and the code reading device are integrated, so that the space can be greatly saved, and the input cost is reduced. The present disclosure is illustrated by the following specific examples.

Fig. 1 is a schematic diagram of some embodiments of the cigarette packet appearance image management system of the present disclosure. As shown in fig. 1, the tobacco bale appearance image management system of the present disclosure may include a tobacco bale appearance camera device 1, an image recognition device 2, and a background management server 3, wherein:

the cigarette packet appearance camera device 1 is installed on a cigarette packet conveying belt of the cigarette packaging machine and used for transmitting a shot cigarette packet photo to the image recognition device 2.

In some embodiments of the present disclosure, the cigarette packet appearance camera 1 is configured to take a photograph of the front surfaces of all 6 sides of the cigarette packet on the cigarette packet conveyor belt without deformation, and send the photograph to the image recognition device 2.

The image recognition device 2 is used for recognizing the image, the character and the two-dimensional code information in the cigarette packet photo through an image, character and two-dimensional code recognition technology, comparing the image, the character and the two-dimensional code information with a standard sample in a system database, and judging whether the printing quality and the packaging quality of the cigarette packet meet requirements or not; after identifying the tobacco bale which does not meet the requirement, the image identification device 2 sends a removal signal to tobacco bale packaging equipment, and the tobacco bale is removed in the subsequent process; for the cigarette packets meeting the requirements, the image recognition device 2 transmits the appearance images, the production time and the two-dimensional code information of the cigarette packets to the background management server 3 through the industrial Ethernet.

In some embodiments of the present disclosure, the production time of the cigarette packet may be the time when the image recognition device 2 receives the cigarette packet photograph taken by the high-speed camera.

And the background management server 3 is used for storing the pictures and the two-dimension code information of the cigarette packets, activating the two-dimension codes and scanning the codes by an application end. The background management server calls cigarette packet processing process information according to the cigarette packet production time, establishes association with the unique cigarette packet identification in the two-dimensional code, and provides support for accurate product quality tracing application.

In some embodiments of the present disclosure, the background management server may be further configured to provide data support for other upper-layer applications, where the related applications include: accurate product quality tracing, product quality abnormity reason investigation, online product two-dimensional code activation, product authenticity identification, consumer activities and the like.

In some embodiments of the present disclosure, a two-dimensional Code, also called a two-dimensional barcode, is a popular encoding method for mobile devices in recent years, which can store more information and represent more data types than a traditional Bar Code barcode. Present tobacco industry mainly through the printed product two-dimensional code on the trademark paper of tobacco bale, gives unique sign for every packet of cigarette package, can be applied to product production process quality at the industry end and traces back, after the customer purchased the tobacco bale, can scan the two-dimensional code through the cell-phone application at the commercial end, differentiatees the product true and false, knows product basic information and participates in the activity.

Based on the tobacco bale outward appearance image management system that this disclosure above-mentioned embodiment provided, through tobacco bale outward appearance camera device obtain the clear image in front of all surfaces of tobacco bale, image recognition device controls the packing of tobacco bale outward appearance and printing quality, can satisfy cigarette product outward appearance quality control requirement, can discern the two-dimensional code information in the tobacco bale image simultaneously and send background management server. The background management server stores appearance images and two-dimension code information of all tobacco packets, associates processing process information of the tobacco packets, meets the requirement of accurate quality tracing in the production process, and provides support for commercial end application, such as online activation of two-dimension codes of products, authenticity identification of the products and the like.

The following describes the structures and functions of the cigarette packet appearance camera device, the image recognition device and the background management server of the cigarette packet appearance image management system according to the present disclosure in specific embodiments.

Fig. 2a is a schematic view of some embodiments of the cigarette packet appearance camera device of the present disclosure. As shown in fig. 2a, the cigarette packet appearance camera device 1 of the present disclosure may include a camera unit 112, wherein:

the camera unit 112 is installed on the cigarette packet conveying belt, and the camera unit 112 is used for shooting photos of all 6 faces of the cigarette packets on the cigarette packet conveying belt without deformation, and sending the photos to the image recognition device.

Fig. 2b is a schematic view of another embodiment of the cigarette packet appearance camera device of the present disclosure. As shown in fig. 2b, the cigarette packet appearance camera device of the present disclosure may include a cigarette packet positioning unit 111, a camera unit 112, and a control unit 113, wherein:

the cigarette packet positioning unit 111 and the camera unit 112 are both in communication connection with the control unit 113.

The cigarette packet positioning unit 111 and the camera unit 112 are mounted on the cigarette packet conveying belt.

And the cigarette packet positioning unit 111 is used for acquiring cigarette packet position information and transmitting the cigarette packet position information to the control unit.

The control unit 113 is used for sending a shooting signal to the camera shooting unit when the cigarette packet reaches the shooting position, and instructing the camera shooting unit 112 to shoot a front non-deformation picture of all 6 surfaces of the cigarette packet on the cigarette packet conveying belt; and transmits the picture taken by the camera unit to the image recognition device.

In some embodiments of the present disclosure, when the cigarette packet positioning unit 111 detects that a cigarette packet reaches the shooting position, a signal is sent to the control unit 114, the control unit 114 sends a shooting instruction to the shooting unit 112, and the shooting unit 112 shoots all front images of 6 sides of the top, the bottom, the front, the back, the right side and the left side of the cigarette packet, where the front of the cigarette packet refers to the opening direction of the cigarette packet, and the top refers to the direction in which cigarettes are taken out after the cigarette packet is opened.

Fig. 3 is a schematic deployment view of a cigarette packet appearance camera device on a first cigarette packet conveyor belt according to some embodiments of the present disclosure. Fig. 4 is a schematic deployment view of a cigarette packet appearance camera device on a second cigarette packet conveyor belt in some embodiments of the present disclosure.

In some embodiments of the present disclosure, as shown in fig. 3 and 4, the first cigarette packet conveying belt may be a cigarette packet longitudinal conveying belt, and the second cigarette packet conveying belt may be a cigarette packet transverse conveying belt.

As shown in fig. 3 and 4, the cigarette packet positioning unit 111 includes: a first cigarette packet presence detector 1111, a second cigarette packet presence detector 1112, and a shaft encoder 1113; the image pickup unit 112 includes: a first camera 1121, a second camera 1122, a third camera 1123, a first mirror 1131, a second mirror 1132, a third mirror 1133; the control unit 113 may include: a programmable controller 1141 and an industrial computer 1142.

In some embodiments of the present disclosure, the first camera 1121, the second camera 1122, and the third camera 1123 may be implemented as high-speed cameras.

In some embodiments of the present disclosure, as shown in fig. 3 and 5, the first reflecting mirror 1131 and the second reflecting mirror 1132 are respectively installed at opposite positions on two sides of the longitudinal tobacco bale conveying belt, the bottoms of the first reflecting mirror 1131 and the second reflecting mirror 1132 are overlapped with the plane where the longitudinal tobacco bale conveying belt is located, and an included angle between the mirror surface and the plane where the longitudinal tobacco bale conveying belt is located is 45 degrees, so as to completely reflect the front and back images of the tobacco bale directly above the longitudinal tobacco bale conveying belt without deformation.

In some embodiments of the present disclosure, the first camera 1121 is configured to photograph a second surface, a third surface and a fourth surface of a cigarette packet, wherein the first surface of the cigarette packet is attached to the first cigarette packet conveying belt for conveying, the second surface is an opposite side of the first surface, the third surface is a left side surface opposite to a conveying direction of the first cigarette packet conveying belt, and the fourth surface is a right side surface opposite to the conveying direction of the first cigarette packet conveying belt.

In some embodiments of the present disclosure, as shown in fig. 3 and 5, the first surface may be a right side face of the pouch, the second surface may be a left side face of the pouch, the third surface may be a front face of the pouch, and the fourth surface may be a back face of the pouch.

In other embodiments of the present disclosure, the first surface attached to the first cigarette packet conveying belt may also be a left side surface of a cigarette packet, a front surface of a cigarette packet, or a back surface of a cigarette packet, and thus the second surface, the third surface, and the fourth surface may also be changed accordingly.

In some embodiments of the present disclosure, as shown in fig. 3 and 5, the first camera 1121 is installed right above the cigarette packet longitudinal conveyor belt, the lens angle is perpendicular to the cigarette packet longitudinal conveyor belt, the distance from the lens to the left side surface of the cigarette packet should be greater than twice the distance from the left side surface of the cigarette packet to the imaging position of the first reflector 1131 on the back surface of the cigarette packet, and the physical image of the left side surface of the cigarette packet and the front surface of the mirror image of the front surface and the back surface can be shot simultaneously without deformation.

The inventor researches and discovers that: when a camera shoots a bar code photo, the included angle alpha between the direction opposite to a lens and a shot surface is ideally 90 degrees (namely the camera is just opposite to the shot surface), but as long as the alpha angle is less than 70 degrees, the shot bar code photo cannot be identified (because the shot angle is not just opposite to the shot bar code, the shot bar code is deformed and cannot be identified, and the shooting angle of 70 degrees is just a critical point)

Thus, from the above, the present disclosure has the following requirements for the first mirror 1131 and the second mirror 1132:

1) the included angle between the mirror surface and the cigarette packet conveying belt can be 45 degrees, as shown in fig. 3 and 5, so that the included angle alpha between the front image of the cigarette packet reflected right above and the lens of the high-speed camera is 90 degrees.

2) The bottom of the mirror surface needs to be lower than the cigarette packet conveying belt, and the top of the mirror needs to be higher than the left side face of the cigarette packet, otherwise, a complete cigarette packet image cannot be obtained.

3) The camera lens of the high-speed camera can be a wide-angle lens, because the front mirror image of the cigarette packet and the left side image of the cigarette packet have height difference, if the common camera is focused on the left side surface of the cigarette packet, the front mirror image of the cigarette packet can be blurred, and the depth of field of the wide-angle lens is larger, so that the definition of the left side image of the cigarette packet and the front mirror image of the cigarette packet can be ensured.

As shown in fig. 3 and 6, the third reflector 1133 and the second reflector 1132 are installed on the same side, the bottom of the third reflector coincides with the plane where the cigarette packet longitudinal conveyor belt is located, the mirror surface is perpendicular to the cigarette packet longitudinal conveyor belt, and the included angle between the mirror surface and the cigarette packet movement direction can be adjusted within the range of 70-80 degrees, so as to reflect the bottom image of the cigarette packet to the top direction completely without deformation.

In some embodiments of the present disclosure, the second camera 1133 may be configured to photograph a fifth surface and a sixth surface of the cigarette packet, where the fifth surface is a front side surface relative to the conveying direction of the first cigarette packet conveying belt, and the sixth surface is a rear side surface relative to the conveying direction of the first cigarette packet conveying belt.

In some embodiments of the present disclosure, as shown in fig. 3 and 6, the fifth surface may be a pouch top and the sixth surface may be a pouch bottom.

In some embodiments of the present disclosure, as shown in fig. 3 and 6, the installation position of the second camera 1122 and the third reflector 1133 are on the same side of the longitudinal conveyor belt of the cigarette packet, the lens directly faces the top of the cigarette packet, the distance from the lens to the top of the cigarette packet should be greater than twice the distance from the top of the cigarette packet to the imaging position of the third reflector 1133 to the bottom of the cigarette packet, and the physical image of the top of the cigarette packet and the mirror image of the bottom of the cigarette packet can be captured simultaneously.

In some embodiments of the present disclosure, as shown in fig. 3 and 6, for the third reflector 1133, since the camera 1122 cannot be directly opposite to the top of the cigarette packet, the top of the cigarette packet faces the moving direction of the cigarette packet, the camera must be mounted close to the conveyor belt, and the lens must be more than a certain distance away from the cigarette packet when the camera shoots, otherwise the shooting angle α is too small, and the image deformation may seriously affect the recognition. The third reflector 1133 must also be close to the conveyor belt and keep a certain distance from the bottom of the cigarette packet to reflect the bottom image of the cigarette packet. At the moment, the included angle between the mirror surface and the tobacco bale conveying direction depends on the distance between the mirror surface and the tobacco bale.

In some embodiments of the present disclosure, as shown in fig. 6, α 1 and α 2 in the figure are cigarette packet top shooting angles, where α 2 is greater than 70 degrees and can meet the barcode identification requirement, and α 1 is less than 70 degrees and cannot meet the barcode identification requirement. Alpha 3 is the shooting angle of the cigarette packet bottom mirror image and is required to be larger than 70 degrees.

In some embodiments of the present disclosure, because the real image of a certain edge of the cigarette packet is not in the same plane as the mirror images of other edges, the first camera 1121 and the second camera 1122 should use wide-angle lenses, and the clear images of the real image of the cigarette packet and the mirror images of different planes can be captured simultaneously by using the characteristic of the wide-angle lenses with a large depth of field.

In some embodiments of the present disclosure, as shown in fig. 4, the third camera 1123 is installed above the lateral conveyor belt of the cigarette packet, and is used for shooting images of the right side surface of the cigarette packet, an included angle between a direction in which a lens of the third camera 1123 faces and a plane in which the right side surface of the cigarette packet is located should be 70 to 80 degrees, so as to avoid compression deformation of the shot images and influence on identification of the two-dimensional code; since only one face image of the cigarette pack is photographed, the third camera 1123 does not need to use a wide-angle lens. The detection of the tight adhesion of the cigarette packet to the conveying belt is realized by installing a high-speed camera, namely a third camera 1123 on the channel after the cigarette packet is turned over.

In some embodiments of the present disclosure, as shown in fig. 3 and 4, the first cigarette packet presence detector 1111 is selected as a reflective type photo detector, and is installed at the side edge of the longitudinal conveyer belt of the cigarette packet, and the installation direction is perpendicular to the front surface of the cigarette packet, so as to detect whether the cigarette packet passes through and whether the cigarette packet is blocked; the shaft encoder 1112 is arranged on a transmission shaft of the cigarette packet longitudinal conveyor belt to obtain the running speed of the cigarette packet longitudinal conveyor belt; the second cigarette packet presence detector 1112 is a reflective photoelectric detector, is mounted above the cigarette packet transverse conveyor belt in a direction perpendicular to the cigarette packet transverse conveyor belt, and is used for detecting whether the cigarette packet reaches a shooting position.

In some embodiments of the present disclosure, as shown in fig. 3, the signal input of the programmable controller 1141 is connected with the signal lines of the first cigarette packet presence detector 1111, the second cigarette packet presence detector 1112, and the shaft encoder 1112; according to the brand and the model of the selected programmable controller, the industrial personal computer 1142 is connected with the selected programmable controller through an RS232 serial port, an MPI interface or an Ethernet interface; the first camera 1111, the second camera 1112 and the third camera 1113 may be interfaced with the industrial computer 1142 via the USB3.2 specification.

In some embodiments of the present disclosure, the control logic of the cigarette packet appearance camera device 1 may be: when the cigarette packet existence detector 1111 detects that a cigarette packet passes through, the cigarette packet speed obtained by the shaft encoder 1112 calculates the real-time position of the cigarette packet, when the cigarette packet reaches the shooting position of the first camera 1111 or the second camera 1112, the programmable controller 1141 sends a signal to the industrial control computer 1142, the industrial control computer 1142 controls the first camera 1111 or the second camera 1112 to shoot the cigarette packet image, and stores the image returned back by the first camera 1111 or the second camera 1112; when the cigarette packet existence detector 1112 detects a cigarette packet, the programmable controller directly sends a signal to the industrial control computer 1142, and the industrial control computer controls the third camera 1113 to shoot and store the cigarette packet image.

In some embodiments of the present disclosure, the cigarette packet presence detector is used to determine whether a cigarette packet passes through, and then determines how long it takes for the cigarette packet to reach the shooting position through the shaft encoder, thereby determining the shooting opportunity of the high-speed camera, so the cigarette packet presence detector only needs to be installed before the high-speed camera.

The tobacco bale outward appearance image management system of this disclosed embodiment, can reflect the image of other faces of tobacco bale to same direction through the speculum, then can shoot the clear image at certain face of the tobacco bale of different planes and other faces of mirror reflection simultaneously through the camera that has the wide angle camera lens, the shooting angle of camera is basically perpendicular with the tobacco bale plane, the image of acquisition can not warp, can satisfy the requirement of characters and two-dimensional code discernment, and use three camera can acquire the image of the whole 6 faces of tobacco bale, when practicing thrift the cost by a wide margin, can also reduce occupation space.

In some embodiments of the present disclosure, software of the image recognition device 2 in the embodiment of fig. 1 is installed on an industrial control computer 1142, photographs taken by a first camera 1111, a second camera 1112 and a third camera 1113 are read, images and characters of each side of a cigarette packet in the photographs are obtained through an image and character recognition technology, the images and characters of each side of the cigarette packet are compared with standard samples in a database, and the appearance quality of the cigarette packet is judged; the two-dimension code information in the cigarette packet image is read through a two-dimension code identification technology, and the printing quality of the two-dimension code and the effectiveness of the two-dimension code can be judged.

In some embodiments of the present disclosure, the image recognition device 2 in the embodiment of fig. 1 may be in communication with a controller of a cigarette packet packaging device, and the industrial control computer 1142 is connected with the cigarette packet packaging device by using RS232 or ethernet according to different brands and models of the cigarette packet packaging device, where the communication protocol includes profibus or GDLAN. When the image recognition device 2 recognizes that the image, the character and the two-dimensional code of the cigarette packet appearance have defects, the image recognition device 2 informs the cigarette packet packaging equipment to remove the cigarette packet in the subsequent process. For a non-defective cigarette packet, the image recognition device 2 sends the image and the two-dimensional code information of the cigarette packet to the background management server 3 through the industrial Ethernet.

In some embodiments of the present disclosure, the background management server 3 in the embodiment of fig. 1 may be set up on an upper system, such as an ERP server, store all tobacco bale images, production time, and two-dimensional code information, and acquire processing process information on the data acquisition system through an ethernet according to the production time of a tobacco bale, and establish association with a unique tobacco bale identifier in a tobacco bale two-dimensional code.

Based on tobacco bale outward appearance image management system that this embodiment of this disclosure provided, can be through integrated image, characters and two-dimensional code recognition function, can satisfy tobacco bale outward appearance quality detection and two-dimensional code recognition demand simultaneously, save tobacco bale image and two-dimensional code information through backstage management server to process information and the only sign of tobacco bale in the two-dimensional code carry out the correlation, can provide data support for the industrial end of tobacco industry and the various applications of commercial end, including product quality accuracy is traceed back, product quality anomaly reason is checked, product two-dimensional code is online activated, product true and false is distinguished, consumer's activity etc..

The dynamic code scanning of the related art uses a code reader, and the code reader is poor in chip processing capability and is identified in the cigarette packet movement process, so that the problem of low success rate is easy to occur. In the system, the high-speed camera is used for shooting the static picture of the cigarette packet and transmitting the static picture to the image recognition device, and the static picture of the cigarette packet is recognized when the image recognition device reads codes, so that the recognition success rate of the system is high.

Fig. 7 is a schematic diagram of some embodiments of the tobacco bale appearance image management method of the present disclosure. Preferably, this embodiment can be executed by this disclosure tobacco bale outward appearance image management system or this disclosure tobacco bale outward appearance camera device. The method comprises at least one of steps 71-72, wherein:

step 71, a cigarette packet appearance camera device shoots a picture of the front surfaces of all 6 surfaces of a cigarette packet on the cigarette packet conveying belt, wherein the cigarette packet appearance camera device is the cigarette packet appearance camera device according to any one of the embodiments.

In some embodiments of the present disclosure, step 71 may include at least one of step 7110, step 713, wherein:

and 711, reflecting a third surface image and a fourth surface image of the cigarette packet to the direction of the second surface of the cigarette packet by using a first reflecting mirror and a second reflecting mirror of the cigarette packet appearance camera device which are arranged on the first cigarette packet conveying belt, and shooting a second surface real image, a third surface image and a front image of the fourth surface image of the cigarette packet by using a first camera of the cigarette packet appearance camera device at the same time.

And step 712, a third reflector of the cigarette packet appearance camera device arranged on the first cigarette packet conveying belt reflects the sixth surface image of the cigarette packet to the fifth surface direction of the cigarette packet, and a second camera of the cigarette packet appearance camera device simultaneously shoots the real object image of the fifth surface of the cigarette packet and the front image of the mirror surface image of the sixth surface of the cigarette packet.

And 713, shooting a front image of the first surface of the cigarette packet by a third camera of the cigarette packet appearance shooting device arranged on the second cigarette packet transverse conveyor belt.

And step 72, the cigarette packet appearance camera device sends the picture to an image recognition device.

Fig. 8 is a schematic diagram of other embodiments of the cigarette packet appearance image management method of the present disclosure. Preferably, this embodiment can be executed by this disclosure tobacco bale outward appearance image management system or this disclosure tobacco bale outward appearance camera device. The method comprises at least one of steps 81-87, wherein:

and step 81, shooting the front non-deformation photos of all 6 surfaces of the cigarette packet on the cigarette packet conveying belt by using a cigarette packet appearance shooting device, wherein the cigarette packet appearance shooting device is the cigarette packet appearance shooting device in any embodiment.

And step 82, the cigarette packet appearance camera device sends the picture to an image recognition device through a USB3.2 interface and the like.

And step 83, the image recognition device recognizes cigarette packet images, characters and two-dimensional codes in the pictures shot by the cigarette packet appearance camera device, matches the cigarette packet images, characters and two-dimensional codes with standard samples in the database, and judges whether the printing quality and the packaging quality of the cigarette packet appearance have defects or not.

And step 84, under the condition that the image recognition device recognizes that the appearance of the cigarette packet has defects, sending a removing instruction to a controller of the cigarette packet packaging equipment, and instructing the cigarette packet packaging equipment to remove the cigarette packet in the next procedure.

And step 85, the image recognition device sends the image, the production time and the two-dimensional code information of the non-defective cigarette packet to a background management server.

In some embodiments of the present disclosure, step 85 may comprise: and sending the image, the production time and the two-dimension code information of the cigarette packet with qualified appearance quality to a background management server through an industrial Ethernet.

And step 86, the background management server stores the picture and the two-dimension code information of the cigarette packet, activates the two-dimension code and allows the two-dimension code to be used by scanning the code by an application terminal.

And step 87, the background management server calls cigarette packet processing process information according to the cigarette packet production time, establishes association with the unique cigarette packet identifier in the two-dimensional code and provides support for upper-layer application.

In some embodiments of the present disclosure, step 87 may comprise: the background management server stores the image and the two-dimension code of the tobacco bale, acquires the processing process information of the tobacco bale from the production data acquisition server according to the production time of the tobacco bale, and establishes the association between the processing process information and the image of the tobacco bale and the two-dimension code, so as to provide data support for various applications of an industrial end and a commercial end of the tobacco industry, wherein the related applications can comprise accurate product quality tracing, abnormal product quality reason checking, online product two-dimension code activation, product authenticity identification, consumer activities and the like.

According to the tobacco bale appearance image management method in the embodiment, by the principle that the mirror reflection and the wide-angle lens have large depth of field, the front clear image of 6 surfaces of a tobacco bale can be shot by using 3 cameras, the requirements of tobacco bale appearance quality detection and two-dimensional code identification can be met simultaneously by integrating the image, characters and two-dimensional code identification functions, the tobacco bale image and the two-dimensional code information are stored by a background management server, the processing process information is associated with the unique identifier of the tobacco bale in the two-dimensional code, data support can be provided for various applications of an industrial end and a commercial end of the tobacco industry, and the method comprises accurate product quality tracing, product quality abnormity reason checking, online product two-dimensional code activation, product authenticity identification, consumer activities and the like.

The embodiment of the disclosure can shoot the images of all sides of the cigarette packet through the cigarette packet appearance camera device, the cigarette packet appearance quality is detected through the image and character recognition technology, the two-dimension code information in the image is recognized through the two-dimension code recognition technology, the recognized two-dimension code is activated and the product processing process information is bound through the background management server, the cigarette packet appearance quality control of the tobacco industry at the cigarette product production end can be met, production tracing, abnormal reason checking and product authenticity identification at the sales end, the requirements of interaction with customers and the like are met, the tracing efficiency of abnormal products is effectively improved, the tracing cost is reduced, and the satisfaction degree of the customers on cigarette products is improved.

As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, apparatus, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The control unit, image recognition device, and back-office management server described above may be implemented as a general purpose processor, a Programmable Logic Controller (PLC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any suitable combination thereof, for performing the functions described herein.

Thus far, the present disclosure has been described in detail. Some details that are well known in the art have not been described in order to avoid obscuring the concepts of the present disclosure. It will be fully apparent to those skilled in the art from the foregoing description how to practice the presently disclosed embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware to implement the above embodiments, where the program may be stored in a non-transitory computer readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic or optical disk, and the like.

The description of the present disclosure has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the disclosure in the form disclosed. Many modifications and variations will be apparent to practitioners skilled in this art. The embodiment was chosen and described in order to best explain the principles of the disclosure and the practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. The utility model provides a tobacco bale outward appearance camera device which characterized in that, includes the unit of making a video recording, wherein:

2. The cigarette packet appearance camera device according to claim 1, wherein the camera unit includes a first camera, a second camera and a third camera, wherein:

3. The cigarette pack appearance camera device according to claim 2, wherein the camera unit further comprises a first reflecting mirror and a second reflecting mirror, wherein:

4. The cigarette packet appearance camera device according to claim 3,

the distance from the first camera lens to the second surface of the cigarette packet is more than twice of the distance from the second surface of the cigarette packet to the imaging position of the first reflector on the third surface of the cigarette packet;

the distance from the first camera lens to the second surface of the cigarette packet is larger than twice of the distance from the second surface of the cigarette packet to the imaging position of the second reflector to the back surface of the cigarette packet.

5. The cigarette packet appearance camera device according to any one of claims 2-4, wherein the camera unit further comprises a third reflector, wherein:

6. The cigarette packet appearance camera device according to claim 5,

the distance from the second camera lens to the fifth surface of the cigarette packet is more than twice of the distance from the fifth surface of the cigarette packet to the sixth surface of the cigarette packet by the third reflecting mirror;

and/or the presence of a gas in the gas,

the first predetermined angle ranges from 70 to 80 degrees.

7. The cigarette packet appearance camera device according to any one of claims 2 to 4,

the third camera is arranged above the second cigarette packet conveying belt, and an included angle between the direction in which the third camera lens faces and the first surface of the cigarette packet is a first preset angle, wherein the value range of the second preset angle is 70-80 degrees.

8. The cigarette packet appearance camera device according to any one of claims 1-4, further comprising a cigarette packet positioning unit and a control unit, wherein:

9. The cigarette packet appearance camera device according to claim 8, wherein the cigarette packet positioning unit includes a first cigarette packet presence detector, a shaft encoder, and a second cigarette packet presence detector, wherein:

10. The cigarette packet appearance camera device according to claim 9,

the signal input end of the control unit is connected with the first cigarette packet presence detector, the shaft encoder and the second cigarette packet presence detector; a signal output unit of the control unit is connected with the first camera, the second camera and the third camera;

11. The tobacco bale outward appearance image management system is characterized by comprising a tobacco bale outward appearance camera device and an image recognition device, wherein:

12. The tobacco bale appearance image management system of claim 11, further comprising a background management server, wherein:

13. A tobacco bale appearance image management method is characterized by comprising the following steps:

the cigarette packet appearance camera shooting device shoots the front non-deformation photos of all 6 surfaces of the cigarette packet on the cigarette packet conveying belt, wherein the cigarette packet appearance camera shooting device is the cigarette packet appearance camera shooting device as claimed in any one of claims 1 to 10;

14. The cigarette packet appearance image management method according to claim 13, wherein the taking of the front non-deformation photograph of all 6 faces of the cigarette packet on the cigarette packet conveyor belt by the cigarette packet appearance camera comprises:

15. The cigarette packet appearance image management method according to claim 13 or 14, further comprising:

16. The cigarette packet appearance image management method according to claim 15, further comprising:

17. A non-transitory computer-readable storage medium storing computer instructions which, when executed by a processor, implement the cigarette package appearance image management method according to any one of claims 13 to 16.