CN115211578B - Baking control method, baking control device, baking equipment and storage medium - Google Patents

Baking control method, baking control device, baking equipment and storage medium Download PDF

Info

Publication number
CN115211578B
CN115211578B CN202210838391.9A CN202210838391A CN115211578B CN 115211578 B CN115211578 B CN 115211578B CN 202210838391 A CN202210838391 A CN 202210838391A CN 115211578 B CN115211578 B CN 115211578B
Authority
CN
China
Prior art keywords
baking
image
sample
sample image
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210838391.9A
Other languages
Chinese (zh)
Other versions
CN115211578A (en
Inventor
闫润强
李奇峰
宋季锟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Henan Xunfei Artificial Intelligence Technology Co ltd
Original Assignee
Henan Xunfei Artificial Intelligence Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Henan Xunfei Artificial Intelligence Technology Co ltd filed Critical Henan Xunfei Artificial Intelligence Technology Co ltd
Priority to CN202210838391.9A priority Critical patent/CN115211578B/en
Publication of CN115211578A publication Critical patent/CN115211578A/en
Application granted granted Critical
Publication of CN115211578B publication Critical patent/CN115211578B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A24TOBACCO; CIGARS; CIGARETTES; SIMULATED SMOKING DEVICES; SMOKERS' REQUISITES
    • A24BMANUFACTURE OR PREPARATION OF TOBACCO FOR SMOKING OR CHEWING; TOBACCO; SNUFF
    • A24B3/00Preparing tobacco in the factory
    • A24B3/10Roasting or cooling tobacco
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/761Proximity, similarity or dissimilarity measures

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)

Abstract

The application provides a baking control method, a baking control device, baking equipment and a storage medium, which can compare a baking target image corresponding to a current baking target with sample images in a sample image library, and determine a reference image matched with the baking target image from the sample images based on the image difference degree between the baking target image and the sample images and the baking state credibility of the sample images. According to the application, the baking parameters of the baking target are adjusted according to the baking parameters corresponding to the reference image matched with the baking target image, so that the automatic adjustment of the baking parameters is realized, the influence of the experience and the level of baking personnel on the baking quality is avoided, and the product quality is ensured.

Description

Baking control method, baking control device, baking equipment and storage medium
Technical Field
The present application relates to the field of automatic control technology, and in particular, to a baking control method, a baking device, a baking apparatus, and a storage medium.
Background
For the production of certain products, the baking and dehydrating treatment of the baking target for the production of the products is an essential step in the production process of the products. For example, tobacco baking is an essential procedure for cigarette processing, and the requirements of subsequent production steps such as cigarette packaging and the like can be met by baking tobacco to reduce the water content in the tobacco.
At present, in the baking and dehydrating treatment process of a baking target, in order to ensure the baking quality of the baking target, baking staff is required to observe the color, the moisture, the shape and the like of the baking target, further judge the baking state of the baking target according to experience, and adjust parameters such as the baking temperature, the humidity and the like. However, the baking quality is greatly influenced by experience and level of baking staff, so that the baking quality is uneven, and the product quality is influenced.
Disclosure of Invention
Based on the above requirements, the present application provides a baking control method, a baking device, a baking apparatus and a storage medium, so as to solve the problem that the baking mode in the prior art affects the product quality.
The technical scheme provided by the application is as follows:
in one aspect, the present application provides a baking control method, comprising:
calculating the image difference degree between the baking target image and a sample image in a preset sample image library; wherein the sample image comprises an image of a sample baking target during baking;
selecting a reference image matched with the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target time is the time of shooting the sample image;
And adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
Further, in the above method, the baking target image includes an image group obtained by photographing the baking target from each photographing position; the sample image library comprises a plurality of sample image groups, and each sample image group comprises an image obtained by shooting a sample baking target from each shooting position;
the calculating the image difference degree between the baking target image and the sample image in the preset sample image library comprises the following steps:
calculating the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group;
and determining the image difference degree between the baking target image and each sample image group based on the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group.
Further, in the above method, the calculating the degree of difference between the baking target image and the image corresponding to the same shooting position in each of the sample image groups includes:
and calculating the image characteristic distance between the baking target image and the image corresponding to the same shooting position in each sample image group.
Further, in the method, selecting a reference image matching the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image includes:
and selecting a sample image group matched with the baking target image from the sample image library as a reference image based on the image difference degree and the baking state reliability of the sample image group.
Further, in the method, the selecting, as the reference image, the sample image group matching the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image group includes:
calculating the product between the baking state difference degree and the image difference degree of each sample image group; a baking state difference degree of each sample image group, representing a difference between a baking state determined according to a baking parameter at the time of capturing the group of sample images and a baking state determined according to the group of sample images; the baking state difference degree and the baking state credibility are in a negative correlation relationship;
and determining a sample image group matched with the baking target image from the sample image library according to the corresponding product of each sample image group, and taking the sample image group as a reference image.
Further, in the above method, the determining process of the baking state reliability of the sample image group includes:
acquiring a first baking state and a second baking state corresponding to each image in each sample image group; the first baking state is determined according to baking parameters when each image is shot, and the second baking state is determined according to each image;
calculating a baking state difference between a first baking state and a second baking state corresponding to each image;
and determining the baking state credibility of each sample image group according to the baking state difference corresponding to each image in each sample image group.
Further, in the above method, the determining the reliability of the baking state of each sample image group according to the baking state difference corresponding to each image in each sample image group includes:
determining the sum of baking state differences corresponding to all images in each sample image group and preset correction parameters as the baking state credibility of each sample image group; wherein the correction parameter is a positive number.
Further, in the above method, the adjusting the baking parameters of the baking target according to the baking parameters corresponding to the reference image includes:
Judging whether the baking parameters of the baking target are the same as the baking parameters corresponding to the reference image;
and if the baking parameters of the baking targets are different from the baking parameters corresponding to the reference images, adjusting the baking parameters of the baking targets until the baking parameters of the baking targets are the same as the baking parameters corresponding to the reference images.
Further, in the method described above, the baking target comprises tobacco.
In another aspect, the present application also provides a toasting control apparatus, comprising:
the computing module is used for computing the image difference degree between the baking target image and the sample images in the preset sample image library; wherein the sample image comprises an image of a sample baking target during baking;
the selection module is used for selecting a reference image matched with the baking target image from the sample image library based on the image difference degree and the baking state credibility of the sample image; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target time is the time of shooting the sample image;
And the adjusting module is used for adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
On the other hand, the application also provides baking equipment, which comprises a processor, a memory connected with the processor and a camera;
the camera is used for acquiring a baking target image;
the memory is used for storing a computer program and a sample image library, wherein the sample image library stores sample images and baking state credibility information of the sample images; wherein the sample image comprises an image of a sample baking target during baking; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target time is the time of shooting the sample image;
the processor is used for calculating the image difference degree between the baking target image acquired from the camera and the sample image stored in the memory by running the computer program; selecting a reference image matched with the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image; and adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
In another aspect, the present application also provides a storage medium, including: the storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the toasting control method as claimed in any one of the preceding claims.
The baking control method, the baking control device, the baking equipment and the storage medium can compare the baking target image corresponding to the current baking target with the sample images in the sample image library, and determine the reference image matched with the baking target image from the sample images based on the image difference degree between the baking target image and the sample images and the baking state credibility of the sample images. According to the application, the baking parameters of the baking target are adjusted according to the baking parameters corresponding to the reference image matched with the baking target image, so that the automatic adjustment of the baking parameters is realized, the influence of the experience and the level of baking personnel on the baking quality is avoided, and the product quality is ensured.
Further, the image difference degree can represent the difference degree between the baking target image and the sample image; the reliability of the baking state is determined by the difference between the baking state determined according to the baking parameters at the target moment and the baking state determined according to the sample image, and the reliability of the baking state in which the sample image is positioned can be characterized, namely, the smaller the baking state difference determined by the two modes is, the higher the reliability of the baking state in which the sample image is positioned is. According to the application, consideration is carried out based on two angles of the image difference degree and the baking state reliability, the reference image with small difference degree with the baking target image and high reliability of the baking state is selected from the sample image library, and when the baking parameters of the baking target are automatically adjusted according to the corresponding baking parameters of the reference image, the baking parameters can be adjusted according to more accurate adjustment directions, so that the product quality is further ensured.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a baking control method according to an embodiment of the present application;
FIG. 2 is a schematic view of a structure of a toaster provided by an embodiment of the present application;
FIG. 3 is a schematic diagram of a baking curve according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of calculating the image difference degree between the baking target image and the sample image according to the embodiment of the application;
FIG. 5 is a schematic view of another oven according to an embodiment of the present application;
FIG. 6 is a schematic flow chart of determining a reference image from a sample image library according to an embodiment of the present application;
FIG. 7 is a flowchart illustrating a process for adjusting a baking parameter of a baking target according to an embodiment of the present application;
fig. 8 is a schematic structural view of a baking control device according to an embodiment of the present application;
Fig. 9 is a schematic structural view of a baking apparatus according to an embodiment of the present application.
Detailed Description
The technical scheme of the embodiment of the application is suitable for application scenes for controlling the baking state, can realize automatic adjustment of baking parameters, reduce the influence of baking experience and level of baking personnel on baking quality, and ensure the quality of baked products.
The technical scheme of the embodiment of the application can be applied to hardware equipment such as a hardware processor or packaged into a software program to be operated, and when the hardware processor executes the processing procedure of the technical scheme of the embodiment of the application or the software program is operated, the control of the baking state can be realized. The embodiment of the application only describes the specific processing procedure of the technical scheme of the application by way of example, and does not limit the specific implementation form of the technical scheme of the application, and any technical implementation form capable of executing the processing procedure of the technical scheme of the application can be adopted by the embodiment of the application.
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The embodiment proposes a baking control method, as shown in fig. 1, which includes:
s101, calculating the image difference degree between the baking target image and a sample image in a preset sample image library.
The above-mentioned baking target refers to a baked object. The baking target can be placed in the baking oven, and the baking of the baking target is realized by controlling parameters such as temperature, humidity, wind speed, heating speed and the like in the baking oven. Illustratively, tobacco is an important baking target for producing cigarettes, which may be used as a baking target during the production of cigarettes.
The baking target image refers to an image of a baking target, which can be acquired by a camera. Specifically, in order to ensure the definition of the baking target image, a camera may be disposed on the inner wall of the baking oven, and the baking target image may be photographed from the inside of the baking oven.
Fig. 2 is a schematic structural diagram of an oven according to an embodiment of the present application. For example, as shown in fig. 2, in order to avoid damage to the camera 21 due to high temperature in the oven, a heat-insulating shield 22 may be provided outside the camera 21. Specifically, the heat-insulating shield 22 is fastened to the inner wall 20 of the oven to form a heat-insulating space, and the camera 21 is installed in the heat-insulating space. Moreover, by arranging the heat insulation protective cover 22, a certain distance is kept between the camera 21 and the baking target, the condition that the image is blurred due to too close distance between the camera 21 and the baking target is avoided, and the definition of the image is improved.
In addition, in the prior art, in order to avoid the situation that the image of the baking target is blurred when the distance between the camera 21 and the baking target is too short, a manner of not placing the baking target near the camera 21 is generally adopted, but a part of empty space exists in the baking box, air vortex is easily formed in the empty space in the baking box, and the fluidity of air is poor. However, parameters such as temperature and humidity in the baking oven are required to be continuously changed in the baking process, so as to achieve the purpose of improving the baking quality, and the baking quality of the baking target near the empty space is lower because the air fluidity is poor, the baking parameters such as temperature and humidity change slowly, and the parameters such as temperature and humidity near the empty space cannot be quickly adjusted to the values required by the current baking state of the baking target when the baking parameters such as temperature and humidity in the baking oven are adjusted.
According to the embodiment of the application, the heat insulation protective cover 22 is arranged, so that the minimum focusing distance of the camera 21 can be met, a spare space is not required to be reserved as a shooting space for ensuring the minimum focusing distance of the camera 21, the condition that the spare space forms air vortex in the baking process is avoided, and the baking quality of a baking target near the spare space is ensured.
The sample image library refers to a database which is preset and used for storing images. A sample image library stores a plurality of sample images. The sample image comprises an image of a sample baking target in the baking process, the sample image is used for comparing with a currently acquired baking target image, and a reference image matched with the baking target image is selected from a sample image library so as to adjust the baking parameters of the current baking target according to the baking parameters of the reference image.
Wherein the sample baking target refers to a target baked for the purpose of collecting a sample image before the baking control of the baking target by the baking control method of the present embodiment. In order to improve the baking quality of the baking targets, a large number of sample baking targets can be collected, and images of each group of sample baking targets in the baking process can be collected. In order to ensure the definition of the image of the sample baking target, an isolation protective cover can be arranged in the baking box to form an insulation protective space, and the camera is placed in the insulation protective space to collect the image of the sample baking target.
When the sample baking target is baked, a conventional baking manner in the prior art may be adopted for baking, and the embodiment is not limited.
In the embodiment of the application, the image difference degree between the baking target image and all sample images in a preset sample image library is calculated.
In the sample image library, the sample baking target obtains a sample image at the same fixed position in each photographing period during the baking process, and then stores the sample images obtained by the plurality of sample baking targets during the photographing periods in the sample image library. Correspondingly, when the baking target is subjected to baking treatment, an image of the baking target can be acquired at the fixed position in each photographing period. An image difference degree between the baking target image and each sample image in the sample image library is calculated.
The parameters such as temperature, humidity, wind speed, heating speed and the like of different parts in the baking oven can have certain gaps, so that the baking states of the baking targets of different parts in the baking oven are different, and the baking states of all the baking targets can not be accurately determined through a single baking target image.
Based on this, still another example, when forming the sample image library, the camera acquires a corresponding number of sample image groups at a plurality of fixed positions in each photographing period during the baking of the sample baking target, and then stores the sample images acquired by a plurality of groups of sample baking targets during a plurality of photographing periods in the sample image library. Correspondingly, when the baking target is baked, the camera can acquire a corresponding number of baking target images at the plurality of fixed positions in each photographing period. The plurality of fixing positions may be set according to actual situations, so that the shooting area of the camera may cover all or part of the outermost baking targets, which is not limited in this embodiment. And calculating the image difference degree between the baking target image and the image corresponding to the same shooting position in each sample image group.
It should be noted that, the camera is generally disposed on the inner wall of the oven, so that the camera can collect the image of the baking target disposed on the outermost layer in the oven. Therefore, in the embodiment of the present application, it is preferable that the photographing area of the camera can cover all or part of the outermost baking target.
The image difference degree refers to the degree of phase difference between the baking target image and the sample image, and the greater the image difference degree between the baking target image and the sample image is, the lower the image similarity between the baking target image and the sample image is. The image difference degree between the baking target image and the sample image may be calculated by extracting the feature vector, which is not limited in this embodiment.
S102, selecting a reference image matched with the baking target image from a sample image library based on the image difference degree and the baking state reliability of the sample image.
The baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target time is the time at which the sample image was taken.
Specifically, the baking parameters corresponding to the moment of shooting the sample image include parameters such as temperature, baking time and the like corresponding to the moment of shooting the sample image. Based on parameters such as corresponding temperature and baking time when the sample image is shot and appearance of a sample baking target, a baking state corresponding to the moment when the sample image is shot can be obtained.
Illustratively, fig. 3 shows a three-stage tobacco curing temperature profile that is currently common, with the X-axis being curing time and the Y-axis being curing temperature. The three-section tobacco baking temperature curve divides tobacco into three baking stages, wherein the first stage is yellow fixation, the second stage is color fixation and the third stage is dry rib. The above three baking stages need to achieve the target, and the corresponding baking temperatures at different times in different baking stages are shown in fig. 3. Thus, in combination with the baking temperature and the baking time of the sample baking target at the time of capturing the sample image, the baking state corresponding to the time of capturing the sample image can be determined by referring to fig. 3.
In another exemplary embodiment, the tobacco baking process may be further refined on the premise of three baking stages of yellow fixing, color fixing and dry rib as shown in fig. 3, and the whole baking process of the tobacco is divided into 7 stages including a yellow early stage, a yellow middle stage, a yellow later stage, a color fixing early stage, a color fixing later stage, a dry rib early stage and a dry rib later stage. Then the temperatures and drying times corresponding to the pre-yellowing stage, mid-yellowing stage, post-yellowing stage, pre-fixing stage, post-fixing stage, pre-drying stage and post-drying stage can be divided on the basis of fig. 3, and the subdivided temperature curves are obtained. Therefore, even if the whole baking process of the tobacco is divided into 7 stages, the baking temperature and the baking time of the sample baking target are combined with the time of photographing the sample image, and the baking state corresponding to the time of photographing the sample image can be determined by referring to the subdivided temperature curve.
Specifically, according to the baking state determined by the sample images, all the sample images may be sent to a professional technician, and the professional technician marks the baking states corresponding to the sample images one by one. If the number of the sample images is huge, the labeling of the sample images one by a professional technician may be low in efficiency, and under such circumstances, a deep learning network model can be established, and the labeling training of the baking state is performed on the deep learning network model, so that a converged deep learning network model is obtained, and the automatic labeling is performed through the deep learning network model, so that the labeling efficiency can be improved.
In the present embodiment, the baking state reliability is determined by the degree of difference between the baking state determined from the baking parameter at the target timing and the baking state determined from the sample image. The closer the baking state determined according to the baking parameter at the target timing is to the baking state determined according to the sample image, the smaller the degree of difference representing the baking state determined by the above two modes is, the higher the baking state reliability of the sample image is.
For example, if the baking states of the sample baking targets are the same at the moment of shooting the sample images in the two completely different modes, the sample baking targets are in the same state at the moment of shooting the sample images, and the baking states of the sample images are high in reliability; if the determined baking states of the sample baking targets at the moment of shooting the sample image are completely different and have larger differences in the two completely different modes, for example, the baking states of the sample baking targets at the moment of shooting the sample image are determined to be in the early yellowing stage in one mode, and the baking states of the sample baking targets at the moment of shooting the sample image are determined to be in the early drying stage in the other mode, the problem occurs in one mode of determining the baking states, and the reliability of the baking states of the sample image is lower.
In this embodiment, the baking state reliability corresponding to the sample image is predetermined based on the above manner. So that after the baking target image is obtained, a reference image matched with the baking target image can be selected from the sample image library based on the baking state reliability of the sample image and the image difference degree determined by the steps.
The embodiment considers based on two angles of the image difference degree and the baking state reliability, and aims to select a reference image with small image difference degree and high baking state reliability from a sample image library.
S103, adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
If the image difference between the sample image and the baking target image is small, the similarity between the sample image and the baking target image is high; if the baking state reliability of the sample image is high, the baking state determined by the baking parameters according to the target moment is less than the baking state determined by the sample image, and the baking parameters of the sample baking target at the moment of shooting the sample image are relatively accurate baking parameters.
A sample image having a small degree of image difference from a baking target image is selected from a sample image library, in order to select a sample image close to a baking state of a baking target at the time of capturing the baking target image as a reference image. A sample image with high reliability of the baking state is selected from a sample image library, and the purpose is to select a sample image with a baking parameter of a sample baking target at a target moment being a relatively accurate baking parameter as a reference image. When the baking parameters of the baking targets are automatically adjusted according to the baking parameters corresponding to the reference images, the baking targets can be adjusted according to more accurate adjustment directions, and the product quality is further ensured.
In this embodiment, a baking target image corresponding to a current baking target can be compared with sample images in a sample image library, and a reference image matched with the baking target image is determined from the sample images based on the image difference degree between the baking target image and the sample images and the baking state reliability of the sample images. According to the application, the baking parameters of the baking target are adjusted according to the baking parameters corresponding to the reference image matched with the baking target image, so that the automatic adjustment of the baking parameters is realized, the influence of the experience and the level of baking personnel on the baking quality is avoided, and the product quality is ensured.
Further, the image difference degree can represent the difference degree between the baking target image and the sample image; the reliability of the baking state is determined by the difference between the baking state determined according to the baking parameters at the target moment and the baking state determined according to the sample image, and the reliability of the baking state in which the sample image is positioned can be characterized, namely, the smaller the baking state difference determined by the two modes is, the higher the reliability of the baking state in which the sample image is positioned is. According to the application, consideration is carried out based on two angles of the image difference degree and the baking state reliability, the reference image with small difference degree with the baking target image and high reliability of the baking state is selected from the sample image library, and when the baking parameters of the baking target are automatically adjusted according to the corresponding baking parameters of the reference image, the baking parameters can be adjusted according to more accurate adjustment directions, so that the product quality is further ensured.
As an alternative implementation manner, as shown in fig. 4, it is disclosed in another embodiment of the present application that the baking target image of the above embodiment includes an image group obtained by photographing the baking target from each photographing position; the sample image library includes a plurality of sample image groups each including an image obtained by photographing a sample baking target from a respective photographing position.
The step of the above embodiment calculates the image difference between the baking target image and the sample image in the preset sample image library, and specifically may include the steps of:
s401, calculating the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group.
Because the baking conditions of the baking targets at different positions in the baking oven are different due to certain differences among parameters such as temperature, humidity, wind speed, heating speed and the like of different positions in the baking oven, the baking conditions of all the baking targets cannot be accurately determined through a single baking target image. Correspondingly, when a sample image library is formed, in the baking process of the sample baking target, the camera acquires sample images at the shooting positions in each shooting period, the sample images acquired in each shooting period form a group of sample image groups, and the acquired groups of sample image groups are stored in the sample image library.
Based on this, the baking target images acquired in the present embodiment are the same as the number of images in any one of the sample image groups in the sample image library, and the shooting positions of the images are in one-to-one correspondence.
The actual shooting position can be determined according to the volume of the baking oven, the type of the baking target, the placement density of the baking target in the baking oven, and the like in the actual baking process, and the embodiment is not limited to the specific position of the shooting position, as long as the obtained baking target image or sample image group can cover all or part of the baking target on the outermost layer when the camera shoots at all the shooting positions.
For example, as shown in fig. 2, a guide rail 23 and a moving means 24 may be provided on an inner wall of the toaster case, the guide rail 23 passing through the photographing position. The camera 21 is arranged on the guide rail 23 and connected with the moving device 24, and the camera 21 can perform moving shooting every preset time to acquire a baking target image or a sample image group. The specific mobile shooting steps are as follows: the camera 21 is stopped to take a picture at the shooting position when passing through the shooting position in the moving process by being driven by the moving device 24 along the guide rail 23, and the moving device 24 drives the camera to continue moving after the shooting is completed until the camera 21 finishes shooting at all shooting positions. The preset time may be determined according to practical situations, for example, 10 minutes, which is not limited in this embodiment.
The moving device 24 and the guide rail 23 can be arranged in the heat insulation protection space formed by buckling the heat insulation protection cover 22 on the inner wall 20 of the baking oven, so that the influence of high temperature in the baking oven on the moving device 24 and the guide rail 23 is avoided.
For example, the moving device 24 may include a motor, a transmission device and a roller, where the camera 21 is mounted on the guide rail 23 through the roller, the roller is connected with the motor through the transmission device, and when the motor rotates, the roller can be driven by the transmission device to move on the guide rail 23, so that the camera 21 can move on the guide rail 23.
The rail 23 includes a first rail perpendicular to the ground and a second rail in the shape of a loop. Specifically, if the width of the inner wall of the baking box is smaller than or equal to the preset width, a first guide rail perpendicular to the ground is arranged on the inner wall of the baking box. The value of the preset width is related to the width of the scene that the camera 21 can irradiate at the shooting position, and for example, the value of the preset width may be set as the value of the width of the scene that the camera 21 can irradiate at the current position. The height of the first guide rail should be matched with the placement height of the baking targets in the baking oven, so that when the camera 21 moves on the first guide rail to shoot, all or most of baking targets opposite to the camera 21 can be shot. As shown in fig. 2, the width of the inner wall on which the camera 21 is mounted is less than or equal to a preset width, and a first guide rail perpendicular to the ground is provided on the inner wall so that the camera 21 can move up and down along the guide rail in a direction perpendicular to the ground, capturing an image of the corresponding baking target.
If the width of the inner wall of the baking box is larger than the preset width, an annular second guide rail is arranged on the inner wall of the baking box. The height of the second guide rail should also be matched with the placement height of the baking target in the baking oven, and the length of the second guide rail should be matched with the placement length of the baking target in the baking oven, so that when the camera 21 moves on the second guide rail to shoot, all or most of baking targets opposite to the camera 21 can be shot. Fig. 5 is a schematic structural diagram of another baking oven according to an embodiment of the present application, as shown in fig. 5, if the width of the inner wall 20 with the camera 21 is greater than a preset width, the guide rail 23 provided on the inner wall is a second annular guide rail, so that the camera 21 can move along the second annular guide rail under the driving of the moving device 24, and an image of the corresponding baking target is captured.
Still another exemplary embodiment, if the baking target is tobacco, the baking oven is a tobacco flue-curing house, and the inner wall formed by the tobacco inlet door and the inner wall opposite to the tobacco inlet door of the general tobacco flue-curing house have smaller width and longer distance, and the inner wall of the tobacco inlet door and the inner wall opposite to the tobacco inlet door can be provided with first guide rails perpendicular to the ground; the width of the inner walls at the two remaining sides of the tobacco flue-curing house is longer, the distance is short, and an annular second guide rail can be arranged at one side of the tobacco flue-curing house. In addition, three layers of tobacco can be hung up and down in a common tobacco flue-curing house, so that the first guide rail can be provided with three shooting positions corresponding to the three layers of tobacco, and at each shooting position, the camera can acquire images corresponding to the tobacco of the layer. And the second guide rail can be respectively provided with three shooting positions at the part vertical to the ground, and can be respectively provided with five shooting positions at the part parallel to the ground, so that the camera can shoot all or most of the images of the baking targets.
In the present embodiment, the degree of difference between the baking target image and the image corresponding to the same shooting position in each sample image group is calculated. So as to determine the image difference degree between the baking target image and each sample image group according to the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group.
S402, determining the image difference degree between the baking target image and each sample image group based on the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group.
If the differences between the baking target image and the images corresponding to the same shooting position in the sample image group are smaller, the differences between the baking target image and the images of the sample image group are smaller; if the differences between the baking target image and the images corresponding to the same shooting position in the sample image group are large, the differences between the images of the baking target image and the sample image group are large.
For example, the degree of image difference of the baking target image from each sample image group may be determined by the following formula:
in the above-mentioned formula(s),representing the image difference degree of a sample image group of the X kang T round in a baking target image and a sample image library; if all shooting positions are ordered from 1 to n,/for each shooting position >Representing the degree of difference between the baking target image and the image corresponding to the shooting position with the sequence number L in the sample image group; n represents the number of baking target images.
In this embodiment, considering the influence of parameters such as temperature, humidity, wind speed and heating speed of different parts in the oven, the baking states of the baking targets of different parts in the oven may be different, and a plurality of shooting positions are set in the oven so as to shoot a plurality of images at different shooting positions, so that a richer data basis is provided for calculating the image difference degree between the baking target image and each sample image group, and a sample image close to the baking state of the baking target when shooting the baking target image is selected as a reference image.
As an alternative implementation manner, the step of calculating the degree of difference between the baking target image and the image corresponding to the same shooting position in each sample image group in the above embodiment may specifically include the following steps:
and calculating the image characteristic distance between the baking target image and the image corresponding to the same shooting position in each sample image group.
Specifically, the present embodiment calculates the image feature distance between the baking target image and the image corresponding to the same shooting position in each sample image group, and determines the image feature distance between the baking target image and the image corresponding to the same shooting position in each sample image group as the degree of difference between the baking target image and the image corresponding to the same shooting position in each sample image group.
The image feature distance refers to the difference value between the feature values corresponding to the two images, if the images contain various features, various feature values corresponding to the two images are extracted, the difference value of each feature value of the two images is calculated, and the sum of the difference values of all the feature values is determined to be the image feature distance of the two images.
The step of extracting the characteristic value from the baking target image and the sample image is as follows:
the image is preprocessed, including filtering, denoising, extracting the region of interest, and the like. After the preprocessing is completed, feature value extraction can be performed on the preprocessed image through a feature extraction algorithm. Feature extraction algorithms include means by deep learning, for example, using convolutional neural networks, etc.; conventional feature extraction algorithms such as a histogram method and a statistical feature method may also be included, and the embodiment is not limited thereto.
For example, if the baking target is tobacco, the step of extracting the feature value from the baking target image and the sample image is specifically as follows:
the tobacco includes mesophyll regions and vein regions, which vary in color during the baking process, and thus require pretreatment of the image to separate the mesophyll regions from the vein regions. Firstly, filtering and denoising the image; then, the region of interest is segmented, and a large amount of background information possibly exists in the image, so that the region of interest can be segmented by adopting the traditional algorithm segmentation modes, such as HSV threshold segmentation, feature value cluster analysis and the like, because the feature extraction is influenced; after the region of interest is obtained, the mesophyll region and the mesophyll region of the tobacco can be segmented, and in certain stages, the change of the mesophyll region is obvious, but the mesophyll change is not obvious, which is an important characteristic basis for judging the baking stage, so that the mesophyll region and the mesophyll region of the tobacco are segmented in the embodiment, and in addition, the mesophyll region is smaller and the characteristics are not obvious, and a deep learning semantic segmentation method is adopted in the embodiment.
After preprocessing is completed, the image characteristic value is extracted by adopting a mode of combining a traditional algorithm with deep learning. Specifically, for the vein region and the mesophyll region, two modes are adopted to perform feature extraction, for example, a convolutional neural network and a histogram method are adopted to extract feature values of the vein region, including color feature values, texture feature values and the like of the vein region; and extracting characteristic values of the mesophyll region by adopting a convolutional neural network and a histogram method, wherein the characteristic values comprise color characteristic values, texture characteristic values and the like of the mesophyll region. Collecting characteristic values of the leaf vein areas extracted by adopting a convolutional neural network and a histogram method to obtain the characteristic values of the leaf vein areas; and collecting the characteristic values of the mesophyll region extracted by adopting a convolutional neural network and a histogram method to obtain the characteristic values of the mesophyll region.
When calculating the image characteristic distance between the baking target image and the image corresponding to the same shooting position in each sample image group, calculating the characteristic value difference value of the mesophyll region of the image at the same shooting position, and determining the difference value and the image characteristic distance between the images at the same shooting position. The calculation formula is as follows:
In the above-mentioned formula(s),representing the degree of difference between the baking target image and the image corresponding to the shooting position with the sequence L in the sample image group,/for>Mesophyll characteristic values of images corresponding to shooting positions with the sequence number L in the baking target images;mesophyll characteristic values corresponding to shooting positions with the sequence number L in the sample image group; />The leaf vein characteristic value of the image corresponding to the shooting position with the sequence number L in the baking target image; />The characteristic value of the veins of the image corresponding to the shooting position with the sequence number L in the sample image group.
In the embodiment of the application, the image characteristic distance between the baking target image and the image corresponding to the same shooting position in each sample image group is calculated, so that the difference degree between the baking target image and the image corresponding to the same shooting position in each sample image group can be effectively determined.
As an alternative implementation manner, the steps of the above embodiment select, from the sample image library, the reference image matched with the baking target image based on the image difference degree and the baking state reliability of the sample image, and specifically may include the following steps:
and selecting a sample image group matched with the baking target image from the sample image library as a reference image based on the image difference degree and the baking state reliability of the sample image group.
As described in the above embodiments, since there may be a certain difference between the parameters such as temperature, humidity, wind speed, and temperature rising speed of different parts in the oven, the baking states of the baking targets of different parts in the oven are different, so in order to provide a richer data basis for the calculation process of selecting the reference image matching with the baking target image from the sample image library, the embodiment of the application photographs the baking target from a plurality of photographing positions when acquiring the baking target image and the sample image.
And selecting a sample image group matched with the baking target image from the sample image library as a reference image according to the image difference degree between the baking target image and each sample image group in the sample image library and the baking state reliability of each sample image group.
In this embodiment, the setting provides a richer data basis for the calculation process of selecting the reference image matched with the baking target image from the sample image library, so as to conveniently select the sample image, which is close to the baking state of the baking target when the baking target image is shot and has relatively accurate baking parameters of the sample baking target at the target moment, as the reference image.
As an alternative implementation manner, as shown in fig. 6, the steps of the above embodiment select, as a reference image, a sample image group matched with a baking target image from a sample image library based on the image difference degree and the baking state reliability of the sample image group, and specifically may include the following steps:
s601, calculating the product of the image difference degree and the baking state difference degree of each sample image group.
The baking state difference degree of each sample image group represents the difference between the baking state determined according to the baking parameters when the group of sample images are shot and the baking state determined according to the group of sample images, and the baking state difference degree and the baking state reliability are in a negative correlation.
The closer the baking state determined from the baking parameters at the time of capturing the set of sample images is to the baking state determined from the set of sample images, the smaller the degree of difference representing the baking state determined by the above two modes is, the higher the baking state reliability of the sample images is. In contrast, the larger the difference between the baking state determined according to the baking parameters at the time of capturing the set of sample images and the baking state determined according to the set of sample images, the larger the degree of difference representing the baking state determined by the above two methods, the lower the baking state reliability of the sample image.
In the embodiment of the application, the purpose is to select the reference image with small difference degree with the baking target image and high reliability of the baking state from the sample image library, namely, select the reference image with small difference degree with the baking target image and small baking state from the sample image library. Based on this, the reference image may be determined from the sample image library by comparing the image difference between the baking target image and each sample image group in the preset sample image library and the size of the product of the baking state difference of the sample image group in a manner of calculating the product of the image difference and the baking state difference of each sample image group.
S602, determining a sample image group matched with the baking target image from a sample image library according to the corresponding product of each sample image group, and taking the sample image group as a reference image.
In this embodiment, the purpose is to select a reference image with small difference degree from the sample image library and small difference degree from the baking target image, and then, after obtaining the product corresponding to each sample image group, select the sample image group corresponding to the smallest product value from the obtained products as the reference image. The specific calculation formula is as follows:
In the above-mentioned formula(s),representing the image difference degree of a sample image group of the X kang T round in a baking target image and a sample image library; />And the baking state difference degree of the sample image group of the T-th round of the Xth kang in the sample image library is represented. />
In the implementation, a sample image group with small difference degree with a baking target image and small baking state difference degree is selected from a sample image library to serve as a reference image, and when baking parameters of the baking target are automatically adjusted according to corresponding baking parameters of the reference image, the baking parameters can be adjusted according to a more accurate adjusting direction, so that the product quality is further ensured.
As an alternative implementation manner, the process for determining the baking state reliability of the sample image group in the above embodiment includes the following steps:
acquiring a first baking state and a second baking state corresponding to each image in each sample image group; calculating a baking state difference between a first baking state and a second baking state corresponding to each image; and determining the baking state credibility of each sample image group according to the baking state difference corresponding to each image in each sample image group.
Specifically, the first baking state is determined according to the baking parameters when each image is photographed, and the second baking state is determined according to each image. The process of specifically acquiring the first baking state and the second baking state corresponding to each image in each sample image group is described in detail in the above embodiments, which is not described herein, and those skilled in the art only need to refer to the description of the above embodiments.
Further, the present embodiment calculates a baking state difference between the first baking state and the second baking state corresponding to each image. The baking states corresponding to the baking targets can be ordered according to the baking process of the baking targets. And calculating the difference value between the serial number of the first baking state and the serial number of the second baking state corresponding to each image to be used as the baking state difference between the first baking state and the second baking state corresponding to the image.
For example, if the baked sample is tobacco, according to the baking process of the tobacco, the 7 baking states of the tobacco, namely, the yellow early stage, the yellow middle stage, the yellow late stage, the color fixing early stage, the color fixing later stage, the dry tendon early stage and the dry tendon later stage, are sequenced, wherein the yellow early stage corresponds to the serial number 1, the yellow middle stage corresponds to the serial number 2, the yellow later stage corresponds to the serial number 3, the color fixing early stage corresponds to the serial number 4, the color fixing later stage corresponds to the serial number 5, the dry tendon early stage corresponds to the serial number 6, the dry tendon later stage corresponds to the serial number 7, and the state which should not appear in the whole baking process corresponds to the serial number 0.
If a certain sample image of the sample image group is determined that the first baking state is the corresponding serial number 2 of the tobacco in the middle yellowing stage, and the determined second baking state is the corresponding serial number 5 of the tobacco in the later fixing stage, the baking state difference value between the first baking state and the second baking state corresponding to the certain sample image group is 3.
If a certain sample image of the sample image group is determined that the first baking state is the corresponding serial number 2 of the tobacco in the middle yellowing stage, and the determined second baking state is the corresponding serial number 2 of the tobacco in the middle yellowing stage, the baking state difference value between the first baking state and the second baking state corresponding to the certain sample image group is 0.
Further, after the baking state difference corresponding to each image in each sample image group is determined, the baking state reliability of the sample image group can be determined according to the baking state difference corresponding to each image in each sample image group.
Specifically, the smaller the baking state difference corresponding to the images in each sample image group, the higher the baking state reliability of the sample image group. The larger the baking state difference corresponding to the images in each sample image group is, the lower the baking state reliability of the sample image group is.
In the embodiment of the application, the baking state reliability of each sample image group can be effectively determined by calculating the baking state difference between the first baking state and the second baking state corresponding to each image in the sample image group, so that the sample image with relatively accurate baking parameters of the sample baking target at the target moment can be selected as the reference image, and when the baking parameters of the baking target are automatically adjusted according to the baking parameters corresponding to the reference image, the baking parameters of the baking target can be adjusted according to a more accurate adjusting direction, thereby further ensuring the product quality.
As an optional implementation manner, the step of determining the baking state reliability of each sample image group according to the baking state difference corresponding to each image in each sample image group in the above embodiment specifically may include the following steps:
determining the sum of baking state differences corresponding to all images in each sample image group and preset correction parameters as the baking state credibility of each sample image group; wherein the correction parameter is a positive number.
Specifically, the baking state reliability corresponding to each sample image group can be calculated according to the following formula:
in the above-mentioned formula(s),and the baking state difference degree of the sample image group of the T-th round of the Xth kang in the sample image library is represented. If all are toShooting positions are ordered from 1 to n, +.>A first baking state representing an image corresponding to a shooting position of a serial number L in the sample image group, and (2)>A second baking state indicating an image corresponding to a shooting position of the serial number L in the sample image group,/for the sample image group>Representing the correction parameters.
Wherein the purpose of setting the correction parameters is to ensureIs not zero. This is because once->And->The values of (2) are identical, so that +.>When the value of the obtained product value is 0 regardless of the value of the image difference degree when the product of the image difference degree and the baking state difference degree of each sample image group is calculated, namely, the parameter of the image difference degree plays no role, and the purpose of selecting a sample image with small image difference degree from a sample image library, namely, selecting a sample image close to the baking state of a baking target when the baking target image is shot as a reference image cannot be achieved. Therefore, the correction parameter a is set in the present embodiment to avoid the above-described situation.
The correction parameter a is a positive number, and the value of a may be 1, for example.
Exemplary, if a is 1, the tobacco is used as the baking sample, and the tobacco has a yellow early-stage corresponding number 1, a yellow middle-stage corresponding number 2, a yellow later-stage corresponding number 3, and a fixed color early-stage corresponding sequenceNumber 4, number 5 corresponding to the post-fixing period, number 6 corresponding to the pre-drying period, number 7 corresponding to the post-drying period, number 0 corresponding to the state which should not appear in the whole baking process, and the shooting positions are 22, thenAnd the maximum value of 155 and the minimum value of 1.
In this embodiment, the baking state reliability of each sample image group is determined by calculating the baking state differences corresponding to all the images in each sample image group and the preset correction parameters, so that the calculation is simple, and the processing speed of the images can be effectively improved.
As an alternative implementation manner, as shown in fig. 7, the steps of the above embodiment adjust the baking parameters of the baking target according to the baking parameters corresponding to the reference image, and may specifically include the following steps:
s701, judging whether the baking parameters of the baking target are the same as those of the reference image; if the baking parameters of the baking target are different from the baking parameters corresponding to the reference image, executing step S702; and if the baking parameters of the baking target are the same as those of the reference image, ending execution.
In the embodiment of the application, after the sample image is acquired, the baking parameters in the baking oven for shooting the sample image are correspondingly stored. Wherein, the baking parameters at least comprise temperature, humidity, wind speed and heating speed. When the baking target image is detected, whether the baking parameters of the baking target are the same as those of the reference image or not is detected, if the baking parameters of the baking target are different from those of the reference image, step S702 is needed to be executed, and if the baking parameters of the baking target are the same as those of the reference image, the baking parameters of the baking target are not needed to be adjusted, and the execution is ended.
It should be noted that, judging whether the baking parameters of the baking target are the same as those of the reference image or not refers to judging whether the temperature of the baking target is the same as that of the reference image or not, judging whether the humidity of the baking target is the same as that of the reference image or not, judging whether the wind speed of the baking target is the same as that of the reference image or not, and judging whether the heating speed of the baking target is the same as that of the reference image or not, and determining that the baking parameters of the baking target are the same as those of the reference image under the condition that the temperature, the humidity, the wind speed and the heating speed are the same; and when at least one of the temperature, the humidity, the wind speed and the heating speed is different, determining that the baking parameters of the baking target are different from those of the reference image.
The same parameter values are not limited to the same values, and the corresponding parameter values are within a predetermined range, which indicates that the parameters are the same. For example, if the temperature value of the difference between the temperature of the baking target and the temperature corresponding to the reference image is within the preset temperature range, the temperature of the baking target is the same as the temperature corresponding to the reference image; if the humidity value of the difference between the humidity of the baking target and the humidity corresponding to the reference image is in the preset humidity range, the humidity of the baking target is the same as the humidity corresponding to the reference image; if the wind speed difference value between the wind speed of the baking target and the wind speed corresponding to the reference image is within the preset wind speed range, the wind speed of the baking target is the same as the wind speed corresponding to the reference image; if the temperature rising speed of the baking target is within the preset temperature rising speed range with the temperature rising speed difference corresponding to the reference image, the temperature rising speed of the baking target is the same as the temperature rising speed corresponding to the reference image.
The temperature range, the humidity range, the wind speed range and the temperature rising speed range can be set according to practical situations, and the embodiment is not limited.
S702, adjusting the baking parameters of the baking targets until the baking parameters of the baking targets are the same as the baking parameters corresponding to the reference images.
If the baking parameters of the baking target are different from those of the reference image, the baking parameters of the baking target are required to be adjusted according to the baking parameters of the reference image until the baking parameters of the baking target are the same as those of the reference image.
According to the embodiment of the application, when the baking parameters of the baking target are automatically adjusted according to the corresponding baking parameters of the reference image, the baking parameters can be adjusted according to a more accurate adjusting direction, so that the product quality is further ensured.
As an alternative implementation, the baking target comprises tobacco. The baking control method is applied to the baking treatment of the tobacco, can automatically adjust the baking parameters of the tobacco, and avoids the influence of the experience and the level of baking staff on the baking quality of the tobacco. In addition, according to the embodiment, consideration is carried out based on two angles of the image difference degree and the baking state reliability, a reference image with small difference degree with the tobacco image and high reliability of the baking state is selected from a sample image library, and when the baking parameters of the tobacco are automatically adjusted according to the corresponding baking parameters of the reference image, the adjustment can be carried out according to a more accurate adjustment direction, so that the baking quality of the tobacco is further ensured.
Corresponding to the above baking control method, the embodiment of the application also discloses a baking control device, as shown in fig. 8, which comprises:
the calculating module 100 is used for calculating the image difference degree between the baking target image and the sample images in the preset sample image library; wherein the sample image comprises an image of a sample baking target during baking;
a selection module 110, configured to select a reference image matching the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target moment is the moment of shooting the sample image;
the adjusting module 120 is configured to adjust a baking parameter of the baking target according to the baking parameter corresponding to the reference image.
According to the baking control device, the baking parameters of the baking targets are adjusted according to the baking parameters corresponding to the reference images matched with the baking target images, so that automatic adjustment of the baking parameters is realized, the influence of experience and level of baking personnel on baking quality is avoided, and the product quality is ensured. Further, in this embodiment, consideration is performed based on two angles of the image difference degree and the baking state reliability, a reference image with small difference degree with the baking target image and high reliability of the baking state is selected from the sample image library, and when the baking parameters of the baking target are automatically adjusted according to the corresponding baking parameters of the reference image, the baking parameters can be adjusted according to a more accurate adjustment direction, so that the product quality is further ensured.
Optionally, in another embodiment of the present application, the baking target image includes an image group obtained by photographing the baking target from each photographing position; the sample image library comprises a plurality of sample image groups, and each sample image group comprises images obtained by shooting a sample baking target from each shooting position;
the calculation module 100 of the above embodiment includes:
a calculation unit for calculating a degree of difference between the baking target image and the image corresponding to the same shooting position in each sample image group;
and a determining unit configured to determine an image difference degree between the baking target image and each of the sample image groups based on the difference degree between the baking target image and the images corresponding to the same shooting position in each of the sample image groups.
Optionally, in another embodiment of the present application, when the calculating unit of the above embodiment calculates the degree of difference between the baking target image and the image corresponding to the same shooting position in each sample image group, the calculating unit is specifically configured to:
and calculating the image characteristic distance between the baking target image and the image corresponding to the same shooting position in each sample image group.
Optionally, in another embodiment of the present application, the determining unit is specifically configured to, when selecting, from the sample image library, a reference image matching the baking target image based on the image difference degree and the baking state reliability of the sample image:
And selecting a sample image group matched with the baking target image from the sample image library as a reference image based on the image difference degree and the baking state reliability of the sample image group.
Optionally, in another embodiment of the present application, the determining unit of the above embodiment includes:
a calculating subunit for calculating a product of the image difference and the baking state difference of each sample image group; a baking state difference degree of each sample image group, representing a difference between a baking state determined according to a baking parameter at the time of capturing the group of sample images and a baking state determined according to the group of sample images; the baking state difference degree and the baking state reliability are in a negative correlation relationship;
and the determining subunit is used for determining a sample image group matched with the baking target image from the sample image library according to the corresponding product of each sample image group as a reference image.
Optionally, in another embodiment of the present application, the baking control device further includes:
the acquisition module is used for acquiring a first baking state and a second baking state corresponding to each image in each sample image group; the first baking state is determined according to baking parameters when each image is shot, and the second baking state is determined according to each image;
A state difference calculating module for calculating a baking state difference between a first baking state and a second baking state corresponding to each image;
and the determining module is used for determining the baking state credibility of each sample image group according to the baking state difference corresponding to each image in each sample image group.
Optionally, in another embodiment of the present application, the determining module of the above embodiment is specifically configured to, when determining the baking state reliability of each sample image group according to the baking state difference corresponding to each image in each sample image group:
determining the sum of baking state differences corresponding to all images in each sample image group and preset correction parameters as the baking state credibility of each sample image group; wherein the correction parameter is a positive number.
Optionally, in another embodiment of the present application, the adjusting module 120 of the above embodiment includes:
the judging unit is used for judging whether the baking parameters of the baking target are the same as the baking parameters corresponding to the reference image;
and the adjusting unit is used for adjusting the baking parameters of the baking targets if the baking parameters of the baking targets are different from the baking parameters corresponding to the reference images until the baking parameters of the baking targets are the same as the baking parameters corresponding to the reference images.
Alternatively, in another embodiment of the present application, the baking target comprises tobacco.
Specifically, for the specific working content of each unit of the baking control device, please refer to the content of the method embodiment, and the description is omitted herein.
Another embodiment of the present application also proposes a toasting apparatus, as shown in fig. 9, comprising:
memory 200, processor 210, and camera 220; the memory 200 and the camera 220 are respectively connected to the processor 210.
The camera 220 is used as an input device for acquiring a baking target image;
the memory 200 is used for storing a computer program and a sample image library, wherein the sample image library stores sample images and baking state reliability information of the sample images; wherein the sample image comprises an image of a sample baking target during baking; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target moment is the moment of shooting the sample image;
a processor 210 for calculating an image difference degree between a baking target image acquired from the camera and a sample image stored in the memory by running a computer program stored in the memory 200; selecting a reference image matched with the baking target image from a sample image library based on the image difference degree and the baking state reliability of the sample image; and adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
Specifically, the above baking apparatus may further include: a bus, a communication interface 230, and an output device 240.
The processor 210, the memory 200, the communication interface 230, and the output device 240 are interconnected by a bus. Wherein:
a bus may comprise a path that communicates information between components of a computer system.
Processor 210 may be a general-purpose processor such as a general-purpose Central Processing Unit (CPU), microprocessor, etc., or may be an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs in accordance with aspects of the present application. But may also be a Digital Signal Processor (DSP), application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.
Processor 210 may include a main processor, and may also include a baseband chip, modem, and the like.
The memory 200 stores a computer program for executing the technical scheme of the present application, and may also store an operating system and other key services. In particular, the program may include program code including computer-operating instructions. More specifically, the memory 200 may include read-only memory (ROM), other types of static storage devices that may store static information and instructions, random access memory (random access memory, RAM), other types of dynamic storage devices that may store information and instructions, disk storage, flash, and the like.
The input device may include means for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input means, a touch screen, a pedometer, or a gravity sensor, etc., in addition to the camera 220 described above, and the input device, the processor 210, the memory 200, the communication interface 230, and the output device 240 are connected to each other by a bus.
Output device 240 may include means, such as a display screen, printer, speakers, etc., that allow information to be output to a user.
The communication interface 230 may include devices that use any transceiver or the like to communicate with other devices or communication networks, such as an ethernet, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), etc.
The processor 210 executes programs stored in the memory 200 and invokes other devices that can be used to implement the various steps of the toasting control method provided by the above-described embodiments of the present application.
Alternatively, in another embodiment of the present application, the baking target image of the above embodiment includes an image group obtained by photographing the baking target from each photographing position; the sample image library comprises a plurality of sample image groups, and each sample image group comprises images obtained by shooting a sample baking target from each shooting position;
The processor 210 of the above embodiment calculates the degree of image difference between the baking target image and the sample image in the preset sample image library, including:
calculating the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group;
and determining the image difference degree between the baking target image and each sample image group based on the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group.
Optionally, in another embodiment of the present application, the processor 210 of the above embodiment calculates a degree of difference between the baking target image and the image corresponding to the same shooting position in each sample image group, including:
and calculating the image characteristic distance between the baking target image and the image corresponding to the same shooting position in each sample image group.
Optionally, in another embodiment of the present application, the processor 210 of the above embodiment selects the reference image matching the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image, including:
and selecting a sample image group matched with the baking target image from the sample image library as a reference image based on the image difference degree and the baking state reliability of the sample image group.
Optionally, in another embodiment of the present application, the processor 210 of the above embodiment selects, as the reference image, a sample image group matching the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image group, including:
calculating the product of the image difference degree and the baking state difference degree of each sample image group; a baking state difference degree of each sample image group, representing a difference between a baking state determined according to a baking parameter at the time of capturing the group of sample images and a baking state determined according to the group of sample images; the baking state difference degree and the baking state reliability are in a negative correlation relationship;
and determining a sample image group matched with the baking target image from the sample image library as a reference image according to the corresponding product of each sample image group.
Optionally, in another embodiment of the present application, the processor 210 of the above embodiment is further configured to:
acquiring a first baking state and a second baking state corresponding to each image in each sample image group; the first baking state is determined according to baking parameters when each image is shot, and the second baking state is determined according to each image;
Calculating a baking state difference between a first baking state and a second baking state corresponding to each image;
and determining the baking state credibility of each sample image group according to the baking state difference corresponding to each image in each sample image group.
Optionally, in another embodiment of the present application, the determining, by the processor 210 of the above embodiment, the baking state reliability of each sample image group according to the baking state difference corresponding to each image in each sample image group includes:
determining the sum of baking state differences corresponding to all images in each sample image group and preset correction parameters as the baking state credibility of each sample image group; wherein the correction parameter is a positive number.
Optionally, in another embodiment of the present application, the adjusting, by the processor 210 of the above embodiment, the baking parameters of the baking target according to the baking parameters corresponding to the reference image includes:
judging whether the baking parameters of the baking target are the same as those of the reference image;
if the baking parameters of the baking targets are different from the baking parameters corresponding to the reference images, adjusting the baking parameters of the baking targets until the baking parameters of the baking targets are the same as the baking parameters corresponding to the reference images.
Alternatively, in another embodiment of the present application, the baking target of the above embodiment comprises tobacco.
The baking apparatus provided in this embodiment belongs to the same application conception as the baking control method provided in the foregoing embodiment of the present application, and may perform the baking control method provided in any of the foregoing embodiments of the present application, and has functional modules corresponding to the execution of the foregoing baking control method and technical details of which beneficial effects are not described in detail in this embodiment, and reference may be made to specific processing contents of the baking control method provided in the foregoing embodiment of the present application, which are not described herein again.
In addition to the methods and apparatus described above, embodiments of the application may also be a computer program product comprising computer program instructions which, when executed by the processor 210, cause the processor 210 to perform the steps of the toasting control method provided by the embodiments described above.
The computer program product may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present application may also be a computer-readable storage medium having stored thereon computer program instructions which, when executed by a processor, cause the processor 210 to perform the steps of the toasting control method provided by the above embodiments.
The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
For the foregoing method embodiments, for simplicity of explanation, the methodologies are shown as a series of acts, but one of ordinary skill in the art will appreciate that the present application is not limited by the order of acts, as some steps may, in accordance with the present application, occur in other orders or concurrently. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required for the present application.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other. For the apparatus class embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference is made to the description of the method embodiments for relevant points.
The steps in the method of each embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs, and the technical features described in each embodiment can be replaced or combined.
The modules and the submodules in the device and the terminal of the embodiments of the application can be combined, divided and deleted according to actual needs.
In the embodiments provided in the present application, it should be understood that the disclosed terminal, apparatus and method may be implemented in other manners. For example, the above-described terminal embodiments are merely illustrative, and for example, the division of modules or sub-modules is merely a logical function division, and there may be other manners of division in actual implementation, for example, multiple sub-modules or modules may be combined or integrated into another module, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or modules, which may be in electrical, mechanical, or other forms.
The modules or sub-modules illustrated as separate components may or may not be physically separate, and components that are modules or sub-modules may or may not be physical modules or sub-modules, i.e., may be located in one place, or may be distributed over multiple network modules or sub-modules. Some or all of the modules or sub-modules may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional module or sub-module in the embodiments of the present application may be integrated in one processing module, or each module or sub-module may exist alone physically, or two or more modules or sub-modules may be integrated in one module. The integrated modules or sub-modules may be implemented in hardware or in software functional modules or sub-modules.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software unit executed by a processor, or in a combination of the two. The software elements may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (12)

1. A baking control method, characterized by comprising:
calculating the image difference degree between the baking target image and a sample image in a preset sample image library; wherein the sample image comprises an image of a sample baking target during baking;
selecting a reference image matched with the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target time is the time of shooting the sample image;
And adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
2. The method according to claim 1, wherein the baking target image includes an image group obtained by photographing the baking target from each photographing position; the sample image library comprises a plurality of sample image groups, and each sample image group comprises an image obtained by shooting a sample baking target from each shooting position;
the calculating the image difference degree between the baking target image and the sample image in the preset sample image library comprises the following steps:
calculating the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group;
and determining the image difference degree between the baking target image and each sample image group based on the difference degree between the baking target image and the images corresponding to the same shooting position in each sample image group.
3. The method according to claim 2, wherein the calculating a degree of difference between the baking target image and the image corresponding to the same shooting position in each of the sample image groups includes:
And calculating the image characteristic distance between the baking target image and the image corresponding to the same shooting position in each sample image group.
4. The method of claim 2, wherein the selecting a reference image from the sample image library that matches the baking target image based on the image variance and baking state confidence of the sample image comprises:
and selecting a sample image group matched with the baking target image from the sample image library as a reference image based on the image difference degree and the baking state reliability of the sample image group.
5. The method of claim 4, wherein selecting a set of sample images from the library of sample images that match the baking target image as reference images based on the image variability and baking state confidence of the set of sample images, comprises:
calculating the product between the baking state difference degree and the image difference degree of each sample image group; a baking state difference degree of each sample image group, representing a difference between a baking state determined according to a baking parameter at the time of capturing the group of sample images and a baking state determined according to the group of sample images; the baking state difference degree and the baking state credibility are in a negative correlation relationship;
And determining a sample image group matched with the baking target image from the sample image library according to the corresponding product of each sample image group, and taking the sample image group as a reference image.
6. The method of claim 4, wherein the determining of the baking state reliability of the sample image set comprises:
acquiring a first baking state and a second baking state corresponding to each image in each sample image group; the first baking state is determined according to baking parameters when each image is shot, and the second baking state is determined according to each image;
calculating a baking state difference between a first baking state and a second baking state corresponding to each image;
and determining the baking state credibility of each sample image group according to the baking state difference corresponding to each image in each sample image group.
7. The method of claim 6, wherein determining the confidence in the baking status of each sample image group based on the baking status differences corresponding to each image in each sample image group comprises:
determining the sum of baking state differences corresponding to all images in each sample image group and preset correction parameters as the baking state credibility of each sample image group; wherein the correction parameter is a positive number.
8. The method of claim 1, wherein adjusting the baking parameters of the baking target according to the baking parameters corresponding to the reference image comprises:
judging whether the baking parameters of the baking target are the same as the baking parameters corresponding to the reference image;
and if the baking parameters of the baking targets are different from the baking parameters corresponding to the reference images, adjusting the baking parameters of the baking targets until the baking parameters of the baking targets are the same as the baking parameters corresponding to the reference images.
9. The method of any one of claims 1-8, wherein the baking target comprises tobacco.
10. A toasting control device, comprising:
the computing module is used for computing the image difference degree between the baking target image and the sample images in the preset sample image library; wherein the sample image comprises an image of a sample baking target during baking;
the selection module is used for selecting a reference image matched with the baking target image from the sample image library based on the image difference degree and the baking state credibility of the sample image; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target time is the time of shooting the sample image;
And the adjusting module is used for adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
11. The baking equipment is characterized by comprising a processor, a memory and a camera, wherein the memory and the camera are connected with the processor;
the camera is used for acquiring a baking target image;
the memory is used for storing a computer program and a sample image library, wherein the sample image library stores sample images and baking state credibility information of the sample images; wherein the sample image comprises an image of a sample baking target during baking; the baking state reliability of the sample image is determined by the degree of difference between the baking state determined according to the baking parameters at the target time and the baking state determined according to the sample image; the target time is the time of shooting the sample image;
the processor is used for calculating the image difference degree between the baking target image acquired from the camera and the sample image stored in the memory by running the computer program; selecting a reference image matched with the baking target image from the sample image library based on the image difference degree and the baking state reliability of the sample image; and adjusting the baking parameters of the baking targets according to the baking parameters corresponding to the reference images.
12. A storage medium, comprising: the storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the toasting control method as claimed in any one of claims 1 to 9.
CN202210838391.9A 2022-07-12 2022-07-12 Baking control method, baking control device, baking equipment and storage medium Active CN115211578B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210838391.9A CN115211578B (en) 2022-07-12 2022-07-12 Baking control method, baking control device, baking equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210838391.9A CN115211578B (en) 2022-07-12 2022-07-12 Baking control method, baking control device, baking equipment and storage medium

Publications (2)

Publication Number Publication Date
CN115211578A CN115211578A (en) 2022-10-21
CN115211578B true CN115211578B (en) 2023-09-26

Family

ID=83612391

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210838391.9A Active CN115211578B (en) 2022-07-12 2022-07-12 Baking control method, baking control device, baking equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115211578B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115969073A (en) * 2023-01-16 2023-04-18 河南讯飞人工智能科技有限公司 Baking stage determination method and device, electronic equipment, baking oven and storage medium
CN117894012B (en) * 2024-03-12 2024-05-31 西安大业食品有限公司 Machine vision-based mass cake baking stage identification method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111079784A (en) * 2019-11-11 2020-04-28 河南农业大学 Flue-cured tobacco baking stage identification method in baking process based on convolutional neural network
CN112394646A (en) * 2019-08-13 2021-02-23 苏州吉食窑智能科技有限公司 Remote monitoring method for kiln baking
CN113080500A (en) * 2021-04-01 2021-07-09 深圳九章聚源人工智能科技有限公司 Tobacco leaf baking method and system based on neural network and related components thereof
CN114331979A (en) * 2021-12-16 2022-04-12 华南农业大学 Intelligent decision method and system for tobacco leaf baking

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IT1218751B (en) * 1985-05-13 1990-04-19 Gome Snc Di Tronchetti G E C AUTOMATIC PANEL FOR DRYING TOBACCO IN BULK CURING CELLS
GB201709660D0 (en) * 2017-06-16 2017-08-02 British American Tobacco Investments Ltd Curing basket

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112394646A (en) * 2019-08-13 2021-02-23 苏州吉食窑智能科技有限公司 Remote monitoring method for kiln baking
CN111079784A (en) * 2019-11-11 2020-04-28 河南农业大学 Flue-cured tobacco baking stage identification method in baking process based on convolutional neural network
CN113080500A (en) * 2021-04-01 2021-07-09 深圳九章聚源人工智能科技有限公司 Tobacco leaf baking method and system based on neural network and related components thereof
CN114331979A (en) * 2021-12-16 2022-04-12 华南农业大学 Intelligent decision method and system for tobacco leaf baking

Also Published As

Publication number Publication date
CN115211578A (en) 2022-10-21

Similar Documents

Publication Publication Date Title
CN115211578B (en) Baking control method, baking control device, baking equipment and storage medium
US11045705B2 (en) Methods and systems for 3D ball trajectory reconstruction
US11205278B2 (en) Depth image processing method and apparatus, and electronic device
CN102891960B (en) Method and camera for determining an image adjustment parameter
US20150002696A1 (en) Photographing method and apparatus
CN108960290A (en) Image processing method, device, computer readable storage medium and electronic equipment
CN107871324A (en) One kind is based on twin-channel method for tracking target and device
CN107743590A (en) For performing the method and apparatus of exposure estimation using time-of-flight sensor
CN106973278A (en) A kind of AWB device and method with reference to face color character
KR20160136391A (en) Information processing apparatus and information processing method
CN104902182B (en) A kind of method and apparatus for realizing continuous auto-focusing
CN105841294A (en) Control method and control device
CN108027884A (en) Optimization object detects
CN113194359B (en) Method, device, equipment and medium for automatically grabbing baby wonderful video highlights
CN105872351A (en) Method and device for shooting picture in backlight scene
CN107888904A (en) For handling the method for image and supporting the electronic installation of this method
CN109164009A (en) A kind of tobacco flue-curing real time on-line monitoring record system
JP2013232060A (en) Image recognition device, control method and control program of the same, and imaging device and display device
US9547669B2 (en) Performing a visual search using a rectified image
CN107992816A (en) Photographing search method and device and electronic equipment
CN115661088A (en) Method and device for determining baking stage, baking equipment and storage medium
CN107340868A (en) A kind of data processing method, device and VR equipment
CN108551473B (en) Agricultural product communication method and device based on visual agriculture
US11790041B2 (en) Method and system for reducing false positives in object detection neural networks caused by novel objects
CN107886959A (en) A kind of method and apparatus extracted honeybee and visit flower video segment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant