JP3962525B2 - Image generation device and sorting classification determination device used for sorting agricultural products - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an apparatus used in a fruit selection field for sorting agricultural products such as mandarin oranges, apples, tomatoes, raisins, and melons, and more specifically, an agricultural product that measures the appearance of agricultural products used as one of sorting information The present invention relates to an image generation apparatus used for sorting, and a sorting classification determination apparatus using the same.
[0002]
[Prior art]
In general, agricultural products such as vegetables and fruits are sorted according to individual quality in a fruit selection field or the like, and the appropriateness of the sorting is regarded as important. This is because evaluations related to quality in consumers and trading markets are directly linked to consideration for agricultural producers.
[0003]
And, as the elements for sorting agricultural products, generally class elements (weight and size), grade elements (appearance such as surface wrinkles, color, etc., and internal quality such as sugar content, ripeness, etc. Considering the characteristic properties of various agricultural products, etc., class and grade elements are measured with cameras and other equipment, and the classification is determined using an MPU (microprocessor unit). However, some of these factors related to the appearance of agricultural products are stable in terms of objectivity, productivity, and efficiency. Instrument measurement that is superior in terms of sexuality is mainly performed.
[0004]
Such a device for appearance measurement is configured by, for example, arranging a plurality of cameras around a conveyor or the like for transporting agricultural products, or a combination of a mirror and a camera. A three-dimensional appearance is imaged from the front, diagonally behind, or the like.
[0005]
The appearance information of the agricultural products imaged as described above, for example, the information on the class elements of the size and the grade elements such as the color and the color, is used for determining the classification of the agricultural products according to a predetermined determination program or the like.
[0006]
By the way, since the above-mentioned captured image is, for example, a sphere-shaped object such as an agricultural product, it is usually inevitable that information on an uncertain part is included in the image even if the lighting or the imaging method is devised. is there. Specifically, there are halation of an outline portion, blurring, image loss due to insufficient illumination, and the like. Therefore, Japanese Patent Laid-Open No. 4-307357 proposes an image processing in which a range (peripheral portion) having a predetermined width from the contour is removed from the image information used for determination in the captured image of the agricultural product.
[0007]
By making it as said proposal, the malfunction by which agricultural products are judged and evaluated improperly by the abnormal information contained in the uncertain part of a captured image is prevented.
[0008]
[Problems to be solved by the invention]
In image processing that removes uncertain parts included in captured images as described above, it is possible to make the sorting of agricultural products as accurate as possible by making them as small as possible (increasing the range of certain parts). Desirable for evaluation classification.
[0009]
From this point of view, the image processing for removing the predetermined range width from the contour of the captured image as an uncertain part was further examined. A part that is prone to halation, blurring, image loss, etc. Assuming that the surface is a smooth curved surface, the normal line (a line perpendicular to the curved surface) set at an arbitrary point on the agricultural product surface and the line connecting the light receiving part of the imaging means from this point The present inventor has considered that the region where the point exists corresponds to the fact that the angle formed between them becomes a predetermined angle or more. In other words, the image of the region where the angle of strabismus is large seems to be greatly influenced by information other than the information derived from the original agricultural product surface.
[0010]
According to this idea, the size of the width to be removed is not constant depending on the relationship between the imaging direction and the shape of the agricultural product, such as a ball block shape.For example, the planar image and the side image when the agricultural product has a rugby ball shape are used. Then, the size of the width to be removed is not the same, and even in the same side image, the same width is not necessarily the same in the side region and the top region. Also, the relatively flat agricultural products such as Wenzhou mandarin and the rugby ball-shaped agricultural products do not have the same width to be removed.
[0011]
In addition to the above, when using a tray called a free tray that is often used for sorting agricultural products in recent times, the agricultural product usually sinks to some extent in a recess (concave) provided in the center of the tray. Since it is conveyed in the state of being packed, the portion that sinks into the tray is not taken as an image of agricultural products. Nevertheless, in this case as well, if image processing that removes a range of a certain width from the contour of the captured image is performed, there is a possibility that an area that does not correspond to an originally uncertain part may be removed. If there is a defect or the like that affects the grade determination, the result is that the determination is ignored, and there is a problem that the reliability of the determination / evaluation by instrument measurement is impaired.
[0012]
The present invention has been made for the purpose of providing an agricultural product image generation apparatus and a sorting classification determination apparatus using the same, which can solve such conventional problems and improve the reliability of determination and evaluation. It is.
[0013]
[Means for Solving the Problems]
The above object is achieved by the following inventions (1) to (8) described in the claims of the present application.
[0014]
The invention of the image generating apparatus used for the agricultural product sorting determination of (1) includes an imaging means for imaging at least a side surface of the agricultural product carried on the agricultural product mounting surface having a slight depression, and a side imaging of the obtained agricultural product Image processing means for determining a region of an appearance determination image for removing the imaged image information within a predetermined width along the contour from the image and determining the appearance of the grade element of the agricultural product, and the like. The means divides the section into a plurality along the image contour and at least eliminates the removal width of the lower surface area of the side image of the agricultural product or makes the removal width of the lower surface area smaller than the removal width of the upper surface area. It is characterized by that.
[0015]
In the above configuration, the “agricultural product placing surface having a slight depression” means a receiving portion (concave portion) for stably placing the agricultural product placed on the conveyor so as not to move, and is a bucket type fixedly provided on the conveyor. Or the thing mounting surface of what is called what is called a so-called free tray which provided the hollow (recessed part) in the saucer which is not connected mechanically with the thing of this similar type, or this is illustrated.
[0016]
The “imaging means” is composed of a CCD (charge coupled device) camera, other imaging element, or a combination of this and a mirror, and for a preferred mode in which image processing is performed for each pixel, an X, Y matrix A means for capturing an image as each pixel signal in the array is used. An illumination lamp or the like also constitutes a part of this imaging means.
[0017]
The “image processing means” is normally configured using computer technology such as MPU, and image processing is arithmetically controlled by a predetermined program.
[0018]
Note that the above configuration specifies the one for generating an image of the agricultural product side of the appearance determination image that is an appropriate region for determining the grade based on the appearance of the agricultural product. Since it is common to use a plane image together with this, means for capturing this plane image, and removing a region that may contain uncertain information of a predetermined width along the image contour from the plane captured image It does not exclude having an image processing means, and it does not exclude having a means for measuring the internal quality of agricultural products and a means for measuring other class elements separately from the appearance image generation. Needless to say. The process according to the configuration of the above invention (1) can measure grades and class elements for determining these other sorting categories, perform image processing, and perform the determination process in parallel or sequentially. It is.
[0019]
According to the present invention (1), according to the shape that varies depending on the type of agricultural product, a determination / evaluation is made by appropriately excluding an area (an uncertain part) that may contain abnormal information in the grade determination. Therefore, it is possible to improve the accuracy of the determination and realize reliable sorting of agricultural products. In particular, by imaging the plane together with the side surface, and further imaging the bottom surface as necessary, the area of the appearance determination image is distributed to more suitable captured images (side surface, plane, bottom surface). Reliability can be further increased.
[0020]
In addition, even if the width of the area that may contain abnormal information (width from the contour) is not the same due to its shape even within one agricultural product, for example, the above removal standard formed between the normal line and the light receiving line Since the removal width can be partially changed appropriately according to the angle, it is possible to realize the sorting of agricultural products with high accuracy of determination and high reliability. Note that dividing the range in which the removal width is changed along the image contour into a plurality of sections refers to, for example, dividing the range into a top surface region, a side surface region, and a bottom surface region in the side surface captured image.
[0021]
The invention of the image generating apparatus used for the agricultural product sorting determination of (2) includes an imaging means for imaging at least a side surface of the agricultural product carried on the agricultural product mounting surface having a slight depression, and a side imaging of the obtained agricultural product Image processing means for deciding a region of an appearance determination image for removing the captured image information within a predetermined width along the contour from the image and making a determination related to the appearance of the produce, the image processing means There is provided a removal width changing unit that divides a section into a plurality along a contour and changes the size of the predetermined width to be removed by dividing the section into sections of the divided side surface captured image.
[0022]
In this invention, the “removal width changing means” included in the image processing determines an appropriate width to be removed empirically or experimentally depending on the type of agricultural product to be selected. As described above, when the surface of the produce is assumed to be a smooth curved surface, the normal line (a line perpendicular to the curved surface) set at an arbitrary point on the produce surface and the light receiving unit of the imaging means from this point The removal width can be determined based on the fact that the angle formed between the connected lines (hereinafter referred to as “light receiving lines” for convenience) is equal to or greater than a predetermined angle (hereinafter referred to as “removal guide angle”). The removal standard angle is not uniform depending on the type of agricultural products, but generally it can be in the range of 40 ° to 50 °. For example, it is empirical in the range of 45 ° or more. Or by repeated testing.
[0023]
According to this invention (2), the uncertain part suitable for every agricultural product made into object can be selected appropriately by changing a removal width.
[0024]
In the invention of (3), in the invention of (2), the removal width changing means at least eliminates the removal width of the lower surface area of the side image of the agricultural product, or removes the lower surface area from the upper surface area. The width is smaller than the width.
[0025]
In the above, the removal width of the lower surface area becomes zero, for example, if the length of sinking into the recess such as the saucer is larger than the removal width of the lower surface area when the agricultural product is placed on a flat surface, it appears on the saucer This is because the portion of the lower surface area is a portion that does not need to be removed that is equal to or smaller than the above-described removal guide angle (removing it rather lowers the determination accuracy), and the side-captured image is not removed in this lower surface region. In addition, the lower surface area removal width is smaller than the upper surface area removal width because the amount of subsidence of the above-mentioned agricultural products into the recess is small, and the surface above the reference removal angle is fixed to the lower surface area in the side-captured image. This is the case. In this case, it suffices to remove the lower surface area of the side-captured image within a necessary small width range.
[0026]
According to the present invention (3), although not limited, since an area effective for grade determination based on the appearance of agricultural products placed so as to sink into the central recess of the free tray can be widely used, accuracy is improved. Achieving high and reliable sorting of agricultural products.
[0027]
In the invention of (4), in each of the above inventions, the removal width changing unit uses each side image of the agricultural product and a plurality of shift images obtained by shifting the side surface image by a predetermined number of pixels in a plurality of directions. The appearance determination image area is determined by the AND process.
[0028]
In the above description, the “shifted image shifted by a predetermined number of pixels” is used only for determining the area of the appearance determination image. For example, the shift image with respect to the side-captured image is set to the vertical address of each pixel. If it is shifted by 10 pixels in the direction, the top 10 pixels of the side-captured image are removed from the area of the appearance determination image by the AND process of each pixel. However, in the invention of the above (1) or (3), the removal width of the lower surface area of the side-captured image is zero or small, so that the removal of the lower 10 pixels in the appearance determination image is not removed or shifted. The number of pixels to be reduced is reduced.
[0029]
According to this invention (4), the process which produces | generates the external appearance determination image suitable for the grade determination of the target agricultural product from a side surface captured image can be easily performed by the shrinkage | contraction process in an image processing technique, and the correction process added to this. There is an advantage.
[0030]
In the invention of (5), in each of the above inventions, when the removal width changing means has a substantially elliptical shape in which the vertical direction is short when viewed from the side, the removal width changing means sets the removal width of the upper surface area of the side captured image. The width is set to be larger than the removal width of the side area.
[0031]
According to the present invention, when sorting agricultural products having the above shapes, for example, agricultural products such as Wenzhou mandarin oranges, tomatoes and strawberries, it is possible to appropriately remove (exclude) areas that may contain abnormal information. it can.
[0032]
The invention of the agricultural product classification determination device according to (6) includes an image generation device including the image processing means according to any one of the above (1) to (5) that determines the region of the appearance determination image, Grade judging means that uses an appearance judgment image as one of the grade judgments of agricultural products is provided.
[0033]
The “grade determination means” in the above is usually configured using computer technology including MPU. Specifically, when the spread of the low portion exceeds a certain area as compared with a predetermined threshold value in the measured image, the portion of the area is determined to be “疵”, Matches the grade element that is determined according to the type of produce, such as determining the color of agricultural products through the detection of light of a predetermined wavelength with a pass filter, or determining the color by analyzing the detected light with a color histogram A means for performing the grade evaluation can be used.
[0034]
According to this invention, the grade determination based on the captured image of the side surface of the agricultural product (usually a combined planar captured image) can be performed with respect to the appearance, and the reliability is determined by determining an appropriate range as necessary and sufficient. Can be secured high.
[0035]
The invention for the agricultural product classification determination apparatus according to (7) is characterized in that, in addition to the invention according to (6), a class determination unit that uses a captured image before image processing as one of the class determination of agricultural products is provided. .
[0036]
According to the present invention, in addition to the above invention (6), there is an advantage that the appearance captured image can be used for the determination of the size (class element) of the agricultural product.
[0037]
The invention of (8) is characterized in that the grade judging means of the invention of (6) or (7) judges the grade based on at least the color and / or the color of the agricultural product.
[0038]
According to the present invention, the grade determination based on the captured image of the side surface of the agricultural product can be performed with high reliability regarding colors and / or wrinkles that are important in appearance.
[0039]
DETAILED DESCRIPTION OF THE INVENTION
Embodiment 1
In this example shown in FIGS. 1 to 9, FIG. 1 shows an outline of the configuration of the agricultural product sorting apparatus 1, and 101 shows a transport conveyor that transports the agricultural product P for sorting. A measurement stage for measuring the appearance of the agricultural product is arranged on the upstream side of the conveyance, and a sorting stage in which branch conveyors 102, 102,. ing. In the present example, for convenience of explanation, only the device for appearance imaging is shown for measurement, but another device for measuring internal quality or the like may be provided. Moreover, as shown in FIG. 4, the conveyance conveyor 101 in this example is comprised so that the conveyance surface in which the center part was depressed along the conveyance horizontal direction may be formed.
[0040]
In the measurement stage arranged on the upstream side of the transport conveyor 1, an illumination lamp 201 and an imaging camera (for example, an RGB camera) 202 that constitute a measurement unit of the image generation apparatus 2 are provided. It is shown in FIG. Reference numeral 3 denotes an arithmetic and control unit composed of a microcomputer. In this example, an image for determining the area of each appearance determination image on the side surface and the plane from the side surface captured image of the agricultural product P captured by the imaging camera 202 and the plane captured image. A processing unit 301 and a removal width changing unit 302 that changes the removal width along the contour of the image captured by the image processing unit 301 are provided, and these are used together with the camera 202 and the like to determine the sorting category. 2 is configured. In the figure, the image processing means 301 and the removal width changing means 302 are shown as block diagrams, but are actually set as computer programs. The removal width changing unit 302 is configured as means for changing the shift amount of the shift image described later, but may be omitted in an agricultural product sorting apparatus specialized for one variety.
[0041]
Further, the arithmetic control device 3 determines and evaluates the size of the agricultural product based on the externally captured image that is not image-processed, and the agricultural product based on the external appearance determination image of the plane after the image processing and the external appearance determination image of the side surface. A determination unit 303 that determines and evaluates the grade is provided, and the classification of agricultural products is determined based on these determination results.
[0042]
The judgment / evaluation of the grade can include, for example, a case where a portion having low lightness is equal to or larger than a predetermined size, which is judged to be cocoon, or a color of agricultural products is judged by color analysis.
[0043]
The obtained sorting information of each agricultural product is sent to the control units 4, 4,... Of the discharge device linked to the branch conveyors 102, 102,. It is discharged to the branching conveyor 102 corresponding to the sorted classification.
[0044]
2 and 3 show the measuring unit of the image generating device 2, a pair of vertically inclined mirrors 203 are arranged on both sides of the conveyance path of the conveyance conveyor 101, and the light from the illumination lamp 201 is the agricultural product. The upper camera 202 captures the light reflected by the mirror 203 and reflected by the mirror 203 to form a side image. Similarly, the reflected light reflected from the upper surface of the agricultural product is imaged by an upper camera to obtain a planar image.
[0045]
In such imaging, as shown in FIG. 4, as for the side-side captured image, a portion (shaded portion) that sinks into the depression of the transfer conveyor 101 cannot be captured. In such a case, if removal (removal region B ′) is performed with a constant width along the contour of the captured image as shown in FIG. It will be contained in the removal part of the lower surface area of.
[0046]
Therefore, in this example, when determining the region A of the side appearance determination image, as shown in FIG. 5, the shifted images S1, S2, and S3 (for example, the images shifted by a predetermined number of pixels in the horizontal direction and the downward direction) 9 mm (S1, S2) laterally and a shift image shifted by 11 mm (S3) downward), and an AND signal output of the original captured image and three shift images (S1 to S3) for each pixel The region having the “S” is defined as a region A of the side appearance determination image. Therefore, since a shifted image obtained by shifting the captured image upward is not used, removal of a certain width along the contour of the captured image (removal region B) is not performed in the lower surface region of the image, as shown in FIG. In addition, the region A of the side appearance determination image on which the fixed width has been removed from the outline in the side surface region and the top surface region of the captured image is determined. In addition, since there is no problem of cutting the imaging area by the conveyor as in the side-side captured image, the planar appearance determination image a is removed from the contour of the captured image as shown in FIG. The inner side excluding the removed region b was used as the appearance determination image a of the plane.
[0047]
FIG. 7 schematically shows the relationship between the captured image of the side surface obtained by the above operation, the region A of the appearance determination image, the wrinkles present in the appearance of the produce, the false detection part due to halation, and the like. According to the present example, the wrinkles present at a position close to the inner bottom surface area can be reliably detected because they are included in the area A of the side appearance determination image, but the lower surface area is removed with a constant width as shown in FIG. In the case of the area A ′ of the side appearance determination image generated as described above, the same defect may be included in the removal area B ′. As a result, the reliability of the determination device is impaired.
[0048]
FIG. 9 illustrates an example of signal processing performed by the arithmetic and control unit 3 described above. Image information including RGB luminance signals (digital signals) of pixels captured by the camera 202 is input as an image. Is binarized as one process, the outer shape of the agricultural product is calculated by comparison with a predetermined threshold value, the size is obtained, and the class is determined. In addition, the degree of deformation is obtained and used as one piece of information for grade determination. Further, the binarized signal is obtained by removing the uncertain part along the contour of the captured image by the method using the shift image described above to generate the area A of the side appearance determination image, and the plane appearance determination. For the image, a portion having a certain width is removed from the contour of the planar captured image to generate a planar appearance determination image region a.
[0049]
Another process using the captured image information in the arithmetic and control unit 3 is to color-convert each pixel signal, for example, depending on whether or not a low-lightness portion exists in the areas A and a of the appearance determination image. The presence / absence of the grade is another piece of information for grade determination. Further, the color degree is obtained by color histogram analysis using the color-converted information, and this is used as another grade determination information.
[0050]
Agricultural product grade is determined based on the above three grade information.
[0051]
Then, a classification classification is obtained from the obtained class determination result and the class determination result, and is sent to the control unit 4 of the discharge device described with reference to FIG. 1 as a classification output.
[0052]
In addition, according to the structure of this example demonstrated above, although the determination of agricultural products is performed only by the plane captured image and the side captured image, it can also consider a bottom captured image, and for this purpose, for example, As described in Japanese Patent No. 2812466, a method can be used in which an image is taken from below the gap of the transfer portion when the agricultural product changes on the conveyor.
[0053]
In addition, in the above example, the side surface of the agricultural product P is captured using the pair of opposed mirrors 203 to capture the agricultural product that passes between them. However, as shown in FIG. The four divided sides are indicated by P1, P2, P3, and P4 in the figure), and each of these divided surfaces is imaged from both sides obliquely before and after both sides of the conveyor, so that the uncertainty in the side area of the side image Such a portion can be substantially eliminated (see Japanese Patent Publication No. 7-99326). Note that P5 indicates the upper surface on which planar imaging is performed.
[0054]
【The invention's effect】
According to the invention of the present application, according to the shape that differs depending on the type of agricultural product, in the grade determination, the area (uncertain part) that may contain abnormal information is appropriately excluded and determined and evaluated. Therefore, it is possible to improve the accuracy of judgment and to sort agricultural products with high reliability.
[0055]
Further, according to the invention (2) of the present application, even in one agricultural product, even when the width (width from the contour) of an area that may contain abnormal information is not the same depending on its shape, for example, a normal line Since the removal width can be partially changed appropriately according to the above-mentioned removal guide angle formed between the light receiving line and the light receiving line, it is possible to realize the sorting of agricultural products with high determination accuracy and high reliability.
[0056]
According to the invention (3) of the present application, since an area effective for grade determination based on the appearance of agricultural products placed so as to sink into the central recess of the free tray can be widely used, agricultural products with high accuracy and high reliability Can be realized.
[0057]
According to invention (4) of this application, the process which produces | generates the external appearance determination image suitable for the grade determination of the target agricultural product from a side surface captured image by the shrinkage | contraction process in image processing technology and the correction process added to this easily There is an advantage that can be done.
[0058]
According to invention (5) of this application, when sorting a specific agricultural product, the area | region which may contain uncertain information can be removed appropriately according to the shape of the said agricultural product.
[0059]
According to the invention (6) of the present application, the grade determination based on the captured image of the side surface of the agricultural product (usually the combined captured image of the plane) can be performed with respect to the appearance, and the reliability is necessary and sufficient. Since it can be decided, it can be secured high.
[0060]
According to the invention (7) of the present application, in addition to the invention of the above (6), the external appearance captured image can be used for the determination of the size (class element) of the agricultural product.
[0061]
According to the invention (8) of the present application, the grade determination based on the captured image of the side surface of the agricultural product can be performed with high reliability with respect to colors and / or wrinkles that are important in appearance.
[Brief description of the drawings]
FIG. 1 is a diagram showing an outline of the configuration of an agricultural product sorting apparatus to which an image generating apparatus of the present invention is applied.
FIG. 2 is a front view of an image measurement unit of the image generation apparatus of FIG.
FIG. 3 is a side view of the image measurement unit in FIG. 2;
FIG. 4 is a diagram for explaining a region of a captured image on a side surface of an agricultural product.
FIG. 5 is a diagram for explaining an operation for generating an appearance determination image from a side-captured image.
FIG. 6 is a diagram showing a region of a generated side appearance determination image.
FIG. 7 is a diagram showing a relationship between a side appearance determination image and wrinkles and the like present on the surface of an agricultural product.
FIG. 8 is a diagram showing a region of a planar appearance determination image.
FIG. 9 is a diagram illustrating a procedure from appearance imaging of agricultural products to sorting classification determination.
FIG. 10 is a diagram showing another example of appearance imaging of agricultural products.
FIG. 11 is a view showing an area of an appearance determination image generated from a side-captured image by a conventional method.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Agricultural product sorter 101 ... Conveyor 102 ... Branch conveyor 2 ... Image generator 201 ... Illumination lamp 202 ... Imaging camera 203 ... Mirror 3 ... Arithmetic controller 301 ... Image processing unit 302 ... Removal width changing unit 303 ... Determination unit 4 ... Control unit P of discharge device ... Agricultural products S1, S2, S3 ... Shift images A, A ', a ... areas B, B ', b ... removed areas P1, P2, P3, P4 ... imaged quadrant side face P5 ... imaged upper surface

Claims (8)

Imaging means for imaging at least the side surface of the agricultural product carried on the agricultural product mounting surface with a slight depression, and the captured image information within a predetermined width along the contour is removed from the side surface captured image of the obtained agricultural product Image processing means for determining an area of an appearance determination image for making a determination related to the appearance of the agricultural product, and the image processing means divides the section into a plurality along the image contour, and at least the side-side captured image of the agricultural product An image generating apparatus for use in agricultural product sorting determination, wherein the removal width of the lower surface area is zero or the removal width of the lower surface area is smaller than the removal width of the upper surface area. Imaging means for imaging at least the side surface of the agricultural product carried on the agricultural product mounting surface with a slight depression, and the captured image information within a predetermined width along the contour is removed from the side surface captured image of the obtained agricultural product Image processing means for determining an area of an appearance determination image for making a determination related to the appearance of the produce, and the image processing means divides the section into a plurality along the image contour and removes the predetermined width. An image generating apparatus used for determination of sorting of agricultural products, characterized by having removal width changing means that can change the size of the divided side-captured image divided into sections. The removal width changing means is characterized in that at least the removal width of the lower surface area of the side image of the agricultural product is zero, or the removal width of the lower surface area is smaller than the removal width of the upper surface area. An image generation apparatus used for determining the sorting of agricultural products according to claim 2. The image processing means uses a side image of the agricultural product and a plurality of shift images obtained by shifting the side image by a predetermined number of pixels in a plurality of directions, and determines an area of the appearance determination image by AND processing of each pixel. The image generating apparatus used for sorting determination of agricultural products according to any one of claims 1 to 3. The image processing means is configured to set the removal width of the upper surface area of the side captured image larger than the removal width of the side area when the agricultural product to be imaged has a substantially elliptical shape that is short in the vertical direction when viewed from the side surface. The image generating apparatus used for the agricultural product sorting determination according to any one of claims 1 to 4. An image generation apparatus comprising the image processing means according to any one of claims 1 to 5 for determining a region of an appearance determination image, and a grade that uses the appearance determination image in the region as one of the agricultural product grade determinations. An agricultural product classification determination device comprising: determination means. An image generation apparatus comprising the image processing means according to any one of claims 1 to 5 for determining a region of an appearance determination image, and a grade that uses the appearance determination image in the region as one of the agricultural product grade determinations. An agricultural product classification determination apparatus comprising: determination means; and class determination means that uses a captured image before image processing as one of the class determinations of agricultural products. The agricultural product classification determination device according to claim 6 or 7, wherein the grade determination means determines the grade based on at least the color and / or the color of the agricultural product.

Images