JP2005091159A - Grain separator - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a grain separator for cutting out a single grain image from acquired image data clearly and precisely and reducing time until a series of processing is completed. <P>SOLUTION: An information processing means 4 is composed as the grain separator that performs labeling processing of an identifier, or the like for identifying a grain region in image data (S11), and further performs labeling processing (S14) to the grain region with additional information in addition to the labeling processing. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  In the present invention, grains of rice, wheat, soybeans, buckwheat, etc. are imaged using a camera such as a line sensor or CCD, and image data of the grain part is cut out from the image data acquired by the imaging. The present invention relates to a grain sorting device that performs processing.

2. Description of the Related Art Conventionally, there is a grain sorting device that removes defective grains by determining whether the grains are good or bad based on the image data of the grains acquired by imaging.
Specifically, such a grain sorter captures grains of rice, wheat, soybeans, buckwheat, etc. using a camera such as a line sensor or CCD, and an image obtained by the imaging. After performing binarization processing, labeling processing, and the like on the data, processing for cutting out a grain region from the image data in units of one grain has been performed.
In addition, the image data regarding the grain region cut out in units of one grain is hereinafter referred to as “single grain image”.
Further, the conventional grain sorting device analyzes the cut-out single grain image to remove the grain corresponding to the single grain image determined to be defective using a sorting means such as an air gun.
That is, the conventional grain sorting apparatus sorts and removes defective grains and collects good grains by executing a series of processes as described above.
As a technique related to such a grain sorting apparatus, for example, there is a technique shown in Patent Document 1 below.

JP 2002-312762 A

However, the conventional grain sorting apparatus as described above has the following problems.
In a case where a single grain image is cut out from a plurality of touched or overlapping grain regions included in image data acquired by imaging, the conventional grain sorting device performs a process for clearly cutting out a single grain image. Therefore, there is a problem that the accuracy of the clipping process is not good.
That is, the labeling process of the grain region is directly executed from the image for each line acquired by the line sensor or the like, and only the process of cutting is performed.
Further, in the conventional grain sorting apparatus, when imaging of the flowing grain is performed using an imaging means such as a line sensor, processing such as binarization, labeling, and cutting is performed for each acquired image of one line. Therefore, there is a problem that the processing load for each image of one line is large, and it takes time to complete a series of processing.
Therefore, the present invention has been made in view of the above circumstances, and the object of the present invention is to cut out a single grain image clearly and accurately from the acquired image data and to shorten the time until a series of processing is completed. It is providing the grain sorter which can do.

  The problems to be solved by the present invention are as described above. Next, means for solving the problems will be described.

In Claim 1, in the grain sorter which removes a defective grain, by judging whether the grain is good or bad based on the image data related to the grain acquired by imaging with a line sensor,
Raw image frame creating means for creating a raw image frame from the image data;
Labeling means for labeling an identifier or the like for identifying a grain region in the image data,
The labeling means is configured as a grain sorting device characterized by further performing a labeling process on the grain detection start time and the detection end time and information on the minimum position and the maximum position of the detection pixel in one line. Yes.

In claim 2, raw image frame creation processing by the raw image frame creation means,
Labeling by the labeling means;
Binarization processing for binarizing the image data;
Is configured as a grain sorting device.

In Claim 3, based on the image data about the grain acquired by imaging with a line sensor, by judging whether the grain is good or bad, in the grain sorting device that removes the defective grain,
The presence or absence of a grain is detected for every line, the positional information on the grain is stored in a memory, and the quality of the grain is determined by cutting out only the area where the grain exists. It is configured as a grain sorting device.

In claim 4, in the grain sorting device for removing defective grains by making a judgment of good or bad of the grains based on the image data relating to the grains acquired by imaging with a line sensor,
The image of the grain is inspected together with the imaging for each line, and only a set of pixels equal to or greater than a predetermined threshold is stored in the memory
Based on the content stored in the memory, it is configured as a grain sorting device that judges whether the grain is good or bad.

  As effects of the present invention, the following effects can be obtained.

  According to claim 1, since it is possible to clearly identify the grain region included in the acquired image data, it is possible to improve the cutting accuracy of the single grain image, and various kinds of grain regions. Since information can be added, a wide variety of information can be integrated in the image data, and data handling becomes easy.

  According to the second aspect, the grain region can be cut out directly from the raw image frame, so that the time required for the cut-out processing can be shortened and the processing speed can be increased.

  According to the third aspect, for example, it is possible to cut out the grain region directly in a limited manner, so that a series of processing speeds up to the cutting process can be increased, and consumption of memory and the like is suppressed. It becomes possible to do.

According to the fourth aspect, only the grain region in the image data and its periphery can be limitedly stored in the storage means such as a memory, so that the memory consumption can be suppressed.
In addition, since the amount of data to be handled is limited, it is possible to increase the processing speed as compared with the conventional case.

Hereinafter, the best mode for carrying out the present invention will be described with reference to the accompanying drawings for understanding of the present invention. The following best mode for carrying out the present invention is an example embodying the present invention, and is not intended to limit the technical scope of the present invention.
FIG. 1 is an overview of the whole grain sorting apparatus, FIG. 2 is a flowchart showing an example of a series of image processing, FIG. 3 is a flowchart showing an example of a series of image processing, and FIG. 4 is acquired by a line sensor. FIG. 5 is an explanatory diagram of image data stored in the memory, FIG. 6 is an explanatory diagram of processing for storing information on the position of the grain region in the memory, and FIG. FIG. 8 is an explanatory diagram of processing for determining the presence or absence of a grain region in image data, and FIG. 8 is an explanatory diagram of processing for cutting out a grain region in image data.

First, the grain sorting apparatus 1 which is an example of the grain sorting apparatus of this invention is demonstrated using FIG.
Moreover, in the following description, although the case of rice is demonstrated as an example of the grain which the said grain selection apparatus 1 processes, a grain is not limited to the said rice.
Examples of grains other than the above-mentioned rice may be grains similar to rice (granular aggregates), for example, grains of wheat, soybeans, buckwheat, etc. good.
Of course, the present invention can also be applied to grains such as grains smaller than the grains etc. according to the resolution of the imaging means provided in the grain sorting apparatus 1.

  As shown in FIG. 1, the grain sorting apparatus 1 mainly includes a transport unit 2, an imaging unit 3, an information processing unit 4, and a sorting unit 5.

First, the transport unit 2 will be described in detail.
The conveying means 2 conveys the grains (grains) that are the selection target of the above-described grain sorting apparatus from the imaging means 3 toward the sorting means 5.
Here, the conveying means 2 includes a tank 11, a feeder 12 and a chute 13.

The tank 11 constitutes the most upstream part of the transport means 2 and plays the role of a container for temporarily storing grains to be sorted.
The internal shape of the tank 11 is substantially bowl-shaped, and a grain inlet 11a is formed on the upper surface.
Since it is comprised in this way, it becomes possible to throw in into the tank 11 the grain which is going to sort out from the said grain inlet 11a.
Furthermore, since the opening part 11b is formed in the lower part of the tank 11, the grain thrown in in the tank 11 is discharged | emitted from this opening part 11b.

The feeder 12 discharges the grain stored in the tank 11 from the tank 11 to the chute 13 while keeping the amount of grain discharged per unit time substantially constant.
Here, the feeder 12 is an electromagnetic type, and a feeder trough 12b is provided on the feeder base 12a via a leaf spring.
The feeder trough 12 b is a substantially rectangular parallelepiped box with one of the upper surface and the four side surfaces opened, and is located below the opening 11 b of the tank 11.
The opened side surface of the feeder trough 12b faces the upstream end of the chute 13, and the feeder trough 12b vibrates with respect to the feeder base 12a by an electromagnet provided on the feeder base 12a.

  The chute 13 is a slope having side walls. The grains discharged from the tank 11 by the feeder 12 slide down on the chute 13.

The imaging means 3 is for acquiring image data relating to the grains conveyed by the conveying means 2, and is arranged in the middle part of the conveying means 2.
In addition, as a specific example of the image pickup means 3, in this embodiment, a line sensor is used, and other cameras such as a CCD camera, an optical sensor, and the like can be cited. However, image data of the grain flowing down from the chute 13 can be acquired. Any configuration may be used, and the present invention is not limited to the above specific example.
Here, the imaging means 3 is composed of a total of two imaging means, the upper surface imaging means 3 a and the lower surface imaging means 3 b, but image information relating to the upper and lower surfaces of the grain passing through each of the imaging means 3. Can be obtained.
Furthermore, image data of only one side of the grain may be acquired according to the type and use of the grain (grain) to be selected, and on the other hand, by providing three or more imaging means, it is more versatile. Alternatively, the image data related to the grain may be acquired.

The information processing means 4 has functions for determining whether the grain is good or bad, for calculation, and for controlling the grain sorting device 1 based on the image data relating to the grain acquired by imaging by the imaging means 3. It is what you have.
As used herein, “judgment of good or bad grain” specifically refers to so-called good rice (good grain) as “good”, and on the other hand, damaged rice, dead rice, foreign matter, etc. (defective) (Grain) is judged as “bad”.
As a specific configuration example of the information processing means 4 for making such a determination, it may be configured by an electronic computer such as a computer.
As a specific configuration of an electronic computer such as the computer, an input means such as a keyboard and a mouse, a CPU that performs calculation / judgment / image processing, and an operation program for operating the grain sorting apparatus 1 are stored and image data. For example, a storage element (RAM, ROM, hard disk drive, etc.) for expanding
The information processing means 4 is connected to a feeder base 12a, an image pickup means 3, a selection means 5, and the like, and controls each connected portion.

The sorting means 5 is a means for sorting and removing grains (damaged rice, dead rice, foreign matter, etc.) that are judged to be defective in the judgment of the quality of the grains by the information processing means 4 Located downstream of the means 2.
As a specific example of the selecting means 5 shown in FIG. 1, for example, an air gun or the like may be used.
In this case, the air gun sprays compressed air on the grain determined to be defective by the information processing means 4, and the grain determined to be defective by this spraying is converted to non-defective rice (good grain). ) Can be separated and removed from the above.
Specifically, as shown in FIG. 1, the grain determined to be defective is collected in the defective product collection unit 15 by the spraying of the sorting means 5, and on the other hand, nothing is processed by the sorting means 5 (air gun). The non-defective rice that has not been collected is collected by the non-defective product collecting unit 14.

<Regarding various functions of the information processing means 4>
The information processing means 4 further has functions such as a labeling means, a storage means, and a grain region storage means.
The labeling means has a function of performing a labeling process for assigning an identifier such as an identification number or an identification name for identifying a grain region in image data relating to a grain acquired by imaging by the imaging means 3.
Further, the labeling means has a function of labeling additional information in the grain region in addition to the labeling process described above.
Specific examples of this additional information may include information related to the minimum position and the maximum position of the detection pixel in one line, in addition to information related to the time when the line sensor starts detecting the grain and the end time.
That is, the additional information other than the identifier may be, for example, the position, size, color, good or bad judgment result, etc. of the grain region.

Next, an example of a series of processes performed by the information processing unit 4 will be described with reference to FIG.
The information processing means 4 acquires the image of the grain flowing down from the chute 13 using the imaging means 3 (S10).
Specifically, the processing in step S10 is performed in the information processing means 4 as follows.
When the imaging means 3 is a line sensor or the like, as shown in FIG. 4, the grains (in the direction of the solid arrows) flowing down from the chute 13 (upper) to the sorting means 5 (lower) are imaged for each line. .
In this case, one line of image data acquired by the line sensor is sequentially taken into the information processing means 4 in the order of dotted arrows, and is stored and stored in a storage means such as a memory.
As a result of such accumulation, as shown in FIG. 4, it is possible to express a single grain region by continuously accumulating and arranging a plurality of one-line image data.
As shown in FIG. 4, a state in which one line of image data is continuously accumulated and arranged is referred to as a frame, and such a frame may be stored in the storage unit of the information processing unit 4.

After the imaging process in step S10, the processes in steps S11, S12, and S13 are performed in parallel.
<Step S11>
Next, the information processing means 4 performs a process of labeling an identifier or the like for identifying a grain region in the image data acquired in step S10 (S11).
The labeling process in step S11 means a process of assigning an identification number, an identification name, etc. as a unique identifier to the grain region in the image data.
<Step S12>
Further, the information processing means 4 executes a process of binarizing and converting the image data acquired in step S10 into two colors (two gradations) such as black or white (S12).
That is, by simply binarizing the image data acquired by the imaging unit 3, it is possible to easily clarify the grain region and the non-grain region in the image data.
The binarized image data obtained in step S12 is hereinafter referred to as “binarized image data”.
<Step S13>
Further, the information processing means 4 performs a process of converting the image data acquired in step S10 into a format that is simply processed by the information processing means 4 (S13).
That is, an image of the whole grain can be obtained by accumulating image data obtained by imaging with a line sensor on a memory and forming a frame.
In the processing in step S13, the image data acquired from the imaging means 3 is simply converted into a format that can be processed by the information processing means 4, and the quality, properties, and contents of the image data are intentionally changed. Absent.
In the following, the image data created by the processing in step S13 is referred to as “raw image data”.
Further, the raw image data for each line acquired by the line sensor is stored in a memory or the like as shown in FIG.
The processes of steps S11, S12, and S13 are executed in parallel for each line.

Next, after the processing in step S11 and step S12 is executed, the information processing means 4 adds to the grain region binarized in step S12 in addition to the labeling processing in step S11. A process of labeling specific information in the grain region (S14).
As a specific example of the “additional information” in step S14, the size of the grain region, the color, the determination result of good or bad, and the like may be used.
That is, as a specific example of the additional information, the minimum position and the maximum position of the detection pixel in one line as well as information on the time and the end time when the line sensor starts imaging (ie, “detection”) of the grain It may be information about

Next, the information processing means 4 is based on the binarized image data labeled with additional information in step S14 and the raw image data obtained by the processing in step S13. The process which cuts out a grain area | region is performed (S15).
That is, by superimposing the binarized image data on the raw image data, it is possible to easily cut out the grain region in the raw image data based on the binarized image data that can clearly identify the grain region. At the same time, it is possible to easily port the data labeled to the binarized image data to the raw image data.
In addition, since it is possible to clearly identify the grain region included in the acquired image data, it is possible to improve the cutting accuracy of a single grain image and add various information to the grain region. As a result, it is possible to collect a wide variety of information in the image data in a unified manner, and data handling becomes easy.

Next, an example of a series of processes performed by the information processing unit 4 will be described with reference to FIG.
As in the case described with reference to FIG. 2, the information processing means 4 acquires an image of the grain flowing down from the chute 13 using the imaging means 3 (S10).

After the imaging process in step S10, the processes in steps S21 and S13 are performed in parallel.
<Step S21>
After the processing of step S10, the information processing means 4 accumulates the image of one line acquired from the line sensor as a frame as shown in FIG. 4, and the pixel area determined to be equal to or greater than a predetermined threshold value. Is determined as a grain region, and a labeling process is performed on the grain region (S21).
Specific examples of the contents of the labeling process may be “time concerning grain detection” or “information about pixel position”, or may be performed by labeling these to the grain area in the image data. good.
This “time concerning grain detection” and “information about pixel position” may be included in the “additional information” already described above.
The above-mentioned “time concerning the detection of the grain” will be specifically described. For each grain, the time when the grain starts to be imaged by the line sensor (that is, the grain has entered the imaging range of the imaging means 3). Time (hereinafter referred to as “start time”), or conversely, the time when the grain has been imaged by the line sensor for each grain (that is, the time when the grain is removed from the imaging range of the imaging means 3). It is referred to as “end time”).
More specifically, the “information on the pixel position” means that, for each grain region in the image data, the highest pixel position at the highest point closest to the chute 13, the closest to the selection means 5, and It may be the lowest pixel position at the lowest point. (A specific example will be described below with reference to FIG. 5.)
<Step S13>
Further, the information processing means 4 performs the process of step S13 already described above, and performs the process of converting the image data acquired in step S10 into a format that is simply processed by the information processing means 4 (S13).

Then, the information processing means 4 uses the contents (“time regarding grain detection”, “information about pixel position”) labeled in step S21 and the raw image data obtained by the process in step S13. Based on this, a process of cutting out the grain region in the image data is performed (S31).
Since the information processing means 4 executes the above-described series of processes, the grain region can be directly cut out without performing the above-described binarization process. It is possible to shorten the time and increase the speed.

Further, the information processing means 4 buffers and frames the image data for each line acquired using the imaging means such as a line sensor, and then has a grain region in the framed image data. If determined, the grain region may be cut out.
As in the case of step S21, the determination of the presence or absence of the grain region is performed by accumulating the image of one line acquired from the line sensor as a frame as shown in FIG. If it is determined that there is a region, the pixel region may be determined as a grain region.
Further, in the determination of the presence or absence, if it is determined that there is a grain region in the image data, the information processing means 4 calculates “information regarding the position of the grain region” indicating the outer shape of the grain region and the like. To do.
This “information regarding the position of the grain region” is specifically as shown in FIG.
For example, point A in FIG. 5 is the lowest point of a certain grain region included in the image data, and is the point at which a pixel is first imaged (detected) at the time of imaging. The time when point A is detected is stored in the memory.
Moreover, B point is the highest point of the grain area | region contained in image data.
For example, when the line sensor scans from left to right toward FIG. 5, the point C is a pixel in the grain region where the grain is first detected in one line, while the point D is the first grain in the one line. It is the pixel of the grain area | region which detected the grain.
That is, when coordinates from left to right are set in FIG. 5, point C is the minimum position on the coordinates, and point D is the maximum position on the coordinates.
Further, the time at which the positions such as the points A to D are detected may also be stored in a memory or the like, and the rectangular area passing through the ABCD points may be applied to the raw image frame to perform the clipping process.
Moreover, you may acquire the point showing the external shape of a grain area | region as position data.
In this case, the information processing means 4 plots points indicating the outer shape every time one line of image data is acquired, and acquires and stores the plotted points as position data.
Specifically, as shown in FIG. 6, the address on the image data of the position data (for example, point A in FIG. 5) is stored and stored in storage means such as a memory.
The information processing unit 4 may store the acquired position data in a memory or the like in association with the image data of the grain region.
Such a position data accumulation process enables the following clipping process.

Moreover, as a cutting-out method of a grain area | region, it may be as shown below.
Before buffering image data for each line acquired using an imaging means such as a line sensor, the presence or absence of a grain region in the image data for one line may be determined.
If it is determined that a grain region exists in the one line of image data, the grain region may be directly cut out.
In this case, a specific method for determining the presence or absence of a grain region in the image data is as shown in FIG.
Conventionally, as shown in FIG. 7A, the information processing means 4 scans the entire framed image data buffered or stored in the memory by a predetermined amount (for example, at regular intervals). Scanning in the direction of the arrow), it is determined that the grain region is present in the image data when the region of the pixel that is equal to or greater than a predetermined threshold value is present in the image data.
On the other hand, the presence / absence of the grain region in the one-line image data described above is determined as shown in FIG.
The information processing unit 4 determines the presence or absence of a grain region in the image data of one line before buffering the image data for each line acquired using an imaging unit such as a line sensor.
When it is determined by the determination that there is a grain area, the information processing means 4 may directly cut out only a peripheral area including the grain area or an area where the grain exists.
By performing such processing, it is possible to directly cut out a part related to the grain region, so that a series of processing speeds up to the cutting processing can be increased.

Next, the information processing unit 4 may be configured to store the grain region in the image data in a storage unit such as a memory within a predetermined section range.
A specific example in this case will be described below with reference to FIG.
The information processing unit 4 forms a frame as shown in FIG. 8A by buffering the image data for each line acquired by using an imaging unit such as a line sensor.
Next, the information processing means 4 determines whether a set of pixels equal to or greater than a predetermined threshold exists in the framed image data.
If it is determined by this determination that there is a set of pixels equal to or greater than the threshold value, the information processing means 4 determines that the set is a grain region.
Further, the information processing means 4 cuts out a predetermined predetermined size section including the grain region and pixels around the grain region.
As a specific example, the “predetermined size section” may be a figure such as a rectangle having two sides of “x” and “y” as shown in FIG.
In addition, the dimensions “x” and “y” may be values determined in advance by a user or the like in accordance with the maximum grain size expected at the time of sorting.
Of course, a polygon surrounded by a polygon other than the rectangle or a closed curve may be adopted as the section.
Further, the information processing means 4 stores the segmented section on the memory as an image as shown in FIG.
Since the image of the grain stored in this way is equal to or higher than the threshold value, there is a high possibility of a defective grain, so the other is judged as non-defective and no further recognition processing is performed. Only the quality is judged to speed up the judgment process.
The storage may be performed in the order in which imaging is started by the line sensor. In the example shown in FIG. 8A, the grain region 110 flows down before the grain region 120. Imaging is started by the line sensor.
Therefore, as shown in FIG. 8B, the grain region 110 is stored on the memory before the grain region 120.
And if the quality judgment for every grain is performed, the memory area will be erase | eliminated and the next image will be memorize | stored in order. Thus, a limited memory area is effectively used, and a large amount of memory capacity is not required.
As described above, the information processing unit 4 stores the grain region in the image data within a predetermined range, thereby limiting the amount of data stored in the memory.
That is, conventionally, the entire image data acquired by the imaging means 3 has been cut out by storing it in a memory or the like, but in the above case, only the grain region in the image data and its periphery are limited. Since the data is stored in the memory, it is possible to reduce the memory consumption as compared with the conventional case.
In addition, since the amount of data to be handled is limited, it is possible to increase the processing speed as compared with the conventional case.

Overall view of the grain sorting device. The flowchart which shows an example of a series of processes of an image process. The flowchart which shows an example of a series of processes of an image process. The schematic diagram which shows an example which arranged the image data acquired with the line sensor for every line. Explanatory drawing of the image data accumulate | stored in memory. Explanatory drawing of the process which accumulate | stores the information regarding the position of a grain area | region in memory. Explanatory drawing of the process which judges the presence or absence of the grain area | region in image data. Explanatory drawing of the process which cuts out the grain area | region in image data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Grain sorting apparatus 2 Conveying means 3 Imaging means 4 Information processing means 5 Sorting means 11 Tank 12 Feeder 13 Chute

Claims (4)

In the grain sorting device that removes defective grains by determining whether the grains are good or bad based on the image data related to the grains acquired by imaging with the line sensor,
Raw image frame creating means for creating a raw image frame from the image data;
Labeling means for labeling an identifier or the like for identifying a grain region in the image data,
The labeling means further performs a labeling process on the detection start time and detection end time of the grain and information on the minimum position and the maximum position of the detection pixel in one line. Raw image frame creation processing by the raw image frame creation means;
Labeling by the labeling means;
Binarization processing for binarizing the image data;
The grain sorting apparatus according to claim 1, wherein the grains are processed in parallel. In the grain sorting device that removes defective grains by determining whether the grains are good or bad based on the image data related to the grains acquired by imaging with the line sensor,
The presence or absence of a grain is detected for every line, the positional information on the grain is stored in a memory, and the quality of the grain is determined by cutting out only the area where the grain exists. Kernel sorting device. In the grain sorting device that removes defective grains by determining whether the grains are good or bad based on the image data related to the grains acquired by imaging with the line sensor,
The image of the grain is inspected together with the imaging for each line, and only a set of pixels equal to or greater than a predetermined threshold is stored in the memory
A grain sorting apparatus that judges whether a grain is good or bad based on the contents stored in the memory.

Images